Rev 8: Merge jams higher compression patches, fixing tests. in http://people.ubuntu.com/~robertc/baz2.0/plugins/index2/trunk

[Robert Collins]

At http://people.ubuntu.com/~robertc/baz2.0/plugins/index2/trunk

------------------------------------------------------------
revno: 8
revision-id: robertc at robertcollins.net-20080701224410-2lbqoqc2dc5v3iey
parent: robertc at robertcollins.net-20080701113743-n0pc6x42arqd4zhd
parent: john at arbash-meinel.com-20080701192734-9mbeqa4zszat3z1f
committer: Robert Collins <robertc at robertcollins.net>
branch nick: trunk
timestamp: Wed 2008-07-02 08:44:10 +1000
message:
  Merge jams higher compression patches, fixing tests.
modified:
  btree_index.py                 index.py-20080624222253-p0x5f92uyh5hw734-7
  chunk_writer.py                chunk_writer.py-20080630234519-6ggn4id17nipovny-1
  tests/test_btree_index.py      test_index.py-20080624222253-p0x5f92uyh5hw734-13
  tests/test_chunk_writer.py     test_chunk_writer.py-20080630234519-6ggn4id17nipovny-2
    ------------------------------------------------------------
    revno: 7.1.4
    revision-id: john at arbash-meinel.com-20080701192734-9mbeqa4zszat3z1f
    parent: john at arbash-meinel.com-20080701184228-dhck7vdmkh47zspa
    committer: John Arbash Meinel <john at arbash-meinel.com>
    branch nick: index2
    timestamp: Tue 2008-07-01 14:27:34 -0500
    message:
      Make PAGE_SIZE be a constant, rather than having it hard-coded everywhere.
    modified:
      btree_index.py                 index.py-20080624222253-p0x5f92uyh5hw734-7
    ------------------------------------------------------------
    revno: 7.1.3
    revision-id: john at arbash-meinel.com-20080701184228-dhck7vdmkh47zspa
    parent: john at arbash-meinel.com-20080701183855-ynb3lm34yrq6sp3w
    committer: John Arbash Meinel <john at arbash-meinel.com>
    branch nick: index2
    timestamp: Tue 2008-07-01 13:42:28 -0500
    message:
      Get rid of all the special-casing code.
      
      It didn't really help much, because we are going to do a repack anyway.
      And it really simplifies the code.
    modified:
      chunk_writer.py                chunk_writer.py-20080630234519-6ggn4id17nipovny-1
    ------------------------------------------------------------
    revno: 7.1.2
    revision-id: john at arbash-meinel.com-20080701183855-ynb3lm34yrq6sp3w
    parent: john at arbash-meinel.com-20080701175844-z5jnbgf6c1qvyuux
    committer: John Arbash Meinel <john at arbash-meinel.com>
    branch nick: index2
    timestamp: Tue 2008-07-01 13:38:55 -0500
    message:
      Use a compressobj again. 
      
      We can do the standard compression with Z_SYNC_FLUSH until we overflow,
      and then we just try to repack. If that fails, then we know we are
      done, we just need to use a new compressobj.
      Timing tests show that it has minimal impact, but results in significantly
      smaller indices. Specifically, 3.3MB versus 4.7MB or ~ 40% savings.
    modified:
      chunk_writer.py                chunk_writer.py-20080630234519-6ggn4id17nipovny-1
      tests/test_chunk_writer.py     test_chunk_writer.py-20080630234519-6ggn4id17nipovny-2
    ------------------------------------------------------------
    revno: 7.1.1
    revision-id: john at arbash-meinel.com-20080701175844-z5jnbgf6c1qvyuux
    parent: robertc at robertcollins.net-20080701113743-n0pc6x42arqd4zhd
    committer: John Arbash Meinel <john at arbash-meinel.com>
    branch nick: index2
    timestamp: Tue 2008-07-01 12:58:44 -0500
    message:
      Try packing more into each index. Seems to cost a bit in CPU, but saves a lot in disk space.
    modified:
      chunk_writer.py                chunk_writer.py-20080630234519-6ggn4id17nipovny-1

Diff too large for email (1045 lines, the limit is 1000).