[MERGE-REQ] bzr.newformat

[Gustavo Niemeyer]

Martin,

As we discussed offlist, I have a new version for the format propose.
It consists of turning ',' into a escape enabling mechanism, rather
than just meaning no-newline.

It has the following advantages:

- Embedded newlines are now allowed, meaning arbitrary "line" sizes
  for binary files
- The only change in the file format if lines are splitted in
  newlines as usual is that the '\' character on comma lines are
  escaped.
- Binary files are still readable

I've run the benchmark and done tests using a tarball of 45MB, with
the following results:

- No speed impact at all when using embedded newlines in 4k chunks,
  nor when using current line-splitted chunks.
- No size impact when using current line-splitted chunks, and the
  file becomes 0.09% larger due to escaping and line breaking at
  regular places when using embedded newlines on 4kb chunks.

Changes are already available at the same repository:

  http://bzr.labix.org/bzr.newformat

Please, let me know what you think about it.

Cheers,

-- 
Gustavo Niemeyer
http://niemeyer.net