RFC: packs and long blobs

[Robert Collins]

On Tue, 2008-08-26 at 10:23 +0200, Vincent Ladeuil wrote:
> >>>>> "robert" == Robert Collins <robertc at robertcollins.net> writes:
> 
>     robert> So currently pack containers are length-prefixed. 
>     robert> I'd like to add a method to put very large blobs into packs, so that I
>     robert> can put indices onto the end of pack containers - and indices may be
>     robert> hundreds of MB in size.
> 
>     robert> I'm thinking of requiring a file object that supports seek(0, 2); len =
>     robert> tell() in this method. Any objections/better ideas?
> 
> Objection: it's not length-prefixed anymore hence not readable as a stream.

In the serialised form it would still be length-prefixed. This is just a
memory-friendly method for adding large blobs. Same disk object
representation.

> Idea: put the indices first :)

Doesn't help - its an orthogonal problem.

-Rob
-- 
GPG key available at: <http://www.robertcollins.net/keys.txt>.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part
Url : https://lists.ubuntu.com/archives/bazaar/attachments/20080826/62b43043/attachment.pgp