Binary file handling

[John Arbash Meinel]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Dmitri Pissarenko wrote:
> Hello!
> 
> Thanks for your answer!
> 
>> Are individual binary files larger than 100 MB or is the combined size
>> of the binary files larger than 100 MB?
> 
> The combined size of binary files may be approx. 100 MB in future. At
> the moment, all binary files together are approx. 85 MB large.
> 
>> How many large binary files do
>> you have?
> 
> I've 141 binary files.
> 
> Of these 141 binary files,
> 
> 1) files with size between 4 and 16 MB constitute 21.4 MB,
> 2) 1-4MB - 39.3 MB,
> 3) 256K - 1 MB - 18.6 MB,
> 4) 64K - 256K - 4.8 MB,
> 5) 16K - 0K - 1.67 MB.
> 
> So, most files are between 1 and 4 MB.
> 
> Best regards
> 
> Dmitri
> 
> 

Having a total tree size of 100MB should be no problem, regardless of
binary or text files.

When versioning binary files, bzr isn't as efficient as it could be. It
does a bit of delta compression, but it is generally not optimal for
binary files.

The specific note in the FAQ is for people who are versioning things
like CD ISO's or HD Movies.

At the moment, the code is tuned around being able to hold 3 copies of a
file in memory at once. (2 sources, and one output). I don't think it is
a strict upper limit, though we try to follow that rule.

That said, we do try to stress test things from time to time. I know
Robert keeps around a repository with 16+GB of data, mostly just a whole
lot of smaller projects. And we've worked with other systems that had
3GB of just a single large project. And a lot of the recent development
work has been around scaling up to larger projects.

John
=:->

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (Cygwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAklmKU4ACgkQJdeBCYSNAANDXACgsGtz1+ywDD7R3OLmMYAkQIpf
t4QAoIrT/YEkU93k+PvLmbGXmWPqDTO4
=RrYE
-----END PGP SIGNATURE-----