"bzr branch" downloads 10x the whole repo size through "dumb" http server (format 2a)?

[John Arbash Meinel]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 2013-05-04 3:13, Marcin Wojdyr wrote:
> On 3 May 2013 21:08, John Arbash Meinel <john at arbash-meinel.com>
> wrote:
> 
>> 
>> Have you tried doing "bzr pack" on that repository? It won't
>> solve all problems, but it might improve your immediate issues.
> 
> Thanks for reply. I tried, it didn't help.
> 
> I just did checkout and observed the size of the created
> directory: for most of the time the size was 32kb and it started
> increasing after maybe 90% of the transfer. 1.7 GB was transferred
> to create .bzr/ directory with size 34MB. I had debug_flags = hpss,
> error, http and I can see that the same ranges of the same files
> were fetched again and again.
> 
> If anyone is interested, I'm pasting the log file: 
> http://pastebin.com/KktitEte
> 
> Marcin
> 

http://pastebin.com/KktitEte

Line 3097:
74.903  Adding the key (<bzrlib.btree_index.BTreeGraphIndex object at
0x2898a10>, 13957, 11581132) to an LRUSizeCache failed. value 63238385
is too big to fit in a the cache with size 41943040 52428800

You have an item which is 64MB in a single item. And the cache is
sized as max size 52MB. So it downloads it, but tries to not use up
all of your memory, so evacuates it, and then it happens again.

The max is set in bzrlib/groupcompress.py line 1225.

You can try setting that to 1024*1024*1024 and see how the http
download works.

John
=:->

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.13 (Cygwin)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iEYEARECAAYFAlGEkZYACgkQJdeBCYSNAANtvACfZsMdO50HrGy79cuBo5EasYG7
ar8AoJU9Douh86BJZUTysFk7bFVGNql2
=vmA7
-----END PGP SIGNATURE-----