<br><br><div class="gmail_quote">On Sat, Oct 9, 2010 at 6:47 AM, John Arbash Meinel <span dir="ltr"><<a href="mailto:john@arbash-meinel.com">john@arbash-meinel.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<div class="im">-----BEGIN PGP SIGNED MESSAGE-----<br>
Hash: SHA1<br>
<br>
</div><div><div></div><div class="h5">On 10/9/2010 12:24 AM, Maritza Mendez wrote:<br>
> I think I have a solid way to reproduce the VM issue, without resorting<br>
> to ulimit. (I'm concerned that ulimit may cause a non-problem to become<br>
> a problem and so mask the actual problem.)<br>
><br>
> Can someone confirm whether the trace attached is a definitive signature<br>
> of the VM limit recently known as the 2GB limit? I want to make sure<br>
> I'm looking at the right problem!<br>
><br>
> Thanks!<br>
> ~M<br>
><br>
><br>
<br>
</div></div>84.753 Adding the key (<bzrlib.btree_index.BTreeGraphIndex object at<br>
0x02F73030>, 110895463, 93519167) to an LRUSizeCache failed. value<br>
418921803 is too big to fit in a the cache with size 41943040 52428800<br>
<br>
^- this looks like you are dealing with some very large content objects<br>
(419MB for a single blob.)<br>
<br>
<br>
...<br>
<br>
File "bzrlib\groupcompress.pyo", line 538, in _prepare_for_extract<br>
File "bzrlib\groupcompress.pyo", line 151, in _ensure_content<br>
MemoryError<br>
<br>
And this does look like it is failing during the zlib.decompress stage.<br>
<div class="im"><br>
John<br>
=:-><br>
-----BEGIN PGP SIGNATURE-----<br>
Version: GnuPG v1.4.9 (Cygwin)<br>
Comment: Using GnuPG with Mozilla - <a href="http://enigmail.mozdev.org/" target="_blank">http://enigmail.mozdev.org/</a><br>
<br>
</div>iEYEARECAAYFAkywcmYACgkQJdeBCYSNAAMwwwCg2bWv9WSBju80HG5Z+K4g2nwR<br>
BeEAoIAsexMDPH1h0kV81UzGTMzYe5zl<br>
=CyUE<br>
-----END PGP SIGNATURE-----<br>
</blockquote></div><br><br>Ok. Thanks for confirming that I have a test case here, based on the groupcompress messages.<br><br>Now here's something. The branch in question has 1.25 GB distributed (very unevenly) over 700 files. The largest single file is 195MB and the cumulative size distribution looks like this:<br>
<br> Size(MB) Total Number of Files Larger than Size<br> ======= ============================<br> 100 2<br> 10 15<br> 1 173<br><br>The second largest file is ~120MB. So could the ca, 419MB number come from a pack which is combining texts?<br>
<br>Thanks<br>~M<br><br>