2GB limit

[Maritza Mendez]

On Sat, Oct 9, 2010 at 6:47 AM, John Arbash Meinel
<john at arbash-meinel.com>wrote:

> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> On 10/9/2010 12:24 AM, Maritza Mendez wrote:
> > I think I have a solid way to reproduce the VM issue, without resorting
> > to ulimit.  (I'm concerned that ulimit may cause a non-problem to become
> > a problem and so mask the actual problem.)
> >
> > Can someone confirm whether the trace attached is a definitive signature
> > of the VM limit recently known as the 2GB limit?  I want to make sure
> > I'm looking at the right problem!
> >
> > Thanks!
> > ~M
> >
> >
>
> 84.753  Adding the key (<bzrlib.btree_index.BTreeGraphIndex object at
> 0x02F73030>, 110895463, 93519167) to an LRUSizeCache failed. value
> 418921803 is too big to fit in a the cache with size 41943040 52428800
>
> ^- this looks like you are dealing with some very large content objects
> (419MB for a single blob.)
>
>
> ...
>
>  File "bzrlib\groupcompress.pyo", line 538, in _prepare_for_extract
>  File "bzrlib\groupcompress.pyo", line 151, in _ensure_content
> MemoryError
>
> And this does look like it is failing during the zlib.decompress stage.
>
> John
> =:->
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1.4.9 (Cygwin)
> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
>
> iEYEARECAAYFAkywcmYACgkQJdeBCYSNAAMwwwCg2bWv9WSBju80HG5Z+K4g2nwR
> BeEAoIAsexMDPH1h0kV81UzGTMzYe5zl
> =CyUE
> -----END PGP SIGNATURE-----
>


Ok.  Thanks for confirming that I have a test case here, based on the
groupcompress messages.

Now here's something.  The branch in question has 1.25 GB distributed (very
unevenly) over 700 files.  The largest single file is 195MB and the
cumulative size distribution looks like this:

   Size(MB)    Total Number of Files Larger than Size
   =======    ============================
   100               2
     10             15
       1            173

The second largest file is ~120MB.  So could the ca, 419MB number come from
a pack which is combining texts?

Thanks
~M
-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://lists.ubuntu.com/archives/bazaar/attachments/20101009/f00e2ce4/attachment.htm