lp:bzr/2.0 upgrade --2a runs out of memory

John Arbash Meinel john at arbash-meinel.com
Fri Sep 4 20:18:07 BST 2009


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Brian de Alwis wrote:
> I tried using the tip from lp:bzr/2.0 to try upgrading a largish branch,
> but the upgrade failed as it ran out of memory.  I ran a parallel ps
> updating every 10 seconds, and the memory maxed out at 3.5GB before it
> died.
> 
> The branch is formed of manually-made periodic snapshots from the
> pkgsrc.org CVS tree.  This tree is broad, but relatively shallow, with
> the latest revision containing 15297 directories and 79723.  There are
> only 21 revisions, but each revision has a large number of changes.  The
> 1.9 .bzr is 129MB in size.  I can make this repository available, if it
> helps.
> 

...

> _create_z_content_from_chunks
>    compressed_chunks = map(compressor.compress, self._content_chunks)
> MemoryError
> 
> 2173.222  return code 3
> 

That would probably be good to see, at least. I'm currently trying to
investigate some of the memory consumption issues. I'm guessing we have
some sort of dangling reference to something that we thought we had
released.

I also wonder if it might be something to do with Mac, but we can always
try to rule that out later.

As this is a conversion, there are also some other possibilities. We do
a little bit more caching, but I certainly wouldn't expect that to grow
into 3.5GB...

John
=:->
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (Cygwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAkqhZ+8ACgkQJdeBCYSNAAPsUQCgoKyT3YkI6DZC7tgb47L3h76q
EoQAniRXfqEKOQkp8r4H1aM8pPO5LtPY
=seTI
-----END PGP SIGNATURE-----



More information about the bazaar mailing list