bzr fast-import performance slows over time

[John Arbash Meinel]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Brian de Alwis wrote:
> Hi Ian.
> 
> On 13-Apr-2009, at 9:37 PM, Ian Clatworthy wrote:
>> I'm seeing the same thing on pretty much every import. I'm yet to look
>> into why. As you're seeing, for really deep histories, the pack times
>> get huge so that's part of the story, but certainly not the only part.
> 
> 
> It looks like there is a memory leak somewhere in bzr or fast-import,
> and much of the time comes from swapping and thrashing.  The machine has
> about 8GB of memory, and 4GB of swap.

I know I recently fixed one memory leak
http://bundlebuggy.aaronbentley.com/project/bzr/request/%3C49E69417.2030505%40arbash-meinel.com%3E

I don't think it would account for 8GB of memory consumption.

I know that the fast-import code uses certain logic for caching the file
contents in memory. It may be that its heuristic fails when use with an
extra wide tree.

John
=:->
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (Cygwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAknrsWAACgkQJdeBCYSNAAO6SwCgmdOn4kz9yar5C513KIn+cRyS
jYoAoKI3BEQcsK1oSpCEwdxK98G5jDFC
=j0vL
-----END PGP SIGNATURE-----