Issue with Loggerhead?

John Arbash Meinel john at arbash-meinel.com
Fri Mar 11 08:32:06 UTC 2011


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 03/11/2011 08:46 AM, Russel Winder wrote:
> I have a Loggerhead running.  When it starts it has 388Mb virtual and
> 42kB resident.  Minute by minute the memory consumed creeps up.  After
> about an hour it was 420MB virtual and 67kB resident.  This morning,
> after seven days of not being observed, it had got to 2.1GB virtual and
> 480MB resident.
> 
> This seems like a very bad idea.
> 
> I am using the 1.18-1~bazaar1~maverick1 package from the Bazaar PPA not
> the 1.17+bzr424-1ubuntu1 which is standard with Maverick.
> 

You may want to investigate using
"lp:~loggerhead-team/loggerhead/experimental".

It uses a different db schema, to do a lot lower memory consumption. It
used to be loggerhead trunk, but it needed a bit more testing before it
was ready to scale to a site as big as Launchpad, so it got moved to an
experimental branch as we finish polishing it.

I know a few people are running it already (Peng on IRC, for example).

The old 1.17 and 1.18 had an in-memory cache of the full ancestry for up
to 10 (default, iirc) branches. So eventually it should cap, but the cap
could be pretty high.

I don't trust Virtual very much, but 480MB resident is certainly
possible after caching a few branches.

The 'experimental' branch doesn't cache the ancestries in memory.
Instead it creates a db structure that allows it to query partial
ancestry quickly.

We'd be happy to get feedback on it. I'm pretty happy with it overall,
but the loggerhead codebase doesn't have much of an automated test suite
(I'm trying to improve that), so it is possible that some pages broke, etc.

John
=:->
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAk153gYACgkQJdeBCYSNAAMBswCcCbrQIEmXS35mSeuP5Iiwxxd7
lY4An3TteVYBQUI6Y6xQHzK3OTn2Vjot
=iaur
-----END PGP SIGNATURE-----



More information about the bazaar mailing list