[storm] Performance Problems using List and Pickle properties

Jürgen Kartnaller kartnaller at lovelysystems.com
Sat Oct 3 12:59:38 BST 2009


The problem exists in 0.14 and 0.15

I tried to reproduce the problem with a simple example without success :(

Jürgen

On Fri, Oct 2, 2009 at 10:16 PM, Jamu Kakar <jkakar at kakar.ca> wrote:

> Hi Jürgen,
>
> On Fri, Oct 2, 2009 at 11:56 AM, Jürgen Kartnaller
> <kartnaller at lovelysystems.com> wrote:
> > After a long time having problems with performance going down in our
> > Zope/Storm applications I could now figure out where it is coming from.
> In
> > my latest app using tornado and Storm I have the same problem.
> >
> > When using List or Pickle properties (both are derived from
> > MutableValueVariable) I found that any time a property is read a flush
> event
> > hook is added but never removed. The longer the app runs the more hooks
> are
> > registered which result in low perfomance in store.flush.
> > The flush event hook is unhooked on the 'stop-tracking-changes' event
> which
> > is only emited if an object is removed from the database.
>
> Are you using the latest version of Storm?  I remember a problem
> like this being fixed some time ago.  I think this is the fix for
> the problem I'm thinking of:
>
> revno: 275 [merge]
> committer: Thomas Hervé <thomas at canonical.com>
> branch nick: trunk
> timestamp: Mon 2008-11-03 20:38:06 +0100
> message:
>  Merge variable-referenceset-leak [r=niemeyer,jkakar]
>
>  Change the way MutableValueVariable hooks up to the store event system, by
>  overriding get and set. This works around a leak discovered when using
>  PickleVariable in a ReferenceSet.
>
> Thanks,
> J.
>



-- 
Jürgen Kartnaller, senior developer

Lovely Systems AG
Telefon +43 5572 908060, Fax +43 5572 908060-77
Schmelzhütterstraße 26a, 6850 Dornbirn, Austria

Sitz: Dornbirn, FB: Landesgericht Feldkirch, FN: 208859x, UID: ATU51736705
Aufsichtsratsvorsitzender: Christian Lutz
Vorstand: Manfred Schwendinger
-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://lists.ubuntu.com/archives/storm/attachments/20091003/909756ab/attachment.htm 


More information about the storm mailing list