[storm] Storm speed

Grahame Bowland grahame at angrygoats.net
Sun Feb 1 15:25:25 GMT 2009


Hi all

I'm using storm to iterate over every row in a table with 900,000
rows. This seems pretty slow - unsurprising! I'm wondering if there
are any patterns people use when using storm to speed up selecting a
large number of rows/objects from a database? Just running the query
against sqlite is very quick, the CPU time is definitely being spent
inside of Storm/Python.

Not sure if there are any tricks to cut down on object creation?
Thanks for any help!

Grahame



More information about the storm mailing list