IRC log for #storm on 20110331

01:12.07*** join/#storm infobot (~infobot@rikers.org)
01:12.07*** topic/#storm is The Storm Python ORM - http://storm.canonical.com/ - 0.18 released! || Review branches: https://code.launchpad.net/storm/+activereviews || IRC logs: http://ibot.rikers.org/#storm/ || API documentation: http://people.canonical.com/~jkakar/storm/
01:18.41*** join/#storm fcorrea (~fcorrea@201-62-110-81-ma.static.vivax.com.br)
03:49.09*** join/#storm stub (~stub@125.24.100.145.adsl.dynamic.totbb.net)
03:49.16*** join/#storm stub (~stub@canonical/launchpad/stub)
04:20.53*** join/#storm pingveno (~pingveno@c-98-246-133-8.hsd1.or.comcast.net)
04:43.37*** part/#storm bigdog (~scmikes@72-197-8-8-arpa.cust.cincinnaticomm.net)
07:34.08*** join/#storm esteve (~quassel@cli-5b7ee22f.bcn.adamo.es)
07:53.45*** join/#storm fcorrea (~fcorrea@201-74-64-215-so.cpe.vivax.com.br)
07:54.41*** join/#storm zmijunkie (~sascha@i59F5DF86.versanet.de)
08:02.17*** join/#storm jamesh (~james@canonical/launchpad/jamesh)
08:14.37*** join/#storm bigjools (~quassel@canonical/launchpad/bigjools)
08:48.15*** join/#storm stub (~stub@canonical/launchpad/stub)
11:01.27*** join/#storm wallyworld (~quassel@27-33-46-253.static.tpgi.com.au)
11:50.34*** join/#storm wallyworld (~quassel@27-33-46-253.static.tpgi.com.au)
12:29.41*** join/#storm jamesh (~james@canonical/launchpad/jamesh)
14:15.01*** join/#storm fcorrea (~fcorrea@187.3.22.136)
14:41.48*** join/#storm danilos (~danilo@cable-178-148-38-107.dynamic.sbb.rs)
14:41.48*** join/#storm danilos (~danilo@canonical/launchpad/danilos)
15:26.32*** join/#storm magmatt (~Matt@74-92-245-181-Utah.hfc.comcastbusiness.net)
15:58.10*** join/#storm _mup__ (~mup@li37-90.members.linode.com)
16:02.46*** join/#storm _mup_ (~mup@li37-90.members.linode.com)
16:47.43*** join/#storm webmaven (~webmaven@97.65.119.2)
16:59.05mgedmintried profiling a bit, found that most of the commit() time was in invalidate, and quite a bit of it was in the method that loops over all the objects and then over all the attributes of an object
16:59.39jkakarmgedmin: Yeah, I guess I'm not so surprised.  I wonder if we could speed that up, somehow.
16:59.55jkakarIt's been a long time since I looked at the code... would need to do a deep dive to relearn how it all works.
17:00.21mgedminmy plan is to rewrite the software and avoid using ORM objects for that table
17:00.41jkakarmgedmin: I'm working on a project now where we're using Storm, but almost entirely without live objects.
17:00.53mgedmin(it basically serializes key-value pairs, I'd like to load it into a bunch of dictionaries)
17:01.23jkakarmgedmin: We're defining Storm objects so that we can use Store.find to run queries, but then in almost all cases we call ResultSet.values(...) and work with the raw values.
17:01.33jkakarmgedmin: It's working well in this situation.
17:02.05jkakarmgedmin: If you don't need to query based on keys/values you might consider using a JSON or Pickle property to store the dicts.
17:03.06mgedminwe refactored the software to use a table of key-value pairs instead of a string property containing the repr() of a dict about a month ago...
17:07.02jkakarmgedmin: Ah, okay.
17:07.07mgedmin:)
17:07.46jkakarmgedmin: We're using a table to store key/value pairs... the values could be None, int, float, bool, etc.
17:08.12jkakarmgedmin: We're using a JSON property there so that we can store whatever we want as a string, but have it behave nicely in code.
17:09.35jkakarmgedmin: So far it's working well... I am slightly concerned about the cost of serializing and deserializing JSON for every column... but I guess we'll wait to see if that's a problem.
17:25.57*** join/#storm sidnei (~sidnei@200-203-4-97.cslce701.dsl.brasiltelecom.net.br)
18:12.36*** join/#storm sidnei (~sidnei@200-203-4-97.cslce701.dsl.brasiltelecom.net.br)
18:50.28*** join/#storm wallyworld (~quassel@27-33-46-253.static.tpgi.com.au)
18:58.38*** join/#storm webmaven (~webmaven@97.65.119.2)
19:23.22*** join/#storm srichter (~srichter@c-98-229-180-68.hsd1.ma.comcast.net)
21:03.59*** join/#storm sidnei (~sidnei@200-203-4-97.cslce701.dsl.brasiltelecom.net.br)
21:46.36*** part/#storm magmatt (~Matt@74-92-245-181-Utah.hfc.comcastbusiness.net)
22:28.21*** join/#storm fcorrea (~fcorrea@201-74-64-215-so.cpe.vivax.com.br)
22:32.24*** join/#storm fcorrea (~fcorrea@201-74-64-215-so.cpe.vivax.com.br)
23:16.53*** join/#storm wallyworld (~quassel@27-33-46-253.static.tpgi.com.au)

Generated by irclog2html.pl Modified by Tim Riker to work with infobot.