01:12.07 | *** join/#storm infobot (~infobot@rikers.org) |
01:12.07 | *** topic/#storm is The Storm Python ORM - http://storm.canonical.com/ - 0.18 released! || Review branches: https://code.launchpad.net/storm/+activereviews || IRC logs: http://ibot.rikers.org/#storm/ || API documentation: http://people.canonical.com/~jkakar/storm/ |
01:18.41 | *** join/#storm fcorrea (~fcorrea@201-62-110-81-ma.static.vivax.com.br) |
03:49.09 | *** join/#storm stub (~stub@125.24.100.145.adsl.dynamic.totbb.net) |
03:49.16 | *** join/#storm stub (~stub@canonical/launchpad/stub) |
04:20.53 | *** join/#storm pingveno (~pingveno@c-98-246-133-8.hsd1.or.comcast.net) |
04:43.37 | *** part/#storm bigdog (~scmikes@72-197-8-8-arpa.cust.cincinnaticomm.net) |
07:34.08 | *** join/#storm esteve (~quassel@cli-5b7ee22f.bcn.adamo.es) |
07:53.45 | *** join/#storm fcorrea (~fcorrea@201-74-64-215-so.cpe.vivax.com.br) |
07:54.41 | *** join/#storm zmijunkie (~sascha@i59F5DF86.versanet.de) |
08:02.17 | *** join/#storm jamesh (~james@canonical/launchpad/jamesh) |
08:14.37 | *** join/#storm bigjools (~quassel@canonical/launchpad/bigjools) |
08:48.15 | *** join/#storm stub (~stub@canonical/launchpad/stub) |
11:01.27 | *** join/#storm wallyworld (~quassel@27-33-46-253.static.tpgi.com.au) |
11:50.34 | *** join/#storm wallyworld (~quassel@27-33-46-253.static.tpgi.com.au) |
12:29.41 | *** join/#storm jamesh (~james@canonical/launchpad/jamesh) |
14:15.01 | *** join/#storm fcorrea (~fcorrea@187.3.22.136) |
14:41.48 | *** join/#storm danilos (~danilo@cable-178-148-38-107.dynamic.sbb.rs) |
14:41.48 | *** join/#storm danilos (~danilo@canonical/launchpad/danilos) |
15:26.32 | *** join/#storm magmatt (~Matt@74-92-245-181-Utah.hfc.comcastbusiness.net) |
15:58.10 | *** join/#storm _mup__ (~mup@li37-90.members.linode.com) |
16:02.46 | *** join/#storm _mup_ (~mup@li37-90.members.linode.com) |
16:47.43 | *** join/#storm webmaven (~webmaven@97.65.119.2) |
16:59.05 | mgedmin | tried profiling a bit, found that most of the commit() time was in invalidate, and quite a bit of it was in the method that loops over all the objects and then over all the attributes of an object |
16:59.39 | jkakar | mgedmin: Yeah, I guess I'm not so surprised. I wonder if we could speed that up, somehow. |
16:59.55 | jkakar | It's been a long time since I looked at the code... would need to do a deep dive to relearn how it all works. |
17:00.21 | mgedmin | my plan is to rewrite the software and avoid using ORM objects for that table |
17:00.41 | jkakar | mgedmin: I'm working on a project now where we're using Storm, but almost entirely without live objects. |
17:00.53 | mgedmin | (it basically serializes key-value pairs, I'd like to load it into a bunch of dictionaries) |
17:01.23 | jkakar | mgedmin: We're defining Storm objects so that we can use Store.find to run queries, but then in almost all cases we call ResultSet.values(...) and work with the raw values. |
17:01.33 | jkakar | mgedmin: It's working well in this situation. |
17:02.05 | jkakar | mgedmin: If you don't need to query based on keys/values you might consider using a JSON or Pickle property to store the dicts. |
17:03.06 | mgedmin | we refactored the software to use a table of key-value pairs instead of a string property containing the repr() of a dict about a month ago... |
17:07.02 | jkakar | mgedmin: Ah, okay. |
17:07.07 | mgedmin | :) |
17:07.46 | jkakar | mgedmin: We're using a table to store key/value pairs... the values could be None, int, float, bool, etc. |
17:08.12 | jkakar | mgedmin: We're using a JSON property there so that we can store whatever we want as a string, but have it behave nicely in code. |
17:09.35 | jkakar | mgedmin: So far it's working well... I am slightly concerned about the cost of serializing and deserializing JSON for every column... but I guess we'll wait to see if that's a problem. |
17:25.57 | *** join/#storm sidnei (~sidnei@200-203-4-97.cslce701.dsl.brasiltelecom.net.br) |
18:12.36 | *** join/#storm sidnei (~sidnei@200-203-4-97.cslce701.dsl.brasiltelecom.net.br) |
18:50.28 | *** join/#storm wallyworld (~quassel@27-33-46-253.static.tpgi.com.au) |
18:58.38 | *** join/#storm webmaven (~webmaven@97.65.119.2) |
19:23.22 | *** join/#storm srichter (~srichter@c-98-229-180-68.hsd1.ma.comcast.net) |
21:03.59 | *** join/#storm sidnei (~sidnei@200-203-4-97.cslce701.dsl.brasiltelecom.net.br) |
21:46.36 | *** part/#storm magmatt (~Matt@74-92-245-181-Utah.hfc.comcastbusiness.net) |
22:28.21 | *** join/#storm fcorrea (~fcorrea@201-74-64-215-so.cpe.vivax.com.br) |
22:32.24 | *** join/#storm fcorrea (~fcorrea@201-74-64-215-so.cpe.vivax.com.br) |
23:16.53 | *** join/#storm wallyworld (~quassel@27-33-46-253.static.tpgi.com.au) |