[wdmmg-dev] urgent (Re: [OpenSpending] #189: API call taking 20 minutes)

Thu Jun 16 06:57:22 UTC 2011

Ok, this issue turns out to be reasonably serious: with the addition of much
more data to the production site, computing aggregates (such as used when
scaling regional results by population) now takes unaccepably long, as a
range query must be performed across all the datasets in Mongo.

Friedrich and I looked at this last night. It may be possible to mitigate by
disabling some uses of aggregator.Results.divide_by_statistic

I'm sorry I don't yet have a better characterisation of the problem than
this(!)

Mk
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/openspending-dev/attachments/20110616/e9c35f1f/attachment.html>