[ckan-dev] DataStore functionality on TheDataHub

Thu Jun 14 13:46:39 UTC 2012

Maybe we should use zookeeper for the distributed locks? Maybe I should get back to my testing.

Ross

On 14 Jun 2012, at 14:44, James Casbon wrote:

> 
> 
> On 14 June 2012 14:36, Ross Jones <ross.jones at okfn.org> wrote:
> 
> On 14 Jun 2012, at 14:29, James Casbon wrote:
> 
> > I'm curious: which bus do you use at the moment for celery?  Are the jobs in the DB too?
> 
> 
> Yes, it's in the main postgres DB. So in some respects not ideal, and I think on the whole
> we're generally going off celery reasonably quickly.
> 
> Celery + DB bus is like the EU: better in theory than in practice ;) 
> 
> Postgres probably does a reasonable job on the locking, but I can't imagine scaling the worker processes without pain.
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> http://lists.okfn.org/mailman/listinfo/ckan-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20120614/ab7290ef/attachment-0001.html>