[ckan-dev] DataStore functionality on TheDataHub

Thu Jun 14 13:27:09 UTC 2012

Hi James,

That looks pretty interesting, especially in light of the new thread called 
'Specification of data processing web services' 
( http://lists.okfn.org/pipermail/ckan-dev/2012-June/002476.html) and the 
need for internal job queueing.

I suspect the initial reaction would be negative about making redis a 
dependency for those services, but as redis has been mentioned in relation
to other solutions, maybe it isn't such as big deal.  Worth some discussion.

Definitely worth the time to take a look I think.  Thanks for pointing it out.

Ross

On 13 Jun 2012, at 14:19, James Casbon wrote:

> On 13 June 2012 13:56, Rufus Pollock <rufus.pollock at okfn.org> wrote:
> No, from what David said, celery crashed in a very unusual way that
> meant it didn't work but it didn't actually close the process (and get
> started by supervisor). Thus the auto converter didn't work (but the
> queued jobs were run on restart).
> 
> OT but I've always wondered how RQ stacks up against celery https://github.com/nvie/rq
> I've found keeping celery going to be a PITA. 
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> http://lists.okfn.org/mailman/listinfo/ckan-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20120614/0350040f/attachment-0001.html>