Writing background tasks is a joy with the new RQ-based queues that are coming with CKAN 2.7. For previous versions of CKAN, I've done a backport in an extension: https://github.com/davidread/ckanext-rq Do give it a try and let me know what you think. And thanks again to @torfsen for doing the work to integrate RQ. Regards, David