[wdmmg-dev] Problem to load Uganda into sandbox

Fri Jun 10 12:24:36 UTC 2011

On 10 June 2011 12:14, Carsten Senger <senger at rehfisch.de> wrote:
> Hi all,
>
> I try to load the Uganda data into sandbox.openspending.org.
> But loading the data does not work reliable.
>
> Most of the time I clicked on "Load Data" button no task was added to the
> celery_taskmeta collection in mongodb. The /sources/task/load/<task id>
> page shows up without errors and reloads, but the task id used in the url
> does not exist and nothing else happens.
>
> The only trace is an entry in /var/log/uwsgi-sandbox.log:
>
> SIGPIPE: writing to a closed pipe/socket/fd (probably the client
> disconnected) on request /sources (ip ___.___.___.__) !!!
> writev(): Broken pipe [plugins/python/wsgi_headers.c line 171]
>
> I've no idea how to reproduce that in my dev instance or debug it when
> running uwsgi.

Suggest a really simple solution: disable use of the task queue --
just load the data directly using call to method in lib/csvimport.py
rather than calling the wrapped method in lib/tasks.py. For most of
these datasets this isn't going to be a problem and we're on sandbox
anyway.

Rufus