[ckan-dev] Preview of dataset fails due to timeout.

Henrik Aagaard Sørensen BU1G at tmf.kk.dk
Wed Oct 2 09:40:33 UTC 2013


Can anyone help me out on debugging the issue with the datastorer.

It is this dataset/resource I would like to store in the datastorer:
http://data.kk.dk/dataset/veje/resource/19a2ba4c-3798-42e2-bfa4-548d493111a4

I've modified the datastorer to accept : (colon) in the URLs in:
/usr/lib/ckan/default/src/ckanext-datastorer/ckanext/datastorer/fetch_resource.py
changing:
elif any(['/' in parsed_url.query, ':' in parsed_url.query]):
to:
elif any(['/' in parsed_url.query]):

When I run:
sudo /usr/lib/ckan/default/bin/paster --plugin=ckanext_datastorer datastore_upload veje -c /etc/ckan/default/production.ini
I get this output:
2013-10-02 11:35:08,663 WARNI [root] Skipping resource http://wfs-kbhkort.kk.dk/k101/ows?service=WFS&version=1.0.0&request=GetFeature&typeName=k101:vejflade&outputFormat=json&SRSNAME=EPSG:4326 from package veje because MIME type application/json and format geojson is unrecognized
2013-10-02 11:35:13,621 WARNI [root] Resource downloaded: id=19a2ba4c-3798-42e2-bfa4-548d493111a4 url=u'http://wfs-kbhkort.kk.dk/k101/ows?service=WFS&version=1.0.0&request=GetFeature&typeName=k101:vejflade&outputFormat=csv&SRSNAME=EPSG:4326' cache_filename=/tmp/tmpr8pfqC length=7453333 hash=d3168087bb4efa12f415b6000bdeaee02125356c
[]

So everything looks fine. There's no error the ckan_default.error.log or any other, such as apache-log, postgres-log etc.

But there's no datastore for the resource.




More information about the ckan-dev mailing list