[ckan-dev] Error with datapusher

Thu Oct 20 12:35:29 UTC 2016

Hi

I have an error with a CKAN on an Azure VM (Redhat) while uploading a file

[Thu Oct 20 14:29:13.652114 2016] [:error] [pid 2793]
/usr/lib/ckan/datapusher/lib/python2.7/site-packages/sqlalchemy/sql/sqltypes.py:219:
SAWarning: Unicode type received non-unicode bind param value
'bd33b5d3-e7ff-48b1-8025-6...'. (this warning may be suppressed after 10
occurrences)
[Thu Oct 20 14:29:13.652137 2016] [:error] [pid 2793]
(util.ellipses_string(value),))
[Thu Oct 20 14:29:13.738562 2016] [:error] [pid 2793] Fetching from: http://
<server>/dataset/747120e4-f291-4624-8dcc-be236acbeffa/resource/89c2ad99-5974-4f04-ae45-0897544500d5/download/magazines.xlsx
[Thu Oct 20 14:29:14.301512 2016] [:error] [pid 2793] Job
"push_to_datastore (trigger: RunTriggerNow, run = True, next run at: None)"
raised an exception
[Thu Oct 20 14:29:14.301543 2016] [:error] [pid 2793] Traceback (most
recent call last):
[Thu Oct 20 14:29:14.301546 2016] [:error] [pid 2793]   File
"/usr/lib/ckan/datapusher/lib/python2.7/site-packages/apscheduler/scheduler.py",
line 512, in _run_job
[Thu Oct 20 14:29:14.301548 2016] [:error] [pid 2793]     retval =
job.func(*job.args, **job.kwargs)
[Thu Oct 20 14:29:14.301550 2016] [:error] [pid 2793]   File
"/usr/lib/ckan/datapusher/src/datapusher/datapusher/jobs.py", line 370, in
push_to_datastore
[Thu Oct 20 14:29:14.301552 2016] [:error] [pid 2793]     types =
messytables.type_guess(row_set.sample, types=TYPES, strict=True)
[Thu Oct 20 14:29:14.301554 2016] [:error] [pid 2793]   File
"/usr/lib/ckan/datapusher/lib/python2.7/site-packages/messytables/types.py",
line 227, in type_guess
[Thu Oct 20 14:29:14.301556 2016] [:error] [pid 2793]     if not
type.test(cell.value):
[Thu Oct 20 14:29:14.301557 2016] [:error] [pid 2793]   File
"/usr/lib/ckan/datapusher/lib/python2.7/site-packages/messytables/types.py",
line 188, in test
[Thu Oct 20 14:29:14.301559 2016] [:error] [pid 2793]     if len(value) ==
1:
[Thu Oct 20 14:29:14.301561 2016] [:error] [pid 2793] TypeError: object of
type 'float' has no len()

Do you have any clue ?

Datapusher seem to work because I was able to import one XLS file. Two
other files (one XLSX and one CSV) that work on other CKAN installs fail
with the error above.

Best

Fx
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20161020/e1636cfb/attachment-0002.html>