[ckan-dev] xlsx import strange behaviour

Tue Nov 22 09:17:11 UTC 2016

Wow, then it really is something more complicated :-)

I would start by looking at whether line 188 of types.py is the same on the
other instances. Delving into the history of messytables on GitHub I see
that it was not always there.

Best,
Matt

On 22 November 2016 at 09:31, Bois Francois-Xavier <fxbois at gmail.com> wrote:

> Matt,
>
> what I discovered this weekend confirms what you are writing below. Some
> xls/xlsx files failed to load on the Azure instance. As they didn't load,
> jsonpdataproxy.appspot.com is triggered.
>
> On Azure, a xls/xlsx files with column where the first value (after the
> header) is numeric trigger an error in :
>
> /usr/lib/ckan/datapusher/lib/python2.7/site-packages/messytables/types.py
> on line 188
> if len(value) == 1:
> TypeError: object of type 'float' has no len()
>
> I solve my issue returning False just before this line (it is a bad patch
> ... but I needed to go forward)
>
> Do you have a clue about why, the same files could trigger an error on
> Azure and not on VirtualBox, Linode ? (same installation)
>
> Best
>
>
> On Mon, Nov 21, 2016 at 3:01 PM, Matthew Fullerton <
> matt.fullerton at gmail.com> wrote:
>
>> Hi Francois,
>> The second part is just a signal that pushing to the datastore using the
>> datapusher didn't work. Pushing not working could be because of firewall
>> (i.e. port configuration on Azure) issues. Datapusher tries to access CKAN
>> from the "outside" using your ckan_url and the datapusher port. If you can
>> ensure that accessing the datapusher from the CKAN Azure machine itself
>> (but using the public url) works, then this might start working.
>>
>> Also, looking under "Manage"... for the Resource under Datastore should
>> show whether pushing was attempted and if it worked.
>>
>> -Matt
>>
>> P.S. The thing with not needing to use the public URL is a known issue:
>> https://github.com/ckan/datapusher/issues/83#issuecomment-151121100
>>
>> --
>> Matt Fullerton
>> Software development & data science for open data and mobility
>> matt at crowdsalad.de
>> +49 89 7456 0495 / +49 176 5789 6501
>> http://www.crowdsalad.de
>>
>>
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20161122/653b3999/attachment-0003.html>