[ckan-dev] Issues loading large excel file

Thu May 21 11:12:04 UTC 2015

The problem now is the question marks in the headers. These confuse Recline/jQuery. I've had the same problem with @ symbols which come up when you convert OpenStreetMap data to CSV. So the upload probably worked just fine, but the display in the data explorer doesn't work.

It might be worth searching the issues/filing an issue at github.com/okfn/recline/issues and/or github.com/ckan/ckan/issues - I have the latest recline in our (near-master) CKAN and the problem is still there.

Best,

Matt

Projekt SMARTLANE

matthew at smartlane.de<mailto:florian at smartlane.de>
T +49.89.289.28575
F +49.89.289.22333
www.smartlane.de<http://www.smartlane.de/>

EXIST-Gründungsvorhaben "Tapestry"
c/o Lehrstuhl für Verkehrstechnik
Technische Universität München
Arcisstraße 21
80333 München

Gefördert vom Bundesministerium für Wirtschaft und Technologie
aufgrund eines Beschlusses des Deutschen Bundestages.

________________________________
Von: ckan-dev <ckan-dev-bounces at lists.okfn.org> im Auftrag von Lynn Greenwood <lynn at akvo.org>
Gesendet: Freitag, 15. Mai 2015 10:40
An: CKAN Development Discussions
Betreff: Re: [ckan-dev] Issues loading large excel file

Thanks for the reply, I've updated any/all duplications I can find but it fails with the same error.

https://opendata.akvo.org/dataset/vanuatu-wash-assessment-april-2015/resource/9f05c411-cff9-41f6-9653-df8192c5e5e8

On 15 May 2015, at 09:38, Brook Elgie <brook.elgie at okfn.org<mailto:brook.elgie at okfn.org>> wrote:

Hi Lynn,

It looks like the problem may be non-unique headers. For example: Columns AS and AW have the same header "Is there another SANITATION key issue?"

If I remove all the other columns, leaving only those two, I can't upload to the datastore without an error. However, if I make the headers unique, I can upload.

Obviously, the error message coming back hasn't been very helpful.

Hope this helps,

Brook

On 14 May 2015 at 13:15, Lynn Greenwood <lynn at akvo.org<mailto:lynn at akvo.org>> wrote:
Hi there

We're looking for some advice.

We're been trying to get https://opendata.akvo.org/dataset/vanuatu-wash-assessment-april-2015/resource/9f05c411-cff9-41f6-9653-df8192c5e5e8 this resource to load correctly to the datastore but it keeps throwing up one error after another.

We've managed to get rid of some errors by removing the offending data but right now, there is nothing else we can remove, as the data would then be meaningless.

When we load this we currently get a very un-user friendly error :Error: CKAN DataStore bad response. Status code: 500 Internal Server Error. At: http://opendata.akvo.org:8080/api/3/action/datastore_create.
HTTP status code: 500
Response: <html> <head> <title>Server Error</title> </head> <body> <h1>Server Error</h1> An internal server error occurred </body> </html>
Requested URL: http://opendata.akvo.org:8080/api/3/action/datastore_create

It seems like it has something to do with the headers of the columns as if I update the column header names to 'a, b, c, d,e, f, aa,bb,cc' etc the file loads without any problem.

I've removed all of the funny characters, numbers, etc but it still won't load.

Any ideas or anyone with a similar issue?

thanks
Lynn

_______________________________________________
ckan-dev mailing list
ckan-dev at lists.okfn.org<mailto:ckan-dev at lists.okfn.org>
https://lists.okfn.org/mailman/listinfo/ckan-dev
Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev

_______________________________________________
ckan-dev mailing list
ckan-dev at lists.okfn.org<mailto:ckan-dev at lists.okfn.org>
https://lists.okfn.org/mailman/listinfo/ckan-dev
Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20150521/7ed4a96c/attachment-0003.html>