[openspending-dev] Data upload failed

Sat Feb 4 23:33:55 UTC 2012

I think that my use-case might not be so unusual:

1. Load big spending data table into Refine to check columns etc. 
2. Export table as TSV (which I generally prefer over CSV for readability reasons)
3. Upload that big data file to theDataHub
4. Load data into OpenSpending --> FAIL

Don't know whats the actual problem here, but I think that Refine CSV/TSV exports should be accepted by OS.

If TSV is a big problem though, we should definitely communicate this. Took me quite a while to upload the data.

– Gregor

Am 05.02.2012 um 00:24 schrieb Friedrich Lindenberg:

> Hey Gregor,
> 
> thanks for trying this but I'm not sure we want to support this - I've
> actually limited the set of things messytables will do in OpenSpending
> intentionally because I think that when data is handed to OS, it
> should already be formatted properly (which includes using actual
> CSV).
> 
> I'll soon have to do a lot of fixes against messytables for the DGU
> spend, but suspect enabling all this in OpenSpending may actually lead
> to more ambiguity than just having a clear rule
> (http://tools.ietf.org/html/rfc4180)
> 
> What do you think?
> 
> - Friedrich
> 
> On Sat, Feb 4, 2012 at 6:42 PM, Gregor Aisch <gregor.aisch at okfn.org> wrote:
>> Tried to upload some spending data to openspending to find out that the
>> automated CSV recognition failed to detect the tab-separated table..
>> 
>> Seems to be a bug in messytables so I added a new issue. Who's maintaining
>> that package?
>> 
>> https://github.com/okfn/messytables/issues/3
>> 
>> 
>> 
>> _______________________________________________
>> openspending-dev mailing list
>> openspending-dev at lists.okfn.org
>> http://lists.okfn.org/mailman/listinfo/openspending-dev
>> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/openspending-dev/attachments/20120205/9578f408/attachment.html>