[ckan-discuss] Greek in preview

[David Raznick]

Hello

Had another look at this.  It appears that as the last column in that csv
is blank causing issues in loading to the datastore.   The encoding issues
are fine with the datastore.
http://ckandeploy.cloudapp.net/dataset/test-dataset/resource/2c9ed18f-81fa-4238-ae6b-53c00330f9ec

Part of the work in 2.2 is showing these upload errors more clearly in the
frontend and give a way to re-upload without needing the cron (by pressing
a button in the ui).

Not sure why the fallback (the dataproxy) is not dealing with those
characters properly though.

Thanks

David



On 31 October 2013 15:18, Sebastian Rahtz <sebastian.rahtz at gmail.com> wrote:

>
> On 31 Oct 2013, at 14:45, David Raznick <david.raznick at okfn.org> wrote:
>
> > We discussed this in our tech meeting today and will look into it.  We
> will respond to your github issue.
> >
> many thanks
>
> >
> > My guess is that its the dataproxy and that if the data is loaded into
> the datastore, it would work properly.  There are many issues with the
> dataproxy (most importantly not handling large files well) and we are
> trying to phase it out.
> >
> > In order to do that we have been working on making uploading data and
> putting it into the datastore much more easy for the user and the person
> running CKAN and those changes will be in the next release.
>
> I am glad to hear  this. its the area which confuses me most in CKAN as it
> stands.
>
> I don’t know why that resource _isnt_ in the datastore, actually. When I
> run the data storer script in cron, it comes up
> as being read (2013-10-31 15:15:19,728 WARNI [root] Resource downloaded:
> id=fe03ffd5-21cf-43e2-964e-174ff2241b24 url=u'
> http://clas-lgpn2.classics.ox.ac.uk/status/architect/csv'
> cache_filename=/tmp/tmptcirsd length=5106
> hash=0dce4a70d9cc4d6bb52e3abda48c24125b280e80), but doesn’t appear in the
> datastore.
> --
> Sebastian Rahtz
> Director (Research) of Academic IT
> University of Oxford IT Services
> 13 Banbury Road, Oxford OX2 6NN. Phone +44 1865 283431
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-discuss/attachments/20131031/68a65549/attachment.htm>