[ckan-dev] CKAN encoding problem

Adrià Mercader adria.mercader at okfn.org
Thu May 1 15:20:00 UTC 2014


Hi again,

I suspect that this is caused by some of the remote CSW documents
having GUIDs (fileIdentifiers) with special characters on them (eg
CZ-JMK-URB-WMS-US-2012-II/416-ŽATČANYČ-SLAVKOV-U-BRNA). This is not a
really good practice when dealing with ids, but I guess that's the way
it is :)


It's really hard to tell what exactly the issue without a full stack
trace. I see that you are running CKAN under paster. On the terminal
you are running "paster serve" you should get the full stack trace of
this error when it happens in the browser, which might give us more
clues. Can you look for it an paste it somewhere?


Adrià

On 30 April 2014 12:35, Marek Šplíchal <marek.splichal at gmail.com> wrote:
> Hi Adrià,
> I have tried this ckanext-harvest branch, but no success.
> I have harvested datasets - on page
> http://192.168.0.61:5000/harvest/admin/geoportal i see
>
> Last Harvest Job
>
> 1648 errors 1964 added 0 updated 0 deleted
>
> Id 796eb5cb-1f4a-4e31-858e-9361499995c6
> Created April 30, 2014, 07:02
> Started April 30, 2014, 07:03
> Finished April 30, 2014, 08:20
> Status Finished
>
> but when i click on View full job report - it is page
> http://192.168.0.61:5000/harvest/geoportal/job/last
> i get
>
> 500 Internal Server Error
>
> The server has either erred or is incapable of performing the requested
> operation.
>
> An error occurred: ['ascii' codec can't encode character u'\u010c' in
> position 40: ordinal not in range(128)]
>
> Marek Šplíchal
>
>
> Dne 28.4.2014 14:10, Adrià Mercader napsal(a):
>
> Hi Marek,
>
> Can you check if using this ckanext-harvest branch fixes the problem for
> you?
>
> https://github.com/ckan/ckanext-harvest/tree/96-harvest-object-encoding-errors
>
> Thanks,
>
> Adrià
>
>
> On 8 April 2014 07:48, Marek Šplíchal <marek.splichal at gmail.com> wrote:
>
> The CSW source is public: http://geoportal.gov.cz/php/micka/csw/index.php
>
> In CKAN error log is:
> [Tue Apr 08 08:47:07 2014] [error] 2014-04-08 08:47:07,161 INFO
> [ckan.lib.base]
> /harvest/geoportalcr/job/564120a2-098f-4369-9087-a8ffdadd196f render time
> 5.858 seconds
> [Tue Apr 08 08:47:07 2014] [error] 2014-04-08 08:47:07,244 INFO
> [ckan.lib.base]
> /harvest/geoportalcr/job/564120a2-098f-4369-9087-a8ffdadd196f render time
> 0.079 seconds
> [Tue Apr 08 08:47:07 2014] [error] [client 127.0.0.1] mod_wsgi (pid=3765):
> Exception occurred processing WSGI script '/etc/ckan/default/apache.wsgi'.
> [Tue Apr 08 08:47:07 2014] [error] [client 127.0.0.1] IOError: failed to
> write data
> [Tue Apr 08 08:47:08 2014] [error] 2014-04-08 08:47:08,104 INFO
> [ckan.lib.base]  /api/i18n/en render time 0.002 seconds
>
> Dne 8.4.2014 8:36, Nigel Babu napsal(a):
>
> Do you have a full traceback in the error logs? Is the CSW source public?
>
> Nigel Babu
>
> Developer  |  @nigelbabu
>
> The Open Knowledge Foundation
>
> Empowering through Open Knowledge
>
> http://okfn.org/  |  @okfn  |  OKF on Facebook  |  Blog  |  Newsletter
>
>
> CKAN | http://ckan.org/ | @CKANproject | the world’s leading open-source
> data portal platform
>
>
> On 8 April 2014 12:00, Marek Šplíchal <marek.splichal at gmail.com> wrote:
>
> Hi, i did CSW harvesting job and when i try to look on job log i get this
> error:
>
> 500 Internal Server Error
>
> The server has either erred or is incapable of performing the requested
> operation.
>
> An error occurred: ['ascii' codec can't encode character u'\u010c' in
> position 40: ordinal not in range(128)]
>
> It look like CKAN is working in ASCII?
>
> Marek Šplíchal
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>
>
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>
>
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>
>
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>



More information about the ckan-dev mailing list