[ckan-dev] CKAN encoding problem

Marek Šplíchal marek.splichal at gmail.com
Thu May 1 19:06:43 UTC 2014


When i set debug to true, in console is:

2014-05-01 21:06:15,327 INFO  [ckan.lib.base] 
/harvest/geoportal/job/last render time 7.088 seconds


Dne 1.5.2014 19:09, Adrià Mercader napsal(a):
> Do you have the following setting on your ini file?
>
> debug = true
>
>
>
> On 1 May 2014 17:23, Marek Šplíchal <marek.splichal at gmail.com> wrote:
>> Hi,
>> in console is only:
>>
>> 2014-05-01 18:22:10,221 INFO  [ckan.lib.base] /harvest/geoportal/job/last
>> render time 7.263 seconds
>> 2014-05-01 18:22:11,777 INFO  [ckan.lib.base] /harvest/geoportal/job/last
>> render time 1.550 seconds
>> 2014-05-01 18:22:12,638 INFO  [ckan.lib.base]  /api/i18n/en render time
>> 0.005 seconds
>>
>> Marek
>>
>> Dne 1.5.2014 17:20, Adrià Mercader napsal(a):
>>
>>> Hi again,
>>>
>>> I suspect that this is caused by some of the remote CSW documents
>>> having GUIDs (fileIdentifiers) with special characters on them (eg
>>> CZ-JMK-URB-WMS-US-2012-II/416-ŽATČANYČ-SLAVKOV-U-BRNA). This is not a
>>> really good practice when dealing with ids, but I guess that's the way
>>> it is :)
>>>
>>>
>>> It's really hard to tell what exactly the issue without a full stack
>>> trace. I see that you are running CKAN under paster. On the terminal
>>> you are running "paster serve" you should get the full stack trace of
>>> this error when it happens in the browser, which might give us more
>>> clues. Can you look for it an paste it somewhere?
>>>
>>>
>>> Adrià
>>>
>>> On 30 April 2014 12:35, Marek Šplíchal <marek.splichal at gmail.com> wrote:
>>>> Hi Adrià,
>>>> I have tried this ckanext-harvest branch, but no success.
>>>> I have harvested datasets - on page
>>>> http://192.168.0.61:5000/harvest/admin/geoportal i see
>>>>
>>>> Last Harvest Job
>>>>
>>>> 1648 errors 1964 added 0 updated 0 deleted
>>>>
>>>> Id 796eb5cb-1f4a-4e31-858e-9361499995c6
>>>> Created April 30, 2014, 07:02
>>>> Started April 30, 2014, 07:03
>>>> Finished April 30, 2014, 08:20
>>>> Status Finished
>>>>
>>>> but when i click on View full job report - it is page
>>>> http://192.168.0.61:5000/harvest/geoportal/job/last
>>>> i get
>>>>
>>>> 500 Internal Server Error
>>>>
>>>> The server has either erred or is incapable of performing the requested
>>>> operation.
>>>>
>>>> An error occurred: ['ascii' codec can't encode character u'\u010c' in
>>>> position 40: ordinal not in range(128)]
>>>>
>>>> Marek Šplíchal
>>>>
>>>>
>>>> Dne 28.4.2014 14:10, Adrià Mercader napsal(a):
>>>>
>>>> Hi Marek,
>>>>
>>>> Can you check if using this ckanext-harvest branch fixes the problem for
>>>> you?
>>>>
>>>>
>>>> https://github.com/ckan/ckanext-harvest/tree/96-harvest-object-encoding-errors
>>>>
>>>> Thanks,
>>>>
>>>> Adrià
>>>>
>>>>
>>>> On 8 April 2014 07:48, Marek Šplíchal <marek.splichal at gmail.com> wrote:
>>>>
>>>> The CSW source is public: http://geoportal.gov.cz/php/micka/csw/index.php
>>>>
>>>> In CKAN error log is:
>>>> [Tue Apr 08 08:47:07 2014] [error] 2014-04-08 08:47:07,161 INFO
>>>> [ckan.lib.base]
>>>> /harvest/geoportalcr/job/564120a2-098f-4369-9087-a8ffdadd196f render time
>>>> 5.858 seconds
>>>> [Tue Apr 08 08:47:07 2014] [error] 2014-04-08 08:47:07,244 INFO
>>>> [ckan.lib.base]
>>>> /harvest/geoportalcr/job/564120a2-098f-4369-9087-a8ffdadd196f render time
>>>> 0.079 seconds
>>>> [Tue Apr 08 08:47:07 2014] [error] [client 127.0.0.1] mod_wsgi
>>>> (pid=3765):
>>>> Exception occurred processing WSGI script
>>>> '/etc/ckan/default/apache.wsgi'.
>>>> [Tue Apr 08 08:47:07 2014] [error] [client 127.0.0.1] IOError: failed to
>>>> write data
>>>> [Tue Apr 08 08:47:08 2014] [error] 2014-04-08 08:47:08,104 INFO
>>>> [ckan.lib.base]  /api/i18n/en render time 0.002 seconds
>>>>
>>>> Dne 8.4.2014 8:36, Nigel Babu napsal(a):
>>>>
>>>> Do you have a full traceback in the error logs? Is the CSW source public?
>>>>
>>>> Nigel Babu
>>>>
>>>> Developer  |  @nigelbabu
>>>>
>>>> The Open Knowledge Foundation
>>>>
>>>> Empowering through Open Knowledge
>>>>
>>>> http://okfn.org/  |  @okfn  |  OKF on Facebook  |  Blog  |  Newsletter
>>>>
>>>>
>>>> CKAN | http://ckan.org/ | @CKANproject | the world’s leading open-source
>>>> data portal platform
>>>>
>>>>
>>>> On 8 April 2014 12:00, Marek Šplíchal <marek.splichal at gmail.com> wrote:
>>>>
>>>> Hi, i did CSW harvesting job and when i try to look on job log i get this
>>>> error:
>>>>
>>>> 500 Internal Server Error
>>>>
>>>> The server has either erred or is incapable of performing the requested
>>>> operation.
>>>>
>>>> An error occurred: ['ascii' codec can't encode character u'\u010c' in
>>>> position 40: ordinal not in range(128)]
>>>>
>>>> It look like CKAN is working in ASCII?
>>>>
>>>> Marek Šplíchal
>>>>
>>>> _______________________________________________
>>>> ckan-dev mailing list
>>>> ckan-dev at lists.okfn.org
>>>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>>>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> ckan-dev mailing list
>>>> ckan-dev at lists.okfn.org
>>>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>>>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> ckan-dev mailing list
>>>> ckan-dev at lists.okfn.org
>>>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>>>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>>>
>>>> _______________________________________________
>>>> ckan-dev mailing list
>>>> ckan-dev at lists.okfn.org
>>>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>>>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> ckan-dev mailing list
>>>> ckan-dev at lists.okfn.org
>>>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>>>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>>>
>>> _______________________________________________
>>> ckan-dev mailing list
>>> ckan-dev at lists.okfn.org
>>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>
>> _______________________________________________
>> ckan-dev mailing list
>> ckan-dev at lists.okfn.org
>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev




More information about the ckan-dev mailing list