[ckan-dev] UnicodeDecodeError when running paster search-index rebuild

Mon Feb 4 11:23:08 UTC 2019

Thanks for the hints, everybody! It was indeed a problem with our Solr 
configuration which caused Solr to produce error messages which pysolr 
then failed to parse.

Regards,
Florian

"ckan-dev" <ckan-dev-bounces at lists.okfn.org> schrieb am 30.01.2019 
13:19:03:

> Von: Stefan Oderbolz <stefan.oderbolz at liip.ch>
> An: CKAN Development Discussions <ckan-dev at lists.okfn.org>, 
> Datum: 30.01.2019 13:19
> Betreff: Re: [ckan-dev] UnicodeDecodeError when running paster 
> search-index rebuild
> Gesendet von: "ckan-dev" <ckan-dev-bounces at lists.okfn.org>
> 
> Hi Florian
> 
> I found an old thread on the mailinglist (https://lists.okfn.org/
> pipermail/ckan-dev/2018-July/022811.html) and an open issue on github (
> https://github.com/ckan/ckan/issues/4128) related to your problem.
> From what I understand, it seems to be a bug of tomcat/jetty 
> (whatever you are using) to return the response as unicode, which it
> did not do before. Maybe you can try to switch to another version of
> solr/jetty/tomcat?
> 
> - Stefan
> 
> On Mon, Jan 28, 2019 at 1:12 PM <Florian.Brucker at it.karlsruhe.de> wrote:
> Hi everyone, 
> 
> I'm currently setting up a CKAN 2.8.2 instance, and I'm running into
> the following UnicodeDecodeError whenever I'm trying to do "paster 
> search-index rebuild": 
> 
> 
> 2019-01-28 12:37:12,326 ERROR [ckan.lib.search.common] 'ascii' codec
> can't decode byte 0xe2 in position 60: ordinal not in range(128) 
> Traceback (most recent call last): 
>   File "/var/transparenz.karlsruhe.de/ckan/ckan/lib/search/common.py
> ", line 60, in is_available 
>     conn.search(q="*:*", rows=1) 
>   File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/
> pysolr.py", line 720, in search 
>     response = self._select(params, handler=search_handler) 
>   File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/
> pysolr.py", line 418, in _select 
>     return self._send_request('get', path) 
>   File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/
> pysolr.py", line 387, in _send_request 
>     solr_message = self._extract_error(resp) 
>   File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/
> pysolr.py", line 496, in _extract_error 
>     reason, full_html = self._scrape_response(resp.headers, 
resp.content) 
>   File "/usr/lib/ckan/default/local/lib/python2.7/site-packages/
> pysolr.py", line 527, in _scrape_response 
>     if response.startswith('<?xml'): 
> UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position
> 60: ordinal not in range(128) 
> 
> 
> Any ideas? 
> 
> 
> Regards,
> Florian_______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> 
> -- 
> Liip AG  // Limmatstrasse 183 //  CH-8005 Zürich
> Tel +41 43 500 39 80 // GnuPG 0x7B588C67 // www.liip.ch
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20190204/5818963a/attachment.html>