[ckan-dev] Newest Solr version compatible with CKAN 2.7.2 SOLVED

Mon Oct 23 11:45:34 UTC 2017

Dear all

I realized that I haven't configured properly the ckan_default Solr node and it had a managed schema so that is now fixed but I cannot use that Solr version (6.6.2).

The defaultSearchField in CKAN 2.7.2 default schema.xml has been deprecated from Lucene version 6.6.0, therefore I guess right now Solr 6.5.1 is the newest CKAN version compatible without any changes (http://archive.apache.org/dist/lucene/solr/). 

Best,
Lucia

_________________________________________________________
Dr. Lucia Espona Pernas

Swiss Federal Institute for Forest, Snow and Landscape Research WSL
Hauptgebäaude Labortrakt (HL C21)
Zürcherstrasse 111
8903 Birmensdorf
Switzerland

+41 44 739 28 71 phone direct
+41 44 739 21 11 reception

www.wsl.ch

-----"ckan-dev" <ckan-dev-bounces at lists.okfn.org> wrote: -----
To: CKAN Development Discussions <ckan-dev at lists.okfn.org>
From: lucia.espona at wsl.ch
Sent by: "ckan-dev" 
Date: 23.10.2017 13:04
Subject: Re: [ckan-dev] Newest Solr version compatible with CKAN 2.7.2

Dear Tyler

Thanks a lot for your answer, we will then use latest Solr 6 (v 6.6.2). It works without making any changes to he schema file (just a couple of warnings).

I installed now a new Solr 6.6.2 with a ckan_default core using the CKAN config (multicore instance). I thought it would be easy to start using this new Solr instance by simply rebuilding the search index with paster but I get an error (see below). I have the impression it is due to the fact that the core is empty and no results are returned. The requested url "http://127.0.0.1:8983/solr/ckan_default/select/?q=%2A%3A%2A&rows=1&wt=json" gives no error, just a json with no results:
{"responseHeader":{"status":0,"QTime":1,"params":{"q":"*:*","rows":"1","wt":"json"}},"response":{"numFound":0,"start":0,"docs":[]}}
Did someone ever try to move to a new Solr server? Should I copy the data directory from old Solr to new server?

Many thanks in advance for any hint.

Best,
Lucia

$ paster search-index rebuild -r --config=/etc/ckan/default/development.ini
2017-10-23 13:00:26,947 INFO  [requests.packages.urllib3.connectionpool] Starting new HTTP connection (1): 127.0.0.1
2017-10-23 13:00:27,036 INFO  [pysolr] Finished 'http://127.0.0.1:8983/solr/ckan_default/select/?q=%2A%3A%2A&rows=1&wt=json' (get) with body '' in 0.095 seconds, with status 200
Traceback (most recent call last):
  File "/Users/lucia/Development/ckan/default/bin/paster", line 11, in <module>
    load_entry_point('PasteScript', 'console_scripts', 'paster')()
  File "/Users/lucia/Development/ckan/default/lib/python2.7/site-packages/paste/script/command.py", line 102, in run
    invoke(command, command_name, options, args[1:])
  File "/Users/lucia/Development/ckan/default/lib/python2.7/site-packages/paste/script/command.py", line 141, in invoke
    exit_code = runner.run(args)
  File "/Users/lucia/Development/ckan/default/lib/python2.7/site-packages/paste/script/command.py", line 236, in run
    result = self.command()
  File "/Users/lucia/Development/ckan/default/src/ckan/ckan/lib/cli.py", line 552, in command
    self._load_config()
  File "/Users/lucia/Development/ckan/default/src/ckan/ckan/lib/cli.py", line 306, in _load_config
    self.site_user = load_config(self.options.config, load_site_user)
  File "/Users/lucia/Development/ckan/default/src/ckan/ckan/lib/cli.py", line 221, in load_config
    load_environment(conf.global_conf, conf.local_conf)
  File "/Users/lucia/Development/ckan/default/src/ckan/ckan/config/environment.py", line 99, in load_environment
    p.load_all()
  File "/Users/lucia/Development/ckan/default/src/ckan/ckan/plugins/core.py", line 129, in load_all
    unload_all()
  File "/Users/lucia/Development/ckan/default/src/ckan/ckan/plugins/core.py", line 182, in unload_all
    unload(*reversed(_PLUGINS))
  File "/Users/lucia/Development/ckan/default/src/ckan/ckan/plugins/core.py", line 210, in unload
    plugins_update()
  File "/Users/lucia/Development/ckan/default/src/ckan/ckan/plugins/core.py", line 121, in plugins_update
    environment.update_config()
  File "/Users/lucia/Development/ckan/default/src/ckan/ckan/config/environment.py", line 207, in update_config
    search.check_solr_schema_version()
  File "/Users/lucia/Development/ckan/default/src/ckan/ckan/lib/search/__init__.py", line 291, in check_solr_schema_version
    res = urllib2.urlopen(req)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 154, in urlopen
    return opener.open(url, data, timeout)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 437, in open
    response = meth(req, response)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 550, in http_response
    'http', request, response, code, msg, hdrs)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 475, in error
    return self._call_chain(*args)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 409, in _call_chain
    result = func(*args)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/urllib2.py", line 558, in http_error_default
    raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
urllib2.HTTPError: HTTP Error 404: Not Found
_________________________________________________________
Dr. Lucia Espona Pernas

Swiss Federal Institute for Forest, Snow and Landscape Research WSL
Hauptgebäaude Labortrakt (HL C21)
Zürcherstrasse 111
8903 Birmensdorf
Switzerland

+41 44 739 28 71 phone direct
+41 44 739 21 11 reception

www.wsl.ch

-----"ckan-dev" <ckan-dev-bounces at lists.okfn.org> wrote: -----
To: CKAN Development Discussions <ckan-dev at lists.okfn.org>
From: Tyler Kennedy 
Sent by: "ckan-dev" 
Date: 22.10.2017 07:26
Subject: Re: [ckan-dev] Newest Solr version compatible with CKAN 2.7.2

Hey Lucia,

All recent versions work with minor changes, but there are so many Solr releases that break small things it's impossible to provide schemas for them all. Solr 6 is currently more widely used with CKAN and you're more likely to get support. I'd recommend sticking with it for now if you don't want to make changes.

Thank you,
Tyler Kennedy

On Sun, Oct 22, 2017 at 1:16 AM,  <lucia.espona at wsl.ch> wrote:
 Dear all

We are running Solr multicore in an independent server, I would like to know which is the latst Solr version compatible with 2.7.2.
I successfully managed to get it work with Solr 6.5.0 so I tried now Solr 7.1.0 but changes would be required in the schema.xml provided by CKAN.

I couldn't find it in the documentation, which is the latest Solr version compatible with CKAN 2.7.2?

Thanks a lot and best regards,
Lucia

_________________________________________________________
Dr. Lucia Espona Pernas

Swiss Federal Institute for Forest, Snow and Landscape Research WSL
Hauptgebäaude Labortrakt (HL C21)
Zürcherstrasse 111
8903 Birmensdorf
Switzerland

+41 44 739 28 71 phone direct
+41 44 739 21 11 reception

www.wsl.ch
_______________________________________________
 ckan-dev mailing list
 ckan-dev at lists.okfn.org
 https://lists.okfn.org/mailman/listinfo/ckan-dev
 Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev

_______________________________________________
ckan-dev mailing list
ckan-dev at lists.okfn.org
https://lists.okfn.org/mailman/listinfo/ckan-dev
Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev

_______________________________________________
ckan-dev mailing list
ckan-dev at lists.okfn.org
https://lists.okfn.org/mailman/listinfo/ckan-dev
Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20171023/ab5b8d31/attachment-0003.html>