[ckan-dev] ckan text search problem

Mon Dec 23 13:44:49 UTC 2013

Hello David,

you nailed it, it's the multilingual extension.
The search works if I deactivate it.

What do you mean "the plugin has to be on when I reindex" ? I did reindex
using the same config file that declares the plugin, to no avail.

Besides, i read somewhere about the need to install a specific schema for
multilingual solr, but could not find a clear documentation about that.
Can that be the problem, and if so, can you point me to such documentation?

thank you for your time,

--p.

On Mon, Dec 23, 2013 at 1:01 PM, David Raznick <david.raznick at okfn.org>wrote:

> Hello
>
> It appears you are using the multilingual plugin.  The multilingual
> plugin has to be on when you reindex too, if not it will not work.
>
> Apart from that, it is hard to tell if its due to not being indexed
> correctly or if the querying is off.  My guess is that this if the
> default language of you instance is not English there could be
> troubles, but that is just a a guess.  Also there are sometimes issues
> with certain stopwords causing the search to go awry.
>
> Does the search always return no results or it is only certain words
> that it seems to fail at?
>
> David
>
> On 23 December 2013 10:06, Philippe Duchesne <pduchesne at gmail.com> wrote:
> > Hello David,
> >
> > when i search for an empty string, i get all datasets, and the solr log
> > looks like:
> >
> > Dec 23, 2013 10:50:09 AM org.apache.solr.core.SolrCore execute
> > INFO: [] webapp=/solr path=/select
> >
> params={facet=true&sort=score+desc,+metadata_modified+desc&facet.mincount=1&facet.limit=50&qf=title_en^8+text_en^4+title_fr^2+text_fr+title_nl^2+text_nl+title_pt^2+text_pt+title_de^2+text_de+title_it^2+text_it+title_pl^2+text_pl+title_ro^2+text_ro+title_es^2+text_es&wt=json&rows=21&fl=id+data_dict&start=0&q=*:*&facet.field=organization&facet.field=groups&facet.field=tags&facet.field=res_format&facet.field=license_id&fq=%2Bdataset_type:dataset+capacity:"public"+%2Bsite_id:"default"+%2Bstate:active}
> > hits=6 status=0 QTime=1
> >
> >
> >
> > while if i search for e.g. 'park' (which is present in both titles and
> tags
> > of multiple datasets) :
> >
> > Dec 23, 2013 10:52:33 AM org.apache.solr.core.SolrCore execute
> > INFO: [] webapp=/solr path=/select
> >
> params={mm=2<-1+5<80%25&facet=true&sort=score+desc,+metadata_modified+desc&facet.mincount=1&tie=0.1&facet.limit=50&qf=title_en^8+text_en^4+title_fr^2+text_fr+title_nl^2+text_nl+title_pt^2+text_pt+title_de^2+text_de+title_it^2+text_it+title_pl^2+text_pl+title_ro^2+text_ro+title_es^2+text_es&wt=json&defType=dismax&rows=21&fl=id+data_dict&start=0&q=park&facet.field=organization&facet.field=groups&facet.field=tags&facet.field=res_format&facet.field=license_id&fq=%2Bdataset_type:dataset+capacity:"public"+%2Bsite_id:"default"+%2Bstate:active}
> > hits=0 status=0 QTime=2
> >
> >
> > i get no hits.
> >
> > Any hint? Can you tell whether the problem lies in solr or ckan?
> >
> > thanks a lot,
> >
> > --p.
> >
> >
> > On Mon, Dec 23, 2013 at 10:13 AM, David Raznick <david.raznick at okfn.org>
> > wrote:
> >>
> >> Hello
> >>
> >> Normally, in a situation like this, I would look in the solr logs and
> >> see what queries are actually being run.  Solr basically is just an
> >> http server so you can see the get requests making and test them
> >> against solr directly.
> >>
> >> If you leave the search box blank and search are there any results?
> >>
> >> David
> >>
> >> On 21 December 2013 23:23, Philippe Duchesne <pduchesne at gmail.com>
> wrote:
> >> >
> >> > and I forgot to mention: i did rebuild the index, and said datasets
> are
> >> > present in the index (when checking using "paster search-index show
> ..."
> >> > )
> >> >
> >> >
> >> > On Sat, Dec 21, 2013 at 10:12 PM, Philippe Duchesne
> >> > <pduchesne at gmail.com>
> >> > wrote:
> >> >>
> >> >>
> >> >> Hello all,
> >> >>
> >> >> i'm having a problem with a ckan instance where the text search
> returns
> >> >> nothing, while it should (there are datasets with matching titles,
> they
> >> >> are
> >> >> public, and i can see them in the datasets list).
> >> >>
> >> >> Solr is configured, and i can see the failing queries in the solr
> logs,
> >> >> returning "hits=0".
> >> >>
> >> >> Can you give me hints at where i should look, how i should debug to
> >> >> understand what's going on?
> >> >>
> >> >> thank you,
> >> >>
> >> >> --p.
> >> >
> >> >
> >> >
> >> > _______________________________________________
> >> > ckan-dev mailing list
> >> > ckan-dev at lists.okfn.org
> >> > https://lists.okfn.org/mailman/listinfo/ckan-dev
> >> > Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> >> >
> >> _______________________________________________
> >> ckan-dev mailing list
> >> ckan-dev at lists.okfn.org
> >> https://lists.okfn.org/mailman/listinfo/ckan-dev
> >> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> >
> >
> >
> > _______________________________________________
> > ckan-dev mailing list
> > ckan-dev at lists.okfn.org
> > https://lists.okfn.org/mailman/listinfo/ckan-dev
> > Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> >
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20131223/9bb18f13/attachment-0003.html>