[ckan-dev] ckan text search problem

Mon Dec 23 17:38:52 UTC 2013

works like a charm.

Thank you and merry christmas!

--p.

On Mon, Dec 23, 2013 at 4:52 PM, David Raznick <david.raznick at okfn.org>wrote:

> Hello
>
> That must be the problem, i.e not having the correct schema installed.
>
> I can not find any docs either about this.  The files are here.
>
> https://github.com/okfn/ckan/tree/master/ckanext/multilingual/solr
>
> This schema.xml that should be used instead of the one in the docs and
> the other files in this directory should be placed in the same
> directory as it.
>
> You will need to restart solr and then reindex for this to work.
>
> David
>
>
>
>
>
>
> On 23 December 2013 13:44, Philippe Duchesne <pduchesne at gmail.com> wrote:
> > Hello David,
> >
> > you nailed it, it's the multilingual extension.
> > The search works if I deactivate it.
> >
> > What do you mean "the plugin has to be on when I reindex" ? I did reindex
> > using the same config file that declares the plugin, to no avail.
> >
> > Besides, i read somewhere about the need to install a specific schema for
> > multilingual solr, but could not find a clear documentation about that.
> > Can that be the problem, and if so, can you point me to such
> documentation?
> >
> > thank you for your time,
> >
> > --p.
> >
> >
> > On Mon, Dec 23, 2013 at 1:01 PM, David Raznick <david.raznick at okfn.org>
> > wrote:
> >>
> >> Hello
> >>
> >> It appears you are using the multilingual plugin.  The multilingual
> >> plugin has to be on when you reindex too, if not it will not work.
> >>
> >> Apart from that, it is hard to tell if its due to not being indexed
> >> correctly or if the querying is off.  My guess is that this if the
> >> default language of you instance is not English there could be
> >> troubles, but that is just a a guess.  Also there are sometimes issues
> >> with certain stopwords causing the search to go awry.
> >>
> >> Does the search always return no results or it is only certain words
> >> that it seems to fail at?
> >>
> >> David
> >>
> >> On 23 December 2013 10:06, Philippe Duchesne <pduchesne at gmail.com>
> wrote:
> >> > Hello David,
> >> >
> >> > when i search for an empty string, i get all datasets, and the solr
> log
> >> > looks like:
> >> >
> >> > Dec 23, 2013 10:50:09 AM org.apache.solr.core.SolrCore execute
> >> > INFO: [] webapp=/solr path=/select
> >> >
> >> >
> params={facet=true&sort=score+desc,+metadata_modified+desc&facet.mincount=1&facet.limit=50&qf=title_en^8+text_en^4+title_fr^2+text_fr+title_nl^2+text_nl+title_pt^2+text_pt+title_de^2+text_de+title_it^2+text_it+title_pl^2+text_pl+title_ro^2+text_ro+title_es^2+text_es&wt=json&rows=21&fl=id+data_dict&start=0&q=*:*&facet.field=organization&facet.field=groups&facet.field=tags&facet.field=res_format&facet.field=license_id&fq=%2Bdataset_type:dataset+capacity:"public"+%2Bsite_id:"default"+%2Bstate:active}
> >> > hits=6 status=0 QTime=1
> >> >
> >> >
> >> >
> >> > while if i search for e.g. 'park' (which is present in both titles and
> >> > tags
> >> > of multiple datasets) :
> >> >
> >> > Dec 23, 2013 10:52:33 AM org.apache.solr.core.SolrCore execute
> >> > INFO: [] webapp=/solr path=/select
> >> >
> >> >
> params={mm=2<-1+5<80%25&facet=true&sort=score+desc,+metadata_modified+desc&facet.mincount=1&tie=0.1&facet.limit=50&qf=title_en^8+text_en^4+title_fr^2+text_fr+title_nl^2+text_nl+title_pt^2+text_pt+title_de^2+text_de+title_it^2+text_it+title_pl^2+text_pl+title_ro^2+text_ro+title_es^2+text_es&wt=json&defType=dismax&rows=21&fl=id+data_dict&start=0&q=park&facet.field=organization&facet.field=groups&facet.field=tags&facet.field=res_format&facet.field=license_id&fq=%2Bdataset_type:dataset+capacity:"public"+%2Bsite_id:"default"+%2Bstate:active}
> >> > hits=0 status=0 QTime=2
> >> >
> >> >
> >> > i get no hits.
> >> >
> >> > Any hint? Can you tell whether the problem lies in solr or ckan?
> >> >
> >> > thanks a lot,
> >> >
> >> > --p.
> >> >
> >> >
> >> > On Mon, Dec 23, 2013 at 10:13 AM, David Raznick <
> david.raznick at okfn.org>
> >> > wrote:
> >> >>
> >> >> Hello
> >> >>
> >> >> Normally, in a situation like this, I would look in the solr logs and
> >> >> see what queries are actually being run.  Solr basically is just an
> >> >> http server so you can see the get requests making and test them
> >> >> against solr directly.
> >> >>
> >> >> If you leave the search box blank and search are there any results?
> >> >>
> >> >> David
> >> >>
> >> >> On 21 December 2013 23:23, Philippe Duchesne <pduchesne at gmail.com>
> >> >> wrote:
> >> >> >
> >> >> > and I forgot to mention: i did rebuild the index, and said datasets
> >> >> > are
> >> >> > present in the index (when checking using "paster search-index show
> >> >> > ..."
> >> >> > )
> >> >> >
> >> >> >
> >> >> > On Sat, Dec 21, 2013 at 10:12 PM, Philippe Duchesne
> >> >> > <pduchesne at gmail.com>
> >> >> > wrote:
> >> >> >>
> >> >> >>
> >> >> >> Hello all,
> >> >> >>
> >> >> >> i'm having a problem with a ckan instance where the text search
> >> >> >> returns
> >> >> >> nothing, while it should (there are datasets with matching titles,
> >> >> >> they
> >> >> >> are
> >> >> >> public, and i can see them in the datasets list).
> >> >> >>
> >> >> >> Solr is configured, and i can see the failing queries in the solr
> >> >> >> logs,
> >> >> >> returning "hits=0".
> >> >> >>
> >> >> >> Can you give me hints at where i should look, how i should debug
> to
> >> >> >> understand what's going on?
> >> >> >>
> >> >> >> thank you,
> >> >> >>
> >> >> >> --p.
> >> >> >
> >> >> >
> >> >> >
> >> >> > _______________________________________________
> >> >> > ckan-dev mailing list
> >> >> > ckan-dev at lists.okfn.org
> >> >> > https://lists.okfn.org/mailman/listinfo/ckan-dev
> >> >> > Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> >> >> >
> >> >> _______________________________________________
> >> >> ckan-dev mailing list
> >> >> ckan-dev at lists.okfn.org
> >> >> https://lists.okfn.org/mailman/listinfo/ckan-dev
> >> >> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> >> >
> >> >
> >> >
> >> > _______________________________________________
> >> > ckan-dev mailing list
> >> > ckan-dev at lists.okfn.org
> >> > https://lists.okfn.org/mailman/listinfo/ckan-dev
> >> > Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> >> >
> >> _______________________________________________
> >> ckan-dev mailing list
> >> ckan-dev at lists.okfn.org
> >> https://lists.okfn.org/mailman/listinfo/ckan-dev
> >> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> >
> >
> >
> > _______________________________________________
> > ckan-dev mailing list
> > ckan-dev at lists.okfn.org
> > https://lists.okfn.org/mailman/listinfo/ckan-dev
> > Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> >
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20131223/e673153d/attachment-0003.html>