[ckan-dev] ckan text search problem

Mon Dec 23 15:52:10 UTC 2013

Hello

That must be the problem, i.e not having the correct schema installed.

I can not find any docs either about this.  The files are here.

https://github.com/okfn/ckan/tree/master/ckanext/multilingual/solr

This schema.xml that should be used instead of the one in the docs and
the other files in this directory should be placed in the same
directory as it.

You will need to restart solr and then reindex for this to work.

David

On 23 December 2013 13:44, Philippe Duchesne <pduchesne at gmail.com> wrote:
> Hello David,
>
> you nailed it, it's the multilingual extension.
> The search works if I deactivate it.
>
> What do you mean "the plugin has to be on when I reindex" ? I did reindex
> using the same config file that declares the plugin, to no avail.
>
> Besides, i read somewhere about the need to install a specific schema for
> multilingual solr, but could not find a clear documentation about that.
> Can that be the problem, and if so, can you point me to such documentation?
>
> thank you for your time,
>
> --p.
>
>
> On Mon, Dec 23, 2013 at 1:01 PM, David Raznick <david.raznick at okfn.org>
> wrote:
>>
>> Hello
>>
>> It appears you are using the multilingual plugin.  The multilingual
>> plugin has to be on when you reindex too, if not it will not work.
>>
>> Apart from that, it is hard to tell if its due to not being indexed
>> correctly or if the querying is off.  My guess is that this if the
>> default language of you instance is not English there could be
>> troubles, but that is just a a guess.  Also there are sometimes issues
>> with certain stopwords causing the search to go awry.
>>
>> Does the search always return no results or it is only certain words
>> that it seems to fail at?
>>
>> David
>>
>> On 23 December 2013 10:06, Philippe Duchesne <pduchesne at gmail.com> wrote:
>> > Hello David,
>> >
>> > when i search for an empty string, i get all datasets, and the solr log
>> > looks like:
>> >
>> > Dec 23, 2013 10:50:09 AM org.apache.solr.core.SolrCore execute
>> > INFO: [] webapp=/solr path=/select
>> >
>> > params={facet=true&sort=score+desc,+metadata_modified+desc&facet.mincount=1&facet.limit=50&qf=title_en^8+text_en^4+title_fr^2+text_fr+title_nl^2+text_nl+title_pt^2+text_pt+title_de^2+text_de+title_it^2+text_it+title_pl^2+text_pl+title_ro^2+text_ro+title_es^2+text_es&wt=json&rows=21&fl=id+data_dict&start=0&q=*:*&facet.field=organization&facet.field=groups&facet.field=tags&facet.field=res_format&facet.field=license_id&fq=%2Bdataset_type:dataset+capacity:"public"+%2Bsite_id:"default"+%2Bstate:active}
>> > hits=6 status=0 QTime=1
>> >
>> >
>> >
>> > while if i search for e.g. 'park' (which is present in both titles and
>> > tags
>> > of multiple datasets) :
>> >
>> > Dec 23, 2013 10:52:33 AM org.apache.solr.core.SolrCore execute
>> > INFO: [] webapp=/solr path=/select
>> >
>> > params={mm=2<-1+5<80%25&facet=true&sort=score+desc,+metadata_modified+desc&facet.mincount=1&tie=0.1&facet.limit=50&qf=title_en^8+text_en^4+title_fr^2+text_fr+title_nl^2+text_nl+title_pt^2+text_pt+title_de^2+text_de+title_it^2+text_it+title_pl^2+text_pl+title_ro^2+text_ro+title_es^2+text_es&wt=json&defType=dismax&rows=21&fl=id+data_dict&start=0&q=park&facet.field=organization&facet.field=groups&facet.field=tags&facet.field=res_format&facet.field=license_id&fq=%2Bdataset_type:dataset+capacity:"public"+%2Bsite_id:"default"+%2Bstate:active}
>> > hits=0 status=0 QTime=2
>> >
>> >
>> > i get no hits.
>> >
>> > Any hint? Can you tell whether the problem lies in solr or ckan?
>> >
>> > thanks a lot,
>> >
>> > --p.
>> >
>> >
>> > On Mon, Dec 23, 2013 at 10:13 AM, David Raznick <david.raznick at okfn.org>
>> > wrote:
>> >>
>> >> Hello
>> >>
>> >> Normally, in a situation like this, I would look in the solr logs and
>> >> see what queries are actually being run.  Solr basically is just an
>> >> http server so you can see the get requests making and test them
>> >> against solr directly.
>> >>
>> >> If you leave the search box blank and search are there any results?
>> >>
>> >> David
>> >>
>> >> On 21 December 2013 23:23, Philippe Duchesne <pduchesne at gmail.com>
>> >> wrote:
>> >> >
>> >> > and I forgot to mention: i did rebuild the index, and said datasets
>> >> > are
>> >> > present in the index (when checking using "paster search-index show
>> >> > ..."
>> >> > )
>> >> >
>> >> >
>> >> > On Sat, Dec 21, 2013 at 10:12 PM, Philippe Duchesne
>> >> > <pduchesne at gmail.com>
>> >> > wrote:
>> >> >>
>> >> >>
>> >> >> Hello all,
>> >> >>
>> >> >> i'm having a problem with a ckan instance where the text search
>> >> >> returns
>> >> >> nothing, while it should (there are datasets with matching titles,
>> >> >> they
>> >> >> are
>> >> >> public, and i can see them in the datasets list).
>> >> >>
>> >> >> Solr is configured, and i can see the failing queries in the solr
>> >> >> logs,
>> >> >> returning "hits=0".
>> >> >>
>> >> >> Can you give me hints at where i should look, how i should debug to
>> >> >> understand what's going on?
>> >> >>
>> >> >> thank you,
>> >> >>
>> >> >> --p.
>> >> >
>> >> >
>> >> >
>> >> > _______________________________________________
>> >> > ckan-dev mailing list
>> >> > ckan-dev at lists.okfn.org
>> >> > https://lists.okfn.org/mailman/listinfo/ckan-dev
>> >> > Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>> >> >
>> >> _______________________________________________
>> >> ckan-dev mailing list
>> >> ckan-dev at lists.okfn.org
>> >> https://lists.okfn.org/mailman/listinfo/ckan-dev
>> >> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>> >
>> >
>> >
>> > _______________________________________________
>> > ckan-dev mailing list
>> > ckan-dev at lists.okfn.org
>> > https://lists.okfn.org/mailman/listinfo/ckan-dev
>> > Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>> >
>> _______________________________________________
>> ckan-dev mailing list
>> ckan-dev at lists.okfn.org
>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>
>
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>