[ckan-dev] Is CKAN suitable for textual search in a 10Gb dataset?

[Andrés Martano]

Thanks for the answers.


Em 07-04-2014 17:47, Dominik Moritz escreveu:
> Since the datastore uses Postgres, you might be able to use its full text search. See http://www.postgresql.org/docs/9.3/static/textsearch.html
Do the datastore always uses Postgres for the queries?
I thought it would be better to use Solr, since it's already installed...
Is there a way to use Solr to do the queries?

> I'm not sure how good this will work for queries across tables, though. 
I plan on just pushing a huge CSV to the datastore.
How do I know if the datastore will create cross tables?


Em 07-04-2014 17:59, Vitor Baptista escreveu:
> Yes. There's an issue/pull request to improve our previews
> at https://github.com/ckan/ckan/pull/1251, allowing a single resource
> to have multiple different previews (called now resource views). It's
> still work in progress, but we've already created a few extensions
> using it, like github.com/ckan/ckanext-basiccharts
> <http://github.com/ckan/ckanext-basiccharts> and
> github.com/ckan/ckanext-mapviews
> <http://github.com/ckan/ckanext-mapviews>.
Great! I will study these extensions and see if I can mimic them.

> Yes, it's possible using the IRoutes plugin interface. Check the docs
> at http://docs.ckan.org/en/latest/extensions/plugin-interfaces.html#ckan.plugins.interfaces.IRoutes and
> an usage example by the DataStore
> at https://github.com/ckan/ckan/blob/master/ckanext/datastore/plugin.py#L226-L230
>
Nice. Is there a reference where I can read more about "Routes map object"?
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20140408/46a8f334/attachment-0003.html>