[ckan-dev] Is CKAN suitable for textual search in a 10Gb dataset?

Wed Apr 9 00:01:28 UTC 2014

Hey Andrés,

You can read more about it at Pylon's documentation, or Route's
https://routes.readthedocs.org/en/latest/.

Cheers,

2014-04-08 10:25 GMT-03:00 Andrés Martano <andres at inventati.org>:

>  Thanks for the answers.
>
>
> Em 07-04-2014 17:47, Dominik Moritz escreveu:
>
> Since the datastore uses Postgres, you might be able to use its full text search. See http://www.postgresql.org/docs/9.3/static/textsearch.html
>
>  Do the datastore always uses Postgres for the queries?
> I thought it would be better to use Solr, since it's already installed...
> Is there a way to use Solr to do the queries?
>
>
>  I'm not sure how good this will work for queries across tables, though.
>
>  I plan on just pushing a huge CSV to the datastore.
> How do I know if the datastore will create cross tables?
>
>
> Em 07-04-2014 17:59, Vitor Baptista escreveu:
>
> Yes. There's an issue/pull request to improve our previews at
> https://github.com/ckan/ckan/pull/1251, allowing a single resource to
> have multiple different previews (called now resource views). It's still
> work in progress, but we've already created a few extensions using it, like
> github.com/ckan/ckanext-basiccharts and github.com/ckan/ckanext-mapviews.
>
> Great! I will study these extensions and see if I can mimic them.
>
>
>   Yes, it's possible using the IRoutes plugin interface. Check the docs
> at
> http://docs.ckan.org/en/latest/extensions/plugin-interfaces.html#ckan.plugins.interfaces.IRoutes and
> an usage example by the DataStore at
> https://github.com/ckan/ckan/blob/master/ckanext/datastore/plugin.py#L226-L230
>
> Nice. Is there a reference where I can read more about "Routes map object"?
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>
>

-- 

Vítor Baptista

Developer  |  http://vitorbaptista.com |
LinkedIn<http://www.linkedin.com/in/vitorbaptista>|
@vitorbaptista <http://twitter.com/vitorbaptista>

The Open Knowledge Foundation <http://okfn.org>

*Empowering through Open Knowledge*

http://okfn.org/  |  @okfn <http://twitter.com/okfn>  |  OKF on
Facebook<https://www.facebook.com/OKFNetwork> |
Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter/>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20140408/9330bc1b/attachment-0003.html>