[ckan-dev] Is CKAN suitable for textual search in a 10Gb dataset?

Wed Apr 9 14:08:39 UTC 2014

At IRC, rossjones, found me this line that enforced the limit:
https://github.com/okfn/messytables/blob/3489e43bbae0b8eb35d7e4203a4b3aaf66bd88cb/messytables/commas.py#L159

Editing it, I got no error in the push interface. But it only pushed
5851 lines of about 160K. Any ideas why?
I replaced all *" *in the text files with *"" *before inserting them in
the CSV.

I tried to use the search, in the web "Grid" preview, but there are many
words that I can see, in the preview, but it can't find.
Same with the datastore_search API.
I had the same problem with a 3Mb CSV.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20140409/97ac0077/attachment-0003.html>