[ckan-discuss] Is there a row limit of 1, 000 for search requests?

[Adrià Mercader]

Hi Konrad,

Yes, there is hard limit of 1000 datasets to avoid overloading. Code is here:

https://github.com/okfn/ckan/blob/master/ckan/lib/search/query.py#L314

It will be easy to add a config option for instances that want to
override this for some reason if you think is useful, but I think a
1000 limit is a fair one and you can always use pagination (with rows
and limit) to get more datasets.

Adrià


On 17 September 2013 00:52, Konrad Reiche <konrad.reiche at gmail.com> wrote:
> Hi there,
>
>
> I don't know if this is new or if I just haven't noticed it before, but
> is there a limit of returned datasets when using the Search API?
>
> I am using /3/action/package_search with pagination (rows + start).
>
> I was able to pass a rows value of 100000. The number in
> response['result']['count'] is correct, but when I count the number of
> datasets in response['result']['results'] then there are never more
> than 1,000.
>
> I have observed this on the publicdata.eu and catalog.data.gov CKAN
> instances. I would assume this is for security reasons so the API
> endpoints are not overloaded?
>
> Best,
> Konrad
>
> _______________________________________________
> ckan-discuss mailing list
> ckan-discuss at lists.okfn.org
> http://lists.okfn.org/mailman/listinfo/ckan-discuss
> Unsubscribe: http://lists.okfn.org/mailman/options/ckan-discuss