[ckan-dev] /dump/ only downloads 100K records.

[Nigel Babu]

I'm not sure why it downloads all the records there, but I do know that the
limit is set in the datastore controller
https://github.com/okfn/ckan/blob/release-v2.1.1/ckanext/datastore/controller.py#L23

Nigel Babu

Developer  |  @nigelbabu <https://twitter.com/nigelbabu>

The Open Knowledge Foundation <http://okfn.org/>

Empowering through Open Knowledge

http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on
Facebook<https://www.facebook.com/OKFNetwork> |
Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>

 CKAN | http://ckan.org/ | @CKANproject
<http://twitter.com/CKANproject> |the world’s leading open-source data
portal platform


On 7 January 2014 13:08, Henrik Aagaard Sørensen <BU1G at tmf.kk.dk> wrote:

> By ”fails” I mean that it only downloads 100K, sorry for the choice of
> word.
>
>
>
> I do have a dataset with 110353 records, which downloads all the of the
> records. That was why I did not think, it was limited to 100K precisely.
>
>
>
>
>
> *Fra:* Nigel Babu [mailto:nigel.babu at okfn.org]
> *Sendt:* 7. januar 2014 07:17
> *Til:* CKAN Development Discussions
> *Cc:* Henrik Aagaard Sørensen
> *Emne:* Re: [ckan-dev] /dump/ only downloads 100K records.
>
>
>
> Hi,
>
> The dump command is limited to 100,000 rows. What do you mean by "fails"?
>
>
> Nigel Babu
>
> Developer  |  @nigelbabu <https://twitter.com/nigelbabu>
>
> The Open Knowledge Foundation <http://okfn.org/>
>
> *Empowering through Open Knowledge*
>
> http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on Facebook<https://www.facebook.com/OKFNetwork> |
> Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>
>
>
>
> CKAN | http://ckan.org/ | @CKANproject <http://twitter.com/CKANproject> |the world’s leading open-source data portal platform
>
>
>
> On 6 January 2014 17:08, Henrik Aagaard Sørensen <BU1G at tmf.kk.dk> wrote:
>
> It fails with a dataset contain mio. of rows.
>
> A dataset with 110K records works fine.
>
> Could it be the size of the created file via /dump/ which fails?
>
>
>
> It’s this dataset:
>
>
> http://data.kk.dk/dataset/parkomat-transaktioner/resource/660e19fa-8838-4a5c-9495-0d7f94fab51e
>
>
>
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20140107/a9acb272/attachment-0003.html>