[ckan-changes] [okfn/ckan] 2bb7fa: [release-v1.6.1] Strip leading spaces from dataset...

GitHub noreply at github.com
Wed Mar 21 10:40:32 UTC 2012


  Branch: refs/heads/release-v1.6.1
  Home:   https://github.com/okfn/ckan
  Commit: 2bb7faab597adf23ffd5b77575ebbe861e8d81f5
      https://github.com/okfn/ckan/commit/2bb7faab597adf23ffd5b77575ebbe861e8d81f5
  Author: Ian Murray <ian.murray at okfn.org>
  Date:   2012-03-21 (Wed, 21 Mar 2012)

  Changed paths:
    M ckan/lib/search/index.py

  Log Message:
  -----------
  [release-v1.6.1] Strip leading spaces from dataset title upon indexing


  Commit: 3fddcd5f8d7083b39ba73ee0ff0d8e41ef4fdb20
      https://github.com/okfn/ckan/commit/3fddcd5f8d7083b39ba73ee0ff0d8e41ef4fdb20
  Author: Ian Murray <ian.murray at okfn.org>
  Date:   2012-03-21 (Wed, 21 Mar 2012)

  Changed paths:
    M ckan/logic/action/get.py
  M doc/apiv3.rst

  Log Message:
  -----------
  [release-v1.6.1] Added pagination to the 'current_package_list_with_resources' action.

Using this action to retrieve the whole list of datasets in even a moderately-sized catalogue
is extremely slow.  (In the order of 5-6 datasets/sec on my development machine).  Aside from
this being slow, this means that since one of our supported deployments is proxying through
nginx, nginx will timeout the request before it is completed.

So as a worksround for now, the datasets can be paginated through multiple smaller requests.
Meaning at least the connection won't timeout; even if the total time retrieving the datasets
is approximately the same.


Compare: https://github.com/okfn/ckan/compare/7b7ed10...3fddcd5


More information about the ckan-changes mailing list