[ckan-changes] [ckan/ckan] 83b963: [#2856] Resubmit to DataPusher if file is reupload...

Wed Mar 23 15:55:29 UTC 2016

  Branch: refs/heads/2856-fix-datapusher-multiple-calls
  Home:   https://github.com/ckan/ckan
  Commit: 83b963cdb16ca541601201409d37b5503dd27116
      https://github.com/ckan/ckan/commit/83b963cdb16ca541601201409d37b5503dd27116
  Author: amercader <amercadero at gmail.com>
  Date:   2016-03-23 (Wed, 23 Mar 2016)

  Changed paths:
    M ckanext/datapusher/logic/action.py

  Log Message:
  -----------
  [#2856] Resubmit to DataPusher if file is reuploaded or URL changes

Previous commits prevent new DataPusher jobs from being created if there
is an ongoing one. There are cases though where we actually want to
resubmit, basically if the data source has changed since the first
DataPusher job started. This can be because a new file was uploaded or
because the URL was changed.

* For file uploads we check the `last_modified` resource property, which
  is set after an upload against the task creation date.
* For URLs we check if the original URL is different from the current
  one.

 We store both the task creation date and the original URL in the
 metadata sent to (and returned from) the DataPusher.