[ckan-dev] ckanext-harvest: "There are no new harvesting jobs"

Mon Jul 20 15:28:01 UTC 2015

Hi Knud,

This is normal behavior (although one could make an argument that in the
case of normal behavior software shouldn't throw an error).

Jobs will run on a harvesting schedule, which you define when you create
the harvester in the web UI. For example, you create a daily harvester and
do 'harvester run'. The job runs, and harvested will compute when the next
job is due to be ran (24 hours from now). If you do `harvester run` before
then, you will get the expected error above.

- Denis

On Mon, Jul 20, 2015 at 11:23 AM, Knud Hinnerk Möller <knud at datalysator.com>
wrote:

> Hi,
>
> I have a problem setting up ckanext-harvest for production. I’m following
> the steps explained in
> https://github.com/ckan/ckanext-harvest/blob/master/README.rst#setting-up-the-harvesters-on-a-production-server,
> which works great at first. However, after the first time the harvester is
> run, I get an error message saying "Exception: There are no new harvesting
> jobs” each time the harvester is run again via cron. It seems I have to
> first create a new harvesting job via command line or Web UI. Is this
> intended behaviour? Or am I missing something? Could someone point me in
> the right direction?
>
> ---------
> 2015-07-20 17:00:03,530 DEBUG [ckan.config.environment] Loading the
> synchronous search plugin
> 2015-07-20 17:00:06,606 DEBUG [ckanext.harvest.model] Harvest tables
> defined in memory
> 2015-07-20 17:00:06,620 DEBUG [ckanext.harvest.model] Harvest tables
> already exist
> 2015-07-20 17:00:06,636 DEBUG [ckanext.berlin.plugin] get_actions
> 2015-07-20 17:00:06,667 DEBUG [ckanext.harvest.plugin] Using auth profile
> at ckanext.harvest.logic.auth
> 2015-07-20 17:00:06,699 INFO  [ckanext.harvest.logic.action.update]
> Harvest job run: {}
> 2015-07-20 17:00:06,734 INFO  [ckanext.harvest.logic.action.update] No new
> harvest jobs.
>
> Traceback (most recent call last):
>   File ".../pyenv/bin/paster", line 9, in <module>
>     load_entry_point('PasteScript==1.7.5', 'console_scripts', 'paster')()
>   File
> ".../pyenv/local/lib/python2.7/site-packages/paste/script/command.py", line
> 104, in run
>     invoke(command, command_name, options, args[1:])
>   File
> ".../pyenv/local/lib/python2.7/site-packages/paste/script/command.py", line
> 143, in invoke
>     exit_code = runner.run(args)
>   File
> ".../pyenv/local/lib/python2.7/site-packages/paste/script/command.py", line
> 238, in run
>     result = self.command()
>   File
> ".../pyenv/src/ckanext-harvest/ckanext/harvest/commands/harvester.py", line
> 108, in command
>     self.run_harvester()
>   File
> ".../pyenv/src/ckanext-harvest/ckanext/harvest/commands/harvester.py", line
> 243, in run_harvester
>     jobs = get_action('harvest_jobs_run')(context,{})
>   File
> ".../pyenv/src/ckanext-harvest/ckanext/harvest/logic/action/update.py",
> line 145, in harvest_jobs_run
>     raise Exception('There are no new harvesting jobs')
> Exception: There are no new harvesting jobs
> ------------
>
> I should add that I’m running an old version of the ckanext-harvest
> (@0609262731) and an old version of CKAN (1.8.2). I don’t think that’s the
> reason, though.
>
> Cheers,
> Knud
>
> --
> Dr. Knud Hinnerk Möller
> Datalysator - Web Data Solutions and Training
> knud at datalysator.com
> +49 151 46 44 83 25
>
>
>
>
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20150720/02b3292a/attachment-0003.html>