[ckan-dev] configure harvester for non-cKAN sources

Wed Jan 9 16:12:21 UTC 2013

Hello,

we want to setup cKAN for harvesting as well non-cKAN sources.

For this I first deployed and installed cKAN package on ubuntu10.4 - 
this worked all straight forward.
Then I followed the instruction in the documentation "Import (Harvest) 
Data from Other Sites", or at

https://github.com/okfn/ckanext-harvest#the-ckan-harvester

Installation of ckanext-harvest worked as well, but I struggle with the 
configuration, i.e. with

....
$ cd ckanext-harvest
$ paster --plugin=ckanext-harvest harvester initdb --config=mysite.ini

First thing is, that there was no mytest.ini, so I just copied it from 
test.ini
(Or should I first create and edit an own mysite.ini ?)

Finally some python code is executed, but terminates in

Traceback (most recent call last):
   File "/usr/bin/paster", line 18, in <module>
     command.run()
   File "/usr/lib/pymodules/python2.6/paste/script/command.py", line 84, 
in run
     invoke(command, command_name, options, args[1:])
   File "/usr/lib/pymodules/python2.6/paste/script/command.py", line 
123, in invoke
     exit_code = runner.run(args)
   File "/usr/lib/pymodules/python2.6/paste/script/command.py", line 
218, in run
     result = self.command()
   File 
"/home/data/MetaData/ckanext-harvest/ckanext/harvest/commands/harvester.py", 
line 83, in command
     self._load_config()
   File 
"/home/data/MetaData/ckanext-harvest/ckanext/harvest/commands/harvester.py", 
line 135, in _load_config
     super(Harvester, self)._load_config()
   File "/usr/lib/pymodules/python2.6/ckan/lib/cli.py", line 77, in 
_load_config
     conf = appconfig('config:' + self.filename)
   File "/usr/lib/pymodules/python2.6/paste/deploy/loadwsgi.py", line 
215, in appconfig
     global_conf=global_conf)
   File "/usr/lib/pymodules/python2.6/paste/deploy/loadwsgi.py", line 
248, in loadcontext
     global_conf=global_conf)
....................
global_conf=global_conf)
   File "/usr/lib/pymodules/python2.6/paste/deploy/loadwsgi.py", line 
275, in _loadconfig
     loader = ConfigLoader(path)
   File "/usr/lib/pymodules/python2.6/paste/deploy/loadwsgi.py", line 
332, in __init__
     self.parser = NicerConfigParser(self.filename)
   File "/usr/lib/pymodules/python2.6/paste/deploy/loadwsgi.py", line 
46, in __init__
     ConfigParser.__init__(self, *args, **kw)
RuntimeError: maximum recursion depth exceeded

Do you have any idea what is going wrong here ?

Best regards,
Heinrich