[ckan-dev] Problems with ckanext-harvest

Tue Jan 17 12:58:42 UTC 2012

Hi Adrià,

after updating CKAN to 1.5.1, the harvester works like a charm! Thanks for your help!

Best,
Philipp

-----Ursprüngliche Nachricht-----
Von: Adrià Mercader [mailto:amercadero at gmail.com] 
Gesendet: Freitag, 13. Januar 2012 16:43
An: Lämmel, Philipp
Cc: ckan-dev
Betreff: Re: [ckan-dev] Problems with ckanext-harvest

Hi Philipp,

I think I've found the problem. Reviewing your last emails I noticed that you are using CKAN version 1.5. The ability to define default groups for the harvesters requires CKAN version 1.5.1, so you will need to upgrade. Sorry about, that should have been stated on the docs.

To upgrade, if you installed CKAN 1.5 from packages, you can follow this instructions:

http://docs.ckan.org/en/latest/install-from-package.html#upgrading

If you installed from sources, you need to switch to the "release-v1.5.1c" branch:

git checkout -b release-v1.5.1c remotes/origin/release-v1.5.1c

This should fix the problem, let me know how it goes.

Adrià

2012/1/13 Philipp Lämmel <philipp.laemmel at fokus.fraunhofer.de>:
> Hi Adrià,
>
> attached to this mail, you can find the JSON I received with the 
> following
> call:
>>
>> http://<ckan-instance>/api/rest/package/dbpedia_37
>
>
> Hope this helps.
>
> Philipp
>
>
> On 01/13/2012 01:58 PM, Adrià Mercader wrote:
>>
>> Hi Philipp,
>> Your permissions look fine.
>>
>> Is the CKAN instance you are harvesting from publicly available or at 
>> least can you PM the url?
>> It's most probably not, so could you send me the output of a similar 
>> call to this one, for a package that is supposed to go into the "edu"
>> group:
>>
>> http://<ckan-instance>/api/rest/package/<package-name>
>>
>> It should be a JSON representation of the package
>>
>>
>> Thanks,
>>
>> Adrià
>>
>>
>>
>> 2012/1/13 "Lämmel, Philipp"<philipp.laemmel at fokus.fraunhofer.de>:
>>>
>>> Hi Adrià,
>>>
>>> sorry for my imprecise phrasing. None of the packages was imported 
>>> and I don't see them on the group page, too.
>>>
>>> I checked my Authorization on the group page: my user 'harvest' is 
>>> admin of this group. This is sufficient, isn't it? 'logged_in' and 
>>> 'visitor' are reader on this group. Could you give me a dump of the 
>>> rights of your harvesting user? I could check, if there are any differences.
>>>
>>> Attached to this mail, one can find my rights.
>>>
>>> Thanks and best regards,
>>> Philipp
>>>
>>> -----Ursprüngliche Nachricht-----
>>> Von: Adrià Mercader [mailto:amercadero at gmail.com]
>>> Gesendet: Donnerstag, 12. Januar 2012 15:20
>>> An: Lämmel, Philipp
>>> Cc: ckan-dev
>>> Betreff: Re: [ckan-dev] Problems with ckanext-harvest
>>>
>>> Hi Philipp,
>>>
>>> Sorry to hear you still have troubles.
>>>
>>> 2012/1/11 "Lämmel, Philipp"<philipp.laemmel at fokus.fraunhofer.de>:
>>>>
>>>> Unfortunately, all packages won't be added to my default group. I 
>>>> tried API v1 (with name) and v2 (with ID). I don't see any errors, 
>>>> but afterwards all packages won't be in my group.
>>>
>>> Do you mean that some of the packages are missing in the group or 
>>> none of them was imported?
>>> Are they showing up on the group page (http://localhost:5000/group/edu)?
>>>
>>>> This is the JSON I used in my configuration field:
>>>> {
>>>>  "api_version":"1",
>>>>  "default_tags":["new-tag-1","new-tag-2"],
>>>>  "default_groups":["edu"],
>>>>
>>>> "default_extras":{"new_extra":"Test","harvest_url":"{harvest_source
>>>> _ur
>>>> l}/package/{dataset_id}"}
>>>> }
>>>
>>> The configuration looks good, and it definitely works for me (ie the 
>>> datasets are added to the edu group) Maybe is there some problem 
>>> with the group permissions? Can you check the "Authorization" tab on 
>>> the edu group page which roles are set up?
>>>
>>> Cheers,
>>> Adrià
>
>