[ckan-dev] Problem with ckanext-harvester and remote_orgs:create

Thu Jan 22 15:21:06 UTC 2015

Hi Stefan,

The local and the remote are 2.2 CKAN instances.

Rodrigo Valdez
0981-530572

2015-01-22 12:07 GMT-03:00 Stefan Oderbolz <stefan.oderbolz at liip.ch>:

> Hi Rodrigo,
>
> can you tell me which instance you're trying to harvest?
>
> - Stefan
>
> On Wed, Jan 21, 2015 at 8:31 PM, Rodrigo Valdez <rodri.valdez at gmail.com>
> wrote:
> > Hi Stefan,
> >
> > Thank you for helping us, I was trying again to create the orgs and I
> found
> > a new problem.
> >
> > INFO  [ckanext.harvest.harvesters.ckanharvester] Organization
> > a4016a94-ea46-4671-907e-b56b51d86efa is not available
> > ERROR [ckanext.harvest.harvesters.ckanharvester] Could not get remote org
> > a4016a94-ea46-4671-907e-b56b51d86efa
> >
> > Its seem to be an error here
> >
> > Regards
> > Rodrigo Valdez
> >
> >
> >
> > Rodrigo Valdez
> > 0981-530572
> >
> >
> > 2015-01-15 7:56 GMT-03:00 Stefan Oderbolz <stefan.oderbolz at liip.ch>:
> >
> >> Hi again,
> >>
> >> my PR just got merged, so if you update ckanext-harvest it should work
> :)
> >>
> >> - Stefan
> >>
> >> On Tue, Jan 13, 2015 at 2:53 PM, Stefan Oderbolz
> >> <stefan.oderbolz at liip.ch> wrote:
> >> > Hi Rodrigo(s),
> >> >
> >> > sorry for the confusion, didn't pay close enough attention to spot
> >> > your last names :)
> >> > In the meantime I had a look at the issue and created a pull request
> >> > with a possible solution:
> >> > https://github.com/ckan/ckanext-harvest/pull/121
> >> >
> >> > - Stefan
> >> >
> >> > On Mon, Jan 5, 2015 at 2:23 PM, Rodrigo Parra <rodpar07 at gmail.com>
> >> > wrote:
> >> >> Thanks Stefan,
> >> >>
> >> >> Actually, Rodrigo Valdez is a different developer, we are both
> >> >> paraguayans
> >> >> though :)
> >> >> He is working with the "client" CKAN instance, while I am maintaining
> >> >> the
> >> >> "source" CKAN instance.
> >> >> I didn't mean to spam the list, I just did not see his previous mail.
> >> >>
> >> >> I would really appreciate your help, if you give me a hint on where
> to
> >> >> look
> >> >> at, I might be able to lend a hand.
> >> >> Otherwise, we'll probably wait for your fix and cherry-pick it.
> >> >>
> >> >> Cheers,
> >> >> Rodrigo (Parra)
> >> >>
> >> >> 2015-01-05 8:46 GMT-03:00 Stefan Oderbolz <stefan.oderbolz at liip.ch>:
> >> >>
> >> >>> Ah, just found your "newer" email.
> >> >>>
> >> >>> It seems that this route used to return organizations as well, but
> >> >>> doesn't
> >> >>> return them anymore now. This seems to be a regression. If I find
> some
> >> >>> time
> >> >>> this week, I'll look into that.
> >> >>>
> >> >>> Regards Stefan
> >> >>>
> >> >>> On Mon, Dec 22, 2014 at 7:45 PM, Rodrigo Parra <rodpar07 at gmail.com>
> >> >>> wrote:
> >> >>>>
> >> >>>> Hello all,
> >> >>>>
> >> >>>> I'm trying to import datasets from a remote CKAN 2.2 instance, and
> I
> >> >>>> would like to import owner organizations as well. According to the
> >> >>>> harvester
> >> >>>> docs, it should be possible (and fairly easy) to do so using the
> >> >>>> remote_orgs:"create" configuration. However, after doing some
> tests,
> >> >>>> no
> >> >>>> organization is being imported.
> >> >>>>
> >> >>>> Looking at the code, the remote organizations are being fetched
> using
> >> >>>> the
> >> >>>> /group route of the v2 of the API. But testing the
> api/2/rest/group/
> >> >>>> with
> >> >>>> Postman, I can see it only returns a list of ids from groups, not
> >> >>>> organizations.
> >> >>>>
> >> >>>> I believe that's the reason why the harvester can't find the
> >> >>>> owner_org.
> >> >>>> Is this a known bug? Should api/2/rest/group/ return organization
> ids
> >> >>>> too
> >> >>>> or is what I'm getting expected behavior?
> >> >>>>
> >> >>>> In case the latter is true, should we change CKANHarvester to use
> v3
> >> >>>> of
> >> >>>> the api and /organization_show ? Or is there a better workaround?
> >> >>>>
> >> >>>> Thanks for your help in advance.
> >> >>>> Cheers,
> >> >>>>
> >> >>>> Rodrigo Parra
> >> >>>>
> >> >>>> _______________________________________________
> >> >>>> ckan-dev mailing list
> >> >>>> ckan-dev at lists.okfn.org
> >> >>>> https://lists.okfn.org/mailman/listinfo/ckan-dev
> >> >>>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> >> >>>>
> >> >>>
> >> >>>
> >> >>>
> >> >>> --
> >> >>> Liip AG  // Limmatstrasse 183 //  CH-8005 Zürich
> >> >>> Tel +41 43 500 39 80 // GnuPG 0x7B588C67 // www.liip.ch
> >> >>>
> >> >>> _______________________________________________
> >> >>> ckan-dev mailing list
> >> >>> ckan-dev at lists.okfn.org
> >> >>> https://lists.okfn.org/mailman/listinfo/ckan-dev
> >> >>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> >> >>>
> >> >>
> >> >>
> >> >> _______________________________________________
> >> >> ckan-dev mailing list
> >> >> ckan-dev at lists.okfn.org
> >> >> https://lists.okfn.org/mailman/listinfo/ckan-dev
> >> >> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> >> >>
> >> >
> >> >
> >> >
> >> > --
> >> > Liip AG  // Limmatstrasse 183 //  CH-8005 Zürich
> >> > Tel +41 43 500 39 80 // GnuPG 0x7B588C67 // www.liip.ch
> >>
> >>
> >>
> >> --
> >> Liip AG  // Limmatstrasse 183 //  CH-8005 Zürich
> >> Tel +41 43 500 39 80 // GnuPG 0x7B588C67 // www.liip.ch
> >> _______________________________________________
> >> ckan-dev mailing list
> >> ckan-dev at lists.okfn.org
> >> https://lists.okfn.org/mailman/listinfo/ckan-dev
> >> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> >
> >
> >
> > _______________________________________________
> > ckan-dev mailing list
> > ckan-dev at lists.okfn.org
> > https://lists.okfn.org/mailman/listinfo/ckan-dev
> > Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> >
>
>
>
> --
> Liip AG  // Limmatstrasse 183 //  CH-8005 Zürich
> Tel +41 43 500 39 80 // GnuPG 0x7B588C67 // www.liip.ch
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20150122/202d00f5/attachment-0003.html>