[ckan-dev] Help - harvest config of Groups
Mark Kirkpatrick
markkirkpatrick at gmail.com
Tue Dec 6 20:31:14 UTC 2016
Hi guys
Greetings from NZ – we are working on a new data.govt.nz CKAN site and in
beta at moment. We have are having a problem with Groups and wondering
if anyone can help us with information....been looking past few days and no
joy
At moment, we are wondering if there is a way to assign groups to data
sources on harvest – e.g.
http://dia-staging-ckan.catalyst.net.nz/harvest/linz-data-service-csw - we
want o harvest 1500+ datasets and assign them all to one group 'Land'
we thought we could pass directives via JSON in config metabox in admin but
not working – how do you guys assign Groups?...do you do it on a ‘per
dataset’ basis or can you assign to harvests, multiple datasets at one time
Any info appreciated!
thanks
On 6 December 2016 at 23:39, <ckan-dev-request at lists.okfn.org> wrote:
> Send ckan-dev mailing list submissions to
> ckan-dev at lists.okfn.org
>
> To subscribe or unsubscribe via the World Wide Web, visit
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> or, via email, send a message with subject or body 'help' to
> ckan-dev-request at lists.okfn.org
>
> You can reach the person managing the list at
> ckan-dev-owner at lists.okfn.org
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of ckan-dev digest..."
>
>
> Today's Topics:
>
> 1. unusual behavior when adding and viewing groups (Sasha Cuerda)
> 2. Re: unusual behavior when adding and viewing groups
> (Matthew Fullerton)
> 3. Changing a datasets organisation - still not working?
> (Timothy Giles)
> 4. translation for dataset_type (Armin Retterath)
> 5. ckanext-scheming vs tag vocabularies (Armin Retterath)
> 6. Re: Changing a datasets organisation - still not working?
> (Adri? Mercader)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Mon, 5 Dec 2016 21:52:24 -0500
> From: Sasha Cuerda <scuerda at ctdata.org>
> To: CKAN Development Discussions <ckan-dev at lists.okfn.org>
> Subject: [ckan-dev] unusual behavior when adding and viewing groups
> Message-ID:
> <CAKj_OWz9dYbck88SFSc=c_dni7+8UO6=48EnNt=_LsFVj6iqhQ at mail.
> gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> Hello folks,
>
> I'm running into very strange behavior with groups on CKAN 2.6. I'm in the
> process of upgrading a CKAN site from a much earlier version and I've had
> to develop some migration scripts to manually recreate datasets, resources,
> and groups.
>
> All of the datasets are correctly migrated and can be viewed. When I am in
> the `/dataset` view, I can see the list of datasets and, in the sidebar,
> the complete list of groups that I created (in this case 11) along with the
> count of datasets for each group. If I click on a group, filtering works
> correctly.
>
> However, if I go to the `/group` url, I get nothing -> "No groups found".
> Similarly, if I visit `/api/3/action/group_list` I get back an empty list.
> Calling `action.group_list()` using the python ckanapi package also returns
> an empty list.
>
> If I create a group using the web interface, it works fine. The api returns
> the correct results. All of the groups that are visible on the `/dataset`
> page are still visible, but the new, web-interface created group is not in
> this list.
>
> This seems unusual. Has anyone run in to anything like this before?
>
> Thanks in advance.
>
> Sasha
> --
> CT Data Collaborative, Director of Technology
> 805 Brook St Building 4
> Rocky Hill, CT 06067
> M: (860) 385-4860
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <http://lists.okfn.org/pipermail/ckan-dev/
> attachments/20161205/891c96d1/attachment-0001.html>
>
> ------------------------------
>
> Message: 2
> Date: Tue, 6 Dec 2016 08:25:28 +0100
> From: Matthew Fullerton <matt.fullerton at gmail.com>
> To: CKAN Development Discussions <ckan-dev at lists.okfn.org>
> Subject: Re: [ckan-dev] unusual behavior when adding and viewing
> groups
> Message-ID:
> <CAAm+7TYqiue3hQ-OMjMYy79BM-vSVUu4BbnzaRY18Rpa7ypKEw at mail.
> gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> Dear Sasha,
> Have you tried rebuilding the search index?
>
> paster --plugin=ckan search-index rebuild -c /path/to/your/ini.file
>
> Best,
> Matt
>
> On 6 Dec 2016 3:52 a.m., "Sasha Cuerda" <scuerda at ctdata.org> wrote:
>
> Hello folks,
>
> I'm running into very strange behavior with groups on CKAN 2.6. I'm in the
> process of upgrading a CKAN site from a much earlier version and I've had
> to develop some migration scripts to manually recreate datasets, resources,
> and groups.
>
> All of the datasets are correctly migrated and can be viewed. When I am in
> the `/dataset` view, I can see the list of datasets and, in the sidebar,
> the complete list of groups that I created (in this case 11) along with the
> count of datasets for each group. If I click on a group, filtering works
> correctly.
>
> However, if I go to the `/group` url, I get nothing -> "No groups found".
> Similarly, if I visit `/api/3/action/group_list` I get back an empty list.
> Calling `action.group_list()` using the python ckanapi package also returns
> an empty list.
>
> If I create a group using the web interface, it works fine. The api returns
> the correct results. All of the groups that are visible on the `/dataset`
> page are still visible, but the new, web-interface created group is not in
> this list.
>
> This seems unusual. Has anyone run in to anything like this before?
>
> Thanks in advance.
>
> Sasha
> --
> CT Data Collaborative, Director of Technology
> 805 Brook St Building 4
> Rocky Hill, CT 06067
> M: (860) 385-4860
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <http://lists.okfn.org/pipermail/ckan-dev/
> attachments/20161206/59ec036a/attachment-0001.html>
>
> ------------------------------
>
> Message: 3
> Date: Tue, 6 Dec 2016 07:38:04 +0000
> From: Timothy Giles <timothy.giles at slu.se>
> To: "'ckan-dev at lists.okfn.org'" <ckan-dev at lists.okfn.org>
> Subject: [ckan-dev] Changing a datasets organisation - still not
> working?
> Message-ID: <428dbd29d1264baaa24f5c95000499b4 at Exch2-2.slu.se>
> Content-Type: text/plain; charset="us-ascii"
>
> Hi all,
>
> I realised last night that we have, on our test server, some datasets
> without an organisation. So, I first thought perhaps I just patch the
> package with the correct owner_org value (an organisation id). After
> wondering why that was not working, I found the :
>
> ckan.logic.action.update.package_owner_org_update(context, data_dict)
> Update the owning organization of a dataset
>
> Parameters:
> id (string) - the name or id of the dataset to update
> organization_id - the name or id of the owning organization
>
> function, which seemed to fit the bill perfectly. With my sysadmin account
> in hand, I tried using it and came across an error message mentioning that
> the current session did not have a revision set.
>
> https://github.com/ckan/ckan/issues/2661
>
> I am using CKAN 2.5.3. I can see a fix has been added - but I wonder if it
> is working? Would anyone that has 5-10 mins try altering a datasets
> owner_org to see it this is the case?
>
> I should also mention that I manually added the same to my context (as is
> noted in the above fix). Did not help.
>
> Thanks Timothy
>
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <http://lists.okfn.org/pipermail/ckan-dev/
> attachments/20161206/aa15dc96/attachment-0001.html>
>
> ------------------------------
>
> Message: 4
> Date: Tue, 6 Dec 2016 10:33:49 +0100
> From: Armin Retterath <armin.retterath at gmail.com>
> To: CKAN Development Discussions <ckan-dev at lists.okfn.org>
> Subject: [ckan-dev] translation for dataset_type
> Message-ID:
> <CAEYoGvFLjaU2_U+VskURXVAPeyAuaeGNxJ488urdQE3jX
> eKnmQ at mail.gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> hello,
>
> with help of the list, i solved the translation problems for using
> ckanext-scheming with own facets for the optional choices elements ;-) .
> how can i provide a translation for the element dataset_type and the
> different types (resp. schemas) in my extension?
>
> thanx in advance
>
> armin
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <http://lists.okfn.org/pipermail/ckan-dev/
> attachments/20161206/2a864dea/attachment-0001.html>
>
> ------------------------------
>
> Message: 5
> Date: Tue, 6 Dec 2016 11:24:06 +0100
> From: Armin Retterath <armin.retterath at gmail.com>
> To: CKAN Development Discussions <ckan-dev at lists.okfn.org>
> Subject: [ckan-dev] ckanext-scheming vs tag vocabularies
> Message-ID:
> <CAEYoGvFni0y0D+uB5Q4p1W+AOd15NWrdatt+j44zkWD4p-xyXg@
> mail.gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> hi together,
>
> if you want to define custom categories, the two different options
> "ckanext-scheming with choices" and "tag vocabularies" are possible. is
> there an idea to merge them into one concept? maybe to use links to
> distributed skos files (maybe also multilingual) in the json-schema
> alternative to define the choices by hand? or maybe the choices array will
> be automatically be transformed in a tag vocabulary in the postgres
> database?
>
> best regards from germany
> armin
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <http://lists.okfn.org/pipermail/ckan-dev/
> attachments/20161206/a4c858ed/attachment-0001.html>
>
> ------------------------------
>
> Message: 6
> Date: Tue, 6 Dec 2016 10:39:11 +0000
> From: Adri? Mercader <adria.mercader at okfn.org>
> To: CKAN Development Discussions <ckan-dev at lists.okfn.org>
> Subject: Re: [ckan-dev] Changing a datasets organisation - still not
> working?
> Message-ID:
> <CAGJR8iJ2Rg8r5=H5boq0Tai7=RkjWZpcGxtt9nyK+tu6qr_dUA at mail.
> gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> Hi Timothy,
>
> This fix was not included on 2.5.3 sadly. I've marked for backporting to
> 2.5.4
>
> https://github.com/ckan/ckan/pull/3133
>
> You can manually cherry-pick it on the meantime.
>
> Adri?
>
> On 6 December 2016 at 07:38, Timothy Giles <timothy.giles at slu.se> wrote:
>
> > Hi all,
> >
> >
> >
> > I realised last night that we have, on our test server, some datasets
> > without an organisation. So, I first thought perhaps I just patch the
> > package with the correct owner_org value (an organisation id). After
> > wondering why that was not working, I found the :
> >
> >
> >
> > ckan.logic.action.update.package_owner_org_update(context, data_dict)
> >
> > Update the owning organization of a dataset
> >
> >
> >
> > Parameters:
> >
> > id (string) ? the name or id of the dataset to update
> >
> > organization_id ? the name or id of the owning organization
> >
> >
> >
> > function, which seemed to fit the bill perfectly. With my sysadmin
> account
> > in hand, I tried using it and came across an error message mentioning
> that
> > the current session did not have a revision set.
> >
> >
> >
> > https://github.com/ckan/ckan/issues/2661
> >
> >
> >
> > I am using CKAN 2.5.3. I can see a fix has been added ? but I wonder if
> it
> > is working? Would anyone that has 5-10 mins try altering a datasets
> > owner_org to see it this is the case?
> >
> >
> >
> > I should also mention that I manually added the same to my context (as is
> > noted in the above fix). Did not help.
> >
> >
> >
> > Thanks Timothy
> >
> >
> >
> > _______________________________________________
> > ckan-dev mailing list
> > ckan-dev at lists.okfn.org
> > https://lists.okfn.org/mailman/listinfo/ckan-dev
> > Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> >
> >
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <http://lists.okfn.org/pipermail/ckan-dev/
> attachments/20161206/34b4b69f/attachment.html>
>
> ------------------------------
>
> Subject: Digest Footer
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>
>
> ------------------------------
>
> End of ckan-dev Digest, Vol 74, Issue 9
> ***************************************
>
--
Regards,
Mark Kirkpatrick,
19 Ascot Street,
Thorndon,
Wellington,
6011
NZ: +64 (0) 21 1841 761
http://www.markkirkpatrick.co.uk
@mkirkpat <http://twitter.com/mkirkpat>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20161207/998b318e/attachment-0002.html>
More information about the ckan-dev
mailing list