[CKAN-support] Fwd: RE: UNDP updates

Wed Feb 19 13:15:17 UTC 2014

Hi Adria, Adam

Thanks for this.  Yes, apologies - DI had DNS issues on Monday

I tried to purge via the browser but got a 500.  Any chance you could via the command line?

Thanks

Steven

---------- Forwarded message ----------
From: Adrià Mercader <adria.mercader at okfn.org<mailto:adria.mercader at okfn.org>>
Date: 17 February 2014 10:59
Subject: Fwd: RE: UNDP updates
To: Steven Flower <stevieflow at gmail.com<mailto:stevieflow at gmail.com>>

Hi Steven,

The email to your devinit.org<http://devinit.org> address was returned, looks like your DNS is down

---------- Forwarded message ----------
From: Adrià Mercader <adria.mercader at okfn.org<mailto:adria.mercader at okfn.org>>
Date: 17 February 2014 10:56
Subject: Re: RE: UNDP updates
To: Steven Flower <Steven.Flower at devinit.org<mailto:Steven.Flower at devinit.org>>
Cc: Adam McGreggor <adam.mcgreggor at okfn.org<mailto:adam.mcgreggor at okfn.org>>, Ben Webb <ben at bjwebb.co.uk<mailto:ben at bjwebb.co.uk>>

Hi Steven,

When deleting datasets they are kept on the database and the URL (name) is still reserved. This hasn't changed on recent CKAN versions.

I see that the original UNDP datasets without date are still on the database (deleted). This means that if they try to assign new datasets with this name it will fail.

http://iatiregistry.org/dataset/undp-afg

To make the names available the datasets need to be purged, ie actually removed from the database. This needs to be done from the command line, but there is a basic UI for sysadmins as well:

http://iatiregistry.org/ckan-admin/trash

This will take a long time to load! It hasn't been looked after in a while so it may be buggy. I think it will be a good idea nonetheless to try to purge all deleted datasets (Button Purge them all at the bottom), as this will make things faster anyway.

If it doesn't work I'll do it from the command line.

Cheers,

Adrià

On 13 February 2014 18:12, Steven Flower <Steven.Flower at devinit.org<mailto:Steven.Flower at devinit.org>> wrote:

Hi Adria

See below from UNDP.  They update all their packages today, but have put date-specific references in the package name, which I queried

It seems - see below / attached - they are doing this due to an issue we had about a year ago around all this

Hence, would this still be an issue if we try to revert back to package names that were previously in use?

Thanks

Steven

-------- Original Message --------
Subject:        RE: UNDP updates
Date:   13/02/14 17:49
From:   Abdul Riza <abdul.riza at undp.org><mailto:abdul.riza at undp.org>
To:     Steven Flower <Steven.Flower at devinit.org><mailto:Steven.Flower at devinit.org>, Mark Cardwell <mark.cardwell at undp.org><mailto:mark.cardwell at undp.org>

Hi Steven,

Thanks for your inputs. In fact when we first created country registry files (2011 data set) we did have the file name as you have suggested (http://iatiregistry.org/dataset/undp-afg) but later we had to create multiple files with year included as we did not have historical data included. When we included the historical data and request you to delete the old files (2010-2012) we tried having the latest file without year but the registry do not allow us to have the name as we get an error message saying that url is already in use (See attached screenshot). That's why we continued to change the year.

Best regards,
Riza

-----Original Message-----
From: Steven Flower [mailto:Steven.Flower at devinit.org]
Sent: Thursday, February 13, 2014 12:24 PM
To: Abdul Riza; Mark Cardwell
Subject: UNDP updates

Hi Mark, Abdul

Further to my email earlier on, we can now see what you've been doing!

It's great that the 2014 updates are now pushed through, yet historical data is also maintained: http://iatiregistry.org/publisher/undp

Our dashboard refreshes at midnight UK time, so Ill check in on what - if anything - remains

Can I check about activities that have "ended" and how you are handling those?  It seems - from our checks - that some activities are now not included in the publication

One further point - Im not convinced that you need to name the actual package with the date.  Hence:

http://iatiregistry.org/dataset/undp-afg2014

links to

http://www.undp.org/content/dam/undp/documents/iati_xml/CO_2014/Afghanistan_projects.xml

with the title:

UNDP Activity File Afghanistan 2014

We can see that this has been an update of the package that was labelled as 2013: http://iatiregistry.org/dataset/activity/undp-afg2014

However, I would suggest a simpler setup of:

http://iatiregistry.org/dataset/undp-afg (no date in URL)

links to

http://www.undp.org/content/dam/undp/documents/iati_xml/CO_2014/Afghanistan_projects.xml
(the same, and can change according to your systems)

with the title:

UNDP Activity File Afghanistan - again, no year

The package description text could reflect that it includes the latest year, but the Registry will pick up on any updates and reflect this in the metadata

The outcome would be a more stable set of data URLs from UNDP - which developers/data users would accomodate

Please let me know your thoughts.

Thanks

Steven

______________________________________________________________________
This email has been scanned by the Symantec Email Security.cloud service.
For more information please visit http://www.symanteccloud.com ______________________________________________________________________

______________________________________________________________________
This email has been scanned by the Symantec Email Security.cloud service.
For more information please visit http://www.symanteccloud.com
______________________________________________________________________

--

------------------
skype: stevieflow
telephone: 441612981213

______________________________________________________________________
This email has been scanned by the Symantec Email Security.cloud service.
For more information please visit http://www.symanteccloud.com
______________________________________________________________________

______________________________________________________________________
This email has been scanned by the Symantec Email Security.cloud service.
For more information please visit http://www.symanteccloud.com
______________________________________________________________________
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.okfn.org/mailman/private/ckan-support/attachments/20140219/cc7d5225/attachment-0002.html>