[wdmmg-dev] Making sense of the OpenSpending UK Govt 25k data dump

Tue Sep 20 09:18:02 UTC 2011

Guys,

you're talking about two different things: the resource_id bits are
from CKAN (DGU, to be precise) and are kept in the data only as a
means of tracking the processing.

Nick: Chris is not dealing with OpenSpending outputs I think but with
the bulk CSV export I made a while back. This was indeed made before I
ran department name normalization (and I think another two or three
sanity checks) and I'd recommend we not use it because: 1) it needs to
be cleaned up, 2) its not up to date and 3) it was not done with the
right tools and has more errors then necessary (we did not make any,
but it did not fix as many as possible).

I think if we could allocate about 3-4 days to re-do it and set it up
in some CI system to run regularly, I think we could produce something
much better.

- Friedrich

On Tue, Sep 20, 2011 at 10:56 AM, Nick Stenning <nick at whiteink.com> wrote:
> On Tue, Sep 20, 2011 at 09:49, Chris Taggart <countculture at gmail.com> wrote:
>> Nick
>> Just wanted to chase up on the specific question of whether there's any
>> relationship between the id in the CSV dump and the URL, and if not whether
>> this can easily be recitified?
>
> Hi Chris,
>
> At the risk of sounding terribly ignorant about a codebase I'm meant
> to be maintaining, where is this "resource_id" field of which you
> speak. I've just had a poke around and every JSON/CSV export I can
> find which refers to entries gives an "_id" field, the one I described
> earlier. Grepping the entire source code for "resource_id" also throws
> up no hits, implying to me that any "resource_id" must be a
> dataset-specific thing.
>
> If you can provide me with any URLs that emit "resource_id" and not
> "_id", I'll be happy to look into this.
>
> N
>
> _______________________________________________
> wdmmg-dev mailing list
> wdmmg-dev at lists.okfn.org
> http://lists.okfn.org/mailman/listinfo/wdmmg-dev
>

-- 
Open Knowledge Foundation
Promoting Open Knowledge in a Digital Age
http://www.okfn.org/ - http://blog.okfn.org/

http://twitter.com/pudo
http://pudo.org