[wdmmg-dev] Open Spending Albania

Mon Jun 20 19:55:40 UTC 2011

Hi Armand,

Thanks for creating the package in CKAN.

The file I am looking at is:
https://spreadsheets.google.com/spreadsheet/pub?hl=en_US&hl=en_US&key=0AhuowaCxiO_TdHUyeG5SWVRKTTR3NmpueWtGeVIxeHc&output=html

I'm just having a look and can spot a couple of things that we need to
look at before we can load your data.

I need to also clarify with my colleagues, this is the first time I
have worked on a dataset with totals in the middle of columns and I
need to find out from the team how we can work to make this match the
required format.

My observations for what I think we will need to change initially:

1. Your CSV File does not contain original column headings (i.e. they
are a mix between the OpenSpending Mapping schema and the original
file)

My suggestions to you would be to use column headings something like
(this is just an example - you need to pick ones which are appropriate
to you):

Spending Area Level 1, Spending Area Level 2, Amount, (Omit Currency),
Commentary

2. The mapping metadata is a *separate* file to the CSV. It shows how
your columns correspond to the system that OpenSpending understands.
Once we have established what the field names in your original file
should be, we can write the mapping metadata.

e.g.

Original Field, OpenSpending Field, Default value, Label, Description,
DataType, ObjectType, Classifier taxonomy, Commentary

Spending Area Level 1, to, society, Area1, General breakdown into
areas, string, entity,,,
...
Amount, amount,, Amount, Amount in Currency XYZ, float, value,,,

I can help you try to put together this mapping metadata tomorrow if
you like, but I need to find out first whether the overall
datastructure is going to present any problems.

@team - could you have a quick look at Armand's data? Will
OpenSpending be able to deal with the Totals in the individual
sections?

I am presuming that in the file you provided, column b is a subset of
column a (i.e. you would like to break your data down firstly by
column a and the drill deeper by column b)?

Many thanks and I look forward to continuing this discussion tomorrow.

Best wishes,

Lucy

>
> On Fri, 10 Jun 2011 17:46:41 +0100, Lucy Chambers <lucy.chambers at okfn.org>
> wrote:
>> Dear Armand,
>>
>> (Cc'ing WDMMG dev)
>>
>> Just a quick update on the way things are working at the moment.
>>
>> 1) We are working on changing the loader system so that people can
>> load data themselves, without needing to go through us to do so. This
>> is taking a while as the datasets we are working with are all *very*
>> different and we need to ensure that the system we build is general
>> enough for everyone's data.
>>
>> I am going to hand over to the guys from the dev team to provide some
>> timeline estimates of what things are looking like atm:
>>
>> @ Martin, Carsten - any updates on the below?
>>
>> 2) In the meanwhile - we can take a look at your data.
>>
>> Have you uploaded it into CKAN yet? (2011 data would be good if you
>> are looking at producing an up to date visualisation)
>>
>> If yes - could you please send me the link to the package in CKAN?
>> If no - could you please add a new package in CKAN, tag it with
>> 'openspending' and email us and we can take a look from there.
>>
>> 3) The next step will be to write some mapping metadata to map your
>> document into the OpenSpending system. I will happily guide you
>> through this and we can get your data ready to trial in the system.
>>
>> A guide to producing this mapping can be found here:
>> http://wiki.openspending.org/Data_Loading#Quickstart
>>
>> Please let me know if I can help with this!
>>
>> Lucy
>>
>>
>> On Fri, Jun 10, 2011 at 2:22 PM, Armand Brahaj <mandi at shqiperia.com>
> wrote:
>>>
>>> Dear Lucy,
>>> Any progress on Open Spending Albania? We are working on some more data
>>> that should include 2011. Do you need them as well?
>>>
>>> We are also having a small activity to present open data in Albania and
>>> we
>>> would like to present the data visualization for Albania at
>>> openspending.org. Any chance we can see some data from Albania there
>>> before
>>> the end of next week? Any thing we can do to speed things up?
>>>
>>> Thank you
>>> Armand
>>>
>>> On Mon, 23 May 2011 19:23:41 +0100, Lucy Chambers
>>> <lucy.chambers at okfn.org>
>>> wrote:
>>>> Hi Armand,
>>>>
>>>> Thank you - we are working on some documentation for OpenSpending as
>>>> we speak. When we have done it, would you be happy to test out how
>>>> good the documentation is with your own data? ))
>>>>
>>>> Lucy
>>>>
>>>> On Sat, May 14, 2011 at 10:01 AM, Armand Brahaj <mandi at shqiperia.com>
>>>> wrote:
>>>>>
>>>>> Good Morning everyone,
>>>>> I have added a CKAN entry in our repository for the Spending Data of
>>>>> Albania. It can be found at:
>>>>> http://katalog.opendata.al/package/shpenzimet-shqiperia
>>>>>
>>>>> Please let me know if you need changes. I checked the version and
> some
>>>>> translations are missing. Will see in the afternoon to translate all
>>> the
>>>>> terms.
>>>>>
>>>>> Kind Regards,
>>>>> Armand
>>>>>
>>>>> On Sat, 14 May 2011 00:42:06 +0100, Jonathan Gray
>>>>> <jonathan.gray at okfn.org>
>>>>> wrote:
>>>>>> Brilliant - thanks Armand.
>>>>>>
>>>>>> Is there a public URL for the spreadsheet anywhere? If not perhaps
> you
>>>>>> could work with Lucy to upload it somewhere - e.g. in a Google Docs
>>>>>> spreadsheet - and then register it in CKAN?
>>>>>>
>>>>>> Lucy: could you take care of this as a first step? Then ping
>>>>> wdmmg-discuss
>>>>>> list?
>>>>>>
>>>>>> All the best,
>>>>>>
>>>>>> Jonathan
>>>>>>
>>>>>> On Sat, May 14, 2011 at 12:39 AM, Armand Brahaj
> <mandi at shqiperia.com>
>>>>>> wrote:
>>>>>>> Hello Jonathan,
>>>>>>> Please go ahead and use it.
>>>>>>> I think I had a chance to meet Friedrich in the Transparency Camp
>>> some
>>>>>>> days ago
>>>>>>>
>>>>>>> _____________________________ Lajmerim i shkurter nga qelizori
>>>>>>>
>>>>>>> Jonathan Gray <jonathan.gray at okfn.org> hat geschrieben:
>>>>>>>
>>>>>>>>Thanks very much for getting in touch Armand!
>>>>>>>>
>>>>>>>>I'm cc'ing Friedrich, Lucy and Rufus.
>>>>>>>>
>>>>>>>>All: see attached.
>>>>>>>>
>>>>>>>>Armand: would you like this data to be loaded into Open Spending?
>>>>>>>>
>>>>>>>>All the best,
>>>>>>>>
>>>>>>>>Jonathan
>>>>>>>>
>>>>>>>>On Thu, May 12, 2011 at 10:40 AM, Armand Brahaj
> <mandi at shqiperia.com>
>>>>>>>>wrote:
>>>>>>>>
>>>>>>>>> Hallo Jonathan,
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> We have a version of the Open Spending in Albania in 2009 and
> 2010.
>>>>>>>>> Can you
>>>>>>>>> please check the attachment and provide feedbacks.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Kind Regards,
>>>>>>>>> Armand
>>>>>>>>>
>>>>>>>>> -------- Original Message --------
>>>>>>>>>   Subject: Re: Version tjeter  Date: Mon, 4 Apr 2011 13:18:27
>>>>>>>>> -0700
>>>>>>>>> (PDT)  From:
>>>>>>>>> blerta zilja <blerta.zilja at yahoo.com>  To: Armand Brahaj <
>>>>>>>>> mandi at shqiperia.com>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>--
>>>>>>>>Jonathan Gray
>>>>>>>>
>>>>>>>>Community Coordinator
>>>>>>>>The Open Knowledge Foundation
>>>>>>>>http://blog.okfn.org
>>>>>>>>
>>>>>>>>http://twitter.com/jwyg
>>>>>>>>http://identi.ca/jwyg
>>>>>>>
>>>>>
>>>
>

-- 
Lucy Chambers
Community Coordinator
Open Knowledge Foundation
http://okfn.org/
Skype: lucyfediachambers