[Open-data-census] [okfn-discuss] A question about the Open Data census scoring system

Tue Oct 1 16:01:10 BST 2013

Rufus & Christianl

Do you have the methodology / ranking / algorithm available anywhere?  That
could help.

Cheers
t

On Tue, Oct 1, 2013 at 3:49 PM, Rufus Pollock <rufus.pollock at okfn.org>wrote:

> @Daniela: We could add a 1-10 score for amount of data and 1-10 for
> quality. My concern is that you introduce (even more) subjectivity but
> could be useful. Definitely worth thinking about ...
>
> Rufus
>
>
> On 1 October 2013 15:38, Daniela Mattern <daniela.mattern at it3s.org> wrote:
>
>> Hi Christian,
>>
>> I have found a similar issue when comparing the scope of data for Austria
>> and Brazil - for instance, for emissions of polluents Brazil got a pretty
>> good score. But the data is far less complete than data on the Austrian
>> page.
>> Brazil only offers a simple list of impacts on carbondioxid emissions by
>> cutting rainforest ...
>>
>> How can we ensure that country results are really comparable?
>>
>> Daniela
>>
>>
>> 2013/10/1 Christian Villum <christian.villum at okfn.org>
>>
>>> Thanks Pierre, this is really valuable feedback. We're discussing the
>>> scoring system right now and will definitely take this into consideration.
>>> Any other feedback from list members on this topic will be warmly
>>> embraced as well.
>>>
>>> -Christian
>>>
>>> --
>>>
>>> Christian Villum
>>>
>>> Community Manager, Open Government Data + Local Groups Network
>>> skype: christianvillum  |  @villum <http://www.twitter.com/villum>
>>> The Open Knowledge Foundation <http://okfn.org/>
>>> *Empowering through Open Knowledge
>>> *http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on
>>> Facebook <https://www.facebook.com/OKFNetwork>  |  Blog<http://blog.okfn.org/> |
>>> Newsletter <http://okfn.org/about/newsletter>
>>>
>>>
>>>
>>>
>>> On Tue, Oct 1, 2013 at 2:39 PM, Pierre Chrzanowski <
>>> pierre.chrzanowski at gmail.com> wrote:
>>>
>>>> Hi All, I already got some feedbacks about the new census results and
>>>> most of the time people are quite surprised with the total score and
>>>> position of France. I think the fact that France (whose most of datasets
>>>> are openly licensed) and China (whose datasets are not open) share almost
>>>> the same score is one of the main reasons.
>>>>
>>>> I already expressed my concerns to Christian that the scoring system
>>>> could be misleading, or even irrelevant.
>>>> And regarding the first feedbacks I got, I must say I am now quite sure
>>>> it is misleading ;)
>>>>
>>>> Then, I would suggest to :
>>>>
>>>> 1/ remove the actual score which does not reflect openess of datasets
>>>> in the countries
>>>>
>>>> and
>>>>
>>>> 2/ create a scoring system that really value openess (i.e score 0 if
>>>> dataset not open)
>>>>
>>>> That being said, I am also wondering if it would not be better not have
>>>> a score at all ...
>>>>
>>>> What do you think ?
>>>>
>>>> I found a discussion on the scoring calculation methodology and how it
>>>> has evolved here
>>>> https://github.com/okfn/opendatacensus/issues/33?source=cc
>>>>
>>>>
>>>>
>>>> On Fri, Aug 23, 2013 at 12:49 PM, Christian Villum <
>>>> christian.villum at okfn.org> wrote:
>>>>
>>>>> Dear Tatyana,
>>>>>
>>>>> Thank you for offering to help, we will definitely be explaining the
>>>>> methodology on the site as part of the coming updates.
>>>>> We'll also look into the EXMO tool, thanks for the tip.
>>>>>
>>>>> Let's stay in touch!
>>>>>
>>>>> -Christian
>>>>>
>>>>> --
>>>>>
>>>>> Christian Villum
>>>>>
>>>>> Community Manager, Open Government Data + Local Groups Network
>>>>> skype: christianvillum  |  @villum <http://www.twitter.com/villum>
>>>>>
>>>>> The Open Knowledge Foundation <http://okfn.org/>
>>>>> *Empowering through Open Knowledge
>>>>> *http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on
>>>>> Facebook <https://www.facebook.com/OKFNetwork>  |  Blog<http://blog.okfn.org/> |
>>>>> Newsletter <http://okfn.org/about/newsletter>
>>>>>
>>>>> *Have you registered for OKCon 2013 <http://okcon.org/>?*
>>>>>
>>>>>
>>>>> On Wed, Aug 21, 2013 at 11:49 AM, Tatyana Tolsteneva <
>>>>> tatyanatolsteneva at gmail.com> wrote:
>>>>>
>>>>>> Dear Rufus,
>>>>>>
>>>>>> thanks a lot for your respond.
>>>>>> I would like suggest to join to the idea of developing and publishing
>>>>>> full methodology of the Census.
>>>>>> We in the Freedom of Information Foundation (Russia) have already
>>>>>> done tis job for our monitoring (please see our methodology on our web-site
>>>>>> in English http://www.svobodainfo.org/en/node/1014).
>>>>>> We would be happy to provide translation support and translate the
>>>>>> Census methodology in Russian.
>>>>>>
>>>>>> Also we would be pleasant to offer you our ICT monitoring tool - EXMO
>>>>>> system, specially developed for government web-sites monitoring. Please
>>>>>> find the article about EXMO work here (in English)
>>>>>> http://www.svobodainfo.org/en/node/2162
>>>>>> Just note, that unique quantity of EXMO is it's interaction part,
>>>>>> which allows not only measure government openness level, but also improve
>>>>>> it via internet communication with officials.
>>>>>>
>>>>>>  Yours sincerely,
>>>>>>
>>>>>> Tatyana Tolsteneva
>>>>>> Development manager
>>>>>> tatyana.tolsteneva at svobodainfo.org
>>>>>>
>>>>>> Freedom of Information Foundation
>>>>>> (formerly known as Institute for Information Freedom Development)
>>>>>> P.O. Box 527, St.-Petersburg, 192007, Russia
>>>>>> Phone:  +7 812 766-03-66
>>>>>> Fax: +7 812 766-52-61
>>>>>> Email: info at svobodainfo.org <info at svobodainfo.org>
>>>>>> www.svobodainfo.org
>>>>>>
>>>>>>
>>>>>> 01.08.2013, в 14:06, Rufus Pollock написал(а):
>>>>>>
>>>>>> On 1 August 2013 10:24, Tatyana Tolsteneva <
>>>>>> tatyanatolsteneva at gmail.com> wrote:
>>>>>>
>>>>>>> Dear Rufus,
>>>>>>>
>>>>>>> thanks a lot for your explanation, i have already found it here
>>>>>>> https://github.com/okfn/opendatacensus/issues/33.
>>>>>>> Please take my apologies for "OKNF", it was just a misprint.
>>>>>>>
>>>>>>
>>>>>> No worries :-) (Just making sure not a confusion as opposed to typo!)
>>>>>>
>>>>>>
>>>>>>> Here in Russia the Census it considered to be most authoritative
>>>>>>> comparative study of open data around the world. And here we really feel
>>>>>>> some lack of official information about the Census methodology.
>>>>>>> It seems, this problem could be solved by official publication of
>>>>>>> the methodology on the Census website.
>>>>>>> Could it be possible? What do you think about the methodology
>>>>>>> publication?
>>>>>>>
>>>>>>
>>>>>> Yes this is a very good idea and we'll get moving on this right away.
>>>>>> Any suggestions for specific things to include or language are very welcome!
>>>>>>
>>>>>> Rufus
>>>>>>
>>>>>> Yours sincerely,
>>>>>>>
>>>>>>> Tatyana Tolsteneva
>>>>>>> Development manager
>>>>>>> tatyana.tolsteneva at svobodainfo.org
>>>>>>>
>>>>>>> Freedom of Information Foundation
>>>>>>> (formerly known as Institute for Information Freedom Development)
>>>>>>> P.O. Box 527, St.-Petersburg, 192007, Russia
>>>>>>> Phone:  +7 812 766-03-66
>>>>>>> Fax: +7 812 766-52-61
>>>>>>> Email: info at svobodainfo.org <info at svobodainfo.org>
>>>>>>> www.svobodainfo.org
>>>>>>>
>>>>>>> 31.07.2013, в 22:28, Rufus Pollock написал(а):
>>>>>>>
>>>>>>> [changing mailing list from okfn-discuss to open-data-census]
>>>>>>>
>>>>>>> On 23 July 2013 12:06, Tatyana Tolsteneva <
>>>>>>> tatyanatolsteneva at gmail.com> wrote:
>>>>>>>
>>>>>>>> Dear colleagues,
>>>>>>>> my name is Tatyana and i'm a development manager of the Freedom of
>>>>>>>> Information Foundation - Russian FOI-advocasy NGO based in St. Petersburg.
>>>>>>>> I'm interested in the OKNF Open Data Census scoring system because
>>>>>>>> i can't catch it's idea of it http://census.okfn.org/G8/
>>>>>>>>
>>>>>>>
>>>>>>> OKFN (Open Knowledge Foundation (Network))
>>>>>>>
>>>>>>>
>>>>>>>> At first i had a hypothesis, that each "yes" costs 1 poin and
>>>>>>>> points just should to be summarized.
>>>>>>>>
>>>>>>>
>>>>>>> That's almost the case but not quite: whether data is up to date
>>>>>>> does not count towards the total score.
>>>>>>>
>>>>>>>
>>>>>>>> This idea has been perfect, if maximum for all questions would have
>>>>>>>> been 7.
>>>>>>>> But we have 6 as maximum.
>>>>>>>> So my question is about "data existence" column
>>>>>>>>
>>>>>>> IN case all  "yes" should cost 1 points, it should be 7 as maximum.
>>>>>>>>
>>>>>>>
>>>>>>> See above.
>>>>>>>
>>>>>>>
>>>>>>>> Form the table http://census.okfn.org/G8/ i can see that some
>>>>>>>> times "yes" per "data existence" is taken into the account.
>>>>>>>>
>>>>>>>
>>>>>>> It should be always taken into account.
>>>>>>>
>>>>>>>
>>>>>>>> Fo example,  Transport timetable is Russia, Government spending is
>>>>>>>> France and in Italy.
>>>>>>>> But in the majority of cases YES per "data existence" is not
>>>>>>>> included into the account. For example Zip-codes Russia
>>>>>>>>
>>>>>>>
>>>>>>> It is included there - it's up to date that is not included.
>>>>>>>
>>>>>>>
>>>>>>>> And speaking about Russian case, company register for Russia  has
>>>>>>>> 2/6 and Transport timetable has 2/6, but Company register is up to date
>>>>>>>> and Transport timetable is not.
>>>>>>>>
>>>>>>>
>>>>>>> See above.
>>>>>>>
>>>>>>>
>>>>>>>> Would you be so kind to explain this scoring and situation with
>>>>>>>> points for "data existence" and i woul be specially glad for explaining in
>>>>>>>> the context of the Russian score.
>>>>>>>>
>>>>>>>
>>>>>>> Hope the above clarifies things. Also thanks for asking as your
>>>>>>> questions will encourage us to put up further documentation on the website!
>>>>>>>
>>>>>>> Rufus
>>>>>>>  *
>>>>>>>
>>>>>>>
>>>>>>> *
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> *
>>>>>> Rufus Pollock
>>>>>> Founder and Executive Director | skype: rufuspollock | @rufuspollock<https://twitter.com/rufuspollock>
>>>>>> The Open Knowledge Foundation <http://okfn.org/>
>>>>>> Empowering through Open Knowledge
>>>>>> http://okfn.org/ | @okfn <http://twitter.com/OKFN> | OKF on Facebook<https://www.facebook.com/OKFNetwork>|
>>>>>> Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>
>>>>>>
>>>>>>
>>>>>> *
>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Open-data-census mailing list
>>>>>> Open-data-census at lists.okfn.org
>>>>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>>>>
>>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Open-data-census mailing list
>>>>> Open-data-census at lists.okfn.org
>>>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> *Pierre Chrzanowski*
>>>> *Open Knowledge Foundation France*
>>>>
>>>> Mail: pierre.chrzanowski at gmail.com
>>>> Mobile: +33 (0)7 855 71 292 | Skype: pierre.chrzanowski | Twitter:
>>>> @piezanowski <https://twitter.com/piezanowski>
>>>>
>>>
>>>
>>> _______________________________________________
>>> Open-data-census mailing list
>>> Open-data-census at lists.okfn.org
>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>
>>>
>>
>>
>> --
>> Daniela Mattern
>> Coordenadora Geral
>> IT3S - Instituto de Fomento à Tecnologia do Terceiro Setor
>> Fone: 0055-11-36285787
>> Celular: 0055-11-987 356 563
>>
>> Siga nosso Twitter <https://twitter.com/#%21/it3s> | Acompanhe nosso
>> Facebook <http://www.facebook.com/IT3S.org>
>> prestandocontas.org
>> maps.mootiro.org <http://mootiro.org>
>> it3s.org
>>
>> _______________________________________________
>> Open-data-census mailing list
>> Open-data-census at lists.okfn.org
>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>
>>
>
>
> --
> *
>
> Rufus Pollock
>
> Founder and Executive Director | skype: rufuspollock | @rufuspollock<https://twitter.com/rufuspollock>
>
> The Open Knowledge Foundation <http://okfn.org/>
>
> Empowering through Open Knowledge
> http://okfn.org/ | @okfn <http://twitter.com/OKFN> | OKF on Facebook<https://www.facebook.com/OKFNetwork>|
> Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>
>
> *
>
> _______________________________________________
> Open-data-census mailing list
> Open-data-census at lists.okfn.org
> http://lists.okfn.org/mailman/listinfo/open-data-census
>
>

-- 
Tracey P. Lauriault
http://traceyplauriault.wordpress.com/2013/07/23/moving-to-ireland/
https://gcrc.carleton.ca/confluence/display/GCRCWEB/Lauriault
http://datalibre.ca/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/open-data-census/attachments/20131001/62e40d00/attachment-0001.htm>