[Open-data-census] [okfn-discuss] A question about the Open Data census scoring system

Tue Oct 1 17:36:38 BST 2013

Hi Tracey,

Brief information is in the FAQ <http://2013.census.okfn.org/faq/>, but
we're working to put more detailed information in there.

-Christian

-- 

Christian Villum

Community Manager, Open Government Data + Local Groups Network
skype: christianvillum  |  @villum <http://www.twitter.com/villum>
The Open Knowledge Foundation <http://okfn.org/>
*Empowering through Open Knowledge
*http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on
Facebook<https://www.facebook.com/OKFNetwork> |
Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>

On Tue, Oct 1, 2013 at 5:01 PM, Tracey P. Lauriault <tlauriau at gmail.com>wrote:

> Rufus & Christianl
>
> Do you have the methodology / ranking / algorithm available anywhere?
> That could help.
>
> Cheers
> t
>
>
> On Tue, Oct 1, 2013 at 3:49 PM, Rufus Pollock <rufus.pollock at okfn.org>wrote:
>
>> @Daniela: We could add a 1-10 score for amount of data and 1-10 for
>> quality. My concern is that you introduce (even more) subjectivity but
>> could be useful. Definitely worth thinking about ...
>>
>> Rufus
>>
>>
>> On 1 October 2013 15:38, Daniela Mattern <daniela.mattern at it3s.org>wrote:
>>
>>> Hi Christian,
>>>
>>> I have found a similar issue when comparing the scope of data for
>>> Austria and Brazil - for instance, for emissions of polluents Brazil got a
>>> pretty good score. But the data is far less complete than data on the
>>> Austrian page.
>>> Brazil only offers a simple list of impacts on carbondioxid emissions by
>>> cutting rainforest ...
>>>
>>> How can we ensure that country results are really comparable?
>>>
>>> Daniela
>>>
>>>
>>> 2013/10/1 Christian Villum <christian.villum at okfn.org>
>>>
>>>> Thanks Pierre, this is really valuable feedback. We're discussing the
>>>> scoring system right now and will definitely take this into consideration.
>>>> Any other feedback from list members on this topic will be warmly
>>>> embraced as well.
>>>>
>>>> -Christian
>>>>
>>>> --
>>>>
>>>> Christian Villum
>>>>
>>>> Community Manager, Open Government Data + Local Groups Network
>>>> skype: christianvillum  |  @villum <http://www.twitter.com/villum>
>>>> The Open Knowledge Foundation <http://okfn.org/>
>>>> *Empowering through Open Knowledge
>>>> *http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on
>>>> Facebook <https://www.facebook.com/OKFNetwork>  |  Blog<http://blog.okfn.org/> |
>>>> Newsletter <http://okfn.org/about/newsletter>
>>>>
>>>>
>>>>
>>>>
>>>> On Tue, Oct 1, 2013 at 2:39 PM, Pierre Chrzanowski <
>>>> pierre.chrzanowski at gmail.com> wrote:
>>>>
>>>>> Hi All, I already got some feedbacks about the new census results and
>>>>> most of the time people are quite surprised with the total score and
>>>>> position of France. I think the fact that France (whose most of datasets
>>>>> are openly licensed) and China (whose datasets are not open) share almost
>>>>> the same score is one of the main reasons.
>>>>>
>>>>> I already expressed my concerns to Christian that the scoring system
>>>>> could be misleading, or even irrelevant.
>>>>> And regarding the first feedbacks I got, I must say I am now quite
>>>>> sure it is misleading ;)
>>>>>
>>>>> Then, I would suggest to :
>>>>>
>>>>> 1/ remove the actual score which does not reflect openess of datasets
>>>>> in the countries
>>>>>
>>>>> and
>>>>>
>>>>> 2/ create a scoring system that really value openess (i.e score 0 if
>>>>> dataset not open)
>>>>>
>>>>> That being said, I am also wondering if it would not be better not
>>>>> have a score at all ...
>>>>>
>>>>> What do you think ?
>>>>>
>>>>> I found a discussion on the scoring calculation methodology and how it
>>>>> has evolved here
>>>>> https://github.com/okfn/opendatacensus/issues/33?source=cc
>>>>>
>>>>>
>>>>>
>>>>> On Fri, Aug 23, 2013 at 12:49 PM, Christian Villum <
>>>>> christian.villum at okfn.org> wrote:
>>>>>
>>>>>> Dear Tatyana,
>>>>>>
>>>>>> Thank you for offering to help, we will definitely be explaining the
>>>>>> methodology on the site as part of the coming updates.
>>>>>> We'll also look into the EXMO tool, thanks for the tip.
>>>>>>
>>>>>> Let's stay in touch!
>>>>>>
>>>>>> -Christian
>>>>>>
>>>>>> --
>>>>>>
>>>>>> Christian Villum
>>>>>>
>>>>>> Community Manager, Open Government Data + Local Groups Network
>>>>>> skype: christianvillum  |  @villum <http://www.twitter.com/villum>
>>>>>>
>>>>>> The Open Knowledge Foundation <http://okfn.org/>
>>>>>> *Empowering through Open Knowledge
>>>>>> *http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on
>>>>>> Facebook <https://www.facebook.com/OKFNetwork>  |  Blog<http://blog.okfn.org/> |
>>>>>> Newsletter <http://okfn.org/about/newsletter>
>>>>>>
>>>>>> *Have you registered for OKCon 2013 <http://okcon.org/>?*
>>>>>>
>>>>>>
>>>>>> On Wed, Aug 21, 2013 at 11:49 AM, Tatyana Tolsteneva <
>>>>>> tatyanatolsteneva at gmail.com> wrote:
>>>>>>
>>>>>>> Dear Rufus,
>>>>>>>
>>>>>>> thanks a lot for your respond.
>>>>>>> I would like suggest to join to the idea of developing and
>>>>>>> publishing full methodology of the Census.
>>>>>>> We in the Freedom of Information Foundation (Russia) have already
>>>>>>> done tis job for our monitoring (please see our methodology on our web-site
>>>>>>> in English http://www.svobodainfo.org/en/node/1014).
>>>>>>> We would be happy to provide translation support and translate the
>>>>>>> Census methodology in Russian.
>>>>>>>
>>>>>>> Also we would be pleasant to offer you our ICT monitoring tool -
>>>>>>> EXMO system, specially developed for government web-sites monitoring.
>>>>>>> Please find the article about EXMO work here (in English)
>>>>>>> http://www.svobodainfo.org/en/node/2162
>>>>>>> Just note, that unique quantity of EXMO is it's interaction part,
>>>>>>> which allows not only measure government openness level, but also improve
>>>>>>> it via internet communication with officials.
>>>>>>>
>>>>>>>  Yours sincerely,
>>>>>>>
>>>>>>> Tatyana Tolsteneva
>>>>>>> Development manager
>>>>>>> tatyana.tolsteneva at svobodainfo.org
>>>>>>>
>>>>>>> Freedom of Information Foundation
>>>>>>> (formerly known as Institute for Information Freedom Development)
>>>>>>> P.O. Box 527, St.-Petersburg, 192007, Russia
>>>>>>> Phone:  +7 812 766-03-66
>>>>>>> Fax: +7 812 766-52-61
>>>>>>> Email: info at svobodainfo.org <info at svobodainfo.org>
>>>>>>> www.svobodainfo.org
>>>>>>>
>>>>>>>
>>>>>>> 01.08.2013, в 14:06, Rufus Pollock написал(а):
>>>>>>>
>>>>>>> On 1 August 2013 10:24, Tatyana Tolsteneva <
>>>>>>> tatyanatolsteneva at gmail.com> wrote:
>>>>>>>
>>>>>>>> Dear Rufus,
>>>>>>>>
>>>>>>>> thanks a lot for your explanation, i have already found it here
>>>>>>>> https://github.com/okfn/opendatacensus/issues/33.
>>>>>>>> Please take my apologies for "OKNF", it was just a misprint.
>>>>>>>>
>>>>>>>
>>>>>>> No worries :-) (Just making sure not a confusion as opposed to typo!)
>>>>>>>
>>>>>>>
>>>>>>>> Here in Russia the Census it considered to be most authoritative
>>>>>>>> comparative study of open data around the world. And here we really feel
>>>>>>>> some lack of official information about the Census methodology.
>>>>>>>> It seems, this problem could be solved by official publication of
>>>>>>>> the methodology on the Census website.
>>>>>>>> Could it be possible? What do you think about the methodology
>>>>>>>> publication?
>>>>>>>>
>>>>>>>
>>>>>>> Yes this is a very good idea and we'll get moving on this right
>>>>>>> away. Any suggestions for specific things to include or language are very
>>>>>>> welcome!
>>>>>>>
>>>>>>> Rufus
>>>>>>>
>>>>>>> Yours sincerely,
>>>>>>>>
>>>>>>>> Tatyana Tolsteneva
>>>>>>>> Development manager
>>>>>>>> tatyana.tolsteneva at svobodainfo.org
>>>>>>>>
>>>>>>>> Freedom of Information Foundation
>>>>>>>> (formerly known as Institute for Information Freedom Development)
>>>>>>>> P.O. Box 527, St.-Petersburg, 192007, Russia
>>>>>>>> Phone:  +7 812 766-03-66
>>>>>>>> Fax: +7 812 766-52-61
>>>>>>>> Email: info at svobodainfo.org <info at svobodainfo.org>
>>>>>>>> www.svobodainfo.org
>>>>>>>>
>>>>>>>> 31.07.2013, в 22:28, Rufus Pollock написал(а):
>>>>>>>>
>>>>>>>> [changing mailing list from okfn-discuss to open-data-census]
>>>>>>>>
>>>>>>>> On 23 July 2013 12:06, Tatyana Tolsteneva <
>>>>>>>> tatyanatolsteneva at gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Dear colleagues,
>>>>>>>>> my name is Tatyana and i'm a development manager of the Freedom of
>>>>>>>>> Information Foundation - Russian FOI-advocasy NGO based in St. Petersburg.
>>>>>>>>> I'm interested in the OKNF Open Data Census scoring system because
>>>>>>>>> i can't catch it's idea of it http://census.okfn.org/G8/
>>>>>>>>>
>>>>>>>>
>>>>>>>> OKFN (Open Knowledge Foundation (Network))
>>>>>>>>
>>>>>>>>
>>>>>>>>> At first i had a hypothesis, that each "yes" costs 1 poin and
>>>>>>>>> points just should to be summarized.
>>>>>>>>>
>>>>>>>>
>>>>>>>> That's almost the case but not quite: whether data is up to date
>>>>>>>> does not count towards the total score.
>>>>>>>>
>>>>>>>>
>>>>>>>>> This idea has been perfect, if maximum for all questions would
>>>>>>>>> have been 7.
>>>>>>>>> But we have 6 as maximum.
>>>>>>>>> So my question is about "data existence" column
>>>>>>>>>
>>>>>>>> IN case all  "yes" should cost 1 points, it should be 7 as maximum.
>>>>>>>>>
>>>>>>>>
>>>>>>>> See above.
>>>>>>>>
>>>>>>>>
>>>>>>>>> Form the table http://census.okfn.org/G8/ i can see that some
>>>>>>>>> times "yes" per "data existence" is taken into the account.
>>>>>>>>>
>>>>>>>>
>>>>>>>> It should be always taken into account.
>>>>>>>>
>>>>>>>>
>>>>>>>>> Fo example,  Transport timetable is Russia, Government spending is
>>>>>>>>> France and in Italy.
>>>>>>>>> But in the majority of cases YES per "data existence" is not
>>>>>>>>> included into the account. For example Zip-codes Russia
>>>>>>>>>
>>>>>>>>
>>>>>>>> It is included there - it's up to date that is not included.
>>>>>>>>
>>>>>>>>
>>>>>>>>> And speaking about Russian case, company register for Russia  has
>>>>>>>>> 2/6 and Transport timetable has 2/6, but Company register is up to date
>>>>>>>>> and Transport timetable is not.
>>>>>>>>>
>>>>>>>>
>>>>>>>> See above.
>>>>>>>>
>>>>>>>>
>>>>>>>>> Would you be so kind to explain this scoring and situation with
>>>>>>>>> points for "data existence" and i woul be specially glad for explaining in
>>>>>>>>> the context of the Russian score.
>>>>>>>>>
>>>>>>>>
>>>>>>>> Hope the above clarifies things. Also thanks for asking as your
>>>>>>>> questions will encourage us to put up further documentation on the website!
>>>>>>>>
>>>>>>>> Rufus
>>>>>>>>  *
>>>>>>>>
>>>>>>>>
>>>>>>>> *
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> *
>>>>>>> Rufus Pollock
>>>>>>> Founder and Executive Director | skype: rufuspollock | @rufuspollock<https://twitter.com/rufuspollock>
>>>>>>> The Open Knowledge Foundation <http://okfn.org/>
>>>>>>> Empowering through Open Knowledge
>>>>>>> http://okfn.org/ | @okfn <http://twitter.com/OKFN> | OKF on Facebook<https://www.facebook.com/OKFNetwork>|
>>>>>>> Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>
>>>>>>>
>>>>>>>
>>>>>>> *
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Open-data-census mailing list
>>>>>>> Open-data-census at lists.okfn.org
>>>>>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Open-data-census mailing list
>>>>>> Open-data-census at lists.okfn.org
>>>>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> *Pierre Chrzanowski*
>>>>> *Open Knowledge Foundation France*
>>>>>
>>>>> Mail: pierre.chrzanowski at gmail.com
>>>>> Mobile: +33 (0)7 855 71 292 | Skype: pierre.chrzanowski | Twitter:
>>>>> @piezanowski <https://twitter.com/piezanowski>
>>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Open-data-census mailing list
>>>> Open-data-census at lists.okfn.org
>>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>>
>>>>
>>>
>>>
>>> --
>>> Daniela Mattern
>>> Coordenadora Geral
>>> IT3S - Instituto de Fomento à Tecnologia do Terceiro Setor
>>> Fone: 0055-11-36285787
>>> Celular: 0055-11-987 356 563
>>>
>>> Siga nosso Twitter <https://twitter.com/#%21/it3s> | Acompanhe nosso
>>> Facebook <http://www.facebook.com/IT3S.org>
>>> prestandocontas.org
>>> maps.mootiro.org <http://mootiro.org>
>>> it3s.org
>>>
>>> _______________________________________________
>>> Open-data-census mailing list
>>> Open-data-census at lists.okfn.org
>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>
>>>
>>
>>
>> --
>> *
>>
>> Rufus Pollock
>>
>> Founder and Executive Director | skype: rufuspollock | @rufuspollock<https://twitter.com/rufuspollock>
>>
>> The Open Knowledge Foundation <http://okfn.org/>
>>
>> Empowering through Open Knowledge
>> http://okfn.org/ | @okfn <http://twitter.com/OKFN> | OKF on Facebook<https://www.facebook.com/OKFNetwork>|
>> Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>
>>
>> *
>>
>> _______________________________________________
>> Open-data-census mailing list
>> Open-data-census at lists.okfn.org
>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>
>>
>
>
> --
> Tracey P. Lauriault
> http://traceyplauriault.wordpress.com/2013/07/23/moving-to-ireland/
> https://gcrc.carleton.ca/confluence/display/GCRCWEB/Lauriault
> http://datalibre.ca/
>
> _______________________________________________
> Open-data-census mailing list
> Open-data-census at lists.okfn.org
> http://lists.okfn.org/mailman/listinfo/open-data-census
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/open-data-census/attachments/20131001/a0a961c1/attachment-0001.htm>