[Open-data-census] [okfn-discuss] A question about the Open Data census scoring system

Tue Oct 1 17:41:39 BST 2013

Cheers! & sorry for missing it earlier!

On Tue, Oct 1, 2013 at 5:36 PM, Christian Villum
<christian.villum at okfn.org>wrote:

> Hi Tracey,
>
> Brief information is in the FAQ <http://2013.census.okfn.org/faq/>, but
> we're working to put more detailed information in there.
>
> -Christian
>
> --
>
> Christian Villum
>
> Community Manager, Open Government Data + Local Groups Network
> skype: christianvillum  |  @villum <http://www.twitter.com/villum>
> The Open Knowledge Foundation <http://okfn.org/>
> *Empowering through Open Knowledge
> *http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on Facebook<https://www.facebook.com/OKFNetwork> |
> Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>
>
>
>
>
> On Tue, Oct 1, 2013 at 5:01 PM, Tracey P. Lauriault <tlauriau at gmail.com>wrote:
>
>> Rufus & Christianl
>>
>> Do you have the methodology / ranking / algorithm available anywhere?
>> That could help.
>>
>> Cheers
>> t
>>
>>
>> On Tue, Oct 1, 2013 at 3:49 PM, Rufus Pollock <rufus.pollock at okfn.org>wrote:
>>
>>> @Daniela: We could add a 1-10 score for amount of data and 1-10 for
>>> quality. My concern is that you introduce (even more) subjectivity but
>>> could be useful. Definitely worth thinking about ...
>>>
>>> Rufus
>>>
>>>
>>> On 1 October 2013 15:38, Daniela Mattern <daniela.mattern at it3s.org>wrote:
>>>
>>>> Hi Christian,
>>>>
>>>> I have found a similar issue when comparing the scope of data for
>>>> Austria and Brazil - for instance, for emissions of polluents Brazil got a
>>>> pretty good score. But the data is far less complete than data on the
>>>> Austrian page.
>>>> Brazil only offers a simple list of impacts on carbondioxid emissions
>>>> by cutting rainforest ...
>>>>
>>>> How can we ensure that country results are really comparable?
>>>>
>>>> Daniela
>>>>
>>>>
>>>> 2013/10/1 Christian Villum <christian.villum at okfn.org>
>>>>
>>>>> Thanks Pierre, this is really valuable feedback. We're discussing the
>>>>> scoring system right now and will definitely take this into consideration.
>>>>> Any other feedback from list members on this topic will be warmly
>>>>> embraced as well.
>>>>>
>>>>> -Christian
>>>>>
>>>>> --
>>>>>
>>>>> Christian Villum
>>>>>
>>>>> Community Manager, Open Government Data + Local Groups Network
>>>>> skype: christianvillum  |  @villum <http://www.twitter.com/villum>
>>>>> The Open Knowledge Foundation <http://okfn.org/>
>>>>> *Empowering through Open Knowledge
>>>>> *http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on
>>>>> Facebook <https://www.facebook.com/OKFNetwork>  |  Blog<http://blog.okfn.org/> |
>>>>> Newsletter <http://okfn.org/about/newsletter>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Tue, Oct 1, 2013 at 2:39 PM, Pierre Chrzanowski <
>>>>> pierre.chrzanowski at gmail.com> wrote:
>>>>>
>>>>>> Hi All, I already got some feedbacks about the new census results and
>>>>>> most of the time people are quite surprised with the total score and
>>>>>> position of France. I think the fact that France (whose most of datasets
>>>>>> are openly licensed) and China (whose datasets are not open) share almost
>>>>>> the same score is one of the main reasons.
>>>>>>
>>>>>> I already expressed my concerns to Christian that the scoring system
>>>>>> could be misleading, or even irrelevant.
>>>>>> And regarding the first feedbacks I got, I must say I am now quite
>>>>>> sure it is misleading ;)
>>>>>>
>>>>>> Then, I would suggest to :
>>>>>>
>>>>>> 1/ remove the actual score which does not reflect openess of datasets
>>>>>> in the countries
>>>>>>
>>>>>> and
>>>>>>
>>>>>> 2/ create a scoring system that really value openess (i.e score 0 if
>>>>>> dataset not open)
>>>>>>
>>>>>> That being said, I am also wondering if it would not be better not
>>>>>> have a score at all ...
>>>>>>
>>>>>> What do you think ?
>>>>>>
>>>>>> I found a discussion on the scoring calculation methodology and how
>>>>>> it has evolved here
>>>>>> https://github.com/okfn/opendatacensus/issues/33?source=cc
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Fri, Aug 23, 2013 at 12:49 PM, Christian Villum <
>>>>>> christian.villum at okfn.org> wrote:
>>>>>>
>>>>>>> Dear Tatyana,
>>>>>>>
>>>>>>> Thank you for offering to help, we will definitely be explaining the
>>>>>>> methodology on the site as part of the coming updates.
>>>>>>> We'll also look into the EXMO tool, thanks for the tip.
>>>>>>>
>>>>>>> Let's stay in touch!
>>>>>>>
>>>>>>> -Christian
>>>>>>>
>>>>>>> --
>>>>>>>
>>>>>>> Christian Villum
>>>>>>>
>>>>>>> Community Manager, Open Government Data + Local Groups Network
>>>>>>> skype: christianvillum  |  @villum <http://www.twitter.com/villum>
>>>>>>>
>>>>>>> The Open Knowledge Foundation <http://okfn.org/>
>>>>>>> *Empowering through Open Knowledge
>>>>>>> *http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on
>>>>>>> Facebook <https://www.facebook.com/OKFNetwork>  |  Blog<http://blog.okfn.org/> |
>>>>>>> Newsletter <http://okfn.org/about/newsletter>
>>>>>>>
>>>>>>> *Have you registered for OKCon 2013 <http://okcon.org/>?*
>>>>>>>
>>>>>>>
>>>>>>> On Wed, Aug 21, 2013 at 11:49 AM, Tatyana Tolsteneva <
>>>>>>> tatyanatolsteneva at gmail.com> wrote:
>>>>>>>
>>>>>>>> Dear Rufus,
>>>>>>>>
>>>>>>>> thanks a lot for your respond.
>>>>>>>> I would like suggest to join to the idea of developing and
>>>>>>>> publishing full methodology of the Census.
>>>>>>>> We in the Freedom of Information Foundation (Russia) have already
>>>>>>>> done tis job for our monitoring (please see our methodology on our web-site
>>>>>>>> in English http://www.svobodainfo.org/en/node/1014).
>>>>>>>> We would be happy to provide translation support and translate the
>>>>>>>> Census methodology in Russian.
>>>>>>>>
>>>>>>>> Also we would be pleasant to offer you our ICT monitoring tool -
>>>>>>>> EXMO system, specially developed for government web-sites monitoring.
>>>>>>>> Please find the article about EXMO work here (in English)
>>>>>>>> http://www.svobodainfo.org/en/node/2162
>>>>>>>> Just note, that unique quantity of EXMO is it's interaction part,
>>>>>>>> which allows not only measure government openness level, but also improve
>>>>>>>> it via internet communication with officials.
>>>>>>>>
>>>>>>>>  Yours sincerely,
>>>>>>>>
>>>>>>>> Tatyana Tolsteneva
>>>>>>>> Development manager
>>>>>>>> tatyana.tolsteneva at svobodainfo.org
>>>>>>>>
>>>>>>>> Freedom of Information Foundation
>>>>>>>> (formerly known as Institute for Information Freedom Development)
>>>>>>>> P.O. Box 527, St.-Petersburg, 192007, Russia
>>>>>>>> Phone:  +7 812 766-03-66
>>>>>>>> Fax: +7 812 766-52-61
>>>>>>>> Email: info at svobodainfo.org <info at svobodainfo.org>
>>>>>>>> www.svobodainfo.org
>>>>>>>>
>>>>>>>>
>>>>>>>> 01.08.2013, в 14:06, Rufus Pollock написал(а):
>>>>>>>>
>>>>>>>> On 1 August 2013 10:24, Tatyana Tolsteneva <
>>>>>>>> tatyanatolsteneva at gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Dear Rufus,
>>>>>>>>>
>>>>>>>>> thanks a lot for your explanation, i have already found it here
>>>>>>>>> https://github.com/okfn/opendatacensus/issues/33.
>>>>>>>>> Please take my apologies for "OKNF", it was just a misprint.
>>>>>>>>>
>>>>>>>>
>>>>>>>> No worries :-) (Just making sure not a confusion as opposed to
>>>>>>>> typo!)
>>>>>>>>
>>>>>>>>
>>>>>>>>> Here in Russia the Census it considered to be most authoritative
>>>>>>>>> comparative study of open data around the world. And here we really feel
>>>>>>>>> some lack of official information about the Census methodology.
>>>>>>>>> It seems, this problem could be solved by official publication of
>>>>>>>>> the methodology on the Census website.
>>>>>>>>> Could it be possible? What do you think about the methodology
>>>>>>>>> publication?
>>>>>>>>>
>>>>>>>>
>>>>>>>> Yes this is a very good idea and we'll get moving on this right
>>>>>>>> away. Any suggestions for specific things to include or language are very
>>>>>>>> welcome!
>>>>>>>>
>>>>>>>> Rufus
>>>>>>>>
>>>>>>>> Yours sincerely,
>>>>>>>>>
>>>>>>>>> Tatyana Tolsteneva
>>>>>>>>> Development manager
>>>>>>>>> tatyana.tolsteneva at svobodainfo.org
>>>>>>>>>
>>>>>>>>> Freedom of Information Foundation
>>>>>>>>> (formerly known as Institute for Information Freedom Development)
>>>>>>>>> P.O. Box 527, St.-Petersburg, 192007, Russia
>>>>>>>>> Phone:  +7 812 766-03-66
>>>>>>>>> Fax: +7 812 766-52-61
>>>>>>>>> Email: info at svobodainfo.org <info at svobodainfo.org>
>>>>>>>>> www.svobodainfo.org
>>>>>>>>>
>>>>>>>>> 31.07.2013, в 22:28, Rufus Pollock написал(а):
>>>>>>>>>
>>>>>>>>> [changing mailing list from okfn-discuss to open-data-census]
>>>>>>>>>
>>>>>>>>> On 23 July 2013 12:06, Tatyana Tolsteneva <
>>>>>>>>> tatyanatolsteneva at gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> Dear colleagues,
>>>>>>>>>> my name is Tatyana and i'm a development manager of the Freedom
>>>>>>>>>> of Information Foundation - Russian FOI-advocasy NGO based in St.
>>>>>>>>>> Petersburg.
>>>>>>>>>> I'm interested in the OKNF Open Data Census scoring system
>>>>>>>>>> because i can't catch it's idea of it http://census.okfn.org/G8/
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> OKFN (Open Knowledge Foundation (Network))
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>> At first i had a hypothesis, that each "yes" costs 1 poin and
>>>>>>>>>> points just should to be summarized.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> That's almost the case but not quite: whether data is up to date
>>>>>>>>> does not count towards the total score.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>> This idea has been perfect, if maximum for all questions would
>>>>>>>>>> have been 7.
>>>>>>>>>> But we have 6 as maximum.
>>>>>>>>>> So my question is about "data existence" column
>>>>>>>>>>
>>>>>>>>> IN case all  "yes" should cost 1 points, it should be 7 as maximum.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> See above.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>> Form the table http://census.okfn.org/G8/ i can see that some
>>>>>>>>>> times "yes" per "data existence" is taken into the account.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> It should be always taken into account.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>> Fo example,  Transport timetable is Russia, Government spending
>>>>>>>>>> is France and in Italy.
>>>>>>>>>> But in the majority of cases YES per "data existence" is not
>>>>>>>>>> included into the account. For example Zip-codes Russia
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> It is included there - it's up to date that is not included.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>> And speaking about Russian case, company register for Russia  has
>>>>>>>>>> 2/6 and Transport timetable has 2/6, but Company register is up to date
>>>>>>>>>> and Transport timetable is not.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> See above.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>> Would you be so kind to explain this scoring and situation with
>>>>>>>>>> points for "data existence" and i woul be specially glad for explaining in
>>>>>>>>>> the context of the Russian score.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Hope the above clarifies things. Also thanks for asking as your
>>>>>>>>> questions will encourage us to put up further documentation on the website!
>>>>>>>>>
>>>>>>>>> Rufus
>>>>>>>>>  *
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> *
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> *
>>>>>>>> Rufus Pollock
>>>>>>>> Founder and Executive Director | skype: rufuspollock |
>>>>>>>> @rufuspollock <https://twitter.com/rufuspollock>
>>>>>>>> The Open Knowledge Foundation <http://okfn.org/>
>>>>>>>> Empowering through Open Knowledge
>>>>>>>> http://okfn.org/ | @okfn <http://twitter.com/OKFN> | OKF on
>>>>>>>> Facebook <https://www.facebook.com/OKFNetwork> |  Blog<http://blog.okfn.org/> |
>>>>>>>> Newsletter <http://okfn.org/about/newsletter>
>>>>>>>>
>>>>>>>>
>>>>>>>> *
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> Open-data-census mailing list
>>>>>>>> Open-data-census at lists.okfn.org
>>>>>>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Open-data-census mailing list
>>>>>>> Open-data-census at lists.okfn.org
>>>>>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> *Pierre Chrzanowski*
>>>>>> *Open Knowledge Foundation France*
>>>>>>
>>>>>> Mail: pierre.chrzanowski at gmail.com
>>>>>> Mobile: +33 (0)7 855 71 292 | Skype: pierre.chrzanowski | Twitter:
>>>>>> @piezanowski <https://twitter.com/piezanowski>
>>>>>>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Open-data-census mailing list
>>>>> Open-data-census at lists.okfn.org
>>>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Daniela Mattern
>>>> Coordenadora Geral
>>>> IT3S - Instituto de Fomento à Tecnologia do Terceiro Setor
>>>> Fone: 0055-11-36285787
>>>> Celular: 0055-11-987 356 563
>>>>
>>>> Siga nosso Twitter <https://twitter.com/#%21/it3s> | Acompanhe nosso
>>>> Facebook <http://www.facebook.com/IT3S.org>
>>>> prestandocontas.org
>>>> maps.mootiro.org <http://mootiro.org>
>>>> it3s.org
>>>>
>>>> _______________________________________________
>>>> Open-data-census mailing list
>>>> Open-data-census at lists.okfn.org
>>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>>
>>>>
>>>
>>>
>>> --
>>> *
>>>
>>> Rufus Pollock
>>>
>>> Founder and Executive Director | skype: rufuspollock | @rufuspollock<https://twitter.com/rufuspollock>
>>>
>>> The Open Knowledge Foundation <http://okfn.org/>
>>>
>>> Empowering through Open Knowledge
>>> http://okfn.org/ | @okfn <http://twitter.com/OKFN> | OKF on Facebook<https://www.facebook.com/OKFNetwork>|
>>> Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>
>>>
>>> *
>>>
>>> _______________________________________________
>>> Open-data-census mailing list
>>> Open-data-census at lists.okfn.org
>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>
>>>
>>
>>
>> --
>> Tracey P. Lauriault
>> http://traceyplauriault.wordpress.com/2013/07/23/moving-to-ireland/
>> https://gcrc.carleton.ca/confluence/display/GCRCWEB/Lauriault
>> http://datalibre.ca/
>>
>> _______________________________________________
>> Open-data-census mailing list
>> Open-data-census at lists.okfn.org
>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>
>>
>

-- 
Tracey P. Lauriault
http://traceyplauriault.wordpress.com/2013/07/23/moving-to-ireland/
https://gcrc.carleton.ca/confluence/display/GCRCWEB/Lauriault
http://datalibre.ca/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/open-data-census/attachments/20131001/a94d9dab/attachment-0001.htm>