[Open-data-census] [okfn-discuss] A question about the Open Data census scoring system

Tue Oct 1 19:11:32 BST 2013

Hi Feng and Rufus,

thanks for your reply.

I think, when the edition of this year's census is concluded we could
select one of the datasets and have a closer look on it, in order to define
which data is used to be delivered by different countries. In my opinion
more details about the dataset quality also helps the work of country
editors.
Today, in order to decide, whether Brazil offers certain data I'm checking
different countries' dataset to compare what is available. Having some
standards would be fine and turn the country editors' evaluations much more
objective and comparable.

Daniela

2013/10/1 Tracey P. Lauriault <tlauriau at gmail.com>

> Cheers! & sorry for missing it earlier!
>
>
> On Tue, Oct 1, 2013 at 5:36 PM, Christian Villum <
> christian.villum at okfn.org> wrote:
>
>> Hi Tracey,
>>
>> Brief information is in the FAQ <http://2013.census.okfn.org/faq/>, but
>> we're working to put more detailed information in there.
>>
>> -Christian
>>
>> --
>>
>> Christian Villum
>>
>> Community Manager, Open Government Data + Local Groups Network
>> skype: christianvillum  |  @villum <http://www.twitter.com/villum>
>> The Open Knowledge Foundation <http://okfn.org/>
>> *Empowering through Open Knowledge
>> *http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on Facebook<https://www.facebook.com/OKFNetwork> |
>> Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>
>>
>>
>>
>>
>> On Tue, Oct 1, 2013 at 5:01 PM, Tracey P. Lauriault <tlauriau at gmail.com>wrote:
>>
>>> Rufus & Christianl
>>>
>>> Do you have the methodology / ranking / algorithm available anywhere?
>>> That could help.
>>>
>>> Cheers
>>> t
>>>
>>>
>>> On Tue, Oct 1, 2013 at 3:49 PM, Rufus Pollock <rufus.pollock at okfn.org>wrote:
>>>
>>>> @Daniela: We could add a 1-10 score for amount of data and 1-10 for
>>>> quality. My concern is that you introduce (even more) subjectivity but
>>>> could be useful. Definitely worth thinking about ...
>>>>
>>>> Rufus
>>>>
>>>>
>>>> On 1 October 2013 15:38, Daniela Mattern <daniela.mattern at it3s.org>wrote:
>>>>
>>>>> Hi Christian,
>>>>>
>>>>> I have found a similar issue when comparing the scope of data for
>>>>> Austria and Brazil - for instance, for emissions of polluents Brazil got a
>>>>> pretty good score. But the data is far less complete than data on the
>>>>> Austrian page.
>>>>> Brazil only offers a simple list of impacts on carbondioxid emissions
>>>>> by cutting rainforest ...
>>>>>
>>>>> How can we ensure that country results are really comparable?
>>>>>
>>>>> Daniela
>>>>>
>>>>>
>>>>> 2013/10/1 Christian Villum <christian.villum at okfn.org>
>>>>>
>>>>>> Thanks Pierre, this is really valuable feedback. We're discussing the
>>>>>> scoring system right now and will definitely take this into consideration.
>>>>>> Any other feedback from list members on this topic will be warmly
>>>>>> embraced as well.
>>>>>>
>>>>>> -Christian
>>>>>>
>>>>>> --
>>>>>>
>>>>>> Christian Villum
>>>>>>
>>>>>> Community Manager, Open Government Data + Local Groups Network
>>>>>> skype: christianvillum  |  @villum <http://www.twitter.com/villum>
>>>>>> The Open Knowledge Foundation <http://okfn.org/>
>>>>>> *Empowering through Open Knowledge
>>>>>> *http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on
>>>>>> Facebook <https://www.facebook.com/OKFNetwork>  |  Blog<http://blog.okfn.org/> |
>>>>>> Newsletter <http://okfn.org/about/newsletter>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Tue, Oct 1, 2013 at 2:39 PM, Pierre Chrzanowski <
>>>>>> pierre.chrzanowski at gmail.com> wrote:
>>>>>>
>>>>>>> Hi All, I already got some feedbacks about the new census results
>>>>>>> and most of the time people are quite surprised with the total score and
>>>>>>> position of France. I think the fact that France (whose most of datasets
>>>>>>> are openly licensed) and China (whose datasets are not open) share almost
>>>>>>> the same score is one of the main reasons.
>>>>>>>
>>>>>>> I already expressed my concerns to Christian that the scoring system
>>>>>>> could be misleading, or even irrelevant.
>>>>>>> And regarding the first feedbacks I got, I must say I am now quite
>>>>>>> sure it is misleading ;)
>>>>>>>
>>>>>>> Then, I would suggest to :
>>>>>>>
>>>>>>> 1/ remove the actual score which does not reflect openess of
>>>>>>> datasets in the countries
>>>>>>>
>>>>>>> and
>>>>>>>
>>>>>>> 2/ create a scoring system that really value openess (i.e score 0 if
>>>>>>> dataset not open)
>>>>>>>
>>>>>>> That being said, I am also wondering if it would not be better not
>>>>>>> have a score at all ...
>>>>>>>
>>>>>>> What do you think ?
>>>>>>>
>>>>>>> I found a discussion on the scoring calculation methodology and how
>>>>>>> it has evolved here
>>>>>>> https://github.com/okfn/opendatacensus/issues/33?source=cc
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Fri, Aug 23, 2013 at 12:49 PM, Christian Villum <
>>>>>>> christian.villum at okfn.org> wrote:
>>>>>>>
>>>>>>>> Dear Tatyana,
>>>>>>>>
>>>>>>>> Thank you for offering to help, we will definitely be explaining
>>>>>>>> the methodology on the site as part of the coming updates.
>>>>>>>> We'll also look into the EXMO tool, thanks for the tip.
>>>>>>>>
>>>>>>>> Let's stay in touch!
>>>>>>>>
>>>>>>>> -Christian
>>>>>>>>
>>>>>>>> --
>>>>>>>>
>>>>>>>> Christian Villum
>>>>>>>>
>>>>>>>> Community Manager, Open Government Data + Local Groups Network
>>>>>>>> skype: christianvillum  |  @villum <http://www.twitter.com/villum>
>>>>>>>>
>>>>>>>> The Open Knowledge Foundation <http://okfn.org/>
>>>>>>>> *Empowering through Open Knowledge
>>>>>>>> *http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on
>>>>>>>> Facebook <https://www.facebook.com/OKFNetwork>  |  Blog<http://blog.okfn.org/> |
>>>>>>>> Newsletter <http://okfn.org/about/newsletter>
>>>>>>>>
>>>>>>>> *Have you registered for OKCon 2013 <http://okcon.org/>?*
>>>>>>>>
>>>>>>>>
>>>>>>>> On Wed, Aug 21, 2013 at 11:49 AM, Tatyana Tolsteneva <
>>>>>>>> tatyanatolsteneva at gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Dear Rufus,
>>>>>>>>>
>>>>>>>>> thanks a lot for your respond.
>>>>>>>>> I would like suggest to join to the idea of developing and
>>>>>>>>> publishing full methodology of the Census.
>>>>>>>>> We in the Freedom of Information Foundation (Russia) have already
>>>>>>>>> done tis job for our monitoring (please see our methodology on our web-site
>>>>>>>>> in English http://www.svobodainfo.org/en/node/1014).
>>>>>>>>> We would be happy to provide translation support and translate the
>>>>>>>>> Census methodology in Russian.
>>>>>>>>>
>>>>>>>>> Also we would be pleasant to offer you our ICT monitoring tool -
>>>>>>>>> EXMO system, specially developed for government web-sites monitoring.
>>>>>>>>> Please find the article about EXMO work here (in English)
>>>>>>>>> http://www.svobodainfo.org/en/node/2162
>>>>>>>>> Just note, that unique quantity of EXMO is it's interaction part,
>>>>>>>>> which allows not only measure government openness level, but also improve
>>>>>>>>> it via internet communication with officials.
>>>>>>>>>
>>>>>>>>>  Yours sincerely,
>>>>>>>>>
>>>>>>>>> Tatyana Tolsteneva
>>>>>>>>> Development manager
>>>>>>>>> tatyana.tolsteneva at svobodainfo.org
>>>>>>>>>
>>>>>>>>> Freedom of Information Foundation
>>>>>>>>> (formerly known as Institute for Information Freedom Development)
>>>>>>>>> P.O. Box 527, St.-Petersburg, 192007, Russia
>>>>>>>>> Phone:  +7 812 766-03-66
>>>>>>>>> Fax: +7 812 766-52-61
>>>>>>>>> Email: info at svobodainfo.org <info at svobodainfo.org>
>>>>>>>>> www.svobodainfo.org
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> 01.08.2013, в 14:06, Rufus Pollock написал(а):
>>>>>>>>>
>>>>>>>>> On 1 August 2013 10:24, Tatyana Tolsteneva <
>>>>>>>>> tatyanatolsteneva at gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> Dear Rufus,
>>>>>>>>>>
>>>>>>>>>> thanks a lot for your explanation, i have already found it here
>>>>>>>>>> https://github.com/okfn/opendatacensus/issues/33.
>>>>>>>>>> Please take my apologies for "OKNF", it was just a misprint.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> No worries :-) (Just making sure not a confusion as opposed to
>>>>>>>>> typo!)
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>> Here in Russia the Census it considered to be most authoritative
>>>>>>>>>> comparative study of open data around the world. And here we really feel
>>>>>>>>>> some lack of official information about the Census methodology.
>>>>>>>>>> It seems, this problem could be solved by official publication
>>>>>>>>>> of the methodology on the Census website.
>>>>>>>>>> Could it be possible? What do you think about the methodology
>>>>>>>>>> publication?
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Yes this is a very good idea and we'll get moving on this right
>>>>>>>>> away. Any suggestions for specific things to include or language are very
>>>>>>>>> welcome!
>>>>>>>>>
>>>>>>>>> Rufus
>>>>>>>>>
>>>>>>>>> Yours sincerely,
>>>>>>>>>>
>>>>>>>>>> Tatyana Tolsteneva
>>>>>>>>>> Development manager
>>>>>>>>>> tatyana.tolsteneva at svobodainfo.org
>>>>>>>>>>
>>>>>>>>>> Freedom of Information Foundation
>>>>>>>>>> (formerly known as Institute for Information Freedom Development)
>>>>>>>>>> P.O. Box 527, St.-Petersburg, 192007, Russia
>>>>>>>>>> Phone:  +7 812 766-03-66
>>>>>>>>>> Fax: +7 812 766-52-61
>>>>>>>>>> Email: info at svobodainfo.org <info at svobodainfo.org>
>>>>>>>>>> www.svobodainfo.org
>>>>>>>>>>
>>>>>>>>>> 31.07.2013, в 22:28, Rufus Pollock написал(а):
>>>>>>>>>>
>>>>>>>>>> [changing mailing list from okfn-discuss to open-data-census]
>>>>>>>>>>
>>>>>>>>>> On 23 July 2013 12:06, Tatyana Tolsteneva <
>>>>>>>>>> tatyanatolsteneva at gmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> Dear colleagues,
>>>>>>>>>>> my name is Tatyana and i'm a development manager of the Freedom
>>>>>>>>>>> of Information Foundation - Russian FOI-advocasy NGO based in St.
>>>>>>>>>>> Petersburg.
>>>>>>>>>>> I'm interested in the OKNF Open Data Census scoring system
>>>>>>>>>>> because i can't catch it's idea of it http://census.okfn.org/G8/
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> OKFN (Open Knowledge Foundation (Network))
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>> At first i had a hypothesis, that each "yes" costs 1 poin and
>>>>>>>>>>> points just should to be summarized.
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> That's almost the case but not quite: whether data is up to date
>>>>>>>>>> does not count towards the total score.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>> This idea has been perfect, if maximum for all questions would
>>>>>>>>>>> have been 7.
>>>>>>>>>>> But we have 6 as maximum.
>>>>>>>>>>> So my question is about "data existence" column
>>>>>>>>>>>
>>>>>>>>>> IN case all  "yes" should cost 1 points, it should be 7 as
>>>>>>>>>>> maximum.
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> See above.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>> Form the table http://census.okfn.org/G8/ i can see that some
>>>>>>>>>>> times "yes" per "data existence" is taken into the account.
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> It should be always taken into account.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>> Fo example,  Transport timetable is Russia, Government spending
>>>>>>>>>>> is France and in Italy.
>>>>>>>>>>> But in the majority of cases YES per "data existence" is not
>>>>>>>>>>> included into the account. For example Zip-codes Russia
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> It is included there - it's up to date that is not included.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>> And speaking about Russian case, company register for Russia
>>>>>>>>>>>  has 2/6 and Transport timetable has 2/6, but Company register is up to
>>>>>>>>>>> date and Transport timetable is not.
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> See above.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>> Would you be so kind to explain this scoring and situation with
>>>>>>>>>>> points for "data existence" and i woul be specially glad for explaining in
>>>>>>>>>>> the context of the Russian score.
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Hope the above clarifies things. Also thanks for asking as your
>>>>>>>>>> questions will encourage us to put up further documentation on the website!
>>>>>>>>>>
>>>>>>>>>> Rufus
>>>>>>>>>>  *
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> *
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> *
>>>>>>>>> Rufus Pollock
>>>>>>>>> Founder and Executive Director | skype: rufuspollock |
>>>>>>>>> @rufuspollock <https://twitter.com/rufuspollock>
>>>>>>>>> The Open Knowledge Foundation <http://okfn.org/>
>>>>>>>>> Empowering through Open Knowledge
>>>>>>>>> http://okfn.org/ | @okfn <http://twitter.com/OKFN> | OKF on
>>>>>>>>> Facebook <https://www.facebook.com/OKFNetwork> |  Blog<http://blog.okfn.org/> |
>>>>>>>>> Newsletter <http://okfn.org/about/newsletter>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> *
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> _______________________________________________
>>>>>>>>> Open-data-census mailing list
>>>>>>>>> Open-data-census at lists.okfn.org
>>>>>>>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> Open-data-census mailing list
>>>>>>>> Open-data-census at lists.okfn.org
>>>>>>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> *Pierre Chrzanowski*
>>>>>>> *Open Knowledge Foundation France*
>>>>>>>
>>>>>>> Mail: pierre.chrzanowski at gmail.com
>>>>>>> Mobile: +33 (0)7 855 71 292 | Skype: pierre.chrzanowski | Twitter:
>>>>>>> @piezanowski <https://twitter.com/piezanowski>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Open-data-census mailing list
>>>>>> Open-data-census at lists.okfn.org
>>>>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Daniela Mattern
>>>>> Coordenadora Geral
>>>>> IT3S - Instituto de Fomento à Tecnologia do Terceiro Setor
>>>>> Fone: 0055-11-36285787
>>>>> Celular: 0055-11-987 356 563
>>>>>
>>>>> Siga nosso Twitter <https://twitter.com/#%21/it3s> | Acompanhe nosso
>>>>> Facebook <http://www.facebook.com/IT3S.org>
>>>>> prestandocontas.org
>>>>> maps.mootiro.org <http://mootiro.org>
>>>>> it3s.org
>>>>>
>>>>> _______________________________________________
>>>>> Open-data-census mailing list
>>>>> Open-data-census at lists.okfn.org
>>>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> *
>>>>
>>>> Rufus Pollock
>>>>
>>>> Founder and Executive Director | skype: rufuspollock | @rufuspollock<https://twitter.com/rufuspollock>
>>>>
>>>> The Open Knowledge Foundation <http://okfn.org/>
>>>>
>>>> Empowering through Open Knowledge
>>>> http://okfn.org/ | @okfn <http://twitter.com/OKFN> | OKF on Facebook<https://www.facebook.com/OKFNetwork>|
>>>> Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>
>>>>
>>>> *
>>>>
>>>> _______________________________________________
>>>> Open-data-census mailing list
>>>> Open-data-census at lists.okfn.org
>>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>>
>>>>
>>>
>>>
>>> --
>>> Tracey P. Lauriault
>>> http://traceyplauriault.wordpress.com/2013/07/23/moving-to-ireland/
>>> https://gcrc.carleton.ca/confluence/display/GCRCWEB/Lauriault
>>> http://datalibre.ca/
>>>
>>> _______________________________________________
>>> Open-data-census mailing list
>>> Open-data-census at lists.okfn.org
>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>
>>>
>>
>
>
> --
> Tracey P. Lauriault
> http://traceyplauriault.wordpress.com/2013/07/23/moving-to-ireland/
> https://gcrc.carleton.ca/confluence/display/GCRCWEB/Lauriault
> http://datalibre.ca/
>

-- 
Daniela Mattern
Coordenadora Geral
IT3S - Instituto de Fomento à Tecnologia do Terceiro Setor
Fone: 0055-11-36285787
Celular: 0055-11-987 356 563

Siga nosso Twitter <https://twitter.com/#%21/it3s> | Acompanhe nosso
Facebook <http://www.facebook.com/IT3S.org>
prestandocontas.org
maps.mootiro.org <http://mootiro.org>
it3s.org
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/open-data-census/attachments/20131001/15d2c09e/attachment-0001.htm>