[Open-data-census] [okfn-discuss] A question about the Open Data census scoring system

Tue Oct 8 14:33:02 BST 2013

Hi Tatyana,

The new scoring is as described in the FAQ and supersedes the old scoring
system. The score algorithm is:

1. If answer is yes to a question at the weighting value to score for that
dataset
2. Add up total scores for each dataset to get a country score

As the weightings indicate timeliness is now included with a weighting of
10.

All the best,

Rufus

On 7 October 2013 15:53, Tatyana Tolsteneva <
tatyana.tolsteneva at svobodainfo.org> wrote:

> Dear colleagues,
> let me please ask you about the Census's results calculation system.
> I have found the table with scoring system at the FAQ page
> http://2013.census.okfn.org/faq/ and have found some explanation:
> "The Open Data Census measures the state of openness of 10 data sets for
> each country. The overall score for a dataset is based on the response to
> specific questions with varying weightings - the weighting for each
> question is listed in the question table above. The overall country score
> is then calculated from the score on each dataset."
> But as far as i can see from the main Census page
> http://2013.census.okfn.org/country/ <http://2013.census.okfn.org/country/> the
> "up to date" score is still excluded form the calculation system as it was
> explained here https://github.com/okfn/opendatacensus/issues/33?source=cc.
> On the main Census page there is no special green/yellow/red mark for "up
> to date" (actually we have 9 questions for each dataset, but only 8
>  green/yellow/red marks for answers)
> Would you be so kind to help me with any explanation of the Census's  results
> calculation?
> Thanks in advance!
>
> Yours sincerely,
>
> Tatyana Tolsteneva
> Development manager
> tatyana.tolsteneva at svobodainfo.org
>
> Freedom of Information Foundation
> (formerly known as Institute for Information Freedom Development)
> P.O. Box 527, St.-Petersburg, 192007, Russia
> Phone:  +7 812 766-03-66
> Fax: +7 812 766-52-61
> Email: info at svobodainfo.org <info at svobodainfo.org>
> www.svobodainfo.org
>
>
>
> 01.10.2013, в 16:39, Pierre Chrzanowski написал(а):
>
> Hi All, I already got some feedbacks about the new census results and most
> of the time people are quite surprised with the total score and position of
> France. I think the fact that France (whose most of datasets are openly
> licensed) and China (whose datasets are not open) share almost the same
> score is one of the main reasons.
>
> I already expressed my concerns to Christian that the scoring system could
> be misleading, or even irrelevant.
> And regarding the first feedbacks I got, I must say I am now quite sure it
> is misleading ;)
>
> Then, I would suggest to :
>
> 1/ remove the actual score which does not reflect openess of datasets in
> the countries
>
> and
>
> 2/ create a scoring system that really value openess (i.e score 0 if
> dataset not open)
>
> That being said, I am also wondering if it would not be better not have a
> score at all ...
>
> What do you think ?
>
> I found a discussion on the scoring calculation methodology and how it has
> evolved here https://github.com/okfn/opendatacensus/issues/33?source=cc
>
>
>
> On Fri, Aug 23, 2013 at 12:49 PM, Christian Villum <
> christian.villum at okfn.org> wrote:
>
>> Dear Tatyana,
>>
>> Thank you for offering to help, we will definitely be explaining the
>> methodology on the site as part of the coming updates.
>> We'll also look into the EXMO tool, thanks for the tip.
>>
>> Let's stay in touch!
>>
>> -Christian
>>
>> --
>>
>> Christian Villum
>>
>> Community Manager, Open Government Data + Local Groups Network
>> skype: christianvillum  |  @villum <http://www.twitter.com/villum>
>>
>> The Open Knowledge Foundation <http://okfn.org/>
>> *Empowering through Open Knowledge
>> *http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on Facebook<https://www.facebook.com/OKFNetwork> |
>> Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>
>>
>> *Have you registered for OKCon 2013 <http://okcon.org/>?*
>>
>>
>> On Wed, Aug 21, 2013 at 11:49 AM, Tatyana Tolsteneva <
>> tatyanatolsteneva at gmail.com> wrote:
>>
>>> Dear Rufus,
>>>
>>> thanks a lot for your respond.
>>> I would like suggest to join to the idea of developing and publishing
>>> full methodology of the Census.
>>> We in the Freedom of Information Foundation (Russia) have already done
>>> tis job for our monitoring (please see our methodology on our web-site in
>>> English http://www.svobodainfo.org/en/node/1014).
>>> We would be happy to provide translation support and translate the
>>> Census methodology in Russian.
>>>
>>> Also we would be pleasant to offer you our ICT monitoring tool - EXMO
>>> system, specially developed for government web-sites monitoring. Please
>>> find the article about EXMO work here (in English)
>>> http://www.svobodainfo.org/en/node/2162
>>> Just note, that unique quantity of EXMO is it's interaction part, which
>>> allows not only measure government openness level, but also improve it via
>>> internet communication with officials.
>>>
>>>  Yours sincerely,
>>>
>>> Tatyana Tolsteneva
>>> Development manager
>>> tatyana.tolsteneva at svobodainfo.org
>>>
>>> Freedom of Information Foundation
>>> (formerly known as Institute for Information Freedom Development)
>>> P.O. Box 527, St.-Petersburg, 192007, Russia
>>> Phone:  +7 812 766-03-66
>>> Fax: +7 812 766-52-61
>>> Email: info at svobodainfo.org <info at svobodainfo.org>
>>> www.svobodainfo.org
>>>
>>>
>>> 01.08.2013, в 14:06, Rufus Pollock написал(а):
>>>
>>> On 1 August 2013 10:24, Tatyana Tolsteneva <tatyanatolsteneva at gmail.com>wrote:
>>>
>>>> Dear Rufus,
>>>>
>>>> thanks a lot for your explanation, i have already found it here
>>>> https://github.com/okfn/opendatacensus/issues/33.
>>>> Please take my apologies for "OKNF", it was just a misprint.
>>>>
>>>
>>> No worries :-) (Just making sure not a confusion as opposed to typo!)
>>>
>>>
>>>> Here in Russia the Census it considered to be most authoritative
>>>> comparative study of open data around the world. And here we really feel
>>>> some lack of official information about the Census methodology.
>>>> It seems, this problem could be solved by official publication of the
>>>> methodology on the Census website.
>>>> Could it be possible? What do you think about the methodology
>>>> publication?
>>>>
>>>
>>> Yes this is a very good idea and we'll get moving on this right away.
>>> Any suggestions for specific things to include or language are very welcome!
>>>
>>> Rufus
>>>
>>> Yours sincerely,
>>>>
>>>> Tatyana Tolsteneva
>>>> Development manager
>>>> tatyana.tolsteneva at svobodainfo.org
>>>>
>>>> Freedom of Information Foundation
>>>> (formerly known as Institute for Information Freedom Development)
>>>> P.O. Box 527, St.-Petersburg, 192007, Russia
>>>> Phone:  +7 812 766-03-66
>>>> Fax: +7 812 766-52-61
>>>> Email: info at svobodainfo.org <info at svobodainfo.org>
>>>> www.svobodainfo.org
>>>>
>>>> 31.07.2013, в 22:28, Rufus Pollock написал(а):
>>>>
>>>> [changing mailing list from okfn-discuss to open-data-census]
>>>>
>>>> On 23 July 2013 12:06, Tatyana Tolsteneva <tatyanatolsteneva at gmail.com>wrote:
>>>>
>>>>> Dear colleagues,
>>>>> my name is Tatyana and i'm a development manager of the Freedom of
>>>>> Information Foundation - Russian FOI-advocasy NGO based in St. Petersburg.
>>>>> I'm interested in the OKNF Open Data Census scoring system because i
>>>>> can't catch it's idea of it http://census.okfn.org/G8/
>>>>>
>>>>
>>>> OKFN (Open Knowledge Foundation (Network))
>>>>
>>>>
>>>>> At first i had a hypothesis, that each "yes" costs 1 poin and points
>>>>> just should to be summarized.
>>>>>
>>>>
>>>> That's almost the case but not quite: whether data is up to date does
>>>> not count towards the total score.
>>>>
>>>>
>>>>> This idea has been perfect, if maximum for all questions would have
>>>>> been 7.
>>>>> But we have 6 as maximum.
>>>>> So my question is about "data existence" column
>>>>>
>>>> IN case all  "yes" should cost 1 points, it should be 7 as maximum.
>>>>>
>>>>
>>>> See above.
>>>>
>>>>
>>>>> Form the table http://census.okfn.org/G8/ i can see that some
>>>>> times "yes" per "data existence" is taken into the account.
>>>>>
>>>>
>>>> It should be always taken into account.
>>>>
>>>>
>>>>> Fo example,  Transport timetable is Russia, Government spending is
>>>>> France and in Italy.
>>>>> But in the majority of cases YES per "data existence" is not included
>>>>> into the account. For example Zip-codes Russia
>>>>>
>>>>
>>>> It is included there - it's up to date that is not included.
>>>>
>>>>
>>>>> And speaking about Russian case, company register for Russia  has 2/6
>>>>> and Transport timetable has 2/6, but Company register is up to date
>>>>> and Transport timetable is not.
>>>>>
>>>>
>>>> See above.
>>>>
>>>>
>>>>> Would you be so kind to explain this scoring and situation with points
>>>>> for "data existence" and i woul be specially glad for explaining in the
>>>>> context of the Russian score.
>>>>>
>>>>
>>>> Hope the above clarifies things. Also thanks for asking as your
>>>> questions will encourage us to put up further documentation on the website!
>>>>
>>>> Rufus
>>>>  *
>>>>
>>>>
>>>> *
>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> *
>>> Rufus Pollock
>>> Founder and Executive Director | skype: rufuspollock | @rufuspollock<https://twitter.com/rufuspollock>
>>> The Open Knowledge Foundation <http://okfn.org/>
>>> Empowering through Open Knowledge
>>> http://okfn.org/ | @okfn <http://twitter.com/OKFN> | OKF on Facebook<https://www.facebook.com/OKFNetwork>|
>>> Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>
>>>
>>>
>>> *
>>>
>>>
>>>
>>> _______________________________________________
>>> Open-data-census mailing list
>>> Open-data-census at lists.okfn.org
>>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>>
>>>
>>
>> _______________________________________________
>> Open-data-census mailing list
>> Open-data-census at lists.okfn.org
>> http://lists.okfn.org/mailman/listinfo/open-data-census
>>
>>
>
>
> --
> *Pierre Chrzanowski*
> *Open Knowledge Foundation France*
>
> Mail: pierre.chrzanowski at gmail.com
> Mobile: +33 (0)7 855 71 292 | Skype: pierre.chrzanowski | Twitter:
> @piezanowski <https://twitter.com/piezanowski>
>
>
>
> _______________________________________________
> Open-data-census mailing list
> Open-data-census at lists.okfn.org
> http://lists.okfn.org/mailman/listinfo/open-data-census
>
>

-- 
*

Rufus Pollock

Founder and Executive Director | skype: rufuspollock |
@rufuspollock<https://twitter.com/rufuspollock>

The Open Knowledge Foundation <http://okfn.org/>

Empowering through Open Knowledge
http://okfn.org/ | @okfn <http://twitter.com/OKFN> | OKF on
Facebook<https://www.facebook.com/OKFNetwork>|
Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>

*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/open-data-census/attachments/20131008/2e8c4a73/attachment-0001.htm>