[open-bibliography] Using IsItOpenData to get information about licensing policies

Wed Mar 16 16:46:40 UTC 2011

My main caution about pooling bulk exports is the issue of updates.  
First, there is the need to have up-to-date bulk files on some kind of  
regular basis. This is sometimes burdensome for the data providers.  
Second, for consumers of the data it is often desirable to get  
incremental updates. If you have added the data to some system or  
function of your own you do not want to receive the entire file in  
order to add new or updated data.

I realize that many of the bulk files being produced today can be  
considered experimental in nature, but if we are to move into  
production mode for any of the data this update issue must be addressed.

kc

Quoting Jim Pitman <pitman at stat.Berkeley.EDU>:

> In the same vein, I have started a correspondence with Mendeley,  
> which has not got far yet,
> about access to their data through their API http://dev.mendeley.com/
> According to  http://dev.mendeley.com/docs/license
> "All data from the Mendeley API is made available under a Creative  
> Commons Attribution 3.0 Unported License for commercial and  
> non-commercial derivations."
> Worth listing on CKAN  I think. But we dont yet have bulk access.
> Anyone else been in touch with Mendeley on this issue?
>
> One possibility would be for a number of agents to extract subsets  
> of Mendeley data they cared about and to pool these
> subsets in an OKFN supported data store.
> This is a general possibility, whenever a data provider provides an  
> open API but is unwilling to support their own bulk store.
> We can consider one store for multiple data sources,  much as Thomas  
> Krichel provides at http://3lib.org/
> Can we estimate the cost of OKFN maintaining such a store on various  
> scales with various levels of service?
>
> --Jim
> ------------------------------------
>
> Rufus Pollock <rufus.pollock at okfn.org> wrote:
>
>> On 8 March 2011 09:20, ianibbo at gmail.com <ianibbo at gmail.com> wrote:
>> >> For me it satisfies the Open Definition. I believe that it does  
>> not qualify
>> >> for CKAN because you cannot "get all the data at once" but this is an
>> >> additional CKAN restriction, not an OKD one.
>>
>> This is incorrect. The http://opendefinition.org/okd/ states:
>>
>> <quote>
>> The work shall be available as a whole and at no more than a
>> reasonable reproduction cost, preferably downloading via the Internet
>> without charge. The work must also be available in a convenient and
>> modifiable form.
>> </quote>
>>
>> Hence the 'bulk' ("as a whole") requirement is in the Open Definition.
>>
>> > I've certainly added OAI (And other streaming protocol) based datasets
>> > to CKAN, wasn't aware of any restriction. I just used the base URL of
>> > the OAI server. Is this an official line? If so it needs to be
>> > challenged and changed (IMNSHO).
>>
>> There's no restriction regarding what you register on CKAN - in
>> particular there is no requirement to only register Open Definition
>> compliant datasets. That said, obviously we do highlight (in a variety
>> of ways) those datasets that are open and I don't think we want
>> datasets that will always remain closed, and especially those datasets
>> that are clearly 'paid-access-only'.
>>
>> Rufus
>>
>> > cheers,
>> > Ian.
>> >
>> > _______________________________________________
>> > open-bibliography mailing list
>> > open-bibliography at lists.okfn.org
>> > http://lists.okfn.org/mailman/listinfo/open-bibliography
>> >
>>
>>
>>
>> --
>> Co-Founder, Open Knowledge Foundation
>> Promoting Open Knowledge in a Digital Age
>> http://www.okfn.org/ - http://blog.okfn.org/
>>
>> _______________________________________________
>> open-bibliography mailing list
>> open-bibliography at lists.okfn.org
>> http://lists.okfn.org/mailman/listinfo/open-bibliography
>
> _______________________________________________
> open-bibliography mailing list
> open-bibliography at lists.okfn.org
> http://lists.okfn.org/mailman/listinfo/open-bibliography
>

-- 
Karen Coyle
kcoyle at kcoyle.net http://kcoyle.net
ph: 1-510-540-7596
m: 1-510-435-8234
skype: kcoylenet