[open-bibliography] Wikipedia project: bibliographic-archival data base

Karen Coyle kcoyle at kcoyle.net
Tue Sep 13 18:41:48 UTC 2011

Quoting Jim Pitman <pitman at stat.Berkeley.EDU>:

> It is wrong to call data open if it is subject to arbitary access  
> restrictions like 3K entries a day.

Access restrictions of this nature generally are not related to  
openness but to system load. Nearly every system that has powerful  
APIs implements some limits to keep API requests from bringing down  
the system. It's a common courtesy to make contact with system folks  
if you are considering doing something that might put a load on their  
system, like downloading large amounts of data. I've watched many  
systems teams negotiate frequencies (one-second intervals) or times  
(over-night) to help users get what they need without damaging the  
service to others. Another option is for systems that anticipate  
frequent requests for "everything" to provide dumps. I see a lot of  
willingness to accommodate a variety of needs on the part of users.


Karen Coyle
kcoyle at kcoyle.net http://kcoyle.net
ph: 1-510-540-7596
m: 1-510-435-8234
skype: kcoylenet

More information about the open-bibliography mailing list