[okfn-labs] Not browserfarm
rufus.pollock at okfn.org
Tue Aug 19 11:52:09 UTC 2014
As I understand it you are especially interested in "distributed scraping"
- is that right?
This definitely a nice (and classic) problem - I know Friedrich did
something with "flockscrape" (
https://pypi.python.org/pypi/flockscrape-client) a while back and
BrowserFarm (which never real got beyond the ideas stage) was about
distributed processing and scraping using the browser as the platform.
On 18 August 2014 11:39, Thomas Levine <_ at thomaslevine.com> wrote:
> I've been working on getting information from Delaware,
> which might involve getting around rate limits based on
> IP addresses.
> Rufus thinks some of you might take interest.
> okfn-labs mailing list
> okfn-labs at lists.okfn.org
> Unsubscribe: https://lists.okfn.org/mailman/options/okfn-labs
*Rufus PollockFounder and President | skype: rufuspollock | @rufuspollock
<https://twitter.com/rufuspollock>Open Knowledge <http://okfn.org/> - see
how data can change the world**http://okfn.org/ <http://okfn.org/> | @okfn
<http://twitter.com/OKFN> | Open Knowledge on Facebook
<https://www.facebook.com/OKFNetwork> | Blog <http://blog.okfn.org/>*
The Open Knowledge Foundation is a not-for-profit organisation. It is
incorporated in England & Wales as a company limited by guarantee, with
company number 05133759. VAT Registration № GB 984404989. Registered
office address: Open Knowledge Foundation, St John’s Innovation Centre,
Cowley Road, Cambridge, CB4 0WS, UK.
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the okfn-labs