[okfn-labs] Not browserfarm

Tue Aug 19 11:52:09 UTC 2014

As I understand it you are especially interested in "distributed scraping"
- is that right?

This definitely a nice (and classic) problem - I know Friedrich did
something with "flockscrape" (
https://pypi.python.org/pypi/flockscrape-client) a while back and
BrowserFarm (which never real got beyond the ideas stage) was about
distributed processing and scraping using the browser as the platform.

Rufus

On 18 August 2014 11:39, Thomas Levine <_ at thomaslevine.com> wrote:

> I've been working on getting information from Delaware,
> which might involve getting around rate limits based on
> IP addresses.
> http://thomaslevine.com/dada/delaware/
>
> Rufus thinks some of you might take interest.
> _______________________________________________
> okfn-labs mailing list
> okfn-labs at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/okfn-labs
> Unsubscribe: https://lists.okfn.org/mailman/options/okfn-labs
>

-- 

*Rufus PollockFounder and President | skype: rufuspollock | @rufuspollock
<https://twitter.com/rufuspollock>Open Knowledge <http://okfn.org/> - see
how data can change the world**http://okfn.org/ <http://okfn.org/> | @okfn
<http://twitter.com/OKFN> | Open Knowledge on Facebook
<https://www.facebook.com/OKFNetwork> |  Blog <http://blog.okfn.org/>*

The Open Knowledge Foundation is a not-for-profit organisation.  It is
incorporated in England & Wales as a company limited by guarantee, with
company number 05133759.  VAT Registration № GB 984404989. Registered
office address: Open Knowledge Foundation, St John’s Innovation Centre,
Cowley Road, Cambridge, CB4 0WS, UK.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/okfn-labs/attachments/20140819/f047f481/attachment-0004.html>