[openbiblio-dev] Distributed scraping using flockscrape

Rufus Pollock rufus.pollock at okfn.org
Wed Jan 19 09:45:51 UTC 2011


There was some discussion last week that we may have need for a
distributed scraping setup for a large scrape of data that we would
like to do.

Friedrich (in cc) has developed FlockScrape:

<http://flockscrape.pudo.org/>

Originally for scraping company info in Germany. Looks like this could
be useful for us.

Rufus




More information about the openbiblio-dev mailing list