[ckan-discuss] Mining other catalogues for packages

[Tim McNamara]

I apologise if this is documented somewhere. What is the process for
creating a script which can be run as a cron job, which will automatically
update current packages as they are amended or create new ones as they are
found in external catalogues?

I think it might be sensible to use a public service like ScraperWiki to
extract the content, then grab the content from there in a structured
manner. That would allow other people to contribute to the scrapers when
they break.


Tim
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-discuss/attachments/20110522/fecbc174/attachment.htm>