[okfn-labs] Reactive Scraper <-> Datahub

Wed May 30 15:48:01 UTC 2012

Hi Duke,

Sorry for delay here! I'm going to write in more detail but my basic
idea is that we boot some kind of iframe with the login for the
DataHub and then ask people to copy across their API key and then we
store that in local storage or a cookie.

Rufus

On 22 May 2012 11:50, Duke Khaos <duke.m16 at gmail.com> wrote:
> Hello Rufus, moving to okfn-labs
>
> Hello everybody,
> Reactive Scraper[1][2] is a easy way to scrape data with javascript, using
> jQuery, and share it. I am trying integrate it with datahub, and need help
> to do it.
>
> I think the user should config database, resource and api_key, if database
> and resource there isn't  in datahub need create it. I think is a good point
> the user can change the endpoint and the default value be "datahub.io"
>
> Duke
>
> [1] http://reactivescraper.herokuapp.com/
> [2] https://github.com/okfn-br/reactive_scraper
>
>
> On Mon, May 21, 2012 at 5:41 AM, Rufus Pollock <rufus.pollock at okfn.org>
> wrote:
>>
>> As per other mail I'd love to move this conversation to
>> okfn-labs at lists.okfn.org. Let me know if that is OK with you! More
>> comments below.
>>
>> On 21 May 2012 05:44, Duke Khaos <duke.m16 at gmail.com> wrote:
>> > Hey Rufus,
>> > I started the code to reactivescraper works with datahub,
>> > but I know  very well how CKAN work, but I think was more easy share
>> > data to
>> > datahub,
>> > I will need create a way to reactive scraper user config the scraper
>> > with
>> > apikey, dataset and resource id, right?
>> > like it:
>> >
>> > datahub.config = {
>> >     dataset: "mydatasetX",
>> >     api_key: "PUTMYAPIKEYHERE",
>> > };
>>
>> That's right -- though you may want to select the dataset on a
>> scrape-by-scrape basis while the api key will be the same always.
>>
>> I've been thinking about how to allow users to get this info easily
>> from the DataHub recently for Recline so this is something I can help
>> with.
>>
>> > What you think about it? I am going to the correct way?
>>
>> I think so.
>>
>> Rufus
>
>

-- 
Co-Founder, Open Knowledge Foundation
Promoting Open Knowledge in a Digital Age
http://www.okfn.org/ - http://blog.okfn.org/