[okfn-labs] Github webhooks and automating creating Data APIs for data packages in Github

Wed Mar 19 16:51:20 UTC 2014

Hi

2014-03-19 13:35 GMT+01:00 Rufus Pollock <rufus.pollock at okfn.org>:

> Hi All,
>
> I have a User Story as follows:
>
>  As a Data Wrangler (Rufus!) I want to push my tabular data package to
> github and have it automatically have a Data API for that data package
> created/updated so that I have a nice API I can use in my app (or JS
> visualization or ...)
>
> *Context*
>
> I'm currently really liking the work flow of pushing Data Packaged
> Datasets to Github (see growing set of "Core" datasets at
> https://github.com/datasets plus personal ones like hard drive prices<https://github.com/rgrp/hard-drive-prices>).
> However, it would be really nice to get a proper Data API. CKAN, and hence
> the DataHub <http://datahub.io/>, now has a nice DataStore with a rich
> Data API <http://docs.ckan.org/en/latest/maintaining/datastore.html> which
> we could use. There is even a nice standalone webapp for automatically
> pulling data into the DataStore - https://github.com/ckan/datapusher
>
> (Note: this would also address the Data API issue in the Frictionless
> Data roadmap <http://data.okfn.org/roadmap>)
>
> *Plan*
>
> Rather than create a new Data API webapp I thought the best thing would be
> create a small webapp that a github webhook can connect to. The app will
> take care of then pushing the updated data to the DataStore.
>
> *Question*
>
> *A. *Does this sound sensible
>

Ofcourse, it make sense , many datapackages are stored into git ,
and wait to be uploaded automatically to DataStore Instance
https://github.com/aliounedia/bce-data,
https://github.com/senegalouvert/data
--Ad

>
> *B. *Do folks have any thoughs and experience on build github webhook
> apps (especially in nodejs or python)
>

No , but I will be happy to help to have it up in my dead time!

>
> All the best,
>
> Rufus
>
>
> _______________________________________________
> okfn-labs mailing list
> okfn-labs at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/okfn-labs
> Unsubscribe: https://lists.okfn.org/mailman/options/okfn-labs
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/okfn-labs/attachments/20140319/74106902/attachment-0004.html>