[ckan-dev] Thoughts on realtime data

Mon Oct 21 09:19:40 UTC 2013

Hi Henrik,

Others may have more informed advice, but some thoughts:

1. The Orbital project [1] did some work with an engineering project
with a dataset of sensor data, using the Datastore API to add rows at
particular time intervals.

2. This might be a better bet than adding a new CSV resource every 5
minutes, which will mean the URL for the data keeps changing.

I don't think much work has been done on using CKAN with real-time
data (perhaps others will correct me) so it would be great if you
updated the list with your thoughts/findings.

Regards,

Mark

[1] orbital.blogs.lincoln.ac.uk

On 16/10/2013, Henrik Aagaard Sørensen <BU1G at tmf.kk.dk> wrote:
> I'm trying to implement realtime data in CKAN from a SQL server.
>
> I've thought of various strategies, such as creating a CSV-file every 5
> minute or so and upload it to CKAN or perhaps using the DataStore to add new
> records every 5 minutes.
>
> Does anyone else have experience with such "challenge" as every thought,
> idea etc. would be very welcomed.
>
>

-- 
Business development and user engagement manager
The Open Knowledge Foundation
Empowering through Open Knowledge
http://okfn.org/  |  @okfn  |  http://ckan.org  |  @CKANproject