[ckan-dev] [ckan-discuss] DataStore

[Dominik Moritz]

Hey,

Yes, the DataStore only offers an API and it should be easy to build an interface in front of it if that is needed. You could also extend the DataStore Recline Backend [1] to support writing. Another interface could come from htsql [2] for which I have already written a plugin [3]. However, at the moment only the query language is supported but not the interface. 

Dominik

[1] http://reclinejs.com/docs/backends.html
[2] http://htsql.org/
[3] https://github.com/okfn/ckanext-htsql

On 6 Sep 2013, at 07:41, Pabitra Dash <pkdash_reena at hotmail.com> wrote:

> 
> Thanks Dominik for providing this information on DataStore. Now I understand how the DataStore is used in CKAN. Initially I was thinking that I would be able to type my query through the CKAN web UI and see the results right there similar to how it is done at mingle.io.  I guess since the DataStore has an API it may not be too hard to build such functionality for our project.
> 
> Pabitra
> 
> 
> 
>> Subject: Re: [ckan-discuss] DataStore
>> From: dominik.moritz at okfn.org
>> Date: Thu, 5 Sep 2013 22:08:34 -0700
>> CC: ckan-dev at lists.okfn.org
>> To: pkdash_reena at hotmail.com
>> 
>> Hi Pabitra,
>> 
>> One example would be this resource [1]. It has a table in the datastore which you can see because on the resource page there is a "Data API" Button. To see the first 5 records of this dataset, you can go to [2]. 
>> 
>> If you upload your own dataset, it can take a few minutes to an hour before the file is downloaded and parsed into the datastore. Also, keep in mind that not all files can be parsed and that you have to set the correct file type (usually csv or xls). 
>> 
>> Cheers,
>> Dominik
>> 
>> [1] http://demo.ckan.org/dataset/building-permits/resource/fc39faf3-dea0-49c1-99e1-ecfa94e8705b
>> [2] http://demo.ckan.org/api/action/datastore_search?resource_id=fc39faf3-dea0-49c1-99e1-ecfa94e8705b&limit=5
>> 
>> On 3 Sep 2013, at 21:54, Pabitra Dash <pkdash_reena at hotmail.com> wrote:
>> 
>>> 
>>> 
>>> Hi Dominik,
>>> 
>>> Thanks for providing this information related to datastore.  I tried to use the demo.ckan.org site to see datastore functionality. However, I am not seeing anything different on this site compared to the site I have where datastore is not enabled. Certainly I am missing something here. How do I create a datastore resource. I tried to create a new dataset and uploaded a csv file. I thought somehow I should be able to query the data in this csv file. But I didn't find anyway to do that.
>>> 
>>> Need your help on this.
>>> 
>>> Thanks,
>>> Pabitra
>>> 
>>>> Subject: Re: [ckan-discuss] DataStore
>>>> From: dominik.moritz at okfn.org
>>>> Date: Tue, 3 Sep 2013 12:25:04 -0700
>>>> CC: ckan-discuss at lists.okfn.org
>>>> To: pkdash_reena at hotmail.com
>>>> 
>>>> Hi Pabitra,
>>>> 
>>>> You can go to http://demo.ckan.org/, which has the datastore enabled and play with it (create your own datastore resource). If you need a list of datasets that already have existing datastore tables, go to [1].
>>>> 
>>>> Cheers,
>>>> Dominik
>>>> 
>>>> [1] http://demo.ckan.org/api/action/datastore_search?resource_id=_table_metadata
>>>> 
>>>> 
>>>> On 3 Sep 2013, at 07:27, Pabitra Dash <pkdash_reena at hotmail.com> wrote:
>>>> 
>>>>> Hello Everyone,
>>>>> 
>>>>> I am very keen on learning about DataStore capabilities. We have a huge need for data subsetting from large data files of various format types. I was wondering if anyone can point me to one or more CKAN based sites where I can see/experience DataStore functionalities.
>>>>> 
>>>>> Thanks,
>>>>> Pabitra
>>>>> 
>>>>> 		 	   		  _______________________________________________
>>>>> ckan-discuss mailing list
>>>>> ckan-discuss at lists.okfn.org
>>>>> http://lists.okfn.org/mailman/listinfo/ckan-discuss
>>>>> Unsubscribe: http://lists.okfn.org/mailman/options/ckan-discuss
>>>> 
>>>> Dominik Moritz
>>>> CKAN developer  |  skype: d.moritz  |  @doobly_doo
>>>> The Open Knowledge Foundation
>>>> Empowering through Open Knowledge
>>>> http://okfn.org/  |  @okfn  |  http://ckan.org  |  @CKANproject
>>>> 
>>> 		 	   		  
>> 
>> Dominik Moritz
>> CKAN developer  |  skype: d.moritz  |  @doobly_doo
>> The Open Knowledge Foundation
>> Empowering through Open Knowledge
>> http://okfn.org/  |  @okfn  |  http://ckan.org  |  @CKANproject
>> 
> 		 	   		  

Dominik Moritz
CKAN developer  |  skype: d.moritz  |  @doobly_doo
The Open Knowledge Foundation
Empowering through Open Knowledge
http://okfn.org/  |  @okfn  |  http://ckan.org  |  @CKANproject

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 495 bytes
Desc: Message signed with OpenPGP using GPGMail
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20130906/fbadf757/attachment-0001.sig>