[ckan-dev] Importing server-side data

[Ian Ward]

Hi Rishi

The RemoteCKAN and TestAppCKAN classes in ckanapi support file uploads
but the LocalCKAN class doesn't yet. It should be a simple change
though and the result will be passing the file object to the code that
will write it into the filestore. So, no HTTP, but the file will still
be copied once through a local process.

If that's good enough for you and you're willing to help debug, I'll
work on adding this feature.

Ian

On Mon, Mar 31, 2014 at 9:26 AM, Stéphane Guidoin <stephane at opennorth.ca> wrote:
> Nigel,
>
> Can't ckanapi (https://github.com/ckan/ckanapi) be used for that?
>
> I have to say I never spent that much time understanding the "LocalCKAN" of
> CkanAPI? Does it bypass http? If anyone has an answer, I'd be curious to
> hear about it
>
> Thanks
>
> Stéphane
>
>
> On Mon, Mar 31, 2014 at 5:55 AM, Nigel Babu <nigel.babu at okfn.org> wrote:
>>
>> Hi Rishi,
>>
>> We don't yet have a script to import data server-side.
>>
>> Nigel Babu
>>
>> Developer  |  @nigelbabu
>>
>> The Open Knowledge Foundation
>>
>> Empowering through Open Knowledge
>>
>> http://okfn.org/  |  @okfn  |  OKF on Facebook  |  Blog  |  Newsletter
>>
>>
>> CKAN | http://ckan.org/ | @CKANproject | the world's leading open-source
>> data portal platform
>>
>>
>> On 26 March 2014 04:20, Verma, Rishi (398J) <Rishi.Verma at jpl.nasa.gov>
>> wrote:
>>>
>>> Hello,
>>>
>>> I was reading through the documentation on Filestore [1] and also the
>>> Loading Data guide [2] but I didn't see anything detailing how to perform
>>> server-side data loads.
>>>
>>> I have tens of gigabytes worth of data stored on my server, which sits on
>>> the same box CKAN is running on. I want to import this data into Filestore
>>> and make it accessible via CKAN. Is there some CKAN API support for non-HTTP
>>> based data import into Filestore? In other words, can I import data into the
>>> Filestore module without having to actually "upload" it and risk the server
>>> crashing?
>>>
>>> An alternative idea I was thinking is linking to the dataset. However, I
>>> don't want to make the dataset accessible over a URL to the entire world,
>>> instead, I want to have CKAN control the access. Any suggestions?
>>>
>>> Thanks much,
>>> Rishi Verma
>>>
>>> --
>>> [1] http://docs.ckan.org/en/latest/maintaining/filestore.html
>>> [2] http://docs.ckan.org/en/ckan-1.7.2/loading-data.html
>>> _______________________________________________
>>> ckan-dev mailing list
>>> ckan-dev at lists.okfn.org
>>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>
>>
>>
>> _______________________________________________
>> ckan-dev mailing list
>> ckan-dev at lists.okfn.org
>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>
>
>
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>