[ckan-dev] Batch upload

Thu Sep 3 14:23:44 UTC 2015

There is a project we did a few months ago, to batch export all CKAN data
and metadata into the Data Packages
(http://dataprotocols.org/data-packages/) format.
The code we wrote is built into the ckanapi:
https://github.com/ckan/ckanapi#bulk-dataset-and-resource-export---datapackagejson-format

Now what's left is the same functionality, the other way. A batch import.

If you have any appetite to take it on, it might be a good addition for
ckanapi as well.

On Thu, Sep 3, 2015 at 12:44 AM, Aaron McGlinchy <
McGlinchyA at landcareresearch.co.nz> wrote:

> Hi,
>    Has anyone done any work on batch upload of data e.g. point to a folder
> containing numerous resources, enter dataset level metadata, point to the
> folder and load up all the files in the folder under that dataset.  Could
> have a manifest file that contained a list of the file names and the
> description to be associated with that file when it was uploaded as a
> resource...
>
> Could consider zipping e.g. if the main folder contained subfolders which
> contained several files, maybe zip each folder.
>
> Not wedded to anything, just wondering what if any work been done around
> such things.
>
> Thanks
> Aaron
>
> ________________________________
>
> Please consider the environment before printing this email
> Warning: This electronic message together with any attachments is
> confidential. If you receive it in error: (i) you must not read, use,
> disclose, copy or retain it; (ii) please contact the sender immediately by
> reply email and then delete the emails.
> The views expressed in this email may not be those of Landcare Research
> New Zealand Limited. http://www.landcareresearch.co.nz
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20150903/bee7f73c/attachment-0003.html>