[ckan-dev] Hierarchical folder structure for a dataset

Wed Aug 9 07:17:38 UTC 2017

Hi Prashant,

Not sure if this will help with your specific use case but we dealt with a
similar requirement on data.gov.au. We allow custodians to upload zip files
for data where they wish to retain the folder structure and additional
context this provides.

End users can then download the zip file if they want the full context.

We also setup a zip file resource view
https://github.com/datagovau/ckanext-zippreview
This allows end user to visually see the folder structure without
downloading the actual zip file.

Then, we also have a zip 'extractor' running which has the job of
extracting interesting resources from Zip files and adding these to the
same dataset as the zip file resource. ref:
https://github.com/datagovau/ckanext-datagovau/blob/master/admin/zip-extract.py

If you have a standard set of resources for datasets, or a logical way to
recognise where resources should sit in a folder structure, then it is
relatively easy to create a zip archive to package up all resources into
the structure you want and provide this to users for download.

Cheers,
Steven

*STEVEN DE COSTA *|
*EXECUTIVE DIRECTOR*www.linkdigital.com.au

Want to be updated with news from Link Digital? Sign up
<http://linkdigital.com.au/content/newsletter> to receive our Newsletter!

On 9 August 2017 at 15:29, Prashant Gupta <p.gupta at auckland.ac.nz> wrote:

> Hi,
>
>
>
> I am using CKAN to serve as an instrument (e.g. mass spec) data service,
> where we may ingest instrument data directly into CKAN – so we have a copy
> of raw data to be stored and shared, and later to be published and
> archived. The problem I am facing is the way CKAN stores its datasets and
> resources. For instrument data, it is vital to retain the folder structure
> and the resources (data, metadata and config files) to be in the correct
> folder. Otherwise the analysis software would have issues analysing it.
>
>
>
> Is there a way CKAN may allow to store dataset and resources in a way that
> when it is downloaded, the folder structure may be retained somehow, and
> resources are in their correct folder?
>
>
>
> Thanks
>
> Prashant
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20170809/1ba64824/attachment-0003.html>