[ckan-dev] ckanext-spatial deploy to production environment (datacats)

Fri Jun 3 12:37:45 UTC 2016

Thanks a lot for the helpful comments, John and Pedro.

I was hoping to hold out on installing a proxy service, which is also why the 'running in production site' instructions weren't helpful - couldn't find the apache.wsgi file. Alas, it seems like I'll have to broaden my horizons and do that if I want ckanext-spatial to work.

In terms of your other comments, I found datacats great for installing CKAN as a non-dev person. There were a couple of hiccups and some figuring out along the way though. Following your questions, I've gone back to the drawing bench and found the most recent useful discussion here:

https://github.com/datacats/datacats/issues/383#issuecomment-222665248

<https://github.com/datacats/datacats/issues/383#issuecomment-222665248>

Since I deployed my CKAN instance it seems like the datacats images on docker have not been updated for a while and CKAN images are back. I may just decide to dive back into Docker and the CKAN images and then decide which ones are more user friendly.

Cheers!

Wiebke

________________________________
From: ckan-dev <ckan-dev-bounces at lists.okfn.org> on behalf of John Jediny - XAAB <john.jediny at gsa.gov>
Sent: 02 June 2016 04:28:07 PM
To: CKAN Development Discussions
Subject: Re: [ckan-dev] ckanext-spatial deploy to production environment (datacats)

Wiebke,

*Sorry in advance, as im going to try to piggyback off your question with a broader conversation with the ckan-dev...

It seems there have been a few attempts now at creating a docker based CKAN...

  1.  Datacat being the best example - but I've heard the core contributors have more or less moved on/away, can anyone confirm status? While we assessed the use of Datacats, one of the issues we foresaw was that it was using python wrappers for the management of docker on a single host (which is completely valid for most use-cases). But we needed to be able to scale out across multiple hosts to pool those resources to truly get a benefit in using docker. This however comes with its own issues as managing shared volumes, queues, ips, port mapping, cron jobs, etc, etc are "Platform" problems that Docker alone doesn't solve (hence the python management of Datacats)...
  2.  I know the docker repo on the CKAN github org has been deprecated, but there was recently a minimal version added within the main repo - https://github.com/ckan/ckan/tree/master/contrib/docker. Can anyone comment on  this (is it only intended for dev/test)? If there are those interested we at Data.gov would like to contribute/collaborate on our docker CKAN work with the community. Any ideas/suggests how best to collaborate on this moving forward would be appreciated:
ckan/ckan<https://github.com/ckan/ckan/tree/master/contrib/docker>
github.com
ckan - CKAN is an open-source DMS (data management system) for powering data hubs and data portals. CKAN makes it easy to publish, share and use data. It powers datahub.io, catalog.data.gov and dat...

     *   https://hub.docker.com/u/datagov/
     *   https://github.com/GSA/catalog-app

Wiebke - per your specific ask...
There are some unique aspects of running pycsw as a docker container and not as a separate service on the same machine:

  *   Here is our pycsw dockerfile for comparison - https://github.com/GSA/catalog-pycsw
  *   You need to add a proxy service (nginx/apache) that makes an alias of /csw & /csw-all to the pycsw container and then --link them - https://github.com/GSA/catalog-nginx/blob/master/nginx.conf
  *   As CKAN doesn't share the same database table as pycsw you need another container with linkages/mappings to run cron jobs - https://github.com/GSA/catalog-scheduler. This is something that is dictated by the different core metadata model is stored/used by CKAN (its own by default) vs pycsw which maps/stores its core metadata model using ISO 19139 2007 (*though I know I'm interested in having them read from the same DB table rather then setting up cron jobs to do the transformation and ingest from CKAN to pycsw (As covered by the link Pedro sent -  http://docs.ckan.org/projects/ckanext-spatial/en/latest/csw.html#running-it-on-production-site.

On Wed, Jun 1, 2016 at 12:59 PM, Wiebke Toussaint <wiebke.toussaint at uct.ac.za<mailto:wiebke.toussaint at uct.ac.za>> wrote:

Hey!

I've installed ckan with datacats and docker and am running it on an Ubuntu 14.04 server. My site is available here: http://energydata.uct.ac.za/. I've been trying to install ckanext-spatial so that my site can be harvested by another data portal.

I've installed ckanext-spatial and pycsw as per instructions, but am struggling to figure out how to deploy it in a production environment, outside of http://localhost:8000. I want my data portal to be accessible via a /csw endpoint.

Any assistance would be greatly appreciated.

Kind regards,
Wiebke

Disclaimer - University of Cape Town This e-mail is subject to UCT policies and e-mail disclaimer published on our website at http://www.uct.ac.za/about/policies/emaildisclaimer/ or obtainable from +27 21 650 9111<tel:%2B27%2021%20650%209111>. If this e-mail is not related to the business of UCT, it is sent by the sender in an individual capacity. Please report security incidents or abuse via csirt at uct.ac.za<mailto:csirt at uct.ac.za>

_______________________________________________
ckan-dev mailing list
ckan-dev at lists.okfn.org<mailto:ckan-dev at lists.okfn.org>
https://lists.okfn.org/mailman/listinfo/ckan-dev
Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev

--
Chief Data Engineer
202-341-0191
@Data.gov<http://Data.gov>
@Office of Citizen Science and Innovative Technologies/18F<http://www.gsa.gov/portal/category/25729>
General Services Administration

[https://www.data.gov/media/2013/11/Datagov_logo.jpg]Work in the Open... ideate, innovate, iterate...
@github<https://github.com/JJediny> | @projectopendata<https://github.com/project-open-data>
Disclaimer - University of Cape Town This e-mail is subject to UCT policies and e-mail disclaimer published on our website at http://www.uct.ac.za/about/policies/emaildisclaimer/ or obtainable from +27 21 650 9111. If this e-mail is not related to the business of UCT, it is sent by the sender in an individual capacity. Please report security incidents or abuse via csirt at uct.ac.za
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20160603/5bee2917/attachment-0003.html>