[ECODP-dev] architecture changes

Thu Dec 6 16:09:38 UTC 2012

Re-sending from my OKF email address.

On 6 December 2012 16:07, Ian Murray <ian.c.murray at gmail.com> wrote:
> Hi Bert,
>
> Moving to CKAN 1.8 with the new datastore would mean:
>
>  - elasticsearch dependency can be dropped.
>  - the nginx dependency could also be dropped if wanted (albeit with a
> little bit of work to replace the proxy-cache and api-lockdown that it
> is currently providing).
>  - to get full potential out of the new datastore, postgresql 9.X
> would need to be installed (replacing the current postgresql 8.4).  It
> *is* possible to run the new datastore on the postgresql 8.X series,
> but doing so would involve not supporting joining data between
> resources.
>  - whichever postgresql version is used, there will be some additional
> administration in setting up the new db server.  Both of these things
> are documented as part of CKAN 1.8:
>     - new database user with special rights needs to be created
>     - new database separate to the CKAN database (in order to ensure
> the datastore is isolated from the meta-data)
>  - there *may* be a need to provide pooling of the database
> connections.  There are a few options here; one of which is a piece of
> middleware sitting between the database and CKAN that provides the
> pooling (eg. pgpool).
>     - Note: this may go hand in hand with sorting out some sort of
> database failover (master-slave).
>  - The CKAN datastorer (note the extra "r") would also be required in
> order to upload data to the datastore.  This makes use of background
> processes to do offline processing.  There should be nothing to change
> here because they are already part of the current deployment; but they
> may require a small amount of additional testing to ensure they're
> running correctly.
>
>
> Other than that, most things remain the same:
>
>  - Apache is still the server container
>  - The same version of solr is used
>
>  - Ian
>
> On 6 December 2012 09:34, Bert Van Nuffelen
> <bert.van.nuffelen at tenforce.com> wrote:
>> Hi Darwin, Ian and David,
>>
>> can you provide us with an overview of the architectural changes when
>> moving to a more recent version of CKAN.
>> This is a question we will have tomorrow by the PO.
>>
>> In particular the search: SOLR/ELASTICSEARCH  and the webserver APACHE/NGINX
>> Are there any novel components introduced in the more recent versions of CKAN?
>>
>> kind regards,
>>
>> Bert
>>
>> --
>> Bert Van Nuffelen
>>
>> Semantic Technologies Software Architect at TenForce
>> www.tenforce.be
>>
>> Bert.Van.Nuffelen at tenforce.com
>> Office: +32 (0)16 31 48 60
>> Mobile:+32 479 06 24 26
>> skype: bert.van.nuffelen
>>
>> _______________________________________________
>> Ecodp-dev mailing list
>> Ecodp-dev at lists.okfn.org
>> http://lists.okfn.org/mailman/listinfo/ecodp-dev