[ckan-dev] road map for horizontal scaling?

Timothy Giles timothy.giles at slu.se
Wed Oct 5 18:52:28 UTC 2016


Hi RMX.


I wonder if you can give a concrete example of what you mean by scale? Since this is a dev forum/mailing list, I think it would helpful to quantify your issue(s) / conern(s). There are instances of CKAN with hundred of thousands and millions of datasets, as well as individual datasets being extremely large ('00s GBs).


MvH Tim




________________________________
From: ckan-dev <ckan-dev-bounces at lists.okfn.org> on behalf of Ruima E. <ruimaximo at gmail.com>
Sent: 05 October 2016 02:40 PM
To: ckan-dev at lists.okfn.org
Subject: [ckan-dev] road map for horizontal scaling?

Hi,

At the moment ckan relies on PostgreSQL as a data store. I was shocked when I found that such nice project relies on a data store that is not suitable to scale. Open data in smart cities is expected to be Big Data and it is expected to scale, jeopardizing the success of the whole initiative in a near future.

Is scaling by using open source technologies part of the  road map for CKAN?

Thank you,
RMX
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20161005/6b047545/attachment-0003.html>


More information about the ckan-dev mailing list