[ckan-dev] linking data in private S3 buckets

Wed Dec 17 16:00:32 UTC 2014

On Wed, Dec 17, 2014 at 10:21 AM, Anton Lundin <anton at dohi.se> wrote:
> On 17 December, 2014 - Ian Ward wrote:
>> Are you interested in contributing development in one of these directions?
>
> Yes we are. I'm currently investigating different strategies we can go
> about in how to solve this problem for us.
>
> The only downside is that i probably can't motivate the upside for doing
> this with the engineering costs it will take to clean this up and
> abstract it to a good interface this alone, according to my guestimates.
>
> But if there are more people interested in solving this, we can pool our
> resources and solve this together.

How about picking up from the work that was started on s3archive?

I'm sure there are other people that are interested in this use case.
Building a reusable extension to store ckan files remotely at least
opens the possibility of not carrying 100% of the maintenance costs
yourself. Why don't you start by creating a ticket outlining what
you're planning to build on https://github.com/ckan/ideas-and-roadmap
then anyone interested can jump in there.

When your approach is clear it's not very hard to get the interfaces
you need added to ckan. Join us at a few dev meetings if you have any
questions.