[ECODP-dev] Problem with storage credentials ODP-236

Wed Jun 19 10:32:57 UTC 2013

Hi Bert,

It seems that CKAN does not currently respect this config option when local
storage is used (ie: not using Google storage or S3). However, the upload
size is limited in NGINX, defaulting to 2mb. I have updated the nginx
config on the test server so that this value is now 1000mb. You will need
to do something similar on the acceptance server and in production,
obviously you can decide what value you think is sensible and we can then
update the test server again accordingly. We are also currently working on
fixing this bug in CKAN core (but you would need to set the NGINX limit in
any case, or equivalent if available on the production server).

Regards,
John

On 11 June 2013 17:10, John Glover <john.glover at okfn.org> wrote:

> Hi Bert,
>
> It should default to 1GB [1] but I need to verify this and get back to you.
>
> [1]:
> http://docs.ckan.org/en/ckan-1.8/filestore.html#setup-and-configuration
>
> Regards,
> John
>
>
> On 11 June 2013 16:25, Bert Van Nuffelen <bert.van.nuffelen at tenforce.com>wrote:
>
>> Hi John,
>>
>> Do you know the file size limit for the upload?
>>
>> kind regards,
>>
>> Bert
>>
>> 2013/6/11 John Glover <john.glover at okfn.org>:
>> > Hi Bert,
>> >
>> > It should be sufficient to simply create a directory, and make sure that
>> > whatever user the Python web process is running as can access it. The
>> > directory can be anywhere sensible, but should be somewhere that won't
>> be
>> > touched during package installation/upgrade.
>> >
>> > Regards,
>> > John
>> >
>> >
>> > On 11 June 2013 15:34, Bert Van Nuffelen <
>> bert.van.nuffelen at tenforce.com>
>> > wrote:
>> >>
>> >> Hi John,
>> >>
>> >> we had our call with PO today. What is needed to activate that
>> directory?
>> >>
>> >> Bert
>> >>
>> >> 2013/6/11 John Glover <john.glover at okfn.org>:
>> >> > Hello Bert,
>> >> >
>> >> > On the dump of the live DB that we are using to investigate the
>> problem
>> >> > with
>> >> > importing data under heavy load, there are no resource URLs that
>> contain
>> >> > 'open-data.europa.eu'. If this is in ckan.site_url on the live
>> server
>> >> > (as we
>> >> > would expect), then this would imply that there are no filestore
>> >> > resources.
>> >> >
>> >> > Regards,
>> >> > John
>> >> >
>> >> >
>> >> > On 5 June 2013 17:37, John Glover <john.glover at okfn.org> wrote:
>> >> >>
>> >> >> Hi Bert,
>> >> >>
>> >> >> I'm currently unable to replicate this on our test server, have you
>> had
>> >> >> any success replicating it on odp.tenforce.com?
>> >> >>
>> >> >> If someone is able to see the resource edit page then they should
>> >> >> really
>> >> >> have correct permissions to upload, so one thing to check is that
>> the
>> >> >> editor
>> >> >> role has the 'file-upload' permission. This can be done with the
>> paster
>> >> >> roles command.
>> >> >>
>> >> >> Eg: paster roles list -c ecportal.ini
>> >> >>
>> >> >> Sample output:
>> >> >>
>> >> >> editor              read-site, ..., file-upload
>> >> >> anon_editor     edit, ..., file-upload
>> >> >> reader             read-site, ..., read
>> >> >>
>> >> >> Also of course you should make sure that ckan can write to the
>> storage
>> >> >> directory (specified in the config file: ofs.storage_dir).
>> >> >>
>> >> >> Regards,
>> >> >> John
>> >> >
>> >> >
>> >> >
>> >> > _______________________________________________
>> >> > Ecodp-dev mailing list
>> >> > Ecodp-dev at lists.okfn.org
>> >> > http://lists.okfn.org/mailman/listinfo/ecodp-dev
>> >> >
>> >>
>> >>
>> >>
>> >> --
>> >> Bert Van Nuffelen
>> >>
>> >> Semantic Technologies Software Architect at TenForce
>> >> www.tenforce.be
>> >>
>> >> Bert.Van.Nuffelen at tenforce.com
>> >> Office: +32 (0)16 31 48 60
>> >> Mobile:+32 479 06 24 26
>> >> skype: bert.van.nuffelen
>> >>
>> >> _______________________________________________
>> >> Ecodp-dev mailing list
>> >> Ecodp-dev at lists.okfn.org
>> >> http://lists.okfn.org/mailman/listinfo/ecodp-dev
>> >
>> >
>> >
>> > _______________________________________________
>> > Ecodp-dev mailing list
>> > Ecodp-dev at lists.okfn.org
>> > http://lists.okfn.org/mailman/listinfo/ecodp-dev
>> >
>>
>>
>>
>> --
>> Bert Van Nuffelen
>>
>> Semantic Technologies Software Architect at TenForce
>> www.tenforce.be
>>
>> Bert.Van.Nuffelen at tenforce.com
>> Office: +32 (0)16 31 48 60
>> Mobile:+32 479 06 24 26
>> skype: bert.van.nuffelen
>>
>> _______________________________________________
>> Ecodp-dev mailing list
>> Ecodp-dev at lists.okfn.org
>> http://lists.okfn.org/mailman/listinfo/ecodp-dev
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.okfn.org/mailman/private/ecodp-dev/attachments/20130619/e98ca3a6/attachment.html>