[ECODP-dev] file-upload issue

Thu Dec 12 16:34:36 UTC 2013

Hello,

I do not understand.  If the site_url is wrong then an upload will be
impossible in the first place as there is no way to connect to CKAN
api todo the upload.

The query I think you want is, nonetheless.

select count(*) from resource where resource_type = 'file.upload'

David

On 12 December 2013 15:46, Bert Van Nuffelen
<bert.van.nuffelen at tenforce.com> wrote:
> Hi David,
>
> can you write a sql query to retrieve all distribution urls?
>
> I think that can aid to asses the situation at PO for the http issue with
> already uploaded distributions.
> I would like to being able to tell them about how many items it will be and
> how they have to adjust them (probably none, but proving that is hard
> without facts)
>
> kind regards,
>
> Bert
>
>
>
>
>
> 2013/12/12 David Raznick <david.raznick at okfn.org>
>>
>> On 12 December 2013 09:27, Bert Van Nuffelen
>> <bert.van.nuffelen at tenforce.com> wrote:
>> > Hi David,
>> >
>> > thanks for the investigation.
>> >
>> > So if I understand it right: we have to understand the effect of the
>> > ckan.site_url & the action replacement in this context.
>> >
>> > To sketch the setup in production (which should been mirrorred in test):
>> > At production: the ckan.site_url will be http://open-data.europa.eu,
>> > this is
>> > the public location.
>> > Any request to the portal will go to the reverse proxy of the PO, which
>> > will
>> > forward that request to http://odp-test.opoce.cec.eu.int on which the
>> > CKAN
>> > is actually running.
>>
>> This seems correct the site_url should be the place where the end user
>> browser points or at least somewhere accessible to the browser.  CKAN
>> generates API endpoints using this URL which the browser needs to
>> access.
>>
>> >
>> > Bert
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > 2013/12/12 David Raznick <david.raznick at okfn.org>
>> >>
>> >> Hello,
>> >>
>> >> I have been looking into this issue but cannot reproduce it.
>> >> The url
>> >> "http://test-ckan-net-storage.commondatastorage.googleapis.com/"
>> >> is in the code but is only there as a placeholder.  The javascript
>> >> replaces it with the correct location once the button is pressed.
>> >>
>> >> This leads be to believe there is some kind of javascript error that
>> >> is happening before this point stopping this replacement.  However, I
>> >> can not make this JavaScript error happen myself.
>> >>
>> >> My best guess looking at the config is to make sure the ckan.site_url
>> >> is correct and is actually a url that is accessable. i.e in this case
>> >> it looks like it should be
>> >>
>> >> ckan.site_url = http://odp-test.oponce.cec.eu.int
>> >>
>> >> and not just http://odp-test/
>> >>
>> >> Thanks
>> >>
>> >> David
>> >>
>> >>
>> >> On 11 December 2013 13:11, KONYA Jaroslav (OP-EXT)
>> >> <Jaroslav.KONYA at ext.publications.europa.eu> wrote:
>> >> > See the attached config from TEST.
>> >> >
>> >> >
>> >> >
>> >> > Regards,
>> >> > Jaroslav KÓNYA
>> >> >
>> >> > From: Bert Van Nuffelen [mailto:bert.van.nuffelen at tenforce.com]
>> >> > Sent: Wednesday, December 11, 2013 1:27 PM
>> >> > To: KONYA Jaroslav (OP-EXT)
>> >> >
>> >> >
>> >> > Cc: Project list for EC ODP CKAN project; MEYER André (OP-EXT)
>> >> > Subject: Re: file-upload issue
>> >> >
>> >> >
>> >> >
>> >> > Hi Jaroslav,
>> >> >
>> >> > from the system we recieved this resource file upload issue from.
>> >> >
>> >> > I suppose this is test.
>> >> >
>> >> > kind regards,
>> >> >
>> >> > Bert
>> >> >
>> >> >
>> >> >
>> >> >
>> >> >
>> >> > 2013/12/11 KONYA Jaroslav (OP-EXT)
>> >> > <Jaroslav.KONYA at ext.publications.europa.eu>
>> >> >
>> >> > Hi Bert,
>> >> >
>> >> >
>> >> >
>> >> > From TEST or PROD?
>> >> >
>> >> >
>> >> >
>> >> > Regards,
>> >> > Jaroslav KÓNYA
>> >> >
>> >> > From: Bert Van Nuffelen [mailto:bert.van.nuffelen at tenforce.com]
>> >> > Sent: Wednesday, December 11, 2013 12:54 PM
>> >> > To: KONYA Jaroslav (OP-EXT); MEYER André (OP-EXT)
>> >> > Cc: Project list for EC ODP CKAN project
>> >> > Subject: file-upload issue
>> >> >
>> >> >
>> >> >
>> >> > Hi Jaroslav and Andre,
>> >> >
>> >> > to check for the file-upload issue we would like to recieve the CKAN
>> >> > configuration file $USERHOME/ckan/conf/ecportal.ini
>> >> >
>> >> > (you can best obfuscate the user credentials)
>> >> >
>> >> >
>> >> > According to the OKF feedback the request to the googleapi is only
>> >> > triggered
>> >> > when the config  has to have the following options. On our test
>> >> > servers
>> >> > using the default configuration we do not see that request being
>> >> > done.
>> >> >
>> >> > ofs.impl = google
>> >> > ofs.gs_access_key_id =
>> >> > ofs.gs_secret_access_key =
>> >> >
>> >> > kind regards,
>> >> >
>> >> > Bert
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > Bert Van Nuffelen
>> >> >
>> >> > Semantic Technologies Software Architect at TenForce
>> >> > www.tenforce.be
>> >> >
>> >> > Bert.Van.Nuffelen at tenforce.com
>> >> > Office: +32 (0)16 31 48 60
>> >> > Mobile:+32 479 06 24 26
>> >> > skype: bert.van.nuffelen
>> >> >
>> >> >
>> >> >
>> >> >
>> >> > --
>> >> > Bert Van Nuffelen
>> >> >
>> >> > Semantic Technologies Software Architect at TenForce
>> >> > www.tenforce.be
>> >> >
>> >> > Bert.Van.Nuffelen at tenforce.com
>> >> > Office: +32 (0)16 31 48 60
>> >> > Mobile:+32 479 06 24 26
>> >> > skype: bert.van.nuffelen
>> >> >
>> >> >
>> >> > _______________________________________________
>> >> > ecodp-dev mailing list
>> >> > ecodp-dev at lists.okfn.org
>> >> > http://lists.okfn.org/mailman/listinfo/ecodp-dev
>> >> >
>> >
>> >
>> >
>> >
>> > --
>> > Bert Van Nuffelen
>> >
>> > Semantic Technologies Software Architect at TenForce
>> > www.tenforce.be
>> >
>> > Bert.Van.Nuffelen at tenforce.com
>> > Office: +32 (0)16 31 48 60
>> > Mobile:+32 479 06 24 26
>> > skype: bert.van.nuffelen
>
>
>
>
> --
> Bert Van Nuffelen
>
> Semantic Technologies Software Architect at TenForce
> www.tenforce.be
>
> Bert.Van.Nuffelen at tenforce.com
> Office: +32 (0)16 31 48 60
> Mobile:+32 479 06 24 26
> skype: bert.van.nuffelen