[ckan-dev] Dataproxy: how can I disabled it?

Mon Oct 31 11:05:44 UTC 2016

Hi Isabel,

As Matthew says this is due to problems with how the datastore_active
flag is set on the resources (there was a bug when if you updated a
resource it would be set to False [1]. This should be fixed on 2.5.3).
For these resources affected, the easiest is to reupload the file to
the DataStore:

Resource Page > Manage > DataStore tab > Upload to DataStore

This will reupload the contents, set the flag to True and keep the resource id.

If there are many of them you might want to use the API for that or
reupload all files to the DataStore with `paster datapusher resubmit`
but of course that could take a long time.

Let me know if you need more help.

Adrià

[1] https://github.com/ckan/ckan/pull/3020

On 31 October 2016 at 05:18, Matthew Fullerton <matt.fullerton at gmail.com> wrote:
> Hi Isabel,
> Are these possibly resources that were in your CKAN prior to an upgrade?
> Datastore_active may need to be manually set in the database to match the
> reality in order to fix this (my experience).
>
> -Matt
>
> On 27 October 2016 at 12:53, Isabel M. Ruiz Mellado
> <isaruizmellado at gmail.com> wrote:
>>
>> Hi Adrià,
>>
>> We have all files in datastore, I can see them tables and datas into
>> datastore database, but CKAN opens some files using datastore and other
>> using dataproxy, for example:
>>
>> This is a datasource which is in our datastore but CKAN tries to load from
>> dataproxy [1]
>>
>> And this is a datasource which is in our datastore and CKAN loads from
>> datastore: [2]
>>
>> It seems, first one is in an incosistent status.
>>
>> [1]:
>> http://datosabiertos.malaga.eu/dataset/lineas-y-horarios-bus-rutas/resource/1aac7c91-06f4-4499-96b8-d917f58c93c4
>>
>> [2]:
>> http://datosabiertos.malaga.eu/dataset/lineas-y-horarios-bus-horario/resource/cf34723a-24a5-43ab-8478-cc7216dfe77c
>>
>>
>> ////////
>>
>> Hola Adrià,
>> Si me permites, te escribo en español, para explicarme con más detalle.
>> Tenemos recursos (como los que te paso arriba) que vemos en la base de
>> datos datastore y veo sus datos, pero algunos de ellos CKAN los abre con el
>> dataproxy y da error [1] y otros los abre con el datastore y funcionan [2].
>>
>> Parece como si estuviera en un estado incosistente y aunque está como
>> datastore, sigue intentandolo con dataproxy.
>>
>> Necesitamos que CKAN abra estos recursos con el datastore y deje de
>> intentarlo con dataproxy, pero no encuentro el modo.
>>
>> Por último, comentarte que hemos descartado la opción de eliminarlos y
>> volver a crearlos porque ya tenemos "terceros" que están usandolo y ya hacen
>> referencia a este ID :(
>>
>>
>> Muchas gracias!
>>
>>
>> On Wed, Oct 26, 2016 at 11:25 AM, Adrià Mercader <adria.mercader at okfn.org>
>> wrote:
>>>
>>> Hi Isabel,
>>>
>>> It's currently not possible to disable DataProxy. The ideal solution
>>> is to get these files into the DataStore to avoid using the DataProxy,
>>> but I agree that disabling the DataProxy and just showing a "Preview
>>> not available" message would be a better approach.
>>>
>>> If you want to override the current recline view this is where the
>>> DataProxy is enabled:
>>>
>>>
>>> https://github.com/ckan/ckan/blob/master/ckanext/reclineview/theme/public/recline_view.js#L51:L57
>>>
>>> Adrià
>>>
>>> On 26 October 2016 at 09:49, Isabel M. Ruiz Mellado
>>> <isaruizmellado at gmail.com> wrote:
>>> > Hi all,
>>> >
>>> > Can anyone help us with this?
>>> >
>>> > Thanks!!
>>> >
>>> >>
>>> >> We have CKAN 2.5.2.
>>> >>
>>> >> We have availabled recline_view.
>>> >>
>>> >> There are some CSV files which show this error:
>>> >>
>>> >> Could not load view: DataProxy returned an error (Request Error:
>>> >> Backend
>>> >> did not respond after 10 seconds)
>>> >>
>>> >> and CSV file can not be previewed.
>>> >>
>>> >> I read some forums and CKAN installations that talk about "Support for
>>> >> the
>>> >> DataProxy will be dropped on future CKAN releases"
>>> >>
>>> >> What can I do to avoid my CKAN attend to access Dataproxy server ?
>>> >>
>>> >>
>>> >> --
>>> >> Isabel M. Ruiz Mellado
>>> >> http://about.me/isabelruiz
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > _______________________________________________
>>> > ckan-dev mailing list
>>> > ckan-dev at lists.okfn.org
>>> > https://lists.okfn.org/mailman/listinfo/ckan-dev
>>> > Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>> >
>>> _______________________________________________
>>> ckan-dev mailing list
>>> ckan-dev at lists.okfn.org
>>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>
>>
>>
>>
>> --
>> Isabel M. Ruiz Mellado
>> http://about.me/isabelruiz
>>
>> _______________________________________________
>> ckan-dev mailing list
>> ckan-dev at lists.okfn.org
>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>
>
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>