[ckan-dev] Dataproxy: how can I disabled it?

Fri Nov 4 10:56:39 UTC 2016

Hi all again.

It finally works!

We have used *paster datapusher resubmit* command.

Thanks.

On Mon, Oct 31, 2016 at 12:05 PM, Adrià Mercader <adria.mercader at okfn.org>
wrote:

> Hi Isabel,
>
> As Matthew says this is due to problems with how the datastore_active
> flag is set on the resources (there was a bug when if you updated a
> resource it would be set to False [1]. This should be fixed on 2.5.3).
> For these resources affected, the easiest is to reupload the file to
> the DataStore:
>
> Resource Page > Manage > DataStore tab > Upload to DataStore
>
> This will reupload the contents, set the flag to True and keep the
> resource id.
>
> If there are many of them you might want to use the API for that or
> reupload all files to the DataStore with `paster datapusher resubmit`
> but of course that could take a long time.
>
> Let me know if you need more help.
>
> Adrià
>
>
> [1] https://github.com/ckan/ckan/pull/3020
>
> On 31 October 2016 at 05:18, Matthew Fullerton <matt.fullerton at gmail.com>
> wrote:
> > Hi Isabel,
> > Are these possibly resources that were in your CKAN prior to an upgrade?
> > Datastore_active may need to be manually set in the database to match the
> > reality in order to fix this (my experience).
> >
> > -Matt
> >
> > On 27 October 2016 at 12:53, Isabel M. Ruiz Mellado
> > <isaruizmellado at gmail.com> wrote:
> >>
> >> Hi Adrià,
> >>
> >> We have all files in datastore, I can see them tables and datas into
> >> datastore database, but CKAN opens some files using datastore and other
> >> using dataproxy, for example:
> >>
> >> This is a datasource which is in our datastore but CKAN tries to load
> from
> >> dataproxy [1]
> >>
> >> And this is a datasource which is in our datastore and CKAN loads from
> >> datastore: [2]
> >>
> >> It seems, first one is in an incosistent status.
> >>
> >> [1]:
> >> http://datosabiertos.malaga.eu/dataset/lineas-y-horarios-
> bus-rutas/resource/1aac7c91-06f4-4499-96b8-d917f58c93c4
> >>
> >> [2]:
> >> http://datosabiertos.malaga.eu/dataset/lineas-y-horarios-
> bus-horario/resource/cf34723a-24a5-43ab-8478-cc7216dfe77c
> >>
> >>
> >> ////////
> >>
> >> Hola Adrià,
> >> Si me permites, te escribo en español, para explicarme con más detalle.
> >> Tenemos recursos (como los que te paso arriba) que vemos en la base de
> >> datos datastore y veo sus datos, pero algunos de ellos CKAN los abre
> con el
> >> dataproxy y da error [1] y otros los abre con el datastore y funcionan
> [2].
> >>
> >> Parece como si estuviera en un estado incosistente y aunque está como
> >> datastore, sigue intentandolo con dataproxy.
> >>
> >> Necesitamos que CKAN abra estos recursos con el datastore y deje de
> >> intentarlo con dataproxy, pero no encuentro el modo.
> >>
> >> Por último, comentarte que hemos descartado la opción de eliminarlos y
> >> volver a crearlos porque ya tenemos "terceros" que están usandolo y ya
> hacen
> >> referencia a este ID :(
> >>
> >>
> >> Muchas gracias!
> >>
> >>
> >> On Wed, Oct 26, 2016 at 11:25 AM, Adrià Mercader <
> adria.mercader at okfn.org>
> >> wrote:
> >>>
> >>> Hi Isabel,
> >>>
> >>> It's currently not possible to disable DataProxy. The ideal solution
> >>> is to get these files into the DataStore to avoid using the DataProxy,
> >>> but I agree that disabling the DataProxy and just showing a "Preview
> >>> not available" message would be a better approach.
> >>>
> >>> If you want to override the current recline view this is where the
> >>> DataProxy is enabled:
> >>>
> >>>
> >>> https://github.com/ckan/ckan/blob/master/ckanext/
> reclineview/theme/public/recline_view.js#L51:L57
> >>>
> >>> Adrià
> >>>
> >>> On 26 October 2016 at 09:49, Isabel M. Ruiz Mellado
> >>> <isaruizmellado at gmail.com> wrote:
> >>> > Hi all,
> >>> >
> >>> > Can anyone help us with this?
> >>> >
> >>> > Thanks!!
> >>> >
> >>> >>
> >>> >> We have CKAN 2.5.2.
> >>> >>
> >>> >> We have availabled recline_view.
> >>> >>
> >>> >> There are some CSV files which show this error:
> >>> >>
> >>> >> Could not load view: DataProxy returned an error (Request Error:
> >>> >> Backend
> >>> >> did not respond after 10 seconds)
> >>> >>
> >>> >> and CSV file can not be previewed.
> >>> >>
> >>> >> I read some forums and CKAN installations that talk about "Support
> for
> >>> >> the
> >>> >> DataProxy will be dropped on future CKAN releases"
> >>> >>
> >>> >> What can I do to avoid my CKAN attend to access Dataproxy server ?
> >>> >>
> >>> >>
> >>> >> --
> >>> >> Isabel M. Ruiz Mellado
> >>> >> http://about.me/isabelruiz
> >>> >
> >>> >
> >>> >
> >>> >
> >>> >
> >>> > _______________________________________________
> >>> > ckan-dev mailing list
> >>> > ckan-dev at lists.okfn.org
> >>> > https://lists.okfn.org/mailman/listinfo/ckan-dev
> >>> > Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> >>> >
> >>> _______________________________________________
> >>> ckan-dev mailing list
> >>> ckan-dev at lists.okfn.org
> >>> https://lists.okfn.org/mailman/listinfo/ckan-dev
> >>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> >>
> >>
> >>
> >>
> >> --
> >> Isabel M. Ruiz Mellado
> >> http://about.me/isabelruiz
> >>
> >> _______________________________________________
> >> ckan-dev mailing list
> >> ckan-dev at lists.okfn.org
> >> https://lists.okfn.org/mailman/listinfo/ckan-dev
> >> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> >>
> >
> >
> > _______________________________________________
> > ckan-dev mailing list
> > ckan-dev at lists.okfn.org
> > https://lists.okfn.org/mailman/listinfo/ckan-dev
> > Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
> >
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>

-- 
Isabel M. Ruiz Mellado
http://about.me/isabelruiz
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20161104/e88127a3/attachment-0002.html>