[CKAN-support] potential filestore access issue

Fri Nov 29 05:28:12 UTC 2013

Hi George,

Thank you for keeping us up-to-date on this issue. That was some really
good debugging and fix :).  You mentioned yesterday that the same resource
would work one minute and not work the next. I wonder what caused that if
this was the problem.

I think it's worth filing an issue about this and having this discussion
there.

Nigel Babu

Developer  |  @nigelbabu <https://twitter.com/nigelbabu>

The Open Knowledge Foundation <http://okfn.org/>

Empowering through Open Knowledge

http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on
Facebook<https://www.facebook.com/OKFNetwork> |
Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>

 CKAN | http://ckan.org/ | @CKANproject
<http://twitter.com/CKANproject> |the world’s leading open-source data
portal platform

On 29 November 2013 07:48, George Sattler <George.sattler at xvt.com.au> wrote:

>  Hi CKAN Support
>
>
>
> I’ve just resolved an issue that I had with one of the Queensland
> Government’s CKAN installations: publications.qld.gov.au.
>
>
>
> Here’s the background:
>
> Yesterday it was noticed that files in the filestore were not accessible
> and any attempt to download resulted in a 500 error. This only happened to
> files that were uploaded prior to a specific point in time. Eventually we
> tracked the problem down to a file in the filestore,
> *perisisted_state.json*. For some reason, when we looked at it, it only
> had records of the recently uploaded files – the one’s that *could* be
> downloaded.
>
>
>
> We therefore reckon that at some point, the file became corrupted or was
> deleted and a new – empty – file was generated in its place. The problem
> therefore is if this file disappears for any reason, how is it possible to
> regenerate the content?
>
>
>
> I’m suggesting something along the line of a paster tool that can query
> the database and populate the file.
>
>
>
> Oh, and the problem was solved by tracking down a backup of the file and
> combining it with the newly populated content.
>
>
>
> If you concur that this is a problem let me know. I’ll be happy to add it
> to the issues list on github.
>
>
>
> Thanks
>
> George
>
>
>
>
>
> ------------------------------
> This email and any files transmitted with it is confidential and intended
> solely for the use of the addressee. The unauthorised use, dissemination,
> forwarding, printing or copying of this communication is strictly
> prohibited. If you have received this communication in error please notify
> us immediately by reply email and destroy this communication. Any views and
> opinions presented in this email are solely those of the author and do not
> necessarily represent the views of XVT Solutions. The recipient should
> check this email and any attachments for viruses. XVT Solutions accepts no
> liability for the content of this email, and any damage caused by any
> viruses that could potentially be transmitted through this email.
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.okfn.org/mailman/private/ckan-support/attachments/20131129/a42ddaf2/attachment-0003.html>