[CKAN-support] potential filestore access issue

Fri Nov 29 02:18:06 UTC 2013

Hi CKAN Support

I've just resolved an issue that I had with one of the Queensland Government's CKAN installations: publications.qld.gov.au.

Here's the background:
Yesterday it was noticed that files in the filestore were not accessible and any attempt to download resulted in a 500 error. This only happened to files that were uploaded prior to a specific point in time. Eventually we tracked the problem down to a file in the filestore, perisisted_state.json. For some reason, when we looked at it, it only had records of the recently uploaded files - the one's that could be downloaded.

We therefore reckon that at some point, the file became corrupted or was deleted and a new - empty - file was generated in its place. The problem therefore is if this file disappears for any reason, how is it possible to regenerate the content?

I'm suggesting something along the line of a paster tool that can query the database and populate the file.

Oh, and the problem was solved by tracking down a backup of the file and combining it with the newly populated content.

If you concur that this is a problem let me know. I'll be happy to add it to the issues list on github.

Thanks
George

________________________________
This email and any files transmitted with it is confidential and intended solely for the use of the addressee. The unauthorised use, dissemination, forwarding, printing or copying of this communication is strictly prohibited. If you have received this communication in error please notify us immediately by reply email and destroy this communication. Any views and opinions presented in this email are solely those of the author and do not necessarily represent the views of XVT Solutions. The recipient should check this email and any attachments for viruses. XVT Solutions accepts no liability for the content of this email, and any damage caused by any viruses that could potentially be transmitted through this email.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.okfn.org/mailman/private/ckan-support/attachments/20131129/493e286b/attachment-0002.html>