[ECODP-dev] ODP: quick fix for the production database - Release 00.07.50.SP1

[ISOARD Olivier (OP)]

Hello Bert,

Thanks for this update. We already got the 2 scripts and are about to run them on our TEST env first. As this is pure db cleaning, it does not matter if we run it on 00.07.50 ?

Please note that we named this delivery 00.07.50.SP1. (I did the update and tagging in SVN myself, preferring you’re still focusing on the complementary investigations :) )

Best regards,

Olivier ISOARD
Projets Informatiques
_________________

Office des publications de l'Union européenne
Direction A – Core Business Services
Unité A3 - Projets Informatiques

2985 Luxembourg • LUXEMBOURG
Tel: +352 292942360 • Fax: +352 292944604
olivier.isoard at publications.europa.eu<mailto:olivier.isoard at publications.europa.eu>
http://publications.europa.eu<http://publications.europa.eu/>

From: Bert Van Nuffelen [mailto:bert.van.nuffelen at tenforce.com]
Sent: Thursday, March 07, 2013 12:43 PM
To: ISOARD Olivier (OP); ZAJAC Agnieszka (OP); HOHN Norbert (OP); MEYER André (OP-EXT)
Cc: Project list for EC ODP CKAN project
Subject: quick fix for the production database

Dear,

our investigations has lead to the first conclusion. The regular upload of (new) data increased the CKAN database table activity to a high number.
Very lickely this causes the instability of the CKAN system.

On our test system (a release 00.07.01) we activated the production dump. During the indexing (a process step required after changing the database in the back)
the CKAN system halted. After emptying the activity table the indexing was restarted and it finished properly. After that we have run rdf2ckan with the latest zip you have provided.
At this moment the EEA and SANCO zips passed. Currently a Eurostat zip is running.

In the svn you find a script to clean the appropriate tables. This is a quick-win step towards having back a stable system.

https://webgate.ec.europa.eu/publications/svn/ODP/trunk/ckan/management_scripts/ckan_clear_activity_table.sh

Copy this script to $USERHOME/ckan_management and complete the necessary parameters. These are the same as for a CKAN backup.
•         TARGETBACKUPDIR
•         CKAN_PWD
•         POSTGRES_HOST
The script will first backup the table and afterwards empty the tables.

The execution on our site costs +- 45 minutes and resulted in a file of 7.6 GB.

After the script execution, you have to trigger for this time the reindexing of the database.
In $USERHOME/ckan_management

     ./ckan_reindex.sh

(It  costs +- 1hour on our site)

We keep you informed about the outcome of the Eurostat test.

ps. I inserted the description of the new script also in the OM on section 7.10.

kind regards,

Bert


--
Bert Van Nuffelen

Semantic Technologies Software Architect at TenForce
www.tenforce.be<http://www.tenforce.be>

Bert.Van.Nuffelen at tenforce.com<mailto:Bert.Van.Nuffelen at tenforce.com>
Office: +32 (0)16 31 48 60
Mobile:+32 479 06 24 26
skype: bert.van.nuffelen
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.okfn.org/mailman/private/ecodp-dev/attachments/20130307/438a7473/attachment.html>