No subject
Thu Oct 25 20:26:07 BST 2012
nclusive and we now are managing the deployment and run of those scripts al=
so on PROD, after having restored the last backup of prod 00.07.05. restore=
is done but cleaning (scripts) is still on going for the moment.
See u tomorrow to doing a new status via telco.
Best regards,
Olivier ISOARD
Projets Informatiques
_________________
Office des publications de l'Union europ=E9enne
Direction A =96 Core Business Services
Unit=E9 A3 - Projets Informatiques
2985 Luxembourg =95 LUXEMBOURG
Tel: +352 292942360 =95 Fax: +352 292944604
olivier.isoard at publications.europa.eu<mailto:olivier.isoard at publications.eu=
ropa.eu>
http://publications.europa.eu<http://publications.europa.eu/>
From: Bert Van Nuffelen [mailto:bert.van.nuffelen at tenforce.com]
Sent: Thursday, March 07, 2013 4:04 PM
To: ISOARD Olivier (OP)
Cc: Project list for EC ODP CKAN project; ZAJAC Agnieszka (OP); HOHN Norber=
t (OP); MEYER Andr=E9 (OP-EXT)
Subject: Re: quick fix for the production database - Release 00.07.50.SP1
Hi
as promised a quick update from our side w.r.t. the upload of eurostat.
The processing finished properly.
I will trigger an additional run with some other eurostat zips to see if th=
e behaviour is reoccurring.
Bert
2013/3/7 Bert Van Nuffelen <bert.van.nuffelen at tenforce.com<mailto:bert.van.=
nuffelen at tenforce.com>>
Hi Olivier,
it does not matter the release version. It is a valid operation for all CKA=
N databases.
kind regards,
Bert
2013/3/7 ISOARD Olivier (OP) <Olivier.ISOARD at publications.europa.eu<mailto:=
Olivier.ISOARD at publications.europa.eu>>
Hello Bert,
Thanks for this update. We already got the 2 scripts and are about to run t=
hem on our TEST env first. As this is pure db cleaning, it does not matter =
if we run it on 00.07.50 ?
Please note that we named this delivery 00.07.50.SP1. (I did the update and=
tagging in SVN myself, preferring you=92re still focusing on the complemen=
tary investigations :) )
Best regards,
Olivier ISOARD
Projets Informatiques
_________________
Office des publications de l'Union europ=E9enne
Direction A =96 Core Business Services
Unit=E9 A3 - Projets Informatiques
2985 Luxembourg =95 LUXEMBOURG
Tel: +352 2929<tel:%2B352%202929>42360 =95 Fax: +352 2929<tel:%2B352%202929=
>44604
olivier.isoard at publications.europa.eu<mailto:olivier.isoard at publications.eu=
ropa.eu>
http://publications.europa.eu<http://publications.europa.eu/>
From: Bert Van Nuffelen [mailto:bert.van.nuffelen at tenforce.com<mailto:bert.=
van.nuffelen at tenforce.com>]
Sent: Thursday, March 07, 2013 12:43 PM
To: ISOARD Olivier (OP); ZAJAC Agnieszka (OP); HOHN Norbert (OP); MEYER And=
r=E9 (OP-EXT)
Cc: Project list for EC ODP CKAN project
Subject: quick fix for the production database
Dear,
our investigations has lead to the first conclusion. The regular upload of =
(new) data increased the CKAN database table activity to a high number.
Very lickely this causes the instability of the CKAN system.
On our test system (a release 00.07.01) we activated the production dump. D=
uring the indexing (a process step required after changing the database in =
the back)
the CKAN system halted. After emptying the activity table the indexing was =
restarted and it finished properly. After that we have run rdf2ckan with th=
e latest zip you have provided.
At this moment the EEA and SANCO zips passed. Currently a Eurostat zip is r=
unning.
In the svn you find a script to clean the appropriate tables. This is a qui=
ck-win step towards having back a stable system.
https://webgate.ec.europa.eu/publications/svn/ODP/trunk/ckan/management_scr=
ipts/ckan_clear_activity_table.sh
Copy this script to $USERHOME/ckan_management and complete the necessary pa=
rameters. These are the same as for a CKAN backup.
=95 TARGETBACKUPDIR
=95 CKAN_PWD
=95 POSTGRES_HOST
The script will first backup the table and afterwards empty the tables.
The execution on our site costs +- 45 minutes and resulted in a file of 7.6=
GB.
After the script execution, you have to trigger for this time the reindexin=
g of the database.
In $USERHOME/ckan_management
./ckan_reindex.sh
(It costs +- 1hour on our site)
We keep you informed about the outcome of the Eurostat test.
ps. I inserted the description of the new script also in the OM on section =
7.10.
kind regards,
Bert
--
Bert Van Nuffelen
Semantic Technologies Software Architect at TenForce
www.tenforce.be<http://www.tenforce.be>
Bert.Van.Nuffelen at tenforce.com<mailto:Bert.Van.Nuffelen at tenforce.com>
Office: +32 (0)16 31 48 60<tel:%2B32%20%280%2916%2031%2048%2060>
Mobile:+32 479 06 24 26<tel:%2B32%20479%2006%2024%2026>
skype: bert.van.nuffelen
--
Bert Van Nuffelen
Semantic Technologies Software Architect at TenForce
www.tenforce.be<http://www.tenforce.be>
Bert.Van.Nuffelen at tenforce.com<mailto:Bert.Van.Nuffelen at tenforce.com>
Office: +32 (0)16 31 48 60<tel:%2B32%20%280%2916%2031%2048%2060>
Mobile:+32 479 06 24 26<tel:%2B32%20479%2006%2024%2026>
skype: bert.van.nuffelen
--
Bert Van Nuffelen
Semantic Technologies Software Architect at TenForce
www.tenforce.be<http://www.tenforce.be>
Bert.Van.Nuffelen at tenforce.com<mailto:Bert.Van.Nuffelen at tenforce.com>
Office: +32 (0)16 31 48 60
Mobile:+32 479 06 24 26
skype: bert.van.nuffelen
--_000_36D4C4CA2E214B4489A43FAC42983FAD01350B11B649OPMERSEM701_
Content-Type: text/html; charset="Windows-1252"
Content-Transfer-Encoding: quoted-printable
<html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr=
osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:x=3D"urn:schemas-microsoft-com:office:excel" xmlns:m=3D"http://schema=
s.microsoft.com/office/2004/12/omml" xmlns=3D"http://www.w3.org/TR/REC-html=
40"><head><meta http-equiv=3DContent-Type content=3D"text/html; charset=3Dw=
indows-1252"><meta name=3DGenerator content=3D"Microsoft Word 14 (filtered =
medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:"Trebuchet MS";
panose-1:2 11 6 3 2 2 2 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0cm;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";
mso-fareast-language:EN-GB;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]--></head><body lang=3DEN-GB link=3Dblue vli=
nk=3Dpurple><div class=3DWordSection1><p class=3DMsoNormal><span style=3D'f=
ont-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Hi Bert,<=
o:p></o:p></span></p><p class=3DMsoNormal><span style=3D'font-size:11.0pt;f=
ont-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></=
p><p class=3DMsoNormal><span style=3D'font-size:11.0pt;font-family:"Calibri=
","sans-serif";color:#1F497D'>Thanks for this new update.<o:p></o:p></span>=
</p><p class=3DMsoNormal><span style=3D'font-size:11.0pt;font-family:"Calib=
ri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=3DMsoN=
ormal><span style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";co=
lor:#1F497D'>From our side, the run of the 2 scripts on our TEST environmen=
t was also conclusive and we now are managing the deployment and run of tho=
se scripts also on PROD, after having restored the last backup of prod 00.0=
7.05. restore is done but cleaning (scripts) is still on going for the mome=
nt.<o:p></o:p></span></p><p class=3DMsoNormal><span style=3D'font-size:11.0=
pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></spa=
n></p><p class=3DMsoNormal><span style=3D'font-size:11.0pt;font-family:"Cal=
ibri","sans-serif";color:#1F497D'>See u tomorrow to doing a new status via =
telco.<o:p></o:p></span></p><p class=3DMsoNormal><span style=3D'font-size:1=
1.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></=
span></p><p class=3DMsoNormal><span style=3D'font-size:11.0pt;font-family:"=
Calibri","sans-serif";color:#1F497D'>Best regards,<o:p></o:p></span></p><p =
class=3DMsoNormal><span style=3D'font-size:11.0pt;font-family:"Calibri","sa=
ns-serif";color:#1F497D'><o:p> </o:p></span></p><p class=3DMsoNormal><=
b><span lang=3DDE style=3D'font-size:10.0pt;font-family:"Trebuchet MS","san=
s-serif";color:#003399'>Olivier <a name=3Dnom></a><span style=3D'text-trans=
form:uppercase'>ISOARD</span> </span></b><i><span lang=3DDE style=3D'font-s=
ize:9.0pt;font-family:"Trebuchet MS","sans-serif";color:#1F497D'><br></span=
></i><a name=3Dfonction></a><i><span lang=3DFR-BE style=3D'font-size:9.0pt;=
font-family:"Trebuchet MS","sans-serif";color:#1F497D'>Projets Informatique=
s</span></i><span lang=3DFR-BE style=3D'font-size:11.0pt;font-family:"Calib=
ri","sans-serif";color:#1F497D'><o:p></o:p></span></p><p class=3DMsoNormal>=
<b><u><span lang=3DDE style=3D'font-size:20.0pt;font-family:"Trebuchet MS",=
"sans-serif";color:#FF9900;text-shadow:auto'>_</span></u></b><b><u><span la=
ng=3DDE style=3D'font-size:20.0pt;font-family:"Trebuchet MS","sans-serif";c=
olor:#0099CC;text-shadow:auto'>__</span></u></b><b><u><span lang=3DDE style=
=3D'font-size:20.0pt;font-family:"Trebuchet MS","sans-serif";color:#003399;=
text-shadow:auto'>_</span></u></b><b><u><span lang=3DDE style=3D'font-size:=
20.0pt;font-family:"Trebuchet MS","sans-serif";color:#339900;text-shadow:au=
to'>__</span></u></b><b><u><span lang=3DDE style=3D'font-size:20.0pt;font-f=
amily:"Trebuchet MS","sans-serif";color:#FF6699;text-shadow:auto'>_</span><=
/u></b><b><u><span lang=3DDE style=3D'font-size:20.0pt;font-family:"Trebuch=
et MS","sans-serif";color:#0099CC;text-shadow:auto'>__</span></u></b><b><u>=
<span lang=3DDE style=3D'font-size:20.0pt;font-family:"Trebuchet MS","sans-=
serif";color:#FF9900;text-shadow:auto'>__</span></u></b><b><u><span lang=3D=
DE style=3D'font-size:20.0pt;font-family:"Trebuchet MS","sans-serif";color:=
#003399;text-shadow:auto'>_</span></u></b><b><u><span lang=3DDE style=3D'fo=
nt-size:20.0pt;font-family:"Trebuchet MS","sans-serif";color:#339900;text-s=
hadow:auto'>__</span></u></b><b><u><span lang=3DDE style=3D'font-size:20.0p=
t;font-family:"Trebuchet MS","sans-serif";color:#FF6699;text-shadow:auto'>_=
</span></u></b><b><u><span lang=3DDE style=3D'font-size:20.0pt;font-family:=
"Trebuchet MS","sans-serif";color:#0099CC;text-shadow:auto'>__</span></u></=
b><b><u><span lang=3DDE style=3D'font-size:6.0pt;font-family:"Trebuchet MS"=
,"sans-serif";color:#0099CC;text-shadow:auto'><o:p></o:p></span></u></b></p=
><p class=3DMsoNormal><b><span lang=3DDE style=3D'font-size:8.0pt;font-fami=
ly:"Trebuchet MS","sans-serif";color:#003399'><o:p> </o:p></span></b><=
/p><p class=3DMsoNormal><a name=3Dop></a><b><span lang=3DDE style=3D'font-s=
ize:9.0pt;font-family:"Trebuchet MS","sans-serif";color:#003399'>Office des=
publications de l'Union europ=E9enne </span></b><span lang=3DDE style=3D'f=
ont-size:9.0pt;font-family:"Trebuchet MS","sans-serif";color:#1F497D'><br><=
a name=3Ddirection></a>Direction A =96 Core Business Services <br><a name=
=3Dunit></a>Unit=E9 A3 - Projets Informatiques<br><br></span><span lang=3DD=
E style=3D'font-size:9.0pt;font-family:"Trebuchet MS","sans-serif";color:#7=
F7F7F'>2985 Luxembourg =95 LUXEMBOURG<br>Tel: +352 2929<a name=3Dtel></a>42=
360 =95 Fax: +352 2929<a name=3Dfax></a>44604<br><a name=3Demail></a><a hre=
f=3D"mailto:olivier.isoard at publications.europa.eu"><span style=3D'font-fami=
ly:"Calibri","sans-serif"'>olivier.isoard at publications.europa.eu</span></a>=
<u><br></u></span><u><span style=3D'font-size:9.0pt;font-family:"Trebuchet =
MS","sans-serif";color:#7F7F7F'><a href=3D"http://publications.europa.eu/">=
<span lang=3DDE style=3D'font-family:"Calibri","sans-serif"'>http://publica=
tions.europa.eu</span></a></span></u><span lang=3DFR-BE style=3D'font-size:=
11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p></o:p></span>=
</p><p class=3DMsoNormal><span lang=3DFR-BE style=3D'font-size:11.0pt;font-=
family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p=
class=3DMsoNormal style=3D'margin-left:36.0pt'><b><span lang=3DEN-US style=
=3D'font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><sp=
an lang=3DEN-US style=3D'font-size:10.0pt;font-family:"Tahoma","sans-serif"=
'> Bert Van Nuffelen [mailto:bert.van.nuffelen at tenforce.com] <br><b>Sent:</=
b> Thursday, March 07, 2013 4:04 PM<br><b>To:</b> ISOARD Olivier (OP)<br><b=
>Cc:</b> Project list for EC ODP CKAN project; ZAJAC Agnieszka (OP); HOHN N=
orbert (OP); MEYER Andr=E9 (OP-EXT)<br><b>Subject:</b> Re: quick fix for th=
e production database - Release 00.07.50.SP1<o:p></o:p></span></p><p class=
=3DMsoNormal style=3D'margin-left:36.0pt'><o:p> </o:p></p><p class=3DM=
soNormal style=3D'mso-margin-top-alt:0cm;margin-right:0cm;margin-bottom:12.=
0pt;margin-left:36.0pt'>Hi <br><br>as promised a quick update from our side=
w.r.t. the upload of eurostat.<br>The processing finished properly.<br><br=
>I will trigger an additional run with some other eurostat zips to see if t=
he behaviour is reoccurring.<br><br>Bert<o:p></o:p></p><div><p class=3DMsoN=
ormal style=3D'margin-left:36.0pt'>2013/3/7 Bert Van Nuffelen <<a href=
=3D"mailto:bert.van.nuffelen at tenforce.com" target=3D"_blank">bert.van.nuffe=
len at tenforce.com</a>><o:p></o:p></p><p class=3DMsoNormal style=3D'mso-ma=
rgin-top-alt:0cm;margin-right:0cm;margin-bottom:12.0pt;margin-left:36.0pt'>=
Hi Olivier,<br><br>it does not matter the release version. It is a valid op=
eration for all CKAN databases.<br><br>kind regards,<br><br>Bert<o:p></o:p>=
</p><div><p class=3DMsoNormal style=3D'margin-left:36.0pt'>2013/3/7 ISOARD =
Olivier (OP) <<a href=3D"mailto:Olivier.ISOARD at publications.europa.eu" t=
arget=3D"_blank">Olivier.ISOARD at publications.europa.eu</a>><o:p></o:p></=
p><div><div><blockquote style=3D'border:none;border-left:solid #CCCCCC 1.0p=
t;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm'><p class=3D=
MsoNormal style=3D'margin-left:36.0pt'><o:p> </o:p></p><div><div><p cl=
ass=3DMsoNormal style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto=
;margin-left:36.0pt'><span style=3D'font-size:11.0pt;font-family:"Calibri",=
"sans-serif";color:#1F497D'>Hello Bert,</span><o:p></o:p></p><p class=3DMso=
Normal style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-l=
eft:36.0pt'><span style=3D'font-size:11.0pt;font-family:"Calibri","sans-ser=
if";color:#1F497D'> </span><o:p></o:p></p><p class=3DMsoNormal style=
=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:36.0pt'>=
<span style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1=
F497D'>Thanks for this update. We already got the 2 scripts and are about t=
o run them on our TEST env first. As this is pure db cleaning, it does not =
matter if we run it on 00.07.50 ?</span><o:p></o:p></p><p class=3DMsoNormal=
style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:36=
.0pt'><span style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";co=
lor:#1F497D'> </span><o:p></o:p></p><p class=3DMsoNormal style=3D'mso-=
margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:36.0pt'><span st=
yle=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>P=
lease note that we named this <b>delivery 00.07.50.SP1</b>. (I did the upda=
te and tagging in SVN myself, preferring you=92re still focusing on the com=
plementary investigations </span><span style=3D'font-size:11.0pt;font-famil=
y:Wingdings;color:#1F497D'>J</span><span style=3D'font-size:11.0pt;font-fam=
ily:"Calibri","sans-serif";color:#1F497D'> )</span><o:p></o:p></p><p class=
=3DMsoNormal style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;ma=
rgin-left:36.0pt'><span style=3D'font-size:11.0pt;font-family:"Calibri","sa=
ns-serif";color:#1F497D'> </span><o:p></o:p></p><p class=3DMsoNormal s=
tyle=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:36.0=
pt'><span style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";colo=
r:#1F497D'>Best regards,</span><o:p></o:p></p><p class=3DMsoNormal style=3D=
'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:36.0pt'><sp=
an style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F49=
7D'> </span><o:p></o:p></p><p class=3DMsoNormal style=3D'mso-margin-to=
p-alt:auto;mso-margin-bottom-alt:auto;margin-left:36.0pt'><b><span lang=3DD=
E style=3D'font-size:10.0pt;font-family:"Trebuchet MS","sans-serif";color:#=
003399'>Olivier <a name=3D"13d44ed5113ac471_13d44de56ff61822_nom"></a><span=
style=3D'text-transform:uppercase'>ISOARD</span> </span></b><i><span lang=
=3DDE style=3D'font-size:9.0pt;font-family:"Trebuchet MS","sans-serif";colo=
r:#1F497D'><br></span></i><a name=3D"13d44ed5113ac471_13d44de56ff61822_fonc=
ti"></a><i><span style=3D'font-size:9.0pt;font-family:"Trebuchet MS","sans-=
serif";color:#1F497D'>Projets Informatiques</span></i><o:p></o:p></p><p cla=
ss=3DMsoNormal style=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;=
margin-left:36.0pt'><b><u><span lang=3DDE style=3D'font-size:20.0pt;font-fa=
mily:"Trebuchet MS","sans-serif";color:#FF9900'>_</span></u></b><b><u><span=
lang=3DDE style=3D'font-size:20.0pt;font-family:"Trebuchet MS","sans-serif=
";color:#0099CC'>__</span></u></b><b><u><span lang=3DDE style=3D'font-size:=
20.0pt;font-family:"Trebuchet MS","sans-serif";color:#003399'>_</span></u><=
/b><b><u><span lang=3DDE style=3D'font-size:20.0pt;font-family:"Trebuchet M=
S","sans-serif";color:#339900'>__</span></u></b><b><u><span lang=3DDE style=
=3D'font-size:20.0pt;font-family:"Trebuchet MS","sans-serif";color:#FF6699'=
>_</span></u></b><b><u><span lang=3DDE style=3D'font-size:20.0pt;font-famil=
y:"Trebuchet MS","sans-serif";color:#0099CC'>__</span></u></b><b><u><span l=
ang=3DDE style=3D'font-size:20.0pt;font-family:"Trebuchet MS","sans-serif";=
color:#FF9900'>__</span></u></b><b><u><span lang=3DDE style=3D'font-size:20=
.0pt;font-family:"Trebuchet MS","sans-serif";color:#003399'>_</span></u></b=
><b><u><span lang=3DDE style=3D'font-size:20.0pt;font-family:"Trebuchet MS"=
,"sans-serif";color:#339900'>__</span></u></b><b><u><span lang=3DDE style=
=3D'font-size:20.0pt;font-family:"Trebuchet MS","sans-serif";color:#FF6699'=
>_</span></u></b><b><u><span lang=3DDE style=3D'font-size:20.0pt;font-famil=
y:"Trebuchet MS","sans-serif";color:#0099CC'>__</span></u></b><o:p></o:p></=
p><p class=3DMsoNormal style=3D'mso-margin-top-alt:auto;mso-margin-bottom-a=
lt:auto;margin-left:36.0pt'><b><span lang=3DDE style=3D'font-size:8.0pt;fon=
t-family:"Trebuchet MS","sans-serif";color:#003399'> </span></b><o:p><=
/o:p></p><p class=3DMsoNormal style=3D'mso-margin-top-alt:auto;mso-margin-b=
ottom-alt:auto;margin-left:36.0pt'><a name=3D"13d44ed5113ac471_13d44de56ff6=
1822_op"></a><b><span lang=3DDE style=3D'font-size:9.0pt;font-family:"Trebu=
chet MS","sans-serif";color:#003399'>Office des publications de l'Union eur=
op=E9enne </span></b><span lang=3DDE style=3D'font-size:9.0pt;font-family:"=
Trebuchet MS","sans-serif";color:#1F497D'><br><a name=3D"13d44ed5113ac471_1=
3d44de56ff61822_direct"></a>Direction A =96 Core Business Services <br><a n=
ame=3D"13d44ed5113ac471_13d44de56ff61822_unit"></a>Unit=E9 A3 - Projets Inf=
ormatiques<br><br></span><span lang=3DDE style=3D'font-size:9.0pt;font-fami=
ly:"Trebuchet MS","sans-serif";color:#7F7F7F'>2985 Luxembourg =95 LUXEMBOUR=
G<br>Tel: <a href=3D"tel:%2B352%202929" target=3D"_blank">+352 2929</a><a n=
ame=3D"13d44ed5113ac471_13d44de56ff61822_tel"></a>42360 =95 Fax: <a href=3D=
"tel:%2B352%202929" target=3D"_blank">+352 2929</a><a name=3D"13d44ed5113ac=
471_13d44de56ff61822_fax"></a>44604<br><a name=3D"13d44ed5113ac471_13d44de5=
6ff61822_email"></a><a href=3D"mailto:olivier.isoard at publications.europa.eu=
" target=3D"_blank"><span style=3D'font-family:"Calibri","sans-serif"'>oliv=
ier.isoard at publications.europa.eu</span></a><u><br></u></span><u><span styl=
e=3D'font-size:9.0pt;font-family:"Trebuchet MS","sans-serif";color:#7F7F7F'=
><a href=3D"http://publications.europa.eu/" target=3D"_blank"><span lang=3D=
DE style=3D'font-family:"Calibri","sans-serif"'>http://publications.europa.=
eu</span></a></span></u><o:p></o:p></p><p class=3DMsoNormal style=3D'mso-ma=
rgin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:36.0pt'><span lang=
=3DFR-BE style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color=
:#1F497D'> </span><o:p></o:p></p><p class=3DMsoNormal style=3D'mso-mar=
gin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:72.0pt'><b><span la=
ng=3DEN-US style=3D'font-size:10.0pt;font-family:"Tahoma","sans-serif"'>Fro=
m:</span></b><span lang=3DEN-US style=3D'font-size:10.0pt;font-family:"Taho=
ma","sans-serif"'> Bert Van Nuffelen [mailto:<a href=3D"mailto:bert.van.nuf=
felen at tenforce.com" target=3D"_blank">bert.van.nuffelen at tenforce.com</a>] <=
br><b>Sent:</b> Thursday, March 07, 2013 12:43 PM<br><b>To:</b> ISOARD Oliv=
ier (OP); ZAJAC Agnieszka (OP); HOHN Norbert (OP); MEYER Andr=E9 (OP-EXT)<b=
r><b>Cc:</b> Project list for EC ODP CKAN project<br><b>Subject:</b> quick =
fix for the production database</span><o:p></o:p></p><p class=3DMsoNormal s=
tyle=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:72.0=
pt'> <o:p></o:p></p><p class=3DMsoNormal style=3D'mso-margin-top-alt:a=
uto;mso-margin-bottom-alt:auto;margin-left:72.0pt'>Dear,<br><br>our investi=
gations has lead to the first conclusion. The regular upload of (new) data =
increased the CKAN database table activity to a high number.<br>Very lickel=
y this causes the instability of the CKAN system. <br><br>On our test syste=
m (a release 00.07.01) we activated the production dump. During the indexin=
g (a process step required after changing the database in the back)<br>the =
CKAN system halted. After emptying the activity table the indexing was rest=
arted and it finished properly. After that we have run rdf2ckan with the la=
test zip you have provided.<br>At this moment the EEA and SANCO zips passed=
. Currently a Eurostat zip is running.<br><br>In the svn you find a script =
to clean the appropriate tables. This is a quick-win step towards having ba=
ck a stable system.<br><br><a href=3D"https://webgate.ec.europa.eu/publicat=
ions/svn/ODP/trunk/ckan/management_scripts/ckan_clear_activity_table.sh" ta=
rget=3D"_blank">https://webgate.ec.europa.eu/publications/svn/ODP/trunk/cka=
n/management_scripts/ckan_clear_activity_table.sh</a><br><br>Copy this scri=
pt to $USERHOME/ckan_management and complete the necessary parameters. Thes=
e are the same as for a CKAN backup. <o:p></o:p></p><p class=3DMsoNormal st=
yle=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:111.6=
pt'><span style=3D'font-family:Symbol'>=B7</span><span style=3D'font-size:7=
.0pt'> </span>TARGETBACKUPD=
IR<o:p></o:p></p><p class=3DMsoNormal style=3D'mso-margin-top-alt:auto;mso-=
margin-bottom-alt:auto;margin-left:111.6pt'><span style=3D'font-family:Symb=
ol'>=B7</span><span style=3D'font-size:7.0pt'>  =
; </span>CKAN_PWD<o:p></o:p></p><p class=3DMsoNormal styl=
e=3D'mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:111.6pt=
'><span style=3D'font-family:Symbol'>=B7</span><span style=3D'font-size:7.0=
pt'> </span>POSTGRES_HOST<o=
:p></o:p></p><p class=3DMsoNormal style=3D'mso-margin-top-alt:auto;mso-marg=
in-bottom-alt:auto;margin-left:72.0pt'>The script will first backup the tab=
le and afterwards empty the tables.<br><br>The execution on our site costs =
+- 45 minutes and resulted in a file of 7.6 GB.<br><br>After the script exe=
cution, you have to trigger for this time the reindexing of the database.<b=
r>In $USERHOME/ckan_management <br><br> ./ckan_rein=
dex.sh<br><br>(It costs +- 1hour on our site)<br><br>We keep you info=
rmed about the outcome of the Eurostat test.<br><br>ps. I inserted the desc=
ription of the new script also in the OM on section 7.10.<br><br clear=3Dal=
l>kind regards,<br><br>Bert<span style=3D'color:#888888'><br><br><br>-- <br=
>Bert Van Nuffelen<br><br>Semantic Technologies Software Architect at TenFo=
rce<br><a href=3D"http://www.tenforce.be" target=3D"_blank">www.tenforce.be=
</a><br><br><a href=3D"mailto:Bert.Van.Nuffelen at tenforce.com" target=3D"_bl=
ank">Bert.Van.Nuffelen at tenforce.com</a><br>Office: <a href=3D"tel:%2B32%20%=
280%2916%2031%2048%2060" target=3D"_blank">+32 (0)16 31 48 60</a><br>Mobile=
:<a href=3D"tel:%2B32%20479%2006%2024%2026" target=3D"_blank">+32 479 06 24=
26</a><br>skype: bert.van.nuffelen </span><o:p></o:p></p></div></div></blo=
ckquote></div></div></div><div><div><p class=3DMsoNormal style=3D'margin-le=
ft:36.0pt'><br><br clear=3Dall><br>-- <br>Bert Van Nuffelen<br><br>Semantic=
Technologies Software Architect at TenForce<br><a href=3D"http://www.tenfo=
rce.be" target=3D"_blank">www.tenforce.be</a><br><br><a href=3D"mailto:Bert=
.Van.Nuffelen at tenforce.com" target=3D"_blank">Bert.Van.Nuffelen at tenforce.co=
m</a><br>Office: <a href=3D"tel:%2B32%20%280%2916%2031%2048%2060" target=3D=
"_blank">+32 (0)16 31 48 60</a><br>Mobile:<a href=3D"tel:%2B32%20479%2006%2=
024%2026" target=3D"_blank">+32 479 06 24 26</a><br>skype: bert.van.nuffele=
n <o:p></o:p></p></div></div></div><p class=3DMsoNormal style=3D'margin-lef=
t:36.0pt'><br><br clear=3Dall><br>-- <br>Bert Van Nuffelen<br><br>Semantic =
Technologies Software Architect at TenForce<br><a href=3D"http://www.tenfor=
ce.be" target=3D"_blank">www.tenforce.be</a><br><br><a href=3D"mailto:Bert.=
Van.Nuffelen at tenforce.com" target=3D"_blank">Bert.Van.Nuffelen at tenforce.com=
</a><br>Office: +32 (0)16 31 48 60<br>Mobile:+32 479 06 24 26<br>skype: ber=
t.van.nuffelen <o:p></o:p></p></div></body></html>=
--_000_36D4C4CA2E214B4489A43FAC42983FAD01350B11B649OPMERSEM701_--
More information about the Ecodp-dev
mailing list