[ECODP-dev] Fwd: FW: [ODP] 09.00 Installation update - general status - comments

Tue Jul 9 06:54:18 UTC 2013

Hi Bert,

I am very surprised by this as we obviously  wouldn't expect this. We will
do some initial investigations this week and come back to you. However as
discussed we have limited availability this week so if we're not able to
diagnose the issue we'll need to continue investigating next week.

Is the performance the same on our test server (212.x) as ODP.tenforce.con?

Best,

Darwin

On Tuesday, July 9, 2013, Bert Van Nuffelen wrote:

> Hi Darwin, John and David,
>
> Can you have a look to the performance. Currentltly release 00.09.00 is 80
> times slower on ingest (from 250ms to 20s).
> That is a serious regression. Would it be possible to give a short status
> for this afternoon (call with PO at 1400h Brussels time) on the
> investigation and what is the action plan to get further improvements.
>
> best regards,
>
> Bert
>
> ---------- Forwarded message ----------
> From: ZAJAC Agnieszka (OP) <Agnieszka.ZAJAC at publications.europa.eu<javascript:_e({}, 'cvml', 'Agnieszka.ZAJAC at publications.europa.eu');>
> >
> Date: 2013/7/8
> Subject: FW: [ODP] 09.00 Installation update - general status - comments
> To: "Bert.Van.Nuffelen at tenforce.com <javascript:_e({}, 'cvml',
> 'Bert.Van.Nuffelen at tenforce.com');>" <Bert.Van.Nuffelen at tenforce.com<javascript:_e({}, 'cvml', 'Bert.Van.Nuffelen at tenforce.com');>
> >
> Cc: "MEYER André (OP-EXT)" <Andre.MEYER at ext.publications.europa.eu<javascript:_e({}, 'cvml', 'Andre.MEYER at ext.publications.europa.eu');>>,
> "SABETE Vafa (OP)" <Vafa.SABETE at publications.europa.eu <javascript:_e({},
> 'cvml', 'Vafa.SABETE at publications.europa.eu');>>, "ISOARD Olivier (OP)" <
> Olivier.ISOARD at publications.europa.eu <javascript:_e({}, 'cvml',
> 'Olivier.ISOARD at publications.europa.eu');>>, "HOHN Norbert (OP)" <
> Norbert.HOHN at publications.europa.eu <javascript:_e({}, 'cvml',
> 'Norbert.HOHN at publications.europa.eu');>>
>
>
>  Hello Bert,****
>
> ** **
>
> Could you please have a look at Andre's observation on the install and
> provide us with the feedback?****
>
> ** **
>
> I put in copy Vafa Sabete who is Olivier's backup for this project.****
>
> ** **
>
> Thank you in advance.****
>
> ** **
>
> Regards,****
>
> Agnieszka****
>
> ** **
>
> *From:* MEYER André (OP-EXT)
> *Sent:* Monday, July 08, 2013 9:52 AM
> *To:* ZAJAC Agnieszka (OP); SABETE Vafa (OP)
> *Cc:* HOHN Norbert (OP); BOUSSERT Philippe (OP); ZADRA Julien (OP-EXT)
> *Subject:* [ODP] 09.00 Installation update - general status - comments****
>
> ** **
>
> Hello Agnieszka, Vafa,****
>
> ** **
>
> *Installation status:*
>
> The installation of 09.00 is officially *finished* and all the required
> steps of the installation manual have been performed. An early check of the
> functionalities looks ok for the basic functions but I do see already one
> major problem. ****
>
> ** **
>
> *Problems:*
>
> **-          **The old rdf import-script rdf2ckan.sh takes around 2hrs on
> the current production & test environment in version 08.04 for a standard
> ESTAT file. The newly revised and supposedly improved version of said
> script took over 14 hours to import the latest ESTAT file, gave a lot of
> warnings for some datasets that were not properly validated and gave an
> error for 33 datasets which were not imported at all.****
>
> **-          **I noticed that the current postgres database on the newly
> installed system with a single ESTAT ingestion has a size of double of that
> of the production system which gets updates twice a day for months … If the
> size increases this drastically we will have to revise the configuration of
> the machines and dramatically increase disk storage.****
>
> **-          **I thought this release was supposed to speed up the
> portal, if this is still the case, then this goal was not achieved as it is
> still awfully slow without the static caching of the BigIP. If no
> performance increase was planned, than please ignore this.****
>
> **-          **The configured cron jobs seem to p
>
>
>
> --
> Bert Van Nuffelen
>
> Semantic Technologies Software Architect at TenForce
> www.tenforce.be
>
> Bert.Van.Nuffelen at tenforce.com <javascript:_e({}, 'cvml',
> 'Bert.Van.Nuffelen at tenforce.com');>
> Office: +32 (0)16 31 48 60
> Mobile:+32 479 06 24 26
> skype: bert.van.nuffelen
>

-- 

*Darwin Peltan*

*Project Manager  |  skype: darwinp  |  twitter:
@darwin<http://twitter.com/darwin>
*

*The Open Knowledge Foundation <http://okfn.org/>*

*Empowering through Open Knowledge*

*http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on
Facebook<https://www.facebook.com/OKFNetwork> |
Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>
*
*
CKAN | http://ckan.org | @ckanproject <http://twitter.com/ckanproject>
|open source data management platform
*
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.okfn.org/mailman/private/ecodp-dev/attachments/20130709/7863845c/attachment.html>