[ECODP-dev] Fwd: FW: [ODP] 09.00 Installation update - general status - comments

Tue Jul 9 08:39:37 UTC 2013

Hi Darwin,

this is indeed on the case on odp.tenforce.com too. We did our tests
yesterday with the information provided by PO and we obtain similar
performance results.
On the test machine, I do not know what John did. So no statement from my
side if that is representable.

Note that this will block probably the acceptance of release 00.09.00 and
might lead to a rejection of the release.

best regards,

Bert

2013/7/9 Darwin Peltan <darwin.peltan at okfn.org>

> Hi Bert,
>
> I am very surprised by this as we obviously  wouldn't expect this. We will
> do some initial investigations this week and come back to you. However as
> discussed we have limited availability this week so if we're not able to
> diagnose the issue we'll need to continue investigating next week.
>
> Is the performance the same on our test server (212.x) as ODP.tenforce.con?
>
> Best,
>
> Darwin
>
>
>
> On Tuesday, July 9, 2013, Bert Van Nuffelen wrote:
>
>> Hi Darwin, John and David,
>>
>> Can you have a look to the performance. Currentltly release 00.09.00 is
>> 80 times slower on ingest (from 250ms to 20s).
>> That is a serious regression. Would it be possible to give a short status
>> for this afternoon (call with PO at 1400h Brussels time) on the
>> investigation and what is the action plan to get further improvements.
>>
>> best regards,
>>
>> Bert
>>
>> ---------- Forwarded message ----------
>> From: ZAJAC Agnieszka (OP) <Agnieszka.ZAJAC at publications.europa.eu>
>> Date: 2013/7/8
>> Subject: FW: [ODP] 09.00 Installation update - general status - comments
>> To: "Bert.Van.Nuffelen at tenforce.com" <Bert.Van.Nuffelen at tenforce.com>
>> Cc: "MEYER André (OP-EXT)" <Andre.MEYER at ext.publications.europa.eu>,
>> "SABETE Vafa (OP)" <Vafa.SABETE at publications.europa.eu>, "ISOARD Olivier
>> (OP)" <Olivier.ISOARD at publications.europa.eu>, "HOHN Norbert (OP)" <
>> Norbert.HOHN at publications.europa.eu>
>>
>>
>>  Hello Bert,****
>>
>> ** **
>>
>> Could you please have a look at Andre's observation on the install and
>> provide us with the feedback?****
>>
>> ** **
>>
>> I put in copy Vafa Sabete who is Olivier's backup for this project.****
>>
>> ** **
>>
>> Thank you in advance.****
>>
>> ** **
>>
>> Regards,****
>>
>> Agnieszka****
>>
>> ** **
>>
>> *From:* MEYER André (OP-EXT)
>> *Sent:* Monday, July 08, 2013 9:52 AM
>> *To:* ZAJAC Agnieszka (OP); SABETE Vafa (OP)
>> *Cc:* HOHN Norbert (OP); BOUSSERT Philippe (OP); ZADRA Julien (OP-EXT)
>> *Subject:* [ODP] 09.00 Installation update - general status - comments***
>> *
>>
>> ** **
>>
>> Hello Agnieszka, Vafa,****
>>
>> ** **
>>
>> *Installation status:*
>>
>> The installation of 09.00 is officially *finished* and all the required
>> steps of the installation manual have been performed. An early check of the
>> functionalities looks ok for the basic functions but I do see already one
>> major problem. ****
>>
>> ** **
>>
>> *Problems:*
>>
>> **-          **The old rdf import-script rdf2ckan.sh takes around 2hrs
>> on the current production & test environment in version 08.04 for a
>> standard ESTAT file. The newly revised and supposedly improved version of
>> said script took over 14 hours to import the latest ESTAT file, gave a lot
>> of warnings for some datasets that were not properly validated and gave an
>> error for 33 datasets which were not imported at all.****
>>
>> **-          **I noticed that the current postgres database on the newly
>> installed system with a single ESTAT ingestion has a size of double of that
>> of the production system which gets updates twice a day for months … If the
>> size increases this drastically we will have to revise the configuration of
>> the machines and dramatically increase disk storage.****
>>
>> **-          **I thought this release was supposed to speed up the
>> portal, if this is still the case, then this goal was not achieved as it is
>> still awfully slow without the static caching of the BigIP. If no
>> performance increase was planned, than please ignore this.****
>>
>> **-          **The configured cron jobs seem to p
>>
>>
>>
>> --
>> Bert Van Nuffelen
>>
>> Semantic Technologies Software Architect at TenForce
>> www.tenforce.be
>>
>> Bert.Van.Nuffelen at tenforce.com
>> Office: +32 (0)16 31 48 60
>> Mobile:+32 479 06 24 26
>> skype: bert.van.nuffelen
>>
>
>
> --
>
> *Darwin Peltan*
>
> *Project Manager  |  skype: darwinp  |  twitter: @darwin<http://twitter.com/darwin>
> *
>
> *The Open Knowledge Foundation <http://okfn.org/>*
>
> *Empowering through Open Knowledge*
>
> *http://okfn.org/  |  @okfn <http://twitter.com/OKFN>  |  OKF on Facebook<https://www.facebook.com/OKFNetwork> |
> Blog <http://blog.okfn.org/>  |  Newsletter<http://okfn.org/about/newsletter>
> *
> *
> CKAN | http://ckan.org | @ckanproject <http://twitter.com/ckanproject> |open source data management platform
> *
>
>
> _______________________________________________
> Ecodp-dev mailing list
> Ecodp-dev at lists.okfn.org
> http://lists.okfn.org/mailman/listinfo/ecodp-dev
>
>

-- 
Bert Van Nuffelen

Semantic Technologies Software Architect at TenForce
www.tenforce.be

Bert.Van.Nuffelen at tenforce.com
Office: +32 (0)16 31 48 60
Mobile:+32 479 06 24 26
skype: bert.van.nuffelen
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.okfn.org/mailman/private/ecodp-dev/attachments/20130709/3ede2faf/attachment.html>