[ECODP-dev] urgent validation required

Wed Sep 25 10:19:31 UTC 2013

Hi John,

Do you have experience with the situation that CKAN is not the only
application connecting to postgreSQL?

We have here the application semmap that is connecting with postgreSQL. So
what it the effect on the database operations?

best,

Bert

2013/9/25 Dimitrios Mexis <dimitrios.mexis at tenforce.com>

>  Guys,
>
> Did you stop postgresql service before you run the reset db ?
>
> Dimitrios
>
>
> On 25/09/2013 11:24, John Glover wrote:
>
> Hi Bert,
>
>  Just to confirm: you are seeing this RDF error message during the
> running of your reset script (which is then hanging at some point)?
>
>  Are there any problems with your servers at the moment? I am unable to
> access the site at http://http://212.71.25.148, and I am not able to save
> a dump of the current database from the test machine at the moment, pg_dump
> is hanging. I'm not sure if this is related or not.
>
>  Regards,
> John
>
>
> On 25 September 2013 11:12, Bert Van Nuffelen <
> bert.van.nuffelen at tenforce.com> wrote:
>
>>    Hi John,
>>
>>  indeed, I see it now too.
>>
>>  But now the reset gets stuck. Maybe of this, maybe not. Is there a
>> connection and is the error we got leading to a problematic situation?
>>  Note we get it on our internal dev server too now.
>>
>>  best,
>>
>>  Bert
>>
>>
>>
>> 2013/9/25 John Glover <john.glover at okfn.org>
>>
>>> Hi Bert,
>>>
>>>  When did you run this? The most recent version of that error message
>>> that I see is from 15:41 yesterday afternoon, unless you are running this
>>> on a different server.
>>>
>>>  Regards,
>>> John
>>>
>>>
>>> On 25 September 2013 11:04, Bert Van Nuffelen <
>>> bert.van.nuffelen at tenforce.com> wrote:
>>>
>>>>   Hi John
>>>>
>>>>  that I can't answer.
>>>>
>>>>  We start the script and it gets stalled and then I went looking into
>>>> the logs.
>>>> As it is an exception I have not clue where it might be.
>>>>
>>>>  I believe the easiest is that you run the script / steps of the script
>>>> on the test machine and see which is the problem one.
>>>>
>>>>  Bert
>>>>
>>>>
>>>>
>>>> 2013/9/25 John Glover <john.glover at okfn.org>
>>>>
>>>>> Hi Bert,
>>>>>
>>>>>  At what stage are you getting this error message?
>>>>>
>>>>>  Also: on a new database you should really load the publishers and
>>>>> vocabs before importing the CSV translations, the recommended sequence is
>>>>> in the 'Additions for operations manual - Release 01.00' Google doc. I
>>>>> don't think that this is the source of your error though.
>>>>>
>>>>>  Regards,
>>>>> John
>>>>>
>>>>>
>>>>> On 25 September 2013 10:55, Bert Van Nuffelen <
>>>>> bert.van.nuffelen at tenforce.com> wrote:
>>>>>
>>>>>> See $USERHOME/ckan/bin/ckan_reset_db.sh
>>>>>>
>>>>>> #!/bin/bash
>>>>>> # ARG1 = the username of the sys admin user.
>>>>>>
>>>>>> # This script creates a valid EU ODP empty CKAN database.
>>>>>>
>>>>>> USERHOME=/applications/ecodp/users/ecodp
>>>>>> CKANHOME=$USERHOME/ckan
>>>>>>
>>>>>> source $CKANHOME/bin/paster.sh
>>>>>>
>>>>>> if [ $# -lt 1 ] ; then
>>>>>>    echo "1 arguments are mandatory"
>>>>>>    echo "arg1 the username of the sysadmin"
>>>>>>    exit
>>>>>>    fi
>>>>>>
>>>>>>
>>>>>> paster --plugin=ckan db clean -c $CKAN_INI
>>>>>> paster --plugin=ckan db init  -c $CKAN_INI
>>>>>> # erase the file storage for CKAN UI and RDF2CKAN
>>>>>> rm -rf $CKANHOME/var/file-storage/*
>>>>>> rm -rf $CKANHOME/var/uploads/*
>>>>>> paster --plugin=ckanext-ecportal ecportal searchcloud-install-tables
>>>>>> -c $CKAN_INI
>>>>>> paster --plugin=ckanext-ecportal ecportal import-csv-translations -c
>>>>>> $CKAN_INI
>>>>>> paster --plugin=ckan search-index rebuild -c $CKAN_INI
>>>>>> paster --plugin=ckanext-ecportal ecportal update-all-vocabs -c
>>>>>> $CKAN_INI
>>>>>> paster --plugin=ckan search-index rebuild -c $CKAN_INI
>>>>>> ...
>>>>>>
>>>>>>
>>>>>>  2013/9/25 John Glover <john.glover at okfn.org>
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>>  Can you tell me the CKAN commands that your script is running? Is
>>>>>>> this just clearing the database or loading some data?
>>>>>>>
>>>>>>>  Regards,
>>>>>>> John
>>>>>>>
>>>>>>>
>>>>>>> On 25 September 2013 10:52, John Glover <john.glover at okfn.org>wrote:
>>>>>>>
>>>>>>>> Hi Bert,
>>>>>>>>
>>>>>>>>  Do you have any more details or context for this? It looks like
>>>>>>>> CKAN is reporting being sent invalid XML in the RDF. See the email thread
>>>>>>>> "Malformed rdf".
>>>>>>>>
>>>>>>>>  Regards,
>>>>>>>> John
>>>>>>>>
>>>>>>>>
>>>>>>>>  On 25 September 2013 10:41, Bert Van Nuffelen <
>>>>>>>> bert.van.nuffelen at tenforce.com> wrote:
>>>>>>>>
>>>>>>>>>  Hi John,
>>>>>>>>>
>>>>>>>>> can you verify urgently on the test server if this is a typo in
>>>>>>>>> CKAN? And if so, if this is in the git repo or just a test on the test
>>>>>>>>> server:
>>>>>>>>>
>>>>>>>>> [Tue Sep 24 15:41:19 2013] [error] 2013-09-24 15:41:19,429 ERROR
>>>>>>>>> [ckanext.ecportal.rdfutil] EntityRef: expecting ';', line 128, column 123
>>>>>>>>>
>>>>>>>>>  kind regards,
>>>>>>>>>
>>>>>>>>>  Bert
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Bert Van Nuffelen
>>>>>>>>>
>>>>>>>>> Semantic Technologies Software Architect at TenForce
>>>>>>>>> www.tenforce.be
>>>>>>>>>
>>>>>>>>> Bert.Van.Nuffelen at tenforce.com
>>>>>>>>> Office: +32 (0)16 31 48 60 <%2B32%20%280%2916%2031%2048%2060>
>>>>>>>>> Mobile:+32 479 06 24 26 <%2B32%20479%2006%2024%2026>
>>>>>>>>> skype: bert.van.nuffelen
>>>>>>>>>
>>>>>>>>>  _______________________________________________
>>>>>>>>> Ecodp-dev mailing list
>>>>>>>>> Ecodp-dev at lists.okfn.org
>>>>>>>>> http://lists.okfn.org/mailman/listinfo/ecodp-dev
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Ecodp-dev mailing list
>>>>>>> Ecodp-dev at lists.okfn.org
>>>>>>> http://lists.okfn.org/mailman/listinfo/ecodp-dev
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Bert Van Nuffelen
>>>>>>
>>>>>> Semantic Technologies Software Architect at TenForce
>>>>>> www.tenforce.be
>>>>>>
>>>>>> Bert.Van.Nuffelen at tenforce.com
>>>>>> Office: +32 (0)16 31 48 60 <%2B32%20%280%2916%2031%2048%2060>
>>>>>> Mobile:+32 479 06 24 26 <%2B32%20479%2006%2024%2026>
>>>>>> skype: bert.van.nuffelen
>>>>>>
>>>>>> _______________________________________________
>>>>>> Ecodp-dev mailing list
>>>>>> Ecodp-dev at lists.okfn.org
>>>>>> http://lists.okfn.org/mailman/listinfo/ecodp-dev
>>>>>>
>>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Ecodp-dev mailing list
>>>>> Ecodp-dev at lists.okfn.org
>>>>> http://lists.okfn.org/mailman/listinfo/ecodp-dev
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Bert Van Nuffelen
>>>>
>>>> Semantic Technologies Software Architect at TenForce
>>>> www.tenforce.be
>>>>
>>>> Bert.Van.Nuffelen at tenforce.com
>>>> Office: +32 (0)16 31 48 60 <%2B32%20%280%2916%2031%2048%2060>
>>>> Mobile:+32 479 06 24 26
>>>> skype: bert.van.nuffelen
>>>>
>>>> _______________________________________________
>>>> Ecodp-dev mailing list
>>>> Ecodp-dev at lists.okfn.org
>>>> http://lists.okfn.org/mailman/listinfo/ecodp-dev
>>>>
>>>>
>>>
>>> _______________________________________________
>>> Ecodp-dev mailing list
>>> Ecodp-dev at lists.okfn.org
>>> http://lists.okfn.org/mailman/listinfo/ecodp-dev
>>>
>>>
>>
>>
>> --
>> Bert Van Nuffelen
>>
>> Semantic Technologies Software Architect at TenForce
>> www.tenforce.be
>>
>> Bert.Van.Nuffelen at tenforce.com
>> Office: +32 (0)16 31 48 60 <%2B32%20%280%2916%2031%2048%2060>
>> Mobile:+32 479 06 24 26 <%2B32%20479%2006%2024%2026>
>> skype: bert.van.nuffelen
>>
>> _______________________________________________
>> Ecodp-dev mailing list
>> Ecodp-dev at lists.okfn.org
>> http://lists.okfn.org/mailman/listinfo/ecodp-dev
>>
>>
>
>
> _______________________________________________
> Ecodp-dev mailing listEcodp-dev at lists.okfn.orghttp://lists.okfn.org/mailman/listinfo/ecodp-dev
>
>
>
> _______________________________________________
> Ecodp-dev mailing list
> Ecodp-dev at lists.okfn.org
> http://lists.okfn.org/mailman/listinfo/ecodp-dev
>
>

-- 
Bert Van Nuffelen

Semantic Technologies Software Architect at TenForce
www.tenforce.be

Bert.Van.Nuffelen at tenforce.com
Office: +32 (0)16 31 48 60
Mobile:+32 479 06 24 26
skype: bert.van.nuffelen
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.okfn.org/mailman/private/ecodp-dev/attachments/20130925/b6708ea9/attachment.html>