[ECODP-dev] Reseting new database error with vocabularies

Dimitrios Mexis dimitrios.mexis at tenforce.com
Mon Sep 9 09:54:07 UTC 2013


The exact commands that we run, is on directory:
/applications/ecodp/users/ecodp/ckan/bin
and the script is ckan_reset_db.sh*
*which is as well on okf-devel machine.*

*For your convenience,**however*,*the commands of the scriptare :
At the bold line it does not return anything right now. And I am sure 
that is there now stuck. As the next command "create-all-vocabs", would 
fail, and now I need to issue update-all-vocabs instead. Right ?

paster --plugin=ckan db clean -c $CKAN_INI
paster --plugin=ckan db init  -c $CKAN_INI
paster --plugin=ckanext-ecportal ecportal searchcloud-install-tables -c 
$CKAN_INI
paster --plugin=ckanext-ecportal ecportal import-csv-translations -c 
$CKAN_INI*
paster --plugin=ckan search-index rebuild -c $CKAN_INI
*paster --plugin=ckanext-ecportal ecportal create-all-vocabs -c $CKAN_INI*


*now I will stop what ever is running, restart the machines( including 
the solr ). In case you want to know where I do the tests we can 
exchange the info through Skype.

best
Dimitrios
*
*On 9/09/2013 11:35, John Glover wrote:
> Hi Dimitrios,
>
> The messages seem ok.
>
> That last message shows that CKAN has finished updating the search 
> index. Does this search-index command not return after printing this 
> message or have you run another command after this that is hanging? 
> Can you list the exact commands that are being run by your script please?
>
> Thanks,
> John
>
>
> On 9 September 2013 11:16, Dimitrios Mexis 
> <dimitrios.mexis at tenforce.com <mailto:dimitrios.mexis at tenforce.com>> 
> wrote:
>
>     Good morning John and thanks for the feed back.
>
>     Right now I observe these messages and give me please your
>     feedback whether they are ok as messages. We don't have them on
>     the previous release :
>     root at tffvirt-rh-template bin]# ./ckan_reset_db.sh api
>     2013-09-09 10:45:51,640 INFO  [ckan.model] Database tables dropped
>     Cleaning DB: SUCCESS
>     */applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/sqlalchemy/engine/reflection.py:47:
>     SAWarning: Skipped unsupported reflection of expression-based
>     index idx_pkg_lname**
>     **  ret = fn(self, con, *args, **kw)*
>     */applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/sqlalchemy/engine/reflection.py:47:
>     SAWarning: Skipped unsupported reflection of expression-based
>     index idx_pkg_slname**
>     **  ret = fn(self, con, *args, **kw)**
>     **/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/sqlalchemy/engine/reflection.py:47:
>     SAWarning: Skipped unsupported reflection of expression-based
>     index idx_pkg_suname**
>     **  ret = fn(self, con, *args, **kw)**
>     **/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/sqlalchemy/engine/reflection.py:47:
>     SAWarning: Skipped unsupported reflection of expression-based
>     index idx_pkg_uname**
>     **  ret = fn(self, con, *args, **kw)**
>     **/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/sqlalchemy/engine/reflection.py:47:
>     SAWarning: Skipped unsupported reflection of expression-based
>     index idx_user_name_index**
>     **  ret = fn(self, con, *args, **kw)**
>     *2013-09-09 10:45:58,134 INFO  [ckan.model] CKAN database version
>     upgraded: 0 -> 59
>     2013-09-09 10:45:59,005 INFO  [ckan.model] Database initialised
>     Initialising DB: SUCCESS
>
>
>     Also now the whole operation is frozen at this point:
>     Initialising DB: SUCCESS
>     Creating the search_query table ...
>     done.
>     Creating the search_popular_latest table ...
>     done.
>     Creating the search_popular_approved table ...
>     done.
>     Creating the search_query_date index ...
>     done.
>     2013-09-09 10:46:08,754 INFO  [ckan.lib.search] Rebuilding search
>     index...
>     2013-09-09 10:46:08,757 INFO  [ckan.lib.search] Rebuilding the
>     whole index...
>     2013-09-09 10:46:08,814 INFO  [ckan.lib.search] Finished
>     rebuilding search index.
>     *2013-09-09 10:46:08,820 INFO  [ckan.lib.search] Commited pending
>     changes on the search index*
>
>
>     What do you think ?
>
>     Regards
>     Dimitrios
>
>
>     On 9/09/2013 11:11, John Glover wrote:
>>     Hi Dimitrios,
>>
>>     Yes, this command has changed from create- to update- with
>>     release 1 (as these commands can now be used to update
>>     vocabularies as well as creating them). This will be in the
>>     release notes / operations manual for this release, for now the
>>     items that we have to add are in this document:
>>     https://docs.google.com/a/okfn.org/document/d/1TGnYuj7GdRswxh0089EO_6Ms8yQRnWrj9OXAIxQJiPo/edit?usp=sharing
>>
>>     So, you should run:
>>
>>     paster --plugin=ckanext-ecportal ecportal update-all-vocabs -c
>>     <config>
>>     paster --plugin=ckanext-ecportal ecportal update-publishers <file
>>     (optional)> -c <config>
>>
>>     Regards,
>>     John
>>
>>
>>     On 9 September 2013 11:04, Dimitrios Mexis
>>     <dimitrios.mexis at tenforce.com
>>     <mailto:dimitrios.mexis at tenforce.com>> wrote:
>>
>>         The following in our test environment for release one, fail:
>>
>>         paster --plugin=ckan db clean -c $CKAN_INI
>>         paster --plugin=ckan db init  -c $CKAN_INI
>>         paster --plugin=ckanext-ecportal ecportal create-all-vocabs
>>         -c $CKAN_INI
>>
>>         please read the following also for your help....
>>
>>         Thank you
>>
>>
>>         On 6/09/2013 10:33, Dimitrios Mexis wrote:
>>>         Hello John/David,
>>>
>>>         under directory */applications/ecodp/users/ecodp/ckan/bin/*
>>>         there is the script :
>>>         /applications/ecodp/users/ecodp/ckan/bin/*ckan_reset_db.sh*
>>>
>>>         which uses the paster commands to reset database and import
>>>         the necessary staff.
>>>
>>>         We get an error. check please the last line. the db is
>>>         unusable later. Keep in mind that we reset a database that
>>>         is already upgraded.
>>>
>>>         Initialising DB: SUCCESS
>>>         Creating the search_query table ...
>>>         done.
>>>         Creating the search_popular_latest table ...
>>>         done.
>>>         Creating the search_popular_approved table ...
>>>         done.
>>>         Creating the search_query_date index ...
>>>         done.
>>>         2013-09-06 10:25:50,739 INFO [ckan.lib.search] Rebuilding
>>>         search index...
>>>         2013-09-06 10:25:50,742 INFO [ckan.lib.search] Rebuilding
>>>         the whole index...
>>>         2013-09-06 10:25:50,825 INFO [ckan.lib.search] Finished
>>>         rebuilding search index.
>>>         2013-09-06 10:25:50,832 INFO [ckan.lib.search] Commited
>>>         pending changes on the search index
>>>         *2013-09-06 10:25:51,853 ERROR [root] Command
>>>         "create-all-vocabs" not recognized* 
>>
>>
>
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.okfn.org/mailman/private/ecodp-dev/attachments/20130909/a16054f0/attachment.html>


More information about the ecodp-dev mailing list