[ECODP-dev] Reseting new database error with vocabularies

Mon Sep 9 10:16:56 UTC 2013

Hi Dimitrios,

Yes, create-all-vocabs should now be update-all-vocabs (and you also need
to run update-publishers as noted in the previous email). The search index
rebuild should definitely not be hanging at this point so let me know if
this happens again.

Regards,
John

On 9 September 2013 11:54, Dimitrios Mexis <dimitrios.mexis at tenforce.com>wrote:

>  The exact commands that we run, is on directory:
> /applications/ecodp/users/ecodp/ckan/bin
> and the script is ckan_reset_db.sh*
> *which is as well on okf-devel machine.*
>
> *For your convenience,* *however*,* the commands of the script are :
> At the bold line it does not return anything right now. And I am sure that
> is there now stuck. As the next command "create-all-vocabs", would fail,
> and now I need to issue update-all-vocabs instead. Right ?
>
>
> paster --plugin=ckan db clean -c $CKAN_INI
> paster --plugin=ckan db init  -c $CKAN_INI
> paster --plugin=ckanext-ecportal ecportal searchcloud-install-tables -c
> $CKAN_INI
> paster --plugin=ckanext-ecportal ecportal import-csv-translations -c
> $CKAN_INI*
> paster --plugin=ckan search-index rebuild -c $CKAN_INI
> *
> paster --plugin=ckanext-ecportal ecportal create-all-vocabs -c $CKAN_INI*
>
>
> *
> now I will stop what ever is running, restart the machines ( including
> the solr ). In case you want to know where I do the tests we can exchange
> the info through Skype.
>
> best
> Dimitrios
> *
> *
> On 9/09/2013 11:35, John Glover wrote:
>
> Hi Dimitrios,
>
>  The messages seem ok.
>
>  That last message shows that CKAN has finished updating the search
> index. Does this search-index command not return after printing this
> message or have you run another command after this that is hanging? Can you
> list the exact commands that are being run by your script please?
>
>  Thanks,
> John
>
>
> On 9 September 2013 11:16, Dimitrios Mexis <dimitrios.mexis at tenforce.com>wrote:
>
>>  Good morning John and thanks for the feed back.
>>
>> Right now I observe these messages and give me please your feedback
>> whether they are ok as messages. We don't have them on the previous release
>> :
>> root at tffvirt-rh-template bin]# ./ckan_reset_db.sh api
>> 2013-09-09 10:45:51,640 INFO  [ckan.model] Database tables dropped
>> Cleaning DB: SUCCESS
>> */applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/sqlalchemy/engine/reflection.py:47:
>> SAWarning: Skipped unsupported reflection of expression-based index
>> idx_pkg_lname**
>> **  ret = fn(self, con, *args, **kw)*
>> */applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/sqlalchemy/engine/reflection.py:47:
>> SAWarning: Skipped unsupported reflection of expression-based index
>> idx_pkg_slname**
>> **  ret = fn(self, con, *args, **kw)**
>> **/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/sqlalchemy/engine/reflection.py:47:
>> SAWarning: Skipped unsupported reflection of expression-based index
>> idx_pkg_suname**
>> **  ret = fn(self, con, *args, **kw)**
>> **/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/sqlalchemy/engine/reflection.py:47:
>> SAWarning: Skipped unsupported reflection of expression-based index
>> idx_pkg_uname**
>> **  ret = fn(self, con, *args, **kw)**
>> **/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/sqlalchemy/engine/reflection.py:47:
>> SAWarning: Skipped unsupported reflection of expression-based index
>> idx_user_name_index**
>> **  ret = fn(self, con, *args, **kw)**
>> *2013-09-09 10:45:58,134 INFO  [ckan.model] CKAN database version
>> upgraded: 0 -> 59
>> 2013-09-09 10:45:59,005 INFO  [ckan.model] Database initialised
>> Initialising DB: SUCCESS
>>
>>
>> Also now the whole operation is frozen at this point:
>>  Initialising DB: SUCCESS
>> Creating the search_query table ...
>> done.
>> Creating the search_popular_latest table ...
>> done.
>> Creating the search_popular_approved table ...
>> done.
>> Creating the search_query_date index ...
>> done.
>>  2013-09-09 10:46:08,754 INFO  [ckan.lib.search] Rebuilding search
>> index...
>> 2013-09-09 10:46:08,757 INFO  [ckan.lib.search] Rebuilding the whole
>> index...
>> 2013-09-09 10:46:08,814 INFO  [ckan.lib.search] Finished rebuilding
>> search index.
>> *2013-09-09 10:46:08,820 INFO  [ckan.lib.search] Commited pending
>> changes on the search index*
>>
>>
>> What do you think ?
>>
>> Regards
>> Dimitrios
>>
>>
>> On 9/09/2013 11:11, John Glover wrote:
>>
>> Hi Dimitrios,
>>
>>  Yes, this command has changed from create- to update- with release 1
>> (as these commands can now be used to update vocabularies as well as
>> creating them). This will be in the release notes / operations manual for
>> this release, for now the items that we have to add are in this document:
>> https://docs.google.com/a/okfn.org/document/d/1TGnYuj7GdRswxh0089EO_6Ms8yQRnWrj9OXAIxQJiPo/edit?usp=sharing
>>
>>  So, you should run:
>>
>>  paster --plugin=ckanext-ecportal ecportal update-all-vocabs -c <config>
>>  paster --plugin=ckanext-ecportal ecportal update-publishers <file
>> (optional)> -c <config>
>>
>>  Regards,
>> John
>>
>>
>> On 9 September 2013 11:04, Dimitrios Mexis <dimitrios.mexis at tenforce.com>wrote:
>>
>>>  The following in our test environment for release one, fail:
>>>
>>> paster --plugin=ckan db clean -c $CKAN_INI
>>> paster --plugin=ckan db init  -c $CKAN_INI
>>> paster --plugin=ckanext-ecportal ecportal create-all-vocabs -c $CKAN_INI
>>>
>>> please read the following also for your help....
>>>
>>> Thank you
>>>
>>>
>>> On 6/09/2013 10:33, Dimitrios Mexis wrote:
>>>
>>> Hello John/David,
>>>
>>> under directory */applications/ecodp/users/ecodp/ckan/bin/*
>>> there is the script :
>>> /applications/ecodp/users/ecodp/ckan/bin/*ckan_reset_db.sh*
>>>
>>> which uses the paster commands to reset database and import the
>>> necessary staff.
>>>
>>> We get an error. check please the last line. the db is unusable later.
>>> Keep in mind that we reset a database that is already upgraded.
>>>
>>> Initialising DB: SUCCESS
>>> Creating the search_query table ...
>>> done.
>>> Creating the search_popular_latest table ...
>>> done.
>>> Creating the search_popular_approved table ...
>>> done.
>>> Creating the search_query_date index ...
>>> done.
>>> 2013-09-06 10:25:50,739 INFO  [ckan.lib.search] Rebuilding search
>>> index...
>>> 2013-09-06 10:25:50,742 INFO  [ckan.lib.search] Rebuilding the whole
>>> index...
>>> 2013-09-06 10:25:50,825 INFO  [ckan.lib.search] Finished rebuilding
>>> search index.
>>> 2013-09-06 10:25:50,832 INFO  [ckan.lib.search] Commited pending changes
>>> on the search index
>>> *2013-09-06 10:25:51,853 ERROR [root] Command "create-all-vocabs" not
>>> recognized*
>>>
>>>
>>>
>>
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.okfn.org/mailman/private/ecodp-dev/attachments/20130909/1668a15e/attachment.html>