[ECODP-dev] SolrIndexError

Thu Aug 8 08:22:43 UTC 2013

Hi John,

for your reference,

going to tomcat6 log I read staff like this, which indicate timeout 
error problem with locks or disk being full. Disk is not full, so the 
first was most probable. I did restart of tomcat6 and now I can re do 
the operation. Here is the relevant exception :

SEVERE: org.apache.lucene.store.LockObtainFailedException: Lock obtain 
timed out: 
NativeFSLock@/applications/ecodp/users/system/tomcat/data/index/lucene-15bc341177d07d12683e99 
ac58eb06d4-write.lock
         at org.apache.lucene.store.Lock.obtain(Lock.java:85)
         at org.apache.lucene.index.IndexWriter.init(IndexWriter.java:1565)
         at 
org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:1421)
         at 
org.apache.solr.update.SolrIndexWriter.<init>(SolrIndexWriter.java:191)
         at 
org.apache.solr.update.UpdateHandler.createMainIndexWriter(UpdateHandler.java:98)
         at 
org.apache.solr.update.DirectUpdateHandler2.openWriter(DirectUpdateHandler2.java:173)
         at 
org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:220)
         at 
org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:61)
         at 
org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:139)
         at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:69)
         at 
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:54)
         at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131)
         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1316)
         at 
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:338)
         at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:241)
         at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
         at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
         at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
         at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
         at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
         at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
         at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
         at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
         at 
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
         at 
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
         at 
org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
         at java.lang.Thread.run(Thread.java:679)

On 8/08/2013 10:03, John Glover wrote:
> Hi Dimitrios,
>
> That just tells us that Solr has returned a 500 error when trying to 
> index the package. The actual error from Solr should be in the Solr 
> log file.
>
> What do you mean by multiple imports of a package? Can you give more 
> detail on what you are doing?
>
> Thanks,
> John
>
>
> On 7 August 2013 17:24, Dimitrios Mexis <dimitrios.mexis at tenforce.com 
> <mailto:dimitrios.mexis at tenforce.com>> wrote:
>
>     hello
>
>     After multiple imports of a package,
>     I get the following message, can you give details on what
>     condition would that happen, and what to do ?
>
>     /
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] URL:
>     http://192.168.35.139/data/api/action/package_update
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/weberror/errormiddleware.py',
>     line 162 in __call__
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]  
>     app_iter = self.application(environ, sr_checker)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/beaker/middleware.py',
>     line 73 in __call__
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]  
>     return self.app(environ, start_response)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/beaker/middleware.py',
>     line 155 in __call__
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]  
>     return self.wrap_app(environ, session_start_response)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/repoze/who/middleware.py',
>     line 87 in __call__
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]  
>     app_iter = app(environ, wrapper.wrap_start_response)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/routes/middleware.py',
>     line 131 in __call__
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]  
>     response = self.app(environ, start_response)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/pylons/wsgiapp.py',
>     line 125 in __call__
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]  
>     response = self.dispatch(controller, environ, start_response)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/pylons/wsgiapp.py',
>     line 324 in dispatch
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]  
>     return controller(environ, start_response)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/controllers/api.py',
>     line 69 in __call__
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]  
>     return base.BaseController.__call__(self, environ, start_response)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/lib/base.py',
>     line 238 in __call__
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]   res =
>     WSGIController.__call__(self, environ, start_response)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/pylons/controllers/core.py',
>     line 221 in __call__
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]  
>     response = self._dispatch_call()
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/pylons/controllers/core.py',
>     line 172 in _dispatch_call
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]  
>     response = self._inspect_call(func)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/pylons/controllers/core.py',
>     line 107 in _inspect_call
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]  
>     result = self._perform_call(func, args)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/pylons/controllers/core.py',
>     line 60 in _perform_call
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]  
>     return func(**args)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/controllers/api.py',
>     line 177 in action
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]  
>     result = function(context, request_data)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/logic/action/update.py',
>     line 275 in package_update
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]
>     model.repo.commit()
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/src/vdm/vdm/sqlalchemy/tools.py',
>     line 102 in commit
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]
>     self.session.commit()
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/sqlalchemy/orm/scoping.py',
>     line 114 in do
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]  
>     return getattr(self.registry(), name)(*args, **kwargs)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/sqlalchemy/orm/session.py',
>     line 656 in commit
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]
>     self.transaction.commit()
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/sqlalchemy/orm/session.py',
>     line 314 in commit
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]
>     self._prepare_impl()
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/sqlalchemy/orm/session.py',
>     line 290 in _prepare_impl
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]
>     self.session.dispatch.before_commit(self.session)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/sqlalchemy/event.py',
>     line 291 in __call__
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]  
>     fn(*args, **kw)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/model/extension.py',
>     line 103 in before_commit
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]
>     methodcaller('before_commit', session)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/model/extension.py',
>     line 38 in notify_observers
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]  
>     func(observer)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/model/modification.py',
>     line 62 in before_commit
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]
>     self.notify(obj, domain_object.DomainObjectOperation.changed)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/model/modification.py',
>     line 68 in notify
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]
>     observer.notify(entity, operation)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/lib/search/__init__.py',
>     line 126 in notify
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]   operation
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/lib/search/__init__.py',
>     line 101 in dispatch_by_operation
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]
>     index.update_dict(entity)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/lib/search/index.py',
>     line 96 in update_dict
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]
>     self.index_package(pkg_dict, defer_commit)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139] File
>     '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/lib/search/index.py',
>     line 228 in index_package
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]   raise
>     SearchIndexError(e)
>     [Wed Aug 07 17:17:25 2013] [error] [client 192.168.35.139]
>     SearchIndexError: HTTP code=500, reason=Internal Server Error
>     /
>
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.okfn.org/mailman/private/ecodp-dev/attachments/20130808/8ce42894/attachment.html>