[ECODP-dev] Import SG package problem

• Previous message: [ECODP-dev] Error in operation of import CKAN
• Next message: [ECODP-dev] update on translations 0.9
• Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

Hi David/John,

we have a strange case. An SG package, that is not uploaded to the
customer, but on our side it is uploaded on 8.

The file of the output of process, shows something as immediate stop of
communication. With no apparent reason.

Attachments & Description:
I attach you the rdf file.  Which is the same file, as in a previous
message I had posted, and that gives problems to the customer as well.
the error log of the ecodp, which signifies some possible problem with
SOLR.
The TENFORCE version 8 is the file generated from ourside trying to upload
on 8 release, and it worked.
Release 9, is interrupted messages I got from the latest version.

Remarks: it seems at this installation of customer, tomcat6 and solr for
version 8 to be...unstable. I don't follow why. As if it might stop on its
own. So : if SOLR is down is the import failing too ?
On 9, I notice strange behavior, that sometimes didn't want to import the
package. Is the rdf valid one for upload ?
I notice that even if I escape characters in bash and using curl I might
have errors like No JSON Output on release 9, and that gives me internal
server errors.

also, I noticed that it failed to me, once when it was trying to import the
data, when I had marked it as deleted. That happened once. At least that is
what I understood. I didn't expect it so I can not tell for sure if that is
problem.

They don't claim to have problems with other packages.

Is it possible to take a look also ?

Thank you
Dimitrios
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.okfn.org/mailman/private/ecodp-dev/attachments/20130726/3baba89e/attachment.html>
-------------- next part --------------
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] Error - <type 'exceptions.ValueError'>: Unicode strings with encoding declaration are not supported.
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] URL: http://192.168.35.231:8008/data/api/action/package_create
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/weberror/errormiddleware.py', line 162 in __call__
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   app_iter = self.application(environ, sr_checker)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/beaker/middleware.py', line 73 in __call__
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   return self.app(environ, start_response)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/beaker/middleware.py', line 155 in __call__
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   return self.wrap_app(environ, session_start_response)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/repoze/who/middleware.py', line 87 in __call__
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   app_iter = app(environ, wrapper.wrap_start_response)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/routes/middleware.py', line 131 in __call__
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   response = self.app(environ, start_response)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/pylons/wsgiapp.py', line 125 in __call__
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   response = self.dispatch(controller, environ, start_response)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/pylons/wsgiapp.py', line 324 in dispatch
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   return controller(environ, start_response)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/controllers/api.py', line 69 in __call__
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   return base.BaseController.__call__(self, environ, start_response)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/lib/base.py', line 238 in __call__
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   res = WSGIController.__call__(self, environ, start_response)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/pylons/controllers/core.py', line 221 in __call__
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   response = self._dispatch_call()
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/pylons/controllers/core.py', line 172 in _dispatch_call
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   response = self._inspect_call(func)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/pylons/controllers/core.py', line 107 in _inspect_call
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   result = self._perform_call(func, args)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/lib/python2.6/site-packages/pylons/controllers/core.py', line 60 in _perform_call
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   return func(**args)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/controllers/api.py', line 177 in action
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   result = function(context, request_data)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/logic/action/create.py', line 132 in package_create
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   data, errors = _validate(data_dict, schema, context)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/lib/navl/dictization_functions.py', line 228 in validate
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   converted_data, errors = _validate(flattened, schema, context)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/lib/navl/dictization_functions.py', line 290 in _validate
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   convert(converter, key, converted_data, errors, context)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckan/ckan/lib/navl/dictization_functions.py', line 186 in convert
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   converter(key, converted_data, errors, context)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckanext-ecportal-release-v1.8.1/ckanext/ecportal/validators.py', line 288 in update_rdf
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   origin_url, xml = rdfutil.update_rdf(rdf, name)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File '/applications/ecodp/users/ecodp/ckan/ecportal/src/ckanext-ecportal-release-v1.8.1/ckanext/ecportal/rdfutil.py', line 23 in update_rdf
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   root = lxml.etree.fromstring(rdf)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File 'lxml.etree.pyx', line 2532 in lxml.etree.fromstring (src/lxml/lxml.etree.c:48270)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] File 'parser.pxi', line 1536 in lxml.etree._parseMemoryDocument (src/lxml/lxml.etree.c:71723)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] ValueError: Unicode strings with encoding declaration are not supported.
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] CGI Variables
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] -------------
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   CKAN_CURRENT_URL: '/api/action/package_create'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   CKAN_LANG: 'en'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   CKAN_LANG_IS_DEFAULT: True
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   CONTENT_LENGTH: '32596'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   CONTENT_TYPE: 'text/json; charset=utf-8'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   DOCUMENT_ROOT: '/applications/ecodp/users/ecodp/drupal/www'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   GATEWAY_INTERFACE: 'CGI/1.1'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   HTTP_AUTHORIZATION: 'Basic YXBpOmFwaQ=='
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   HTTP_CONNECTION: 'Keep-Alive'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   HTTP_HOST: '192.168.35.231:8008'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   HTTP_USER_AGENT: 'Apache-HttpClient/4.1.3 (java 1.5)'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   HTTP_X_CKAN_API_KEY: 'fdd060a5-513d-4e91-aafd-21c82155014f'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   PATH_INFO: '/api/action/package_create'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   PATH_TRANSLATED: 'redirect:/index.php/action/package_create'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   REMOTE_ADDR: '192.168.33.19'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   REMOTE_PORT: '58394'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   REQUEST_METHOD: 'POST'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   REQUEST_URI: '/data/api/action/package_create'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   SCRIPT_FILENAME: '/applications/ecodp/users/ecodp/ckan/conf/wsgi.py'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   SCRIPT_NAME: '/data'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   SCRIPT_URI: 'http://192.168.35.231:8008/data/api/action/package_create'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   SCRIPT_URL: '/data/api/action/package_create'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   SERVER_ADDR: '192.168.35.231'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   SERVER_ADMIN: 'root at localhost'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   SERVER_NAME: '192.168.35.231'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   SERVER_PORT: '8008'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   SERVER_PROTOCOL: 'HTTP/1.1'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   SERVER_SIGNATURE: '<address>Apache/2.2.15 (Red Hat) Server at 192.168.35.231 Port 8008</address>\\n'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   SERVER_SOFTWARE: 'Apache/2.2.15 (Red Hat)'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] WSGI Variables
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] --------------
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   application: <beaker.middleware.CacheMiddleware object at 0x7fd63e8a6550>
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   beaker.cache: <beaker.cache.CacheManager object at 0x7fd63e8a6510>
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   beaker.get_session: <bound method SessionMiddleware._get_session of <beaker.middleware.SessionMiddleware object at 0x7fd63e8a6210>>
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   beaker.session: {'_accessed_time': 1374766258.8025911, '_creation_time': 1374766258.8025911}
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   mod_wsgi.application_group: 'open-data.europa.eu:8008|/data'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   mod_wsgi.callable_object: 'application'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   mod_wsgi.handler_script: ''
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   mod_wsgi.input_chunked: '0'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   mod_wsgi.listener_host: ''
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   mod_wsgi.listener_port: '8008'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   mod_wsgi.process_group: 'ecodp'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   mod_wsgi.request_handler: 'wsgi-script'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   mod_wsgi.script_reloading: '1'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   mod_wsgi.version: (3, 2)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   paste.registry: <paste.registry.Registry object at 0x7fd63eda74d0>
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   paste.throw_errors: True
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   pylons.action_method: <bound method ApiController.action of <ckan.controllers.api.ApiController object at 0x7fd63edd6310>>
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   pylons.controller: <ckan.controllers.api.ApiController object at 0x7fd63edd6310>
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   pylons.environ_config: {'session': 'beaker.session', 'cache': 'beaker.cache'}
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   pylons.pylons: <pylons.util.PylonsContext object at 0x7fd63edd6250>
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   pylons.routes_dict: {'action': u'action', 'controller': u'api', 'ver': 3, 'logic_function': u'package_create'}
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   pylons.status_code_redirect: True
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   repoze.who.api: <repoze.who.api.API object at 0x7fd63eda7190>
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   repoze.who.logger: <logging.Logger instance at 0x7fd63e784dd0>
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   repoze.who.plugins: {'use_beaker': <UseBeakerPlugin 140558148987024>, 'ckan.lib.authenticator:UsernamePasswordAuthenticator': <ckan.lib.authenticator.UsernamePasswordAuthenticator object at 0x7fd63e787ed0>, 'friendlyform': <FriendlyFormPlugin 140558148986320>, 'ckan.lib.authenticator:BeakerSessionAuthenticator': <ckan.lib.authenticator.BeakerSessionAuthenticator object at 0x7fd63e787f90>}
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   routes.route: <routes.route.Route object at 0x7fd63e753cd0>
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   routes.url: <routes.util.URLGenerator object at 0x7fd63eda7610>
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   webob._parsed_query_vars: (GET([]), '')
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   webob.adhoc_attrs: {'language': 'en-us'}
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   webob.is_body_seekable: True
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   wsgi process: 'Multi process AND threads (?)'
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   wsgi.file_wrapper: <built-in method file_wrapper of mod_wsgi.Adapter object at 0x7fd63eb7bd50>
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   wsgi.version: (1, 1)
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19]   wsgiorg.routing_args: (<routes.util.URLGenerator object at 0x7fd63eda7610>, {'action': u'action', 'controller': u'api', 'ver': 3, 'logic_function': u'package_create'})
[Thu Jul 25 17:30:58 2013] [error] [client 192.168.33.19] ------------------------------------------------------------
-------------- next part --------------
A non-text attachment was scrubbed...
Name: regExp.rdf
Type: text/xml
Size: 29849 bytes
Desc: not available
URL: <https://lists.okfn.org/mailman/private/ecodp-dev/attachments/20130726/3baba89e/attachment.xml>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ecodp.error.log.zip
Type: application/zip
Size: 180850 bytes
Desc: not available
URL: <https://lists.okfn.org/mailman/private/ecodp-dev/attachments/20130726/3baba89e/attachment-0001.zip>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: TENFORCE_VERSION_8_c.zip_20130725_101315.log
Type: application/octet-stream
Size: 338330 bytes
Desc: not available
URL: <https://lists.okfn.org/mailman/private/ecodp-dev/attachments/20130726/3baba89e/attachment-0001.obj>

• Previous message: [ECODP-dev] Error in operation of import CKAN
• Next message: [ECODP-dev] update on translations 0.9
• Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]