Dear Harold,
I try for Data Pusher : http://docs.ckan.org/projects/datapusher/en/latest/
but data pusher itself not working
Please see the attached screen sort and log..
Please help me on this.. I think Data Pusher is not working..
I have attached production.ini file and other data pusher related error and
logs
Regards,
Bhavesh Patel
Thanks & Regards,
*Bhavesh R. Patel *
- www.bhaveshpatel.info
- www.onlinequizportal.com
- www.hindisuvichar.com
"Never leave till tomorrow which you can do today"
*Please consider the environment before printing this e-mail.*
On Thu, Oct 16, 2014 at 4:36 PM, harold carrel <haroldcb at hotmail.fr> wrote:
> That's it yes.
> Just pay attention to the installation's explanation which are for
> different cases...
>
>
> ------------------------------
> From: bhavesh.bece.13 at gmail.com
> Date: Thu, 16 Oct 2014 16:28:37 +0530
> Subject: Re: [ckan-dev] Download text/geojson files, files without
> extension
> To: haroldcb at hotmail.fr
>
> Dear Harold,
>
> I have to follow this :
> http://docs.ckan.org/projects/datapusher/en/latest/ right ?
>
> Please provide me URL if it's wrong.
>
> Thanks & Regards,
> Bhavesh
>
> Thanks & Regards,
> *Bhavesh R. Patel *
>
> - www.bhaveshpatel.info
> - www.onlinequizportal.com
> - www.hindisuvichar.com
>
> "Never leave till tomorrow which you can do today"
> *Please consider the environment before printing this e-mail.*
>
> On Thu, Oct 16, 2014 at 4:21 PM, harold carrel <haroldcb at hotmail.fr>
> wrote:
>
> I have the same config so I should be able to help you!
> Try to install the datapusher which will automaticaly add your file in the
> Datastore and won't use the Dataproxy anymore to preview your file.
> It should solve your problem (it solved mine), let me know
> Harold
>
> ------------------------------
> From: bhavesh.bece.13 at gmail.com
> Date: Thu, 16 Oct 2014 16:16:09 +0530
> Subject: Re: [ckan-dev] Download text/geojson files, files without
> extension
> To: haroldcb at hotmail.fr
>
> Thanks for your quick response harold.
>
> I have install CKAN in VirtualBox using :
> http://docs.ckan.org/en/ckan-2.2/install-from-source.html
>
> OS : Ubuntu 12.04 LTS
> CKAN : 2.2
>
> This is on our local IP : for example : http://192.168.251.87:8080/
>
> I am able to upload files into dataset but while click on preview it's
> give those error.
>
> I have done only :
> http://docs.ckan.org/en/ckan-2.2/datastore.html#relationship-to-filestore
> and
> http://docs.ckan.org/en/ckan-2.2/datastore.html#setting-up-the-datastore
>
> I have not integrate DataPusher
>
> Please let me know if you required more information.
>
> Regards,
> Bhavesh
>
>
> Thanks & Regards,
> *Bhavesh R. Patel *
>
> - www.bhaveshpatel.info
> - www.onlinequizportal.com
> - www.hindisuvichar.com
>
> "Never leave till tomorrow which you can do today"
> *Please consider the environment before printing this e-mail.*
>
> On Thu, Oct 16, 2014 at 4:05 PM, harold carrel <haroldcb at hotmail.fr>
> wrote:
>
> Hi,
> You get this error on the demo site or on your CKAN instance?
> This problem comes from the DataStore/Datapusher and the DataProxy
> check this:
> http://docs.ckan.org/en/ckan-2.2/datastore.html
> http://datapusher.readthedocs.org/en/latest/
> Tell me if it works or not, if not I give me more informations about your
> CKAN installation and I will try to help you more.
> Regards,
> Harold
>
> ------------------------------
> From: bhavesh.bece.13 at gmail.com
> Date: Thu, 16 Oct 2014 15:43:23 +0530
> Subject: Re: [ckan-dev] Download text/geojson files, files without
> extension
> To: haroldcb at hotmail.fr
>
> Dear Harold,
>
> For displaying the preview of CSV file. I got following error
>
> [image: Inline image 1]
>
> What may be the issue. This is in my local system. for preview it's
> require the server must have live ip or something ?
>
> I need your help to resolve this issue
>
>
> Thanks & Regards,
> *Bhavesh R. Patel *
>
> "Never leave till tomorrow which you can do today"
> *Please consider the environment before printing this e-mail.*
>
> On Thu, Oct 16, 2014 at 3:38 PM, harold carrel <haroldcb at hotmail.fr>
> wrote:
>
> HI,
> I've noticed some problems with CKAN and I would like to know if somebody
> has a solution:
> - When I add a text or json file on my CKAN version, or in the CKAN demo
> version (http://demo.ckan.org/fr/), it can display it (I don't know if it
> uses the Data Proxy or not), but when I try to download it, the file is
> just displayed on a new web page instead of beeing downloaded... If you
> don't see what I mean, try on this example:
> http://demo.ckan.org/fr/dataset/sample-json/resource/b834935d-7645-4796-bfdd-a5ff47813d88
> Do someone has a solution to this?
> - I have also noticed that files which don't have extensions in their name
> couldn't be displaed or downloaded, even if the type is specified when
> adding the file on CKAN...
> Does CKAN only accepts file with extensions or is there a solution?
>
> Thanks
> Harold
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>
>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20141017/38942363/attachment-0003.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 28406 bytes
Desc: not available
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20141017/38942363/attachment-0003.png>
-------------- next part --------------
[Fri Oct 17 17:25:57 2014] [error] 2014-10-17 17:25:57,232 WARNI [ckan.logic] package a7709400-b9a9-48b9-8869-87a6e80e3981 in index but not in database
[Fri Oct 17 17:25:57 2014] [error] 2014-10-17 17:25:57,236 WARNI [ckan.logic] package 6d106564-2e12-461b-9b2a-203f6475eb3d in index but not in database
[Fri Oct 17 17:25:57 2014] [error] 2014-10-17 17:25:57,239 WARNI [ckan.logic] package 2c6ef2f8-a9c4-47ef-8e51-a7fc2fb291a5 in index but not in database
[Fri Oct 17 17:25:57 2014] [error] 2014-10-17 17:25:57,241 WARNI [ckan.logic] package b6c105cb-69a6-4184-a67d-75124d934b8b in index but not in database
[Fri Oct 17 17:25:57 2014] [error] 2014-10-17 17:25:57,458 INFO [ckan.lib.base] /dataset render time 0.252 seconds
[Fri Oct 17 17:25:57 2014] [error] 2014-10-17 17:25:57,547 INFO [ckan.lib.base] /api/i18n/en render time 0.001 seconds
[Fri Oct 17 17:25:58 2014] [error] 2014-10-17 17:25:58,080 INFO [ckan.lib.base] /user/login render time 0.035 seconds
[Fri Oct 17 17:25:58 2014] [error] 2014-10-17 17:25:58,143 INFO [ckan.lib.base] /api/i18n/en render time 0.001 seconds
[Fri Oct 17 17:26:03 2014] [error] 2014-10-17 17:26:03,050 INFO [ckan.lib.base] /user/logged_in render time 0.004 seconds
[Fri Oct 17 17:26:04 2014] [error] 2014-10-17 17:26:04,224 INFO [ckan.lib.base] /user/logged_in render time 1.161 seconds
[Fri Oct 17 17:26:05 2014] [error] 2014-10-17 17:26:05,167 CRITI [ckan.logic] Action `user_followee_list` is being called directly all action calls should be accessed via logic.get_action
[Fri Oct 17 17:26:05 2014] [error] 2014-10-17 17:26:05,172 CRITI [ckan.logic] Action `dataset_followee_list` is being called directly all action calls should be accessed via logic.get_action
[Fri Oct 17 17:26:05 2014] [error] 2014-10-17 17:26:05,177 CRITI [ckan.logic] Action `group_followee_list` is being called directly all action calls should be accessed via logic.get_action
[Fri Oct 17 17:26:05 2014] [error] 2014-10-17 17:26:05,184 CRITI [ckan.logic] Action `dashboard_activity_list` is being called directly all action calls should be accessed via logic.get_action
[Fri Oct 17 17:26:05 2014] [error] 2014-10-17 17:26:05,488 INFO [ckan.lib.base] /dashboard render time 1.249 seconds
[Fri Oct 17 17:26:05 2014] [error] 2014-10-17 17:26:05,626 INFO [ckan.lib.base] /api/i18n/en render time 0.002 seconds
[Fri Oct 17 17:26:07 2014] [error] 2014-10-17 17:26:07,056 WARNI [ckan.logic] package a7709400-b9a9-48b9-8869-87a6e80e3981 in index but not in database
[Fri Oct 17 17:26:07 2014] [error] 2014-10-17 17:26:07,059 WARNI [ckan.logic] package 6d106564-2e12-461b-9b2a-203f6475eb3d in index but not in database
[Fri Oct 17 17:26:07 2014] [error] 2014-10-17 17:26:07,062 WARNI [ckan.logic] package 2c6ef2f8-a9c4-47ef-8e51-a7fc2fb291a5 in index but not in database
[Fri Oct 17 17:26:07 2014] [error] 2014-10-17 17:26:07,065 WARNI [ckan.logic] package b6c105cb-69a6-4184-a67d-75124d934b8b in index but not in database
[Fri Oct 17 17:26:07 2014] [error] 2014-10-17 17:26:07,137 INFO [ckan.lib.base] /dataset render time 0.099 seconds
[Fri Oct 17 17:26:07 2014] [error] 2014-10-17 17:26:07,222 INFO [ckan.lib.base] /api/i18n/en render time 0.001 seconds
[Fri Oct 17 17:26:08 2014] [error] 2014-10-17 17:26:08,673 INFO [ckan.lib.base] /dataset/new render time 0.146 seconds
[Fri Oct 17 17:26:08 2014] [error] 2014-10-17 17:26:08,756 INFO [ckan.lib.base] /api/i18n/en render time 0.001 seconds
[Fri Oct 17 17:26:30 2014] [error] 2014-10-17 17:26:30,243 INFO [ckan.lib.base] /dataset/new render time 0.604 seconds
[Fri Oct 17 17:26:30 2014] [error] 2014-10-17 17:26:30,408 INFO [ckan.lib.base] /dataset/new_resource/final-data-pusher-test render time 0.150 seconds
[Fri Oct 17 17:26:30 2014] [error] 2014-10-17 17:26:30,562 INFO [ckan.lib.base] /api/i18n/en render time 0.001 seconds
[Fri Oct 17 17:26:48 2014] [error] 2014-10-17 17:26:48,760 INFO [ckan.lib.base] /api/2/util/resource/format_autocomplete render time 0.035 seconds
[Fri Oct 17 17:26:53 2014] [error] 2014-10-17 17:26:53,300 CRITI [ckanext.datapusher.plugin] {'status_code': 500, 'message': 'An Error occurred while sending the job: 500 Server Error: Internal Server Error', 'details': u'<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\\n<html><head>\\n<title>500 Internal Server Error</title>\\n</head><body>\\n<h1>Internal Server Error</h1>\\n<p>The server encountered an internal error or\\nmisconfiguration and was unable to complete\\nyour request.</p>\\n<p>Please contact the server administrator,\\n [no address given] and inform them of the time the error occurred,\\nand anything you might have done that may have\\ncaused the error.</p>\\n<p>More information about this error may be available\\nin the server error log.</p>\\n<hr>\\n<address>Apache/2.2.22 (Ubuntu) Server at 0.0.0.0 Port 8800</address>\\n</body></html>\\n'}
[Fri Oct 17 17:26:53 2014] [error] 2014-10-17 17:26:53,370 INFO [ckan.lib.base] /dataset/new_resource/final-data-pusher-test render time 1.313 seconds
[Fri Oct 17 17:26:53 2014] [error] 2014-10-17 17:26:53,543 INFO [ckan.lib.base] /dataset/new_metadata/final-data-pusher-test render time 0.157 seconds
[Fri Oct 17 17:26:53 2014] [error] 2014-10-17 17:26:53,632 INFO [ckan.lib.base] /api/i18n/en render time 0.001 seconds
[Fri Oct 17 17:27:57 2014] [error] 2014-10-17 17:27:57,607 CRITI [ckanext.datapusher.plugin] {'status_code': 500, 'message': 'An Error occurred while sending the job: 500 Server Error: Internal Server Error', 'details': u'<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\\n<html><head>\\n<title>500 Internal Server Error</title>\\n</head><body>\\n<h1>Internal Server Error</h1>\\n<p>The server encountered an internal error or\\nmisconfiguration and was unable to complete\\nyour request.</p>\\n<p>Please contact the server administrator,\\n [no address given] and inform them of the time the error occurred,\\nand anything you might have done that may have\\ncaused the error.</p>\\n<p>More information about this error may be available\\nin the server error log.</p>\\n<hr>\\n<address>Apache/2.2.22 (Ubuntu) Server at 0.0.0.0 Port 8800</address>\\n</body></html>\\n'}
[Fri Oct 17 17:27:58 2014] [error] 2014-10-17 17:27:58,105 INFO [ckan.lib.base] /dataset/new_metadata/final-data-pusher-test render time 2.193 seconds
[Fri Oct 17 17:27:58 2014] [error] 2014-10-17 17:27:58,247 INFO [ckan.lib.base] /dataset/final-data-pusher-test render time 0.127 seconds
[Fri Oct 17 17:27:58 2014] [error] 2014-10-17 17:27:58,353 INFO [ckan.lib.base] /api/i18n/en render time 0.001 seconds
[Fri Oct 17 17:28:01 2014] [error] 2014-10-17 17:28:01,339 INFO [ckan.lib.base] /dataset/final-data-pusher-test/resource/253e18b3-bc9c-43a9-8100-3ad51064612f render time 0.074 seconds
[Fri Oct 17 17:28:01 2014] [error] 2014-10-17 17:28:01,433 INFO [ckan.lib.base] /dataset/9eed687f-955a-47a3-8735-95ac32b70279/resource/253e18b3-bc9c-43a9-8100-3ad51064612f/preview render time 0.033 seconds
[Fri Oct 17 17:28:01 2014] [error] 2014-10-17 17:28:01,450 INFO [ckan.lib.base] /api/i18n/en render time 0.001 seconds
[Fri Oct 17 17:28:01 2014] [error] 2014-10-17 17:28:01,555 INFO [ckan.lib.base] /api/i18n/en render time 0.001 seconds
-------------- next part --------------
A non-text attachment was scrubbed...
Name: datapusher_error_curl_test.JPG
Type: image/jpeg
Size: 54692 bytes
Desc: not available
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20141017/38942363/attachment-0009.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: datapusher_error_log.JPG
Type: image/jpeg
Size: 237825 bytes
Desc: not available
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20141017/38942363/attachment-0010.jpe>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: upload_to_datastore_ckan.JPG
Type: image/jpeg
Size: 38824 bytes
Desc: not available
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20141017/38942363/attachment-0011.jpe>
-------------- next part --------------
#
# CKAN - Pylons configuration
#
# These are some of the configuration options available for your CKAN
# instance. Check the documentation in 'doc/configuration.rst' or at the
# following URL for a description of what they do and the full list of
# available options:
#
# http://docs.ckan.org/en/ckan-2.2/configuration.html
#
# The %(here)s variable will be replaced with the parent directory of this file
#
[DEFAULT]
# WARNING: *THIS SETTING MUST BE SET TO FALSE ON A PRODUCTION ENVIRONMENT*
debug = false
[server:main]
use = egg:Paste#http
host = 0.0.0.0
port = 5000
#host = 192.168.251.87
[app:main]
#ckan.storage_path = /var/lib/ckan/default
ofs.impl = pairtree
ofs.storage_dir = /mnt/ckandata
#ckan.datapusher.url = http://0.0.0.0:8800/
use = egg:ckan
full_stack = true
cache_dir = /tmp/%(ckan.site_id)s/
beaker.session.key = ckan
# This is the secret token that the beaker library uses to hash the cookie sent
# to the client. `paster make-config` generates a unique value for this each
# time it generates a config file.
beaker.session.secret = /vZeVdhufP2wxz7HYccNZKG2U
# `paster make-config` generates a unique value for this each time it generates
# a config file.
app_instance_uuid = {68a3aa4e-af55-4337-8f4d-955b3bfe00fa}
# repoze.who config
who.config_file = %(here)s/who.ini
who.log_level = warning
who.log_file = %(cache_dir)s/who_log.ini
## Database Settings
#sqlalchemy.url = postgresql://ckan_default:pass@localhost/ckan_default
sqlalchemy.url = postgresql://ckan_default:ckan@localhost/ckan_default
ckan.datastore.write_url = postgresql://ckan_default:ckan@localhost/datastore_default
ckan.datastore.read_url = postgresql://datastore_default:ckan@localhost/datastore_default
## Site Settings
ckan.site_url = http://0.0.0.0:8080
## Authorization Settings
ckan.auth.anon_create_dataset = false
ckan.auth.create_unowned_dataset = true
ckan.auth.create_dataset_if_not_in_organization = true
ckan.auth.user_create_groups = true
ckan.auth.user_create_organizations = true
ckan.auth.user_delete_groups = true
ckan.auth.user_delete_organizations = true
ckan.auth.create_user_via_api = false
ckan.auth.create_user_via_web = true
ckan.auth.roles_that_cascade_to_sub_groups = admin
## Search Settings
ckan.site_id = default
solr_url = http://127.0.0.1:8983/solr
#ckan.simple_search = 1
## Plugins Settings
# Note: Add ``datastore`` to enable the CKAN DataStore
# Add ``datapusher`` to enable DataPusher
# Add ``pdf_preview`` to enable the resource preview for PDFs
# Add ``resource_proxy`` to enable resorce proxying and get around the
# same origin policy
#ckan.plugins = stats text_preview recline_preview datastore
ckan.plugins = datastore text_preview recline_preview datapusher
## Front-End Settings
ckan.site_title = CKAN
ckan.site_logo = /base/images/ckan-logo.png
ckan.site_description =
ckan.favicon = /images/icons/ckan.ico
ckan.gravatar_default = identicon
ckan.preview.direct = png jpg gif
ckan.preview.loadable = html htm rdf+xml owl+xml xml n3 n-triples turtle plain atom csv tsv rss txt json
# package_hide_extras = for_search_index_only
#package_edit_return_url = http://another.frontend/dataset/<NAME>
#package_new_return_url = http://another.frontend/dataset/<NAME>
#ckan.recaptcha.publickey =
#ckan.recaptcha.privatekey =
#licenses_group_url = http://licenses.opendefinition.org/licenses/groups/ckan.json
# ckan.template_footer_end =
## Internationalisation Settings
ckan.locale_default = en
ckan.locale_order = en pt_BR ja it cs_CZ ca es fr el sv sr sr at latin no sk fi ru de pl nl bg ko_KR hu sa sl lv
ckan.locales_offered =
ckan.locales_filtered_out = en_GB
## Feeds Settings
ckan.feeds.authority_name =
ckan.feeds.date =
ckan.feeds.author_name =
ckan.feeds.author_link =
## Storage Settings
#ckan.storage_path = /var/lib/ckan
#ckan.max_resource_size = 10
#ckan.max_image_size = 2
## Datapusher settings
# Make sure you have set up the DataStore
ckan.datapusher.formats = csv xls
ckan.datapusher.url = http://127.0.0.1:8800/
## Activity Streams Settings
#ckan.activity_streams_enabled = true
#ckan.activity_list_limit = 31
#ckan.activity_streams_email_notifications = true
# ckan.email_notifications_since = 2 days
## Email settings
email_to = you at yourdomain.com
error_email_from = paste at localhost
smtp.server = localhost
smtp.starttls = False
#smtp.user = your_username at gmail.com
#smtp.password = your_password
#smtp.mail_from =
## Logging configuration
[loggers]
keys = root, ckan, ckanext
[handlers]
keys = console
[formatters]
keys = generic
[logger_root]
level = WARNING
handlers = console
[logger_ckan]
level = INFO
handlers = console
qualname = ckan
propagate = 0
[logger_ckanext]
level = DEBUG
handlers = console
qualname = ckanext
propagate = 0
[handler_console]
class = StreamHandler
args = (sys.stderr,)
level = NOTSET
formatter = generic
[formatter_generic]
format = %(asctime)s %(levelname)-5.5s [%(name)s] %(message)s