[ckan-dev] Settings up FileStore/Datastore on CKAN 2.1
Michael Speth
spethm at landcareresearch.co.nz
Wed Jan 29 03:52:31 UTC 2014
Hi,
Here is the output when I run the command against the database.
{"help": "Search a DataStore resource.\n\n The datastore_search action allows you to search data in a resource.\n DataStore resources that belong to private CKAN resource can only be\n read by you if you have access to the CKAN resource and send the appropriate\n authorization.\n\n :param resource_id: id or alias of the resource to be searched against\n :type resource_id: string\n :param filters: matching conditions to select, e.g {\"key1\": \"a\", \"key2\": \"b\"} (optional)\n :type filters: dictionary\n :param q: full text query (optional)\n :type q: string\n :param plain: treat as plain text query (optional, default: true)\n :type plain: bool\n :param language: language of the full text query (optional, default: english)\n :type language: string\n :param limit: maximum number of rows to return (optional, default: 100)\n :type limit: int\n :param offset: offset this number of rows (optional)\n :type offset: int\n :param fields: fields to return (optional, default: all fields in original order)\n :type fields: list or comma separated string\n :param sort: comma separated field names with ordering\n e.g.: \"fieldname1, fieldname2 desc\"\n :type sort: string\n\n Setting the ``plain`` flag to false enables the entire PostgreSQL `full text search query language`_.\n\n A listing of all available resources can be found at the alias ``_table_metadata``.\n\n .. _full text search query language: http://www.postgresql.org/docs/9.1/static/datatype-textsearch.html#DATATYPE-TSQUERY\n\n If you need to download the full resource, read :ref:`dump`.\n\n **Results:**\n\n The result of this action is a dictionary with the following keys:\n\n :rtype: A dictionary with the following keys\n :param fields: fields/columns and their extra metadata\n :type fields: list of dictionaries\n :param offset: query offset value\n :type offset: int\n :param limit: query limit value\n :type limit: int\n :param filters: query filters\n :type filters: list of dictionaries\n :param total: number of total matching records\n :type total: int\n :param records: list of matching results\n :type records: list of dictionaries\n\n ", "success": true, "result": {"resource_id": "_table_metadata", "fields": [{"type": "text", "id": "_id"}, {"type": "name", "id": "name"}, {"type": "oid", "id": "oid"}, {"type": "name", "id": "alias_of"}], "records": [{"_id": "1fab8662e5772995", "alias_of": "pg_views", "name": "_table_metadata", "oid": 16391}, {"_id": "21b5fe766665b205", "alias_of": "pg_tables", "name": "_table_metadata", "oid": 16391}], "_links": {"start": "/api/3/action/datastore_search?resource_id=_table_metadata", "next": "/api/3/action/datastore_search?offset=100&resource_id=_table_metadata"}, "total": 2}}
Does this help?
On Tue, Jan 28, 2014 at 7:15 PM, Nigel Babu <nigel.babu at okfn.org<mailto:nigel.babu at okfn.org>> wrote:
On 28 January 2014 03:23, Michael Speth <spethm at landcareresearch.co.nz<mailto:spethm at landcareresearch.co.nz>> wrote:
* The DNS is duplicated. Can you take a look at your site_url in your configuration.
>From the production.ini
ckan.site_url = test.ckan.zen.landcareresearch.co.nz<http://test.ckan.zen.landcareresearch.co.nz>
* The resource is not accessible publically. To preview a resource that's not in the datastore, CKAN uses dataproxy which is a public service that will fetch a csv file and return JSON. If the dataproxy can't "see" the file, you can't preview it.
curl -X GET "http://127.0.0.1:5000/api/3/action/datastore_search?resource_id=_table_metadata"
output
curl: (7) couldn't connect to host
Would this indicate a permissions problem?
No. You should run that action against your CKAN instance, not against 127.0.0.1 on port 5000.
On Fri, Jan 24, 2014 at 8:04 PM, Nigel Babu <nigel.babu at okfn.org<mailto:nigel.babu at okfn.org>> wrote:
There's two problems here:
* The DNS is duplicated. Can you take a look at your site_url in your configuration.
* The resource is not accessible publically. To preview a resource that's not in the datastore, CKAN uses dataproxy which is a public service that will fetch a csv file and return JSON. If the dataproxy can't "see" the file, you can't preview it.
Nigel Babu
Developer | @nigelbabu<https://twitter.com/nigelbabu>
The Open Knowledge Foundation<http://okfn.org/>
Empowering through Open Knowledge
http://okfn.org/ | @okfn<http://twitter.com/OKFN> | OKF on Facebook<https://www.facebook.com/OKFNetwork> | Blog<http://blog.okfn.org/> | Newsletter<http://okfn.org/about/newsletter>
CKAN | http://ckan.org/ | @CKANproject<http://twitter.com/CKANproject> | the world's leading open-source data portal platform
On 22 January 2014 08:16, Michael Speth <spethm at landcareresearch.co.nz<mailto:spethm at landcareresearch.co.nz>> wrote:
Greetings,
I am trying to setup<https://github.com/Conzar/ckan-puppet/> both FileStore and DataStore on the deb CKAN 2.1 package. After uploading a csv and clicking on the preview button, the following error is displayed:
This resource can not be previewed at the moment. Click here for more information.<http://test.ckan.zen.landcareresearch.co.nz/dataset/test2/resource/f7038c5b-307a-485d-8c5c-cbb202157037#>
Could not load preview: DataProxy returned an error (Data transformation failed. error: An error occured while connecting to the server: DNS lookup failed for URL: http://test.ckan.zen.landcareresearch.co.nz/test.ckan.zen.landcareresearch.co.nz/storage/f/2014-01-22T02%3A37%3A27.715Z/test.csv)
Problem
The DNS for the host has been replicated twice (http://test.ckan.zen.landcareresearch.co.nz/test.ckan.zen.landcareresearch.co.nz). If I use this URL, my browser can download the file without issue.
http://test.ckan.zen.landcareresearch.co.nz/storage/f/2014-01-22T02%3A37%3A27.715Z/test.csv)
Anyone know why the DNS is duplicated?
Thanks
--
Michael Speth
DevOps Computer Engineer
Landcare Research Consultant
________________________________
Please consider the environment before printing this email
Warning: This electronic message together with any attachments is confidential. If you receive it in error: (i) you must not read, use, disclose, copy or retain it; (ii) please contact the sender immediately by reply email and then delete the emails.
The views expressed in this email may not be those of Landcare Research New Zealand Limited. http://www.landcareresearch.co.nz
_______________________________________________
ckan-dev mailing list
ckan-dev at lists.okfn.org<mailto:ckan-dev at lists.okfn.org>
https://lists.okfn.org/mailman/listinfo/ckan-dev
Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
_______________________________________________
ckan-dev mailing list
ckan-dev at lists.okfn.org<mailto:ckan-dev at lists.okfn.org>
https://lists.okfn.org/mailman/listinfo/ckan-dev
Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
--
Michael Speth
DevOps Computer Engineer
Landcare Research Consultant
________________________________
Please consider the environment before printing this email
Warning: This electronic message together with any attachments is confidential. If you receive it in error: (i) you must not read, use, disclose, copy or retain it; (ii) please contact the sender immediately by reply email and then delete the emails.
The views expressed in this email may not be those of Landcare Research New Zealand Limited. http://www.landcareresearch.co.nz
_______________________________________________
ckan-dev mailing list
ckan-dev at lists.okfn.org<mailto:ckan-dev at lists.okfn.org>
https://lists.okfn.org/mailman/listinfo/ckan-dev
Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
_______________________________________________
ckan-dev mailing list
ckan-dev at lists.okfn.org<mailto:ckan-dev at lists.okfn.org>
https://lists.okfn.org/mailman/listinfo/ckan-dev
Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
--
Michael Speth
DevOps Computer Engineer
Landcare Research Consultant
________________________________
Please consider the environment before printing this email
Warning: This electronic message together with any attachments is confidential. If you receive it in error: (i) you must not read, use, disclose, copy or retain it; (ii) please contact the sender immediately by reply email and then delete the emails.
The views expressed in this email may not be those of Landcare Research New Zealand Limited. http://www.landcareresearch.co.nz
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20140129/5ee1a0f9/attachment-0003.html>
More information about the ckan-dev
mailing list