[ckan-dev] CKAN on an EC2 Not Connecting

William Morris wboykinm at geosprocket.com
Fri Jan 17 02:41:07 UTC 2014 

Oh man, this had a simple resolution. I hadn't checked to see that
nginx was running along with apache, and indeed it wasn't. As soon as
I started the server the application became available in the browser.

Many thanks to NigelB for helping me with that one!

-Bill



----------
William Morris | Cartographer
(802)-870-0880 | geosprocket.io | GeoSprocket LLC, Burlington VT


On Thu, Jan 16, 2014 at 6:34 AM,  <ckan-dev-request at lists.okfn.org> wrote:
> Send ckan-dev mailing list submissions to
>         ckan-dev at lists.okfn.org
>
> To subscribe or unsubscribe via the World Wide Web, visit
>         https://lists.okfn.org/mailman/listinfo/ckan-dev
> or, via email, send a message with subject or body 'help' to
>         ckan-dev-request at lists.okfn.org
>
> You can reach the person managing the list at
>         ckan-dev-owner at lists.okfn.org
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of ckan-dev digest..."
>
>
> Today's Topics:
>
>    1. Re: GIS dataset import (Cliff Ingham)
>    2. CKAN API to Access Private Datasets (Sajan Ravindran)
>    3. question on plugins.toolkit.get_action('user_list')
>       (frederic.prieur at ville.montreal.qc.ca)
>    4. CKAN on an EC2 Not Connecting (William Morris)
>    5. CKAN dataset license options/information link (Aaron McGlinchy)
>    6. CKAN with local file storage issue (Milica Knezevic)
>    7. Re: GIS dataset import (David Read)
>    8. Re: GIS dataset import (Philippe Duchesne)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Wed, 15 Jan 2014 08:36:54 -0500
> From: Cliff Ingham <inghamn at bloomington.in.gov>
> To: CKAN Development Discussions <ckan-dev at lists.okfn.org>
> Subject: Re: [ckan-dev] GIS dataset import
> Message-ID: <52D68EF6.3050409 at bloomington.in.gov>
> Content-Type: text/plain; charset=ISO-8859-1
>
> Thanks for the pointers.  The fog has cleared some.  So, it sounds like
> we do actually put the data into ckan, and not just metadata.
>
> In other words, we need to find some way to export 3G of spatial and
> relational data from our GIS system into one of these formats?  Then
> load the exported data into CKAN as a dataset.
>
> Of these, it looks like only GeoJSON has support for both the spatial
> and the relational properties.
>
> On 01/14/2014 04:36 PM, Philippe Duchesne wrote:
>> Hello David, Cliff,
>>
>> FYI, a fork of ckanext-spatial done for openbelgium.be has support for
>> WFS,WMS,KML,GML,GeoJSON,ArcGIS and Google Fusion Tables.
>>
>> You can have a look at
>> http://portal.openbelgium.be/dataset/geospatial-testfor a demo.
>>
>> The code is still in beta stage, but available at
>> https://github.com/pduchesne/ckanext-spatial/tree/OL3_VIEWER
>>
>> best,
>>
>> --p.
>>
>>
>> On Tue, Jan 14, 2014 at 5:52 PM, David Read
>> <david.read at hackneyworkshop.com>wrote:
>>
>>> Cliff,
>>>
>>> CKAN's datastore can store GIS data files like any others. The service
>>> you then want to provide is the ability to preview them.
>>>
>>> data.gov has a previewer that I think should cover KML, and I don't
>>> think it would be too hard to develop it to show GeoJSON and
>>> Shapefiles too (since I believe OpenLayers supports these). Perhaps
>>> OKF people can find a dataset as an example, because I couldn't find a
>>> KML file with a quick look.
>>>
>>> The other way geodata is often provided is via a WMS or WFS server
>>> (rather than as a downloadable file). CKAN is not ideal for serving
>>> this data. But data.gov.uk has developed a WMS viewer for CKAN and it
>>> is easily extended to WFS. I believe OKF has recently done a similar
>>> tool.
>>>
>>> David
>>>
>>> On 13 January 2014 18:22, Cliff Ingham <inghamn at bloomington.in.gov> wrote:
>>>> We're looking at publishing all of the GIS data for our city.  Am I
>>>> correct in thinking that CKAN is built for this, or is CKAN only for the
>>>> metadata about our GIS data?
>>>>
>>>> Importing GIS data files as datasets has not been going very well.  I'm
>>>> thinking we're doing it wrong.
>>>>
>>>> --
>>>> Cliff Ingham
>>>> http://www.ohloh.net/accounts/inghamn
>>>> -------------------------------------
>>>> "If debugging is the process of removing software bugs, then programming
>>>> must be the process of putting them in."
>>>> -- Edsger Dijkstra
>>>> _______________________________________________
>>>> ckan-dev mailing list
>>>> ckan-dev at lists.okfn.org
>>>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>>>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>> _______________________________________________
>>> ckan-dev mailing list
>>> ckan-dev at lists.okfn.org
>>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>>
>>
>>
>>
>> _______________________________________________
>> ckan-dev mailing list
>> ckan-dev at lists.okfn.org
>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>
>
>
> ------------------------------
>
> Message: 2
> Date: Wed, 15 Jan 2014 11:16:10 -0500
> From: Sajan Ravindran <sajanravindran at gmail.com>
> To: CKAN Development Discussions <ckan-dev at lists.okfn.org>
> Subject: [ckan-dev] CKAN API to Access Private Datasets
> Message-ID:
>         <CAFtWpoRZNP+Mn8UXfUpv=6XCg8r6EOJ2SsWL1b+1LSBONkGMXg at mail.gmail.com>
> Content-Type: text/plain; charset="iso-8859-1"
>
> Hi,
>
> I was wondering is there a way by which a particular private dataset could
> be accessed/searched for using CKAN Get API. While going through the list
> of API's, I did find the current_package_list_with_resource and used it.
> However, that seemed to list all. Any help would be appreciated.
>
> Thanks.
> Sajan
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <https://lists.okfn.org/pipermail/ckan-dev/attachments/20140115/84341efb/attachment-0001.html>
>
> ------------------------------
>
> Message: 3
> Date: Wed, 15 Jan 2014 11:53:01 -0500
> From: frederic.prieur at ville.montreal.qc.ca
> To: ckan-dev at lists.okfn.org
> Subject: [ckan-dev] question on
>         plugins.toolkit.get_action('user_list')
> Message-ID:
>         <OFDF11008A.67BBE5B7-ON85257C61.005B257D-85257C61.005CBEC8 at ville.montreal.qc.ca>
>
> Content-Type: text/plain; charset="iso-8859-1"
>
> Hi guys,
>
> I got a question regarding the plugin.toolkit.get_action request.
>
> I try to get all the users of my ckan instance with the code above:
>
> data_dict = {
>         'q': '*:*',
>         'order_by': 'name',
> }
>
> result = plugins.toolkit.get_action('user_list')(context, data_dict)
>
>
>
> I always get a empty list even if the api call says that i got 5 users.
>
> Am I doing something wrong ?
>
> Thanks in advance
> ---------------------------------------------------------------------------
> Fr?d?ric Prieur
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <https://lists.okfn.org/pipermail/ckan-dev/attachments/20140115/c2909554/attachment-0001.html>
>
> ------------------------------
>
> Message: 4
> Date: Wed, 15 Jan 2014 21:45:21 -0500
> From: William Morris <wboykinm at geosprocket.com>
> To: ckan-dev <ckan-dev at lists.okfn.org>
> Subject: [ckan-dev] CKAN on an EC2 Not Connecting
> Message-ID:
>         <CAP42BmiJd=pCtN70wGooUr+r0yqAE45TTAfsZs11gK92fOskzw at mail.gmail.com>
> Content-Type: text/plain; charset=ISO-8859-1
>
> Many apologies for missing what is almost certainly in front of my
> nose, but I can't for the life of me figure out how I failed to make
> my CKAN package install accessible from my EC2 instance.
>
> The problem: Attempting to access the IP - as well as the solr page
> :8983/solr - results in a timeout and "Could not connect" message in
> the browser.
>
> The configuration: I'm running . . .
> - CKAN 2.1.1, installed from package
> - on an Ubuntu 12.04.3 LTS 64-bit EC2
> - on elastic IP 50.19.249.31
> - with a security group that has ports 22, 80 and 5000 open
> - solr is successfully running on jetty (according to the command line)
> - "ckan db init" was successful, with some messages:
> https://gist.github.com/wboykinm/169b1214a4ce69533793
> - still no connection in the browser, even after I restarted apache to be sure
>
> I followed the same process to get CKAN working successfully on a
> local VM, so it's obviously a problem with my EC2 security settings,
> but what am I missing? I followed the procedure indicated in the docs:
> http://docs.ckan.org/en/ckan-1.7.4/install-from-package-amazon.html
>
> Thanks for your assistance, in any case.
>
> -Bill Morris
> Burlington, VT
>
> William Morris | Cartographer
> (802)-870-0880 | geosprocket.io | GeoSprocket LLC, Burlington VT
>
>
> ------------------------------
>
> Message: 5
> Date: Thu, 16 Jan 2014 03:34:56 +0000
> From: Aaron McGlinchy <McGlinchyA at landcareresearch.co.nz>
> To: "ckan-dev at lists.okfn.org" <ckan-dev at lists.okfn.org>
> Subject: [ckan-dev] CKAN dataset license options/information link
> Message-ID:
>         <A924326C14714F409FB3703B815FF9FD1213074E at HERMES.landcare.ad.landcareresearch.co.nz>
>
> Content-Type: text/plain; charset="us-ascii"
>
> Hi, We have edited the json file which has the default license choices in it to show ones appropriate to our situation/country.  The new license choices are showing up I the drop down list when loading a new dataset.
>
> The note beside the license choice box says "License definitions and additional information can be found at opendefinition.org" which is OK, but ideally we'd point to an NZ site with information targeted at our situation.  Is it an easy fix to alter the text/link?
>
> Thanks
> Aaron
>
> ________________________________
>
> Please consider the environment before printing this email
> Warning: This electronic message together with any attachments is confidential. If you receive it in error: (i) you must not read, use, disclose, copy or retain it; (ii) please contact the sender immediately by reply email and then delete the emails.
> The views expressed in this email may not be those of Landcare Research New Zealand Limited. http://www.landcareresearch.co.nz
>
>
> ------------------------------
>
> Message: 6
> Date: Thu, 16 Jan 2014 10:23:09 +0100
> From: Milica Knezevic <knezevic.milica at gmail.com>
> To: CKAN Development Discussions <ckan-dev at lists.okfn.org>
> Subject: [ckan-dev] CKAN with local file storage issue
> Message-ID:
>         <CANchxPMH0=3MwZB7Vz+SPvuuqD21pNEfR8cUMQs7VX3dYdj+WA at mail.gmail.com>
> Content-Type: text/plain; charset="iso-8859-1"
>
> Hi all,
>
> I have installed CKAN 2.1.1 with local file storage configuration.
> Recently, I encountered a problem when the number of uploaded files
> exceeded 32.000 because of the limitation on ext3 file system. The problem
> is solved by converting to ext4, but what concerns me are potential
> performance issues caused by current organization of uploaded files. My
> CKAN instance is configured with the following storage settings:
>
> ofs.impl = pairtree
> ofs.storage_dir = /var/lib/ckan/default/data
>
> Each uploaded file is stored in its own directory named after the timestamp
> and the storage looks like this:
> /var/lib/ckan/default/data/de/fa/ul/t/obj/<timestamp1>/<filename1>
> ...
> /var/lib/ckan/default/data/de/fa/ul/t/obj/<timestampN>/<filenameN>
>
> So we ended up with a large number of subdirs in obj directory. I'm
> concerned about potential performance issues caused by this kind of
> organization. Isn't the idea of pairtree to "spread the load of storing
> high numbers of objects, while retaining the ability to treat each object
> distinctly"?
>
> Best,
> Milica
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <https://lists.okfn.org/pipermail/ckan-dev/attachments/20140116/dfc759eb/attachment-0001.html>
>
> ------------------------------
>
> Message: 7
> Date: Thu, 16 Jan 2014 11:00:37 +0000
> From: David Read <david.read at hackneyworkshop.com>
> To: CKAN Development Discussions <ckan-dev at lists.okfn.org>
> Subject: Re: [ckan-dev] GIS dataset import
> Message-ID:
>         <CAOY41VX=z0Tzv77DZrNNAMV9Qfb19TX+Zgv0CBvN-6dALncFBQ at mail.gmail.com>
> Content-Type: text/plain; charset=ISO-8859-1
>
> Philippe,
>
> This is spectacular! A previewer for geo-data in nearly any format!
>
> A glance at the code suggests you've done an extensive job on this,
> with a proxy that chunks and OpenLayers 2 and 3 support. So once
> you've ironed out the remaining issues, I'm sure everyone will be
> pleased to benefit from it and encourage more geo-data publishing.
>
> One idea that I'm keen on is creating thumbnail images of these
> previews, that could be shown on the resource or even dataset page. I
> think this would entice people to the previews. Is there some JS or
> OpenLayers function that could create a mini screenshot to create the
> thumbnail automatically that we might employ at some point?
>
> David
>
> On 14 January 2014 21:36, Philippe Duchesne <philippe at okfn.be> wrote:
>> Hello David, Cliff,
>>
>> FYI, a fork of ckanext-spatial done for openbelgium.be has support for
>> WFS,WMS,KML,GML,GeoJSON,ArcGIS and Google Fusion Tables.
>>
>> You can have a look at http://portal.openbelgium.be/dataset/geospatial-test
>> for a demo.
>>
>> The code is still in beta stage, but available at
>> https://github.com/pduchesne/ckanext-spatial/tree/OL3_VIEWER
>>
>> best,
>>
>> --p.
>>
>>
>> On Tue, Jan 14, 2014 at 5:52 PM, David Read <david.read at hackneyworkshop.com>
>> wrote:
>>>
>>> Cliff,
>>>
>>> CKAN's datastore can store GIS data files like any others. The service
>>> you then want to provide is the ability to preview them.
>>>
>>> data.gov has a previewer that I think should cover KML, and I don't
>>> think it would be too hard to develop it to show GeoJSON and
>>> Shapefiles too (since I believe OpenLayers supports these). Perhaps
>>> OKF people can find a dataset as an example, because I couldn't find a
>>> KML file with a quick look.
>>>
>>> The other way geodata is often provided is via a WMS or WFS server
>>> (rather than as a downloadable file). CKAN is not ideal for serving
>>> this data. But data.gov.uk has developed a WMS viewer for CKAN and it
>>> is easily extended to WFS. I believe OKF has recently done a similar
>>> tool.
>>>
>>> David
>>>
>>> On 13 January 2014 18:22, Cliff Ingham <inghamn at bloomington.in.gov> wrote:
>>> > We're looking at publishing all of the GIS data for our city.  Am I
>>> > correct in thinking that CKAN is built for this, or is CKAN only for the
>>> > metadata about our GIS data?
>>> >
>>> > Importing GIS data files as datasets has not been going very well.  I'm
>>> > thinking we're doing it wrong.
>>> >
>>> > --
>>> > Cliff Ingham
>>> > http://www.ohloh.net/accounts/inghamn
>>> > -------------------------------------
>>> > "If debugging is the process of removing software bugs, then programming
>>> > must be the process of putting them in."
>>> > -- Edsger Dijkstra
>>> > _______________________________________________
>>> > ckan-dev mailing list
>>> > ckan-dev at lists.okfn.org
>>> > https://lists.okfn.org/mailman/listinfo/ckan-dev
>>> > Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>> _______________________________________________
>>> ckan-dev mailing list
>>> ckan-dev at lists.okfn.org
>>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>
>>
>>
>> _______________________________________________
>> ckan-dev mailing list
>> ckan-dev at lists.okfn.org
>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>
>
>
> ------------------------------
>
> Message: 8
> Date: Thu, 16 Jan 2014 12:34:49 +0100
> From: Philippe Duchesne <philippe at okfn.be>
> To: CKAN Development Discussions <ckan-dev at lists.okfn.org>
> Subject: Re: [ckan-dev] GIS dataset import
> Message-ID:
>         <CAG9URtw1N-PaJDvW_AmA0zdmOqSQS6Bx_iV8BvxL56s9TpZ=8w at mail.gmail.com>
> Content-Type: text/plain; charset="iso-8859-1"
>
> thank you David.
>
> yes, thumbnail generation is something i have thought about.
> Ideally i would consider it as part of the harvesting process, thus running
> server side.
> However it is probably easier to first do that browser-side, and leverage
> the existing openlayers-based viewer. But it would then be a manual
> operation.
> Is there a generic support for thumbnails generation/storage/display in
> CKAN ? (geo stuff put aside)
>
> To be exact, there is currently no OL3 support, as OL3 has not yet protocol
> implementations for OGC services. So it's currently all OL2.
>
> FYI, one more simple but convenient feature : the CKAN resource url
> supports the BBOX fragment to directly point the viewer at a given bounding
> box:
> http://portal.openbelgium.be/dataset/geospatial-test/resource/f1b701a2-a3f3-46b5-9947-ebcc6bb806cc#bbox=4.3837,50.8426,4.3884,50.8446
>
> I'll share further developments.
>
> best,
>
> --p.
>
>
>
> On Thu, Jan 16, 2014 at 12:00 PM, David Read <david.read at hackneyworkshop.com
>> wrote:
>
>> Philippe,
>>
>> This is spectacular! A previewer for geo-data in nearly any format!
>>
>> A glance at the code suggests you've done an extensive job on this,
>> with a proxy that chunks and OpenLayers 2 and 3 support. So once
>> you've ironed out the remaining issues, I'm sure everyone will be
>> pleased to benefit from it and encourage more geo-data publishing.
>>
>> One idea that I'm keen on is creating thumbnail images of these
>> previews, that could be shown on the resource or even dataset page. I
>> think this would entice people to the previews. Is there some JS or
>> OpenLayers function that could create a mini screenshot to create the
>> thumbnail automatically that we might employ at some point?
>>
>> David
>>
>> On 14 January 2014 21:36, Philippe Duchesne <philippe at okfn.be> wrote:
>> > Hello David, Cliff,
>> >
>> > FYI, a fork of ckanext-spatial done for openbelgium.be has support for
>> > WFS,WMS,KML,GML,GeoJSON,ArcGIS and Google Fusion Tables.
>> >
>> > You can have a look at
>> http://portal.openbelgium.be/dataset/geospatial-test
>> > for a demo.
>> >
>> > The code is still in beta stage, but available at
>> > https://github.com/pduchesne/ckanext-spatial/tree/OL3_VIEWER
>> >
>> > best,
>> >
>> > --p.
>> >
>> >
>> > On Tue, Jan 14, 2014 at 5:52 PM, David Read <
>> david.read at hackneyworkshop.com>
>> > wrote:
>> >>
>> >> Cliff,
>> >>
>> >> CKAN's datastore can store GIS data files like any others. The service
>> >> you then want to provide is the ability to preview them.
>> >>
>> >> data.gov has a previewer that I think should cover KML, and I don't
>> >> think it would be too hard to develop it to show GeoJSON and
>> >> Shapefiles too (since I believe OpenLayers supports these). Perhaps
>> >> OKF people can find a dataset as an example, because I couldn't find a
>> >> KML file with a quick look.
>> >>
>> >> The other way geodata is often provided is via a WMS or WFS server
>> >> (rather than as a downloadable file). CKAN is not ideal for serving
>> >> this data. But data.gov.uk has developed a WMS viewer for CKAN and it
>> >> is easily extended to WFS. I believe OKF has recently done a similar
>> >> tool.
>> >>
>> >> David
>> >>
>> >> On 13 January 2014 18:22, Cliff Ingham <inghamn at bloomington.in.gov>
>> wrote:
>> >> > We're looking at publishing all of the GIS data for our city.  Am I
>> >> > correct in thinking that CKAN is built for this, or is CKAN only for
>> the
>> >> > metadata about our GIS data?
>> >> >
>> >> > Importing GIS data files as datasets has not been going very well.
>>  I'm
>> >> > thinking we're doing it wrong.
>> >> >
>> >> > --
>> >> > Cliff Ingham
>> >> > http://www.ohloh.net/accounts/inghamn
>> >> > -------------------------------------
>> >> > "If debugging is the process of removing software bugs, then
>> programming
>> >> > must be the process of putting them in."
>> >> > -- Edsger Dijkstra
>> >> > _______________________________________________
>> >> > ckan-dev mailing list
>> >> > ckan-dev at lists.okfn.org
>> >> > https://lists.okfn.org/mailman/listinfo/ckan-dev
>> >> > Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>> >> _______________________________________________
>> >> ckan-dev mailing list
>> >> ckan-dev at lists.okfn.org
>> >> https://lists.okfn.org/mailman/listinfo/ckan-dev
>> >> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>> >
>> >
>> >
>> > _______________________________________________
>> > ckan-dev mailing list
>> > ckan-dev at lists.okfn.org
>> > https://lists.okfn.org/mailman/listinfo/ckan-dev
>> > Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>> >
>> _______________________________________________
>> ckan-dev mailing list
>> ckan-dev at lists.okfn.org
>> https://lists.okfn.org/mailman/listinfo/ckan-dev
>> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>>
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <https://lists.okfn.org/pipermail/ckan-dev/attachments/20140116/aa271565/attachment.html>
>
> ------------------------------
>
> Subject: Digest Footer
>
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/optionss/ckan-dev
>
>
> ------------------------------
>
> End of ckan-dev Digest, Vol 39, Issue 18
> ****************************************

More information about the ckan-dev mailing list