[ckan-dev] DataStorer and preview troubleshooting

Mon Jul 30 17:57:41 UTC 2012

On Mon, Jul 30, 2012 at 6:42 PM, Jim Craner <jim at codeforamerica.org> wrote:
> Thanks, guys... So I have a possibly related question that pertains to
> ElasticSearch.
>
> When I do an API search call against the *working* CSV resource, the
> returned JSON references what I presume is ElasticSearch stuff, namely
> 5 shards and this:
>
> "_index": "ckan-data.cityofsantacruz.com"
>
> in addition to the actual data returned.
>
> Today while troubleshooting, I noticed that I'm getting several errors
> in my ElasticSearch logs similar to this:
>
> [2012-07-28 22:35:57,899][DEBUG][action.index             ]
> [Gatecrasher] [ckan-data.cityofsantacruz.com][3],
> node[t67o_ONdTLOlKEVkKqd-LQ], [P], s[STARTED]: Failed to execute
> [index {[ckan-data.cityofsantacruz.com][2d4beb1b-80b5-4df4-a7ec-305bd3313ce4][smbshr.pl],
> source[host=%22%20%2DFOOBAR%7Cecho%20%22%20Sharename%22%0Aecho%0Aecho%20%22%20%20SomeShare%20%20Disk%20%22%60id%60%20%23%22]}]
>
> Now my question is -- where does "ckan-data.cityofsantacruz.com" from?

This comes from the ini file. It is derived of the site_id.  The
site_id must be data.cityofsantacruz.com, we prepend "ckan-" to it.

>  I grepped my entire home directory (where I installed ElasticSearch,
> CKAN, extensions, etc.) as well as /etc/apache2, /etc/supervisor,
> everywhere else I could think of and I couldn't find *any* references
> to that hostname -- or even the string "ckan-data" -- other than in
> the logs.  Is that the "dynamically generated node name" that the ES
> config file documentation is referring to?
>
> I'm also wondering if host=FOOBAR in there is indicative of another problem :-)

The above issue is definitely something to do with ckan receiving the
wrong hostname/script headers and not being able to determine where it
is.  So that may be part of the problem.  If I could see your
apache/nginx config that would be handy.

Thanks

David