[ckan-dev] Problem with 'ghost' dataset

Thu Aug 1 00:51:52 UTC 2019

Thanks Stefan,
Reindexing helped with part of the problem.  We also found a bug in CKAN (v2.7.2) such that if in our descriptions of the data we used certain characters, this was what caused the datasets to 'ghost' (i.e. not be listed amongst datasets).

The characters I am aware of are the apostrophe ', and the emdash/endash  (using a plain dash works OK).

Removing those characters in the metadata made the datasets show up.  Include them anywhere and they disappear from the dataset list (but the data is still there - just ghost like).

Regards
Aaron
------------------------------

Message: 2
Date: Thu, 25 Jul 2019 07:41:10 +0200
From: Stefan Oderbolz <odi at metaodi.ch>
To: CKAN Development Discussions <ckan-dev at lists.okfn.org>
Subject: Re: [ckan-dev] Problem with 'ghost' dataset
Message-ID:
<CAOEki+SKX9XwJ0rhbJp2efY+NQ+ZvHn_WQU1iii8wJzmKWvdOA at mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi Aaron

This sounds like a problem with the Solr index, i.e. the information in the index differs from the information in the database. Maybe in the whole deleting/purging process the old "ghost" dataset was not removed from the Solr index.
So I would first of all rebuild the index and check if It works as expected.

- Stefan

On Thu, Jul 25, 2019, 02:19 Aaron McGlinchy < McGlinchyA at landcareresearch.co.nz> wrote:

> Hi, we are using CKAN 2.7.2 (which we do need to update).
>
> I created a dataset, during which I edited the URL ckan assigned by
> default.  On the face of it the dataset created properly, once I'd
> uploaded resource and saved, it looked as expected.  I sent the URL to
> someone else to look at and it worked.
>
> The problem is that the dataset doesn't show up in the list of
> datasets, nor within an organisation.  The dataset is set to public,
> and I am logged in as sysadmin.  Thus there is no way for anyone else
> to find or see this dataset, unless they already know the URL.
>
> I tried to rectify it by creating another dataset to see if it showed
> up as expected (it did).  I then copied the metadata and data
> resources over to the new dataset, deleted the old 'ghost' dataset
> (purged the trash, but got an error message (integrity error on table
> resource..., though the dataset did disappear from the trash), I then
> edited the URL to what the 'ghost' dataset had - it failed 'URL
> already in use', so I changed it to a slightly different URL.
>
> But now that dataset has issues - it is set to Public, and when I open
> the dataset it doesn't show the private 'flag' at the top right, BUT
> when I look at the list of datasets/datasets within an organisation,
> the private flag is showing.  If I log out I cannot see the dataset in
> the list (it's treating it as private), but if I enter the URL
> directly it will open the dataset (treating as public).  I tired
> editing the datastet and toggling the visibility from public to
> private and back again to see if that would reset things, but no joy.
>
> So I'm after any ideas on how to fix my problem dataset, and to flag
> that their may be a bug that occurs when you edit a datasets URL that
> messes things up.
>
> Thanks
> Aaron
>
>
> ________________________________
>
> Please consider the environment before printing this email
> Warning: This electronic message together with any attachments is
> confidential. If you receive it in error: (i) you must not read, use,
> disclose, copy or retain it; (ii) please contact the sender
> immediately by reply email and then delete the emails.
> The views expressed in this email may not be those of Landcare
> Research New Zealand Limited. http://www.landcareresearch.co.nz
> _______________________________________________
> ckan-dev mailing list
> ckan-dev at lists.okfn.org
> https://lists.okfn.org/mailman/listinfo/ckan-dev
> Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20190725/8c04a655/attachment-0001.html>

------------------------------

Message: 3
Date: Thu, 25 Jul 2019 11:08:27 +0200
From: Vladimir Ma?ala <vladimirmasala at gmail.com>
To: CKAN Development Discussions <ckan-dev at lists.okfn.org>
Subject: [ckan-dev] Too many .lock files
Message-ID:
<CANqTGjVqiV0QqUDcibeNgYduHvC6wE9P19BHPdnDiVtQ+kAx=w at mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi all

In var/ckan/data/sessions i have 2 subfolders:
1. containter_file
2. containter_file_lock

My problem is that fodlers are full of .lock files with size 0, but  there is so many files that i am having problem with "inode limit" basiclly too many files.

I am using https://github.com/datagovuk instalation so i am not sure if this is standard ckan issue or not.

So i have few questions:
1. Is it safe to delete .lock files
2. Why are they not deleted automatically?

Thnx for help
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20190725/7bb447f8/attachment-0001.html>

------------------------------

Subject: Digest Footer

_______________________________________________
ckan-dev mailing list
ckan-dev at lists.okfn.org
https://lists.okfn.org/mailman/listinfo/ckan-dev
Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev

------------------------------

End of ckan-dev Digest, Vol 105, Issue 9
****************************************

________________________________

Please consider the environment before printing this email
Warning: This electronic message together with any attachments is confidential. If you receive it in error: (i) you must not read, use, disclose, copy or retain it; (ii) please contact the sender immediately by reply email and then delete the emails.
The views expressed in this email may not be those of Landcare Research New Zealand Limited. http://www.landcareresearch.co.nz