[datacatalogs] Problem with search on datacatalogs.org

[James McKinney]

My guess is that the code that renders the page checks for the latest approved version, but the code that routes the URL just checks the latest version, regardless of whether or not it's approved.

On 2012-10-03, at 3:10 PM, James McKinney wrote:

> As an anonymous user, if I go to http://datacatalogs.org/catalog/edit/the-data-hub, then "Url" field is hidden with "display: none;" but that doesn't fool a spambot.
> 
> I manually entered "yes-this-is-a-bug" into that field and saved, and LO AND BEHOLD the catalog page is now:
> 
> http://datacatalogs.org/catalog/yes-this-is-a-bug
> 
> And http://datacatalogs.org/catalog/the-data-hub 404s. Please fix.
> 
> On 2012-10-03, at 2:35 PM, Rufus Pollock wrote:
> 
>> On 3 October 2012 16:06, James McKinney <james at opennorth.ca> wrote:
>>> Going through the revision history, there are dozens of these. Here is one
>>> that is pure spam (never had a good revision):
>>> http://datacatalogs.org/catalog/zjukvoxppwv
>>> 
>>> I found Le Mans and data.gouv.fr and restored all those I found to their
>>> original content. I went up to page 26 (Nov 8, 2011) in the revision history
>>> to fix Paris. The above spam was created Jul 2011. This took about 30 mins
>>> so if someone wants to go through the rest it should be quick.
>> 
>> Note you can delete "spam" revisions - go to history page, click on
>> revision link and hit delete. You can then purge those spam revisions
>> via http://datacatalogs.org/ckan-admin/trash
>> 
>> Rufus
>> 
>>> I recommend blocking all anonymous edits until the revision bug I described
>>> below is fixed (in which the URL changes without the revision being
>>> approved).
>> 
>> In theory they are blocked - none of the changes should happen without
>> approval. However, if this is not happening we'll definitely check and
>> shut down anonymous editing.
>> 
>> Rufus
>> 
>>> On 2012-10-03, at 10:45 AM, Benjamin Ooghe-Tabanou wrote:
>>> 
>>> Great James, thanks, these are some the ones I was wondering about.
>>> Now why they have such weird ids and uris now is a mystery to me !
>>> 
>>> Benjamin
>>> 
>>> 
>>> On Wed, Oct 3, 2012 at 4:40 PM, James McKinney <james at opennorth.ca> wrote:
>>> 
>>> If you go to this page: http://datacatalogs.org/group/france there are 5
>>> 
>>> that 404. I found 3. Not sure where Le Mans and data.gouv.fr are.
>>> 
>>> 
>>> On 2012-10-03, at 10:39 AM, James McKinney wrote:
>>> 
>>> 
>>> I think I found two of them from this page:
>>> 
>>> http://datacatalogs.org/user/Roux
>>> 
>>> 
>>> Paris http://datacatalogs.org/catalog/bpsmyxycx
>>> 
>>> Bordeaux http://datacatalogs.org/catalog/ndvorzw
>>> 
>>> 
>>> Another that now has an odd "URI" is Data-Publica
>>> 
>>> http://datacatalogs.org/catalog/uufurt
>>> 
>>> 
>>> On 2012-10-03, at 9:24 AM, Benjamin Ooghe-Tabanou wrote:
>>> 
>>> 
>>> Hey Rufus,
>>> 
>>> 
>>> These work indeed but they're empty of any of all the information that
>>> 
>>> were present in the original ones that are now 404 :
>>> 
>>> http://datacatalogs.org/catalog/paris_fr
>>> 
>>> http://datacatalogs.org/catalog/data-gouv-fr
>>> 
>>> ...
>>> 
>>> 
>>> Benjamin
>>> 
>>> 
>>> 
>>> On Wed, Oct 3, 2012 at 3:21 PM, Rufus Pollock <rufus.pollock at okfn.org>
>>> 
>>> wrote:
>>> 
>>> 
>>> Hi All,
>>> 
>>> 
>>> 
>>> None of those pages 404 for me:
>>> 
>>> 
>>> 
>>> http://datacatalogs.org/catalog/le_mans_fr
>>> 
>>> 
>>> http://datacatalogs.org/catalog/paris
>>> 
>>> 
>>> http://datacatalogs.org/catalog/bordeaux
>>> 
>>> 
>>> 
>>> Can you confirm they are still 404'ing?
>>> 
>>> 
>>> 
>>> Rufus
>>> 
>>> 
>>> 
>>> On 3 October 2012 13:45, Benjamin Ooghe-Tabanou <b.ooghe at gmail.com> wrote:
>>> 
>>> 
>>> It's a little bit sad to fall back on these very empty pages when I
>>> 
>>> 
>>> spent a lot of times making all of these page properly filled with all
>>> 
>>> 
>>> the proper metadata for all of these platforms
>>> 
>>> 
>>> Does anybody know what happened that made them become 404 ?
>>> 
>>> 
>>> 
>>> Benjamin
>>> 
>>> 
>>> 
>>> 
>>> On Wed, Oct 3, 2012 at 1:24 PM, Antti Poikola <antti.poikola at gmail.com>
>>> 
>>> wrote:
>>> 
>>> 
>>> I reported the same problem earlier (June 21st)
>>> 
>>> 
>>> 
>>> ---CLIP---
>>> 
>>> 
>>> 
>>> I found these four catalogs with broken links, I can't remove them but all
>>> 
>>> 
>>> of them have already working substitute page... Rufus or someone, could you
>>> 
>>> 
>>> get rid of the "404 Not Found" -catalogs so that they don't show in the
>>> 
>>> 
>>> search results (like for example: http://datacatalogs.org/catalog?q=paris )
>>> 
>>> 
>>> 
>>> Bordeaux http://datacatalogs.org/catalog/bordeaux
>>> 
>>> 
>>> 404 Not Found http://datacatalogs.org/catalog/bordeaux_fr
>>> 
>>> 
>>> 
>>> France http://datacatalogs.org/catalog/france
>>> 
>>> 
>>> 404 Not Found http://datacatalogs.org/catalog/data-gouv-fr
>>> 
>>> 
>>> 
>>> Paris http://datacatalogs.org/catalog/paris
>>> 
>>> 
>>> 404 Not Found http://datacatalogs.org/catalog/paris_fr
>>> 
>>> 
>>> 
>>> Le Mans http://datacatalogs.org/catalog/le_mans_fr
>>> 
>>> 
>>> 404 Not Found http://datacatalogs.org/catalog/le-mans-datapage
>>> 
>>> 
>>> 
>>> 
>>> On 3.10.2012 12:25, Richard Cyganiak wrote:
>>> 
>>> 
>>> 
>>> All,
>>> 
>>> 
>>> 
>>> This query finds two results:
>>> 
>>> 
>>> 
>>> http://datacatalogs.org/dataset?q=paris
>>> 
>>> 
>>> 
>>> The second result is for a catalog "paris_fr", but clicking on the result
>>> 
>>> 
>>> takes us to a 404 error page, as if the catalog "paris_fr" doesn't exist.
>>> 
>>> 
>>> 
>>> Why does it show up in the search then? Maybe the catalog was deleted or
>>> 
>>> 
>>> renamed, and the CKAN software doesn't update its search index correctly?
>>> 
>>> 
>>> 
>>> Could someone with CKAN expertise comment on this?
>>> 
>>> 
>>> 
>>> Thanks a million,
>>> 
>>> 
>>> Richard
>>> 
>>> 
>>> _______________________________________________
>>> 
>>> 
>>> data-catalogs mailing list
>>> 
>>> 
>>> data-catalogs at lists.okfn.org
>>> 
>>> 
>>> http://lists.okfn.org/mailman/listinfo/data-catalogs
>>> 
>>> 
>>> 
>>> 
>>> 
>>> --
>>> 
>>> 
>>> +358 44 337 5439
>>> 
>>> 
>>> about.me/apoikola
>>> 
>>> 
>>> 
>>> _______________________________________________
>>> 
>>> 
>>> data-catalogs mailing list
>>> 
>>> 
>>> data-catalogs at lists.okfn.org
>>> 
>>> 
>>> http://lists.okfn.org/mailman/listinfo/data-catalogs
>>> 
>>> 
>>> 
>>> 
>>> _______________________________________________
>>> 
>>> 
>>> data-catalogs mailing list
>>> 
>>> 
>>> data-catalogs at lists.okfn.org
>>> 
>>> 
>>> http://lists.okfn.org/mailman/listinfo/data-catalogs
>>> 
>>> 
>>> 
>>> 
>>> 
>>> --
>>> 
>>> 
>>> Co-Founder, Open Knowledge Foundation
>>> 
>>> 
>>> Promoting Open Knowledge in a Digital Age
>>> 
>>> 
>>> http://www.okfn.org/ - http://blog.okfn.org/
>>> 
>>> 
>>> 
>>> _______________________________________________
>>> 
>>> data-catalogs mailing list
>>> 
>>> data-catalogs at lists.okfn.org
>>> 
>>> http://lists.okfn.org/mailman/listinfo/data-catalogs
>>> 
>>> 
>>> 
>>> 
>>> 
>> 
>> 
>> 
>> -- 
>> Co-Founder, Open Knowledge Foundation
>> Promoting Open Knowledge in a Digital Age
>> http://www.okfn.org/ - http://blog.okfn.org/
> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/data-catalogs/attachments/20121003/b4166708/attachment-0001.html>