[datacatalogs] Problem with search on datacatalogs.org

James McKinney james at opennorth.ca
Wed Oct 3 19:10:26 UTC 2012


As an anonymous user, if I go to http://datacatalogs.org/catalog/edit/the-data-hub, then "Url" field is hidden with "display: none;" but that doesn't fool a spambot.

I manually entered "yes-this-is-a-bug" into that field and saved, and LO AND BEHOLD the catalog page is now:

http://datacatalogs.org/catalog/yes-this-is-a-bug

And http://datacatalogs.org/catalog/the-data-hub 404s. Please fix.

On 2012-10-03, at 2:35 PM, Rufus Pollock wrote:

> On 3 October 2012 16:06, James McKinney <james at opennorth.ca> wrote:
>> Going through the revision history, there are dozens of these. Here is one
>> that is pure spam (never had a good revision):
>> http://datacatalogs.org/catalog/zjukvoxppwv
>> 
>> I found Le Mans and data.gouv.fr and restored all those I found to their
>> original content. I went up to page 26 (Nov 8, 2011) in the revision history
>> to fix Paris. The above spam was created Jul 2011. This took about 30 mins
>> so if someone wants to go through the rest it should be quick.
> 
> Note you can delete "spam" revisions - go to history page, click on
> revision link and hit delete. You can then purge those spam revisions
> via http://datacatalogs.org/ckan-admin/trash
> 
> Rufus
> 
>> I recommend blocking all anonymous edits until the revision bug I described
>> below is fixed (in which the URL changes without the revision being
>> approved).
> 
> In theory they are blocked - none of the changes should happen without
> approval. However, if this is not happening we'll definitely check and
> shut down anonymous editing.
> 
> Rufus
> 
>> On 2012-10-03, at 10:45 AM, Benjamin Ooghe-Tabanou wrote:
>> 
>> Great James, thanks, these are some the ones I was wondering about.
>> Now why they have such weird ids and uris now is a mystery to me !
>> 
>> Benjamin
>> 
>> 
>> On Wed, Oct 3, 2012 at 4:40 PM, James McKinney <james at opennorth.ca> wrote:
>> 
>> If you go to this page: http://datacatalogs.org/group/france there are 5
>> 
>> that 404. I found 3. Not sure where Le Mans and data.gouv.fr are.
>> 
>> 
>> On 2012-10-03, at 10:39 AM, James McKinney wrote:
>> 
>> 
>> I think I found two of them from this page:
>> 
>> http://datacatalogs.org/user/Roux
>> 
>> 
>> Paris http://datacatalogs.org/catalog/bpsmyxycx
>> 
>> Bordeaux http://datacatalogs.org/catalog/ndvorzw
>> 
>> 
>> Another that now has an odd "URI" is Data-Publica
>> 
>> http://datacatalogs.org/catalog/uufurt
>> 
>> 
>> On 2012-10-03, at 9:24 AM, Benjamin Ooghe-Tabanou wrote:
>> 
>> 
>> Hey Rufus,
>> 
>> 
>> These work indeed but they're empty of any of all the information that
>> 
>> were present in the original ones that are now 404 :
>> 
>> http://datacatalogs.org/catalog/paris_fr
>> 
>> http://datacatalogs.org/catalog/data-gouv-fr
>> 
>> ...
>> 
>> 
>> Benjamin
>> 
>> 
>> 
>> On Wed, Oct 3, 2012 at 3:21 PM, Rufus Pollock <rufus.pollock at okfn.org>
>> 
>> wrote:
>> 
>> 
>> Hi All,
>> 
>> 
>> 
>> None of those pages 404 for me:
>> 
>> 
>> 
>> http://datacatalogs.org/catalog/le_mans_fr
>> 
>> 
>> http://datacatalogs.org/catalog/paris
>> 
>> 
>> http://datacatalogs.org/catalog/bordeaux
>> 
>> 
>> 
>> Can you confirm they are still 404'ing?
>> 
>> 
>> 
>> Rufus
>> 
>> 
>> 
>> On 3 October 2012 13:45, Benjamin Ooghe-Tabanou <b.ooghe at gmail.com> wrote:
>> 
>> 
>> It's a little bit sad to fall back on these very empty pages when I
>> 
>> 
>> spent a lot of times making all of these page properly filled with all
>> 
>> 
>> the proper metadata for all of these platforms
>> 
>> 
>> Does anybody know what happened that made them become 404 ?
>> 
>> 
>> 
>> Benjamin
>> 
>> 
>> 
>> 
>> On Wed, Oct 3, 2012 at 1:24 PM, Antti Poikola <antti.poikola at gmail.com>
>> 
>> wrote:
>> 
>> 
>> I reported the same problem earlier (June 21st)
>> 
>> 
>> 
>> ---CLIP---
>> 
>> 
>> 
>> I found these four catalogs with broken links, I can't remove them but all
>> 
>> 
>> of them have already working substitute page... Rufus or someone, could you
>> 
>> 
>> get rid of the "404 Not Found" -catalogs so that they don't show in the
>> 
>> 
>> search results (like for example: http://datacatalogs.org/catalog?q=paris )
>> 
>> 
>> 
>> Bordeaux http://datacatalogs.org/catalog/bordeaux
>> 
>> 
>> 404 Not Found http://datacatalogs.org/catalog/bordeaux_fr
>> 
>> 
>> 
>> France http://datacatalogs.org/catalog/france
>> 
>> 
>> 404 Not Found http://datacatalogs.org/catalog/data-gouv-fr
>> 
>> 
>> 
>> Paris http://datacatalogs.org/catalog/paris
>> 
>> 
>> 404 Not Found http://datacatalogs.org/catalog/paris_fr
>> 
>> 
>> 
>> Le Mans http://datacatalogs.org/catalog/le_mans_fr
>> 
>> 
>> 404 Not Found http://datacatalogs.org/catalog/le-mans-datapage
>> 
>> 
>> 
>> 
>> On 3.10.2012 12:25, Richard Cyganiak wrote:
>> 
>> 
>> 
>> All,
>> 
>> 
>> 
>> This query finds two results:
>> 
>> 
>> 
>> http://datacatalogs.org/dataset?q=paris
>> 
>> 
>> 
>> The second result is for a catalog "paris_fr", but clicking on the result
>> 
>> 
>> takes us to a 404 error page, as if the catalog "paris_fr" doesn't exist.
>> 
>> 
>> 
>> Why does it show up in the search then? Maybe the catalog was deleted or
>> 
>> 
>> renamed, and the CKAN software doesn't update its search index correctly?
>> 
>> 
>> 
>> Could someone with CKAN expertise comment on this?
>> 
>> 
>> 
>> Thanks a million,
>> 
>> 
>> Richard
>> 
>> 
>> _______________________________________________
>> 
>> 
>> data-catalogs mailing list
>> 
>> 
>> data-catalogs at lists.okfn.org
>> 
>> 
>> http://lists.okfn.org/mailman/listinfo/data-catalogs
>> 
>> 
>> 
>> 
>> 
>> --
>> 
>> 
>> +358 44 337 5439
>> 
>> 
>> about.me/apoikola
>> 
>> 
>> 
>> _______________________________________________
>> 
>> 
>> data-catalogs mailing list
>> 
>> 
>> data-catalogs at lists.okfn.org
>> 
>> 
>> http://lists.okfn.org/mailman/listinfo/data-catalogs
>> 
>> 
>> 
>> 
>> _______________________________________________
>> 
>> 
>> data-catalogs mailing list
>> 
>> 
>> data-catalogs at lists.okfn.org
>> 
>> 
>> http://lists.okfn.org/mailman/listinfo/data-catalogs
>> 
>> 
>> 
>> 
>> 
>> --
>> 
>> 
>> Co-Founder, Open Knowledge Foundation
>> 
>> 
>> Promoting Open Knowledge in a Digital Age
>> 
>> 
>> http://www.okfn.org/ - http://blog.okfn.org/
>> 
>> 
>> 
>> _______________________________________________
>> 
>> data-catalogs mailing list
>> 
>> data-catalogs at lists.okfn.org
>> 
>> http://lists.okfn.org/mailman/listinfo/data-catalogs
>> 
>> 
>> 
>> 
>> 
> 
> 
> 
> -- 
> Co-Founder, Open Knowledge Foundation
> Promoting Open Knowledge in a Digital Age
> http://www.okfn.org/ - http://blog.okfn.org/

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/data-catalogs/attachments/20121003/d87cc2e3/attachment-0001.html>


More information about the data-catalogs mailing list