[ckan-dev] problem downloading some of the files

Tue Feb 24 13:50:00 UTC 2015

Hi there ! Found my problem.

Because I was using 2 domain names :"data" and "date" at first, until I
realised that it  was wrong, half of my files had the link build up with
"data" and the other half with "date".

After changing one of the file links to the right domain the   ofs-hero
script added that file to the json.

Now all I need is a solution to loop through the db and replace al my urls
the corect way.

I updated one entry in resources table but when i checked to se if the
update made any changes on the website I noticed that it didn't . 

I believe that the link has to be replaced in multiple tables, but I don't
know which tables.

Any help would be much appreciated !

Thank you ! 

From: ckan-dev [mailto:ckan-dev-bounces at lists.okfn.org] On Behalf Of Hamadi
Seluan
Sent: Tuesday, February 24, 2015 12:05 PM
To: ckan-dev at lists.okfn.org
Subject: [ckan-dev] problem downloading some of the files

Hello again ! 

After I regenerating the json file I noticed that the new one is indeed
biger ( contains more file links) but not all of them.

I also noticed that the files that can't be downloaded are missing from the
json file.

I tried to regenerate the json once again and it was the same size as the
first one that I regenerated.

I thought that it might be a chance to insert a new link line in the json
manually , a link to one of the files that can't be downloaded but still no
result.

I think that the ofs-hero script does more than rebuilding the json file and
therefore my noob solution didn't work.

Of course after each change I restarted the services.

Please give me an ideea on what to do in order to have the json regenerated
completely.

Thank you!

From: ckan-dev [mailto:ckan-dev-bounces at lists.okfn.org] On Behalf Of Hamadi
Seluan
Sent: Monday, February 23, 2015 4:53 PM
To: 'CKAN Development Discussions'
Subject: Re: [ckan-dev] problem downloading some of the files

Thank you very much for your answer, Rachel!I followed the steps and
replaced the json file but unfortunately it didn't solve my problem L. 

From: ckan-dev [mailto:ckan-dev-bounces at lists.okfn.org] On Behalf Of Rachel
Knowler
Sent: Monday, February 23, 2015 4:04 PM
To: CKAN Development Discussions
Subject: Re: [ckan-dev] problem downloading some of the files

Hi Hamadi,

We had this problem too, and it was because the filestore index would get
corrupted. Nigel Babu has written this script to fix it:
https://github.com/ckan/ofs-hero. We installed it as it says in the readme
and just set up a cronjob to call it regularly, and haven't had any trouble
since then. (There's more discussion in the archives here:
https://lists.okfn.org/pipermail/ckan-dev/2014-February/006826.html)

Hope this helps!

- Rae

On 23.02.2015 13:51, Hamadi Seluan wrote:

Hi there! I'm dealing with an issue on a ckan 2.0 instance running on a
ubuntu desktop  (Ubuntu 12.04.3 LTS ).

We have a problem downloading some of the files. I could not identify the
source.

The site returns the following error "Internal server error".

I looked through the logs in Apache error log and found this Error - <class
'pairtree.storage_exceptions.FileNotFoundException'.

The first thought was that the files are missing or maybe a matter of file
rights but I checked and the files are in place and have identical rights as
the files that can be downloaded.

I tried to find a link between non-functional files by the date they were
added but the error occurs randomly.

Full
loghttps://redmine.seluan.ro/attachments/download/6/ckan%20apache%20error%20
log.txt

Any help would be much appreciated. thank you in advance!

_______________________________________________
ckan-dev mailing list
ckan-dev at lists.okfn.org
https://lists.okfn.org/mailman/listinfo/ckan-dev
Unsubscribe: https://lists.okfn.org/mailman/options/ckan-dev

-- 
Liip AG // Limmatstrasse 183 // CH-8005 Zürich
Tel +41 43 500 39 80 // Mob +41 78 658 26 12 // www.liip.ch
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/ckan-dev/attachments/20150224/9ccdfc4b/attachment-0003.html>