[CKAN-support] [Open Knowledge Foundation] Re: iati-archiver / Denmark file

[Steven Flower]

Hi Adria

OK , thanks for this

I wonder if we increase the timeout to 120 seconds - whether this might help.  I appreciate that we are in a false situation, but would be useful to try this, and then monitor
Thanks
Steven
On 23/06/14 16:51, support at ckan.org<mailto:support at ckan.org> wrote:
##- Please type your reply above this line -##
[Adrià Merc]

Adrià Mercader (Open Knowledge Foundation)

Jun 23 16:52

Hi Steven,

The archiver is definetely trying to access the file, but timing out after a while. It appears that requesting time varies, the first time I tried it timed out, but the next ones were faster and it actually got through:

http://iatiregistry.org/dataset/danida-all

It might be that they are caching the file if it has been accessed in say a day, and that the archiver is the first to get the slow request.
I'm not sure how to handle it, other than increase the timeout a bit more.

The archiver was actually set up to run at 18:00 (the danish file turn was around 18:17) . I think the server datetime was wrong at some point and our sysadmins fixed it. I've now updated to run at midnight as expected, sorry if that caused confusion.

Adrià



[Steven Flo]

Steven Flower

Jun 18 11:39

Hi Adria

Please can you check this package:

http://iatiregistry.org/dataset/danida-all

We've issues with accessing this file via their API - but I wanted to check

a) whether the Registry archiver is reading/accessing this file
b) why the activity history ( http://iatiregistry.org/dataset/history/danida-all) seems to suggest the iati-archiver is running at 18:17 each day...

Anything you can spot/find would be appreciated

Thanks

Steven

______________________________________________________________________
This email has been scanned by the Symantec Email Security.cloud service.
For more information please visit http://www.symanteccloud.com
______________________________________________________________________



This email is a service from Open Knowledge Foundation. Delivered by Zendesk<http://www.zendesk.com/help-desk-software/?utm_medium=email-notification&utm_campaign=text>.
Message-Id:93QPQJM5_53a84d20b127e_5c003f91f60b332c21182a_sprut
______________________________________________________________________
This email has been scanned by the Symantec Email Security.cloud service.
For more information please visit http://www.symanteccloud.com
______________________________________________________________________


______________________________________________________________________
This email has been scanned by the Symantec Email Security.cloud service.
For more information please visit http://www.symanteccloud.com
______________________________________________________________________
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.okfn.org/mailman/private/ckan-support/attachments/20140623/1a88f314/attachment-0002.html>