[iRail] API Liveboards - scraper failure due to new mobile railtime website

Wed Aug 31 06:20:44 UTC 2011

Thank you.

About the bug in the liveboard, Christophe told me yesterday with an
example, I've started to fix the issue with htmldom, I'll finish this
friday.

Yours.
On Aug 31, 2011 12:29 AM, "Pieter Colpaert" <pieter.colpaert at gmail.com>
wrote:
> Hi Ludovic!
>
> Great work! Using that library instead of regexs is not a bad approach
> at all :) I will review the code later this week.
>
>
> If anyone feels like fixing the liveboard API better, please go ahead.
> There are still some serious issues with a lot of stations. Maybe it's
> better to use the htmldom lib as well?
>
> Kind regards,
>
> Pieter
>
>
>
>
> On Tue, 2011-08-30 at 00:58 +0200, Ludovic Gasc wrote:
>> Small remark:
>> I've used this library: http://simplehtmldom.sourceforge.net/manual.htm
>>
>> For me it will be easier to adapt quickly your source code with a HTML
>> parser than a regex.
>>
>> If it's a problem for somebody, please give us the right regex to do
this.
>>
>> On Tue, Aug 30, 2011 at 12:56 AM, Ludovic Gasc <gmludo at gmail.com> wrote:
>> > Hi,
>> >
>> > As discussed on the IRC channel, this is a patch to fix this problem:
>> > https://github.com/iRail/iRail/pull/15
>> >
>> > Thanks for your remarks.
>> >
>> > Yours.
>> >
>> > PS: It's my first patch for iRail, please to be indulgent with me ;-)
>> >
>> > On Sun, Aug 28, 2011 at 11:25 PM, Pieter Colpaert
>> > <pieter.colpaert at gmail.com> wrote:
>> >> Hi list,
>> >>
>> >> Today the guys from railtime launched a new website: m.railtime.be.
>> >> Without notifying us (although we asked DUO, infrabel and NMBS to do
>> >> so). Of course, our liveboard API which still scrapes this site was
>> >> broken.
>> >>
>> >> Quentin made a quick fix for it and partially rewrote the scraper. A
lot
>> >> of code was reusable although they changed they way you ask for a
>> >> specific station. Now you have to give the perfect railtime name AND
the
>> >> perfect railtime id. As we have those in our database we could quickly
>> >> fix this as well. Why they did this? No idea.
>> >>
>> >> If anything is still not functioning correctly, please wait notifying
>> >> Quentin and me after Wednesday, when both of our examinations are
>> >> finished ;)
>> >>
>> >> Of course, the api is still at:
>> >> http://api.irail.be/liveboard/?station=brussel%
>> >> 20centraal&lang=nl&format=json
>> >>
>> >> Kind regards,
>> >>
>> >> Pieter
>> >>
>> >>
>> >> --
>> >> iRail vzw/asbl
>> >> +32 (0) 486/747122
>> >>
>> >> _______________________________________________
>> >> iRail mailing list
>> >> iRail at list.irail.be
>> >> http://lists.rootspirit.com/mailman/listinfo/irail
>> >>
>> >
>> >
>> >
>> > --
>> > Ludovic Gasc
>> >
>>
>>
>>
>
> --
> iRail vzw/asbl
> +32 (0) 486/747122
>
> _______________________________________________
> iRail mailing list
> iRail at list.irail.be
> http://lists.rootspirit.com/mailman/listinfo/irail
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.okfn.org/pipermail/irail/attachments/20110831/6e57b859/attachment-0003.html>