[open-linguistics] [CFP] STREAM MACHINE LEARNING (STREAML) OPEN CHALLENGE 2017-2018

Tue Nov 28 08:00:31 UTC 2017

—————————————————————————————————
StreaML Open Challenge 2017-2018
—————————————————————————————————
After a successful co-organization of the DEBS Grand Challenge with the HOBBIT project (https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=1ebf62138c&e=ba2124fabf) at the DEBS 2017 Conference, HOBBIT is proud to announce the Stream Machine Learning (StreaML) Open Challenge, which starts in December 2017.

The StreaML Open Challenge will ensure continuous participation and systems evaluation with periodic cutoffs. The first cutoff is in May 2018.
* A monetary prize will be provided to the best-winning system!
* Stay tuned and get ready to participate!

————————————————————————————–————————————————————————————–
The StreaML Open Challenge at a glance
————————————————————————————————————————————————————–————–
The StreaML Open Challenge focuses on the task related to the problem of automatic detection of anomalies for manufacturing equipment.
The overall goal of the task is to detect abnormal behavior of a manufacturing machine based on the observation of the stream of measurements provided by each of the machines from observable set, which is dynamic (i.e. machines dynamically join and leave the set of observable machines). The data produced by each sensor is clustered and the state transitions between the observed clusters are modelled as a Markov chain. Based on this classification, anomalies are detected as sequences of transitions that happen with a probability lower than a given threshold.

We herewith invite system developers to participate in the aforementioned scenario. To ensure that the system results are comparable, we will provide the HOBBIT benchmarking platform for the generation of the final results to be included into the system publications. A specification of the hardware on which the benchmarks will be run will be released in due course.

Please note, that StreaML Open Challenge reuses the dataset (https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=9fc6ea7e71&e=ba2124fabf) and the task description (https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=361eb1d161&e=ba2124fabf) of DEBS GC 2017 but in contrast to DEBS Challenge, systems will be continuously evaluated every week and results will be shown at leaderboard.

Participants are allowed to use the published benchmark (https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=fafce91cf6&e=ba2124fabf) as a reference implementation of anomaly detection algorithm to pass the correctness checks and focus on performance and stability of their systems, which are included into evaluation criteria.

Read more details here: https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=393ff790fe&e=ba2124fabf

————————————————————————————–
Prizes
————————————————————————————–
The winner of each round of the challenge will get a prize of 500€.

————————————————————————————–
Important Dates
————————————————————————————–
Dry run: December 2017 – end of January 2018
Training phase: February – end of April 2018
Cutoff and results proclamation: May 2018

————————————————————————————–
Registration and Submission
————————————————————————————–
Submission and registration procedure is documented here: https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=eec056206a&e=ba2124fabf

The evaluation platform can be reached under following address: https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=6cd5ba2172&e=ba2124fabf

————————————————————————————–
Organization
————————————————————————————–
* Pavel Smirnov – AGT Group GmbH
* Martin Strohbach – AGT Group GmbH

————————————————————————————–
Sponsorship
————————————————————————————–
We would like to explicitly thank AGT International (https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=04e42c42c6&e=ba2124fabf) for being a sponsor for the StreaML Open Challenge.

————————————————————————————–
Further Information and Contact
————————————————————————————–
For detailed information, including datasets and submission guidelines,
please visit the challenge website:
https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=08fc0a8f86&e=ba2124fabf
Feel free to join StreaML open challenge google group to ask any questions: https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=3d1a5152f2&e=ba2124fabf

==============================================
Holistic Benchmarking of Big Linked Data - HOBBIT EU Project
https://project-hobbit.eu

Unsubscribe open-linguistics at lists.okfn.org from this list:
https://project-hobbit.us12.list-manage.com/unsubscribe?u=00d040a1bedee64c86d8911b0&id=1e33221579&e=ba2124fabf&c=dc698eaa39

Forward this email to a friend:
http://us12.forward-to-friend.com/forward?u=00d040a1bedee64c86d8911b0&id=dc698eaa39&e=ba2124fabf

 Update your profile:
https://project-hobbit.us12.list-manage.com/profile?u=00d040a1bedee64c86d8911b0&id=1e33221579&e=ba2124fabf