[open-linguistics] [CFP] OKE 2018 – Open Knowledge Extraction Challenge - deadline extension
Hobbit Team
community at project-hobbit.eu
Thu Mar 1 15:47:35 UTC 2018
———————————————————————————————
CALL FOR PAPERS
———————————————————————————————
OKE 2018 – Open Knowledge Extraction Challenge
in conjunction with the 15th European Semantic Web Conference (ESWC 2018)
3rd-7th June 2018, Heraklion, Crete, Greece
———————————————————————————————
URL: https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=c1fdeaddd4&e=ba2124fabf
URL: https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=a3bfa0c878&e=ba2124fabf
email: OKE-contact at googlegroups.com
email: speck at informatik.uni-leipzig.de
———————————————————————————————
The OKE challenge invites researchers and practitioners from academia as well as industry to compete to the aim of pushing further the state of the art in knowledge extraction from text for the Semantic Web. The challenge has the ambition to provide a reference framework for research in this field by redefining a number of tasks typically from information and knowledge extraction by taking into account Semantic Web requirements and has the goal to test the performance of knowledge extraction systems.
This year, the challenge goes in the fourth round and consists of four tasks which include named entity identification, disambiguation by linking to a knowledge base as well as relation and knowledge extraction. The challenge makes use of small gold standard datasets that consist of manually curated documents and large silver standard datasets that consist of automatically generated synthetic documents. The performance measure of a participating system is twofold based on (1) Precision, Recall, F1-measure and on (2) Precision, Recall, F1-measure with respect to the runtime of the system.
This year, the challenge comprises the following tasks:
-Task 1: Focused Named Entity Identification and Linking
-Task 2: Broader Named Entity Identification and Linking
-Task 3: Relation Extraction
-Task 4: Knowledge Extraction
Participants will be expected to describe their solution and results on the training datasets over a 5 page paper. In particular, a short summary of the approach chosen, a link to the experimental results and an analysis of the strengths and weaknesses of the approach are expected.
———————————————————————————————
Important Dates
———————————————————————————————
– Paper submission deadline (5 pages): Friday, March 30th, 2018(*)
– Challenge paper reviews: Thursday, April 26th, 2018
– Notification of authors and invitation to challenge: Monday, April 30th, 2018
– Camera ready papers (5 pages): Monday, May 14th, 2018
– Camera ready papers for the challenge post-proceedings (up to 15 pages): Friday, July 6th, 2018 (tentative deadline)
– Release of training data and detailed instructions: Monday, February 12, 2018
– Release of test dataset: Monday, May 7th, 2018
– Deadline for system submission: TBA
– Running of the systems: TBA
– Presentation of challenge results: During ESWC 2018
– Proclamation of winners: During ESWC 2018 closing ceremony
———————————————————————————————
Organization
———————————————————————————————
* Axel-Cyrille Ngonga Ngomo, Paderborn University, Paderborn, Germany
* René Speck, Leipzig University, Leipzig, Germany
* Michael Röder, Paderborn Leipzig, Paderborn, Germany
* Ricardo Usbeck, Paderborn University, Paderborn, Germany
For the complete list of organizers and program committee members, visit the challenge website.
———————————————————————————————
Further Information and Contact
———————————————————————————————-
For detailed information, including datasets and submission guidelines, please visit the challenge website: https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=d60ff82dc0&e=ba2124fabf
Contact Email: OKE-contact at googlegroups.com OR speck at informatik.uni-leipzig.de
————————————————————————————–
==============================================
Holistic Benchmarking of Big Linked Data - HOBBIT EU Project
https://project-hobbit.eu
Unsubscribe open-linguistics at lists.okfn.org from this list:
https://project-hobbit.us12.list-manage.com/unsubscribe?u=00d040a1bedee64c86d8911b0&id=1e33221579&e=ba2124fabf&c=8693af9fff
Forward this email to a friend:
http://us12.forward-to-friend.com/forward?u=00d040a1bedee64c86d8911b0&id=8693af9fff&e=ba2124fabf
Update your profile:
https://project-hobbit.us12.list-manage.com/profile?u=00d040a1bedee64c86d8911b0&id=1e33221579&e=ba2124fabf
More information about the open-linguistics
mailing list