[open-linguistics] [CFP] SCALABLE QUESTION ANSWERING OPEN CHALLENGE (SQA) 2017-2018

Hobbit Team community at project-hobbit.eu
Mon Nov 20 06:44:14 UTC 2017


—————————————————————————————————————————————————————————————————
Scalable Question Answering Open Challenge (SQA) 2017 – 2018
—————————————————————————————————————————————————————————————————

After the successful organization of the QALD-7 challenge at the ESWC 2017 and the QALD-8 challenge incorporated in the NLIWoD workshop at ISWC 2017, with more than 50 participants, the HOBBIT project (https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=1feb6e8d47&e=ba2124fabf) is proud to announce the Scalable Question Answering Open Challenge (SQA) over Linked Data. SQA Open Challenge will run periodically with cutoff dates in June  2018 (coinciding with ESWC 2018) and November 2018. Therewith, the challenge will ensure continuous participation and system evaluation. Stay tuned and get ready to participate!

Monetary prizes will be provided to the best winning systems at each cutoff date.
Please express your interest in SQA Open Challenge by adding your email via the link: https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=5a7f9d8207&e=ba2124fabf. You will receive further information and notifications regarding the progress of SQA Open Challenge.
—————————————————————————————————
Important Dates
—————————————————————————————————

Dry run phase:                    December 2017 to January 2018
Release of the test questions
without answers:                  TBA
Training phase*:                  February to April 2018
Test phase:                       May 2018
Proclamation of results:          June 3rd, 2018

*Weekly release of evaluation results from the end of January onwards.

—————————————————————————————————
Prizes
—————————————————————————————————
The winner of the challenge will get a prize of 250€

——————————————————————————————————————————————————————————
Scalable Question Answering Open Challenge at a glance
——————————————————————————————————————————————————————————
The key challenge for Scalable Question Answering over Linked Data is in the need to translate a user’s information request into such a form that it can be efficiently evaluated using standard Semantic Web query processing and inferencing techniques.

Therefore, the main task of SQA Open Challenge is the following: given an RDF dataset and and a large volume of natural language questions or keywords, return the correct answers (or SPARQL queries that retrieves those answers).

Small test Data and Documentation are available for SQA Open Challenge:
* Sample dataset: https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=891fc03968&e=ba2124fabf
* Description: https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=ffbc83f263&e=ba2124fabf

In the Scalable Question Answering Open Challenge (SQA) users can display the capabilities of their systems using the HOBBIT platform (https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=e0e67e143e&e=ba2124fabf) provided by the homonymous H2020 project.

——————————————————————————–
Organization
——————————————————————————–

* Giulio Napolitano, IAIS, Fraunhofer, Germany
* Axel-Cyrille Ngonga Ngomo, University of Paderborn, Germany
* Ricardo Usbeck, University of Paderborn, Germany

——————————————————————————————–
Further Information and Contact
——————————————————————————————–

For detailed information including datasets and submission guidelines,
please visit the challenge website:  https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=10818030c5&e=ba2124fabf
Contact Email: Giulio.Napolitano at iais.fraunhofer.de


==============================================
Holistic Benchmarking of Big Linked Data - HOBBIT EU Project
https://project-hobbit.eu

Unsubscribe open-linguistics at lists.okfn.org from this list:
https://project-hobbit.us12.list-manage.com/unsubscribe?u=00d040a1bedee64c86d8911b0&id=1e33221579&e=ba2124fabf&c=930819f9b9

Forward this email to a friend:
http://us12.forward-to-friend.com/forward?u=00d040a1bedee64c86d8911b0&id=930819f9b9&e=ba2124fabf

 Update your profile:
https://project-hobbit.us12.list-manage.com/profile?u=00d040a1bedee64c86d8911b0&id=1e33221579&e=ba2124fabf



More information about the open-linguistics mailing list