[open-linguistics] [CFP] SQA 2018 – Scalable Question Answering Challenge

Hobbit Team community at project-hobbit.eu
Thu Jan 25 07:29:21 UTC 2018


SQA 2018 – Scalable Question Answering

in conjunction with the 15th European Semantic Web Conference (ESWC 2018)
3rd-7th June 2018, Heraklion, Crete, Greece

URL: https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=85896c1b85&e=ba2124fabf
URL: https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=7d6ab5e747&e=ba2124fabf
email: Giulio.Napolitano at iais.fraunhofer.de

The key challenge for Scalable Question Answering over Linked Data is the need to translate a user’s information request into such a form that it can be efficiently evaluated using standard Semantic Web query processing and inferencing techniques.

Therefore, the main task of SQA Challenge is the following: given an RDF dataset and and a large volume of natural language questions or keywords, return the correct answers (or SPARQL queries that retrieves those answers).

Training dataset and documentation are available:
* Training dataset: https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=3255fbf78b&e=ba2124fabf
* Description: https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=eab98af4c1&e=ba2124fabf

In the Scalable Question Answering Challenge (SQA) users can display the capabilities of their systems using the HOBBIT platform (https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=6825fb498c&e=ba2124fabf) provided by the homonymous H2020 project.

Participants will be expected to describe their solution and results on the training datasets over a 5 page paper. In particular, a short summary of the approach chosen, a link to the experimental results and an analysis of the strengths and weaknesses of the approach are expected.

Important Dates
– Challenge papers submission deadline (5 pages document): Friday March 9th, 2018
– Notifications sent to participants and invitations to submit task results: Monday April 9th, 2018
– Test data (and other participation tools) published: Monday April 16th, 2018
– Camera ready papers for the conference (5 pages document): Monday April 23rd, 2018
– Instructions for evaluation: Monday February 12th, 2018
– Deadline for submission of system answers (cut-off): Friday June 1st, 2018
– Camera ready papers for the challenge proceedings (up to 15 pages): Friday, July 6th, 2018 (tentative deadline)

– Proclamation of winners: During ESWC2018 closing ceremony
– Eligible to submit papers are only authors participating in the challenge.

* Giulio Napolitano, IAIS, Fraunhofer, Germany
* Axel-Cyrille Ngonga Ngomo, University of Paderborn, Germany
* Ricardo Usbeck, University of Paderborn, Germany

Further Information and Contact
For detailed information including datasets and submission guidelines, please visit
the challenge website: https://project-hobbit.us12.list-manage.com/track/click?u=00d040a1bedee64c86d8911b0&id=5535472605&e=ba2124fabf
Contact Email: Giulio.Napolitano at iais.fraunhofer.de

Holistic Benchmarking of Big Linked Data - HOBBIT EU Project

Unsubscribe open-linguistics at lists.okfn.org from this list:

Forward this email to a friend:

 Update your profile:

More information about the open-linguistics mailing list