Our Shared Task WikiKGQA - Wiki-Based Knowledge Graph Question Answering - has been accepted at the 25th International Semantic Web Conference ISWC2026 in Bari, Italy.
KGQA Knowledge Graph Question Answering) has a long tradition in the Semantic Web community, particularly under the Question Answering over Linked Data (QALD) moniker and challenge series. With the rise of LLMs, the performance of state-of-the-art systems has improved dramatically. However, benchmark datasets in the space exhibit well-known limitations, primarily due to the manual cost of creating parallel corpora of natural language questions and structured queries. To address these issues, QAWiki proposes a collaboratively-edited community resource of hand-crafted question-query pairs, focusing currently on English & Spanish questions answered over Wikidata’s SPARQL query service.
The motivation is two-fold:
- (1) to evaluate KGQA systems over a hand-crafted collection of multilingual question-query pairs over Wikidata, and
- (2) to build a community centered around QAWiki, to expand and improve it, and thus expand and improve the resources available for training and benchmarking of KGQA systems.
Find more info and how to participate at WikiKGQA