The NFDI4DS project is organizing an extensive line-up of Shared Tasks concerned with scholarly information processing and retrieval as well as practices related to digital research objects. Below is a list of tasks that we are currently working on. If you have any questions, please feel free to contact us via nfdi4ds@fokus.fraunhofer.de.
Shared Tasks (Upcoming):
- Task - Scholarly QALD at ISWC 2023
- Subtask 1: SciQA — Question Answering of Scholarly Knowledge
- Subtask 2: DBLP-QUAD — Knowledge Graph Question Answering over DBLP
- https://kgqa.github.io/scholarly-QALD-challenge/2023/
- Contact: Ricardo Usbeck (Uni Hamburg) & Sören Auer (TIB)
Shared Tasks (In Preparation):
- Task - FORC: Field of Research Classification for Scholarly Publications
- Subtask 1: General single-label classification
- Subtask 2: Fine-grained NLP multi-label classification
- Contact: Raia Abu Ahmad (DFKI) & Georg Rehm (DFKI)
- Task - SOTA: Tracking the State-of-the-Art in Empirical AI Scholarly Publications
- Subtask 1: Task, Dataset, Metric (TDM) Extraction
- Subtask 2: Task, Dataset, Metric, Score (TDMS) Extraction
- Subtask 3: Zero-shot Task, Dataset, Metric (TDM) Extraction
- Contact: Jennifer D’Souza (TIB)
- Task - SOMD: Software Mention Detection in Scholarly Publications
- Subtask 1: Software Mention Detection
- Subtask 2: Additional Information Detection
- Subtask 3: Relation Extraction
- Subtask 4: Disambiguation
- Subtask 5: End to End
- Contact: Frank Krüger (HS Wismar) & Stefan Dietze (GESIS)
Shared Tasks (Under Development):
- Task 4 - Dataset Mention Detection
- Contact: Wolf Otto (GESIS)
- Task 5 - Machine Learning Model Mention Detection
- Contact: Saurav Karmakar & Matthäus Zloch (GESIS)
- Task 6 - Question Answering
- Contact: Tilahun Abedissa (UHH) & Ricardo Usbeck (UHH)
- Task 7 - Standards, FAIR principles, and FDOs
- Contact: Fidan Limani (ZBW) & Atif Latif (ZBW)