NFDI4DS organizes interactive events, such as hackathons and shared tasks, that attract the data science and AI community.
Shared Tasks provide a framework for scientifically exciting and challenging tasks for the NFDI4DS community.
NFDI4DS is currently organizing an extensive line-up of Shared Tasks. It provides each shared task together with a dataset. Currently, four shared tasks are running in the context of well-known events:
If you have any questions, please feel free to contact us via nfdi4ds@fokus.fraunhofer.de.
Shared Tasks (Upcoming):
- Task - Scholarly QALD at ISWC 2023
- Scholarly QUALD: Subtasks for Question Answering over Scholarly Knowledge Graphs
- Subtask 1: SciQA — Question Answering of Scholarly Knowledge
- Subtask 2: DBLP-QUAD — Knowledge Graph Question Answering over DBLP
- https://kgqa.github.io/scholarly-QALD-challenge/2023/
- Contact: Ricardo Usbeck (Uni Hamburg) & Sören Auer (TIB)
- Task - SOTA at CLEF 2024
- SOTA: Tracking the State-of-the-Art in Empirical AI Scholarly Publications
- Subtask 1: Task, Dataset, Metric (TDM) Extraction
- Subtask 2: Task, Dataset, Metric, Score (TDMS) Extraction
- Subtask 3: Zero-shot Task, Dataset, Metric (TDM) Extraction
- Contact: Jennifer D’Souza (TIB)
- Task - FORC at ESWC 2024
- FORC: Field of Research Classification for Scholarly Publications
- Subtask 1: General single-label classification
- Subtask 2: Fine-grained NLP multi-label classification
- Contact: Raia Abu Ahmad (DFKI) & Georg Rehm (DFKI)
- Task - SOMD at ESWC 2024
- SOMD: Software Mention Detection in Scholarly Publications
- Subtask 1: Software Mention Detection
- Subtask 2: Additional Information Detection
- Subtask 3: Relation Extraction
- Subtask 4: Disambiguation
- Subtask 5: End to End
- Contact: Frank Krüger (HS Wismar) & Stefan Dietze (GESIS)
Shared Tasks (In Preparation):
- Task - Dataset Mention Detection
- Contact: Wolf Otto (GESIS)
- Task - Machine Learning Model Mention Detection
- Contact: Saurav Karmakar & Matthäus Zloch (GESIS)
- Task - Question Answering
- Contact: Tilahun Abedissa (UHH) & Ricardo Usbeck (UHH)
- Task - Standards, FAIR principles, and FDOs
- Contact: Fidan Limani (ZBW) & Atif Latif (ZBW)