NFDI4DS organizes interactive events, such as hackathons and shared tasks, that attract the data science and AI community.

Shared Tasks provide a framework for scientifically exciting and challenging tasks for the NFDI4DS community.

NFDI4DS is currently organizing an extensive line-up of Shared Tasks. It provides each shared task together with a dataset. Currently, four shared tasks are running in the context of well-known events:

If you have any questions, please feel free to contact us via nfdi4ds@fokus.fraunhofer.de.

Shared Tasks (Upcoming):

• Task - Scholarly QALD at ISWC 2023
  • Scholarly QUALD: Subtasks for Question Answering over Scholarly Knowledge Graphs
  • Subtask 1: SciQA — Question Answering of Scholarly Knowledge
  • Subtask 2: DBLP-QUAD — Knowledge Graph Question Answering over DBLP
  • https://kgqa.github.io/scholarly-QALD-challenge/2023/
  • Contact: Ricardo Usbeck (Uni Hamburg) & Sören Auer (TIB)
• Task - SOTA at CLEF 2024
  • SOTA: Tracking the State-of-the-Art in Empirical AI Scholarly Publications
  • Subtask 1: Task, Dataset, Metric (TDM) Extraction
  • Subtask 2: Task, Dataset, Metric, Score (TDMS) Extraction
  • Subtask 3: Zero-shot Task, Dataset, Metric (TDM) Extraction
  • Contact: Jennifer D’Souza (TIB)
• Task - FORC at ESWC 2024
  • FORC: Field of Research Classification for Scholarly Publications
  • Subtask 1: General single-label classification
  • Subtask 2: Fine-grained NLP multi-label classification
  • Contact: Raia Abu Ahmad (DFKI) & Georg Rehm (DFKI)
• Task - SOMD at ESWC 2024
  • SOMD: Software Mention Detection in Scholarly Publications
  • Subtask 1: Software Mention Detection
  • Subtask 2: Additional Information Detection
  • Subtask 3: Relation Extraction
  • Subtask 4: Disambiguation
  • Subtask 5: End to End
  • Contact: Frank Krüger (HS Wismar) & Stefan Dietze (GESIS)

Shared Tasks (In Preparation):

• Task - Dataset Mention Detection
  • Contact: Wolf Otto (GESIS)
• Task - Machine Learning Model Mention Detection
  • Contact: Saurav Karmakar & Matthäus Zloch (GESIS)
• Task - Question Answering
  • Contact: Tilahun Abedissa (UHH) & Ricardo Usbeck (UHH)
• Task - Standards, FAIR principles, and FDOs
  • Contact: Fidan Limani (ZBW) & Atif Latif (ZBW)