cd
NFDI4DS

Shared Tasks

Shared Tasks

2023-02-01
2 min read

The NFDI4DS project is organizing an extensive line-up of Shared Tasks concerned with scholarly information processing and retrieval as well as practices related to digital research objects. Below is a list of tasks that we are currently working on. If you have any questions, please feel free to contact us via nfdi4ds@fokus.fraunhofer.de.

Shared Tasks (Upcoming):

  • Task - Scholarly QALD at ISWC 2023

Shared Tasks (In Preparation):

  • Task - FORC: Field of Research Classification for Scholarly Publications
    • Subtask 1: General single-label classification
    • Subtask 2: Fine-grained NLP multi-label classification
    • Contact: Raia Abu Ahmad (DFKI) & Georg Rehm (DFKI)
  • Task - SOTA: Tracking the State-of-the-Art in Empirical AI Scholarly Publications
    • Subtask 1: Task, Dataset, Metric (TDM) Extraction
    • Subtask 2: Task, Dataset, Metric, Score (TDMS) Extraction
    • Subtask 3: Zero-shot Task, Dataset, Metric (TDM) Extraction
    • Contact: Jennifer D’Souza (TIB)
  • Task - SOMD: Software Mention Detection in Scholarly Publications
    • Subtask 1: Software Mention Detection
    • Subtask 2: Additional Information Detection
    • Subtask 3: Relation Extraction
    • Subtask 4: Disambiguation
    • Subtask 5: End to End
    • Contact: Frank Krüger (HS Wismar) & Stefan Dietze (GESIS)

Shared Tasks (Under Development):

  • Task 4 - Dataset Mention Detection
    • Contact: Wolf Otto (GESIS)
  • Task 5 - Machine Learning Model Mention Detection
    • Contact: Saurav Karmakar & Matthäus Zloch (GESIS)
  • Task 6 - Question Answering
    • Contact: Tilahun Abedissa (UHH) & Ricardo Usbeck (UHH)
  • Task 7 - Standards, FAIR principles, and FDOs
    • Contact: Fidan Limani (ZBW) & Atif Latif (ZBW)