Tasks

• Task 1 Subjectivity
• Task 2 Claims Extraction & Normalization
• Task 3 Fact-Checking Numerical Claims
• Task 4 Scientific Web Discourse

Registration

Please register to participate in the CheckThat! Lab tasks.

Important Dates

• November 2024: Lab registration opens
• December 2024: Release of the training materials
• 25 April 2025: Lab registration closes
• 2 May 2025: Beginning of the evaluation cycle (test sets release)
• 30 April 2025: Beginning of the evaluation cycle (test sets release)
• 10 May 2025 (23:59 AOE): End of the evaluation cycle (run submission)
• 30 May 2025 MIDNIGHT CEST (11.59PM CEST): Deadline for the submission of working notes [CEUR-WS]
• 30 May – 27 June 2025: Review process of participant papers
• 9 June 2025: Submission of Condensed Lab Overviews [LNCS]
• 16 June 2025: Notification of Acceptance for Condensed Lab Overviews [LNCS]
• 23 June 2025: Camera Ready Copy of Condensed Lab Overviews [LNCS] due
• 27 June 2025: Notification of Acceptance for Participant Papers [CEUR-WS]
• 7 July 2025: Camera Ready Copy of Participant Papers and Extended Lab Overviews [CEUR-WS] due
• 21-25 July 2025: CEUR-WS Working Notes Preview for Checking by Authors and Lab Organizers
• 9-12 September 2025: CLEF 2025 Conference in Madrid, Spain

Recent Updates

• 29 May, 2025: Gold labels for all test datasets are available on git repo.
• 15 May, 2025: Leaderboard made public.
• 2 May, 2025: Submission URLs are available. Please check task specific page.
• 25 Apr, 2025: An online session will be conducted on 2nd May from 10:00 to 11:00 AM (UTC+3) to provide a walkthrough of the CodaLab system, submission process, and working notes.
• 24 Apr, 2025: Test data release for task 1.
• 27 Mar, 2025: Training data release for task 4.
• 4 Feb, 2025: Training data release for task 1.
• 12 Jan, 2025: Training data release for task 3 (English).
• 20 Jan, 2025: Training data release for task 3 (Spanish).
• 20 Jan, 2025: Training data release for task 2.
• 7 Sept, 2024: website is up.

Organisers

• General:
  • Firoj Alam, Qatar Computing Research Institute, HBKU, Qatar
  • Julia Maria Struß, University of Applied Sciences Potsdam, Germany
• Task 1: Federico Ruggeri, Università di Bologna, Italy
• Task 2:
  • Preslav Nakov, MBZUAI, UAE
  • Tanmoy Chakraborty, Indian Institute of Technology Delhi, India
• Task 3: Vinay Setty, University of Stavanger, Norway
• Task 4: Stefan Dietze, GESIS - Leibniz Institute for the Social Sciences, Cologne, Germany

PC chairs

• Julia Maria Struß, University of Applied Sciences Potsdam, Germany

Communication chair

• Firoj Alam, Qatar Computing Research Institute, HBKU, Qatar

Citations

The bib entries will included below and in this bib file.

ECIR 2025

@InProceedings{10.1007/978-3-031-88720-8_68,
  author="Alam, Firoj
  and Stru{\ss}, Julia Maria
  and Chakraborty, Tanmoy
  and Dietze, Stefan
  and Hafid, Salim
  and Korre, Katerina
  and Muti, Arianna
  and Nakov, Preslav
  and Ruggeri, Federico
  and Schellhammer, Sebastian
  and Setty, Vinay
  and Sundriyal, Megha
  and Todorov, Konstantin
  and V., Venktesh",
editor="Hauff, Claudia
  and Macdonald, Craig
  and Jannach, Dietmar
  and Kazai, Gabriella
  and Nardini, Franco Maria
  and Pinelli, Fabio
  and Silvestri, Fabrizio
  and Tonellotto, Nicola",
title="The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval",
booktitle="Advances in Information Retrieval",
year="2025",
publisher="Springer Nature Switzerland",
address="Cham",
pages="467--478",
isbn="978-3-031-88720-8",
}

CLEF 2025 LNCS

@InProceedings{clef-checkthat:2025-lncs,
  author = {
    Alam, Firoj
    and Struß, Julia Maria      
    and Chakraborty, Tanmoy
    and Dietze, Stefan
    and Hafid, Salim
    and Korre, Katerina
    and Muti, Arianna
    and Nakov, Preslav
    and Ruggeri, Federico
    and Schellhammer, Sebastian
    and Setty, Vinay
    and Sundriyal, Megha
    and Todorov, Konstantin
    and Venktesh, V
  },
  title = {Overview of the {CLEF}-2025 {CheckThat! Lab}: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval},
  editor = {
    Carrillo-de-Albornoz, Jorge and
    Gonzalo, Julio and
    Plaza, Laura and
    García Seco de Herrera, Alba and
    Mothe, Josiane and
    Piroi, Florina and
    Rosso, Paolo and
    Spina, Damiano and
    Faggioli, Guglielmo and
    Ferro, Nicola
  },
  booktitle = {Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Sixteenth International Conference of the CLEF Association (CLEF 2025)},
  year = {2025}
}

CLEF 2025 CEUR papers

Here you find the task-specific papers. They all cross-ref to include information about the volume:

@proceedings{clef2025-workingnotes,
    editor = "Faggioli, Guglielmo and
    Ferro, Nicola and
    Rosso, Paolo and
    Spina, Damiano",
    title = "Working Notes of CLEF 2025 - Conference and Labs of the Evaluation Forum",
    booktitle = "Working Notes of CLEF 2025 - Conference and Labs of the Evaluation Forum",
    series = "CLEF~2025",
    address = "Madrid, Spain",
    year = 2025
}

Task 1 overview paper

@inproceedings{clef-checkthat:2025:task1,
  title     = {Overview of the {CLEF-2025 CheckThat!} Lab Task 1 on Subjectivity in News Article},
  author    = {
    Ruggeri, Federico and
    Muti, Arianna and
    Korre, Katerina and
    Stru{\ss}, Julia Maria and
    Siegel, Melanie and
    Wiegand, Michael and
    Alam, Firoj and
    Biswas, Rafiul and
    Zaghouani, Wajdi and
    Nawrocka, Maria and
    Ivasiuk, Bogdan and
    Razvan, Gogu and
    Mihail, Andreiana
  },
  crossref  = {clef2025-workingnotes}
}

Task 2 overview paper

@inproceedings{clef-checkthat:2025:task2,
  title     = {Overview of the {CLEF-2025 CheckThat!} Lab Task 2 on Claim Normalization},
  author    = {
    Sundriyal, Megha and
    Chakraborty, Tanmoy and
    Nakov, Preslav
  },
  crossref  = {clef2025-workingnotes}
}

Task 3 overview paper

@inproceedings{clef-checkthat:2025:task3,
  title     = {Overview of the {CLEF-2025 CheckThat!} Lab Task 3 on Fact-Checking Numerical Claims},
  author    = {
    Venktesh, V. and
    Setty, Vinay and
    Anand, Avishek and
    Hasanain, Maram and
    Bendou, Boushra and
    Bouamor, Houda and
    Alam, Firoj and
    Iturra-Bocaz, Gabriel and
    Galuščáková, Petra
  },
  crossref  = {clef2025-workingnotes}
}

Task 4 overview paper

@inproceedings{clef-checkthat:2025:task4,
  title     = {Overview of the {CLEF-2025 CheckThat!} Lab Task 4 on Scientific Web Discourse},
  author    = {
    Hafid, Salim and
    Kartal, Yavuz Selim and
    Schellhammer, Sebastian and
    Boland, Katarina and
    Dimitrov, Dimitar and
    Bringay, Sandra and
    Todorov, Konstantin and
    Dietze, Stefan
  },
  crossref  = {clef2025-workingnotes}
}

CLEF 2025

This edition of the CheckThat! lab is held within CLEF 2025, part of the CLEF initiative.