Tasks

• Task 1 Subjectivity
• Task 2 Claims Extraction & Normalization
• Task 3 Fact-Checking Numerical Claims
• Task 4 Scientific Web Discourse

Registration

Please register to participate in the CheckThat! Lab tasks.

Important Dates

• November 2024: Lab registration opens
• December 2024: Release of the training materials
• 25 April 2025: Lab registration closes
• 2 May 2025: Beginning of the evaluation cycle (test sets release)
• 30 April 2025: Beginning of the evaluation cycle (test sets release)
• 10 May 2025 (23:59 AOE): End of the evaluation cycle (run submission)
• 30 May 2025: Deadline for the submission of working notes [CEUR-WS]
• 30 May – 27 June 2025: Review process of participant papers
• 9 June 2025: Submission of Condensed Lab Overviews [LNCS]
• 16 June 2025: Notification of Acceptance for Condensed Lab Overviews [LNCS]
• 23 June 2025: Camera Ready Copy of Condensed Lab Overviews [LNCS] due
• 27 June 2025: Notification of Acceptance for Participant Papers [CEUR-WS]
• 7 July 2025: Camera Ready Copy of Participant Papers and Extended Lab Overviews [CEUR-WS] due
• 21-25 July 2025: CEUR-WS Working Notes Preview for Checking by Authors and Lab Organizers
• 9-12 September 2025: CLEF 2025 Conference in Madrid, Spain

Recent Updates

• 25 Apr, 2025: An online session will be conducted on 2nd May from 10:00 to 11:00 AM (UTC+3) to provide a walkthrough of the CodaLab system, submission process, and working notes.
• 24 Apr, 2025: Test data release for task 1.
• 27 Mar, 2025: Training data release for task 4.
• 4 Feb, 2025: Training data release for task 1.
• 12 Jan, 2025: Training data release for task 3 (English).
• 20 Jan, 2025: Training data release for task 3 (Spanish).
• 20 Jan, 2025: Training data release for task 2.
• 7 Sept, 2024: website is up.

Organisers

• General:
  • Firoj Alam, Qatar Computing Research Institute, HBKU, Qatar
  • Julia Maria Struß, University of Applied Sciences Potsdam, Germany
• Task 1: Federico Ruggeri, Università di Bologna, Italy
• Task 2:
  • Preslav Nakov, MBZUAI, UAE
  • Tanmoy Chakraborty, Indian Institute of Technology Delhi, India
• Task 3: Vinay Setty, University of Stavanger, Norway
• Task 4: Stefan Dietze, GESIS - Leibniz Institute for the Social Sciences, Cologne, Germany

PC chairs

• Julia Maria Struß, University of Applied Sciences Potsdam, Germany

Communication chair

• Firoj Alam, Qatar Computing Research Institute, HBKU, Qatar

Citations

The bib entries will included below and in this bib file.

ECIR 2025

Alam, F. et al. (2025). The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval. In: Hauff, C., et al. Advances in Information Retrieval. ECIR 2025. Lecture Notes in Computer Science, vol 15576. Springer, Cham. https://doi.org/10.1007/978-3-031-88720-8_68

@InProceedings{10.1007/978-3-031-88720-8_68,
  author="Alam, Firoj
  and Stru{\ss}, Julia Maria
  and Chakraborty, Tanmoy
  and Dietze, Stefan
  and Hafid, Salim
  and Korre, Katerina
  and Muti, Arianna
  and Nakov, Preslav
  and Ruggeri, Federico
  and Schellhammer, Sebastian
  and Setty, Vinay
  and Sundriyal, Megha
  and Todorov, Konstantin
  and V., Venktesh",
editor="Hauff, Claudia
  and Macdonald, Craig
  and Jannach, Dietmar
  and Kazai, Gabriella
  and Nardini, Franco Maria
  and Pinelli, Fabio
  and Silvestri, Fabrizio
  and Tonellotto, Nicola",
title="The CLEF-2025 CheckThat! Lab: Subjectivity, Fact-Checking, Claim Normalization, and Retrieval",
booktitle="Advances in Information Retrieval",
year="2025",
publisher="Springer Nature Switzerland",
address="Cham",
pages="467--478",
isbn="978-3-031-88720-8",
}

CLEF 2025

This edition of the CheckThat! lab is held within CLEF 2025, part of the CLEF initiative.