CLEF 2026 - CheckThat! Lab

Home

Editions

Tasks

Contents

Advancing Multilingual Fact-Checking

Lab programme

The poster sessions will take place on Wednesday 23rd September from 10:00–10:30 and 15:30–16.00.

Plenary Talk Overview — Wednesday 23rd September

Time Speaker Title
11:15 – 12:05 Julia Maria Struß CheckThat! Lab Overview

Session 1 — Wednesday 23rd September, 16:00–17:30 (Chair: Stefan Dietze)

Time Speaker Title
16:00 – 17:00 Prof. Dr. Benno Stein Keynote on Text Watermarking
17:00 – 17:30 - CheckThat! Task Overview

Session 2 — Thursday 24th September, 11:00–12:30 (Chair: Julia Maria Struß)

Time Task Title
11:00 – 11:05 1 CheckThat! Task 1 Overview
11:05 – 11:25 1 Boyes Boys at CheckThat! 2026: Go big or go home
11:25 – 11:45 1 MeVer at CheckThat! 2026: Cluster-Aware Hard-Negative Mining for Multilingual Scientific Source Retrieval
11:45 – 12:05 1 Claim2Source at CheckThat! 2026: Improving Multilingual Scientific Claim–Source Retrieval with Verification-based Re-Ranking
12:05 – 12:30 1,2,3 Outsider at CheckThat! 2026: Retrieval, Verification, and Generation for Multilingual Fact-Checking

Session 3 — Thursday 24th September, 14:00–15:30 (Chair: Preslav Nakov)

Time Task Title
14:00 – 14:05 3 CheckThat! Task 3 Overview
14:05 – 14:25 3 UTS at CheckThat! 2026: Cite-Frame Engineering for Generated Fact-Checking Articles
14:25 – 14:30 2 CheckThat! Task 2 Overview
14:30 – 14:50 2 GippLab at CheckThat! 2026: Multilingual Numerical Claim Verification with QLoRA Trace Scoring
14:50 – 15:10 2 CheckMates at CheckThat! 2026: Combining Ranking Models and LLM Judges for Numerical Reasoning Trace Verification
15:10 – 15:20 What's next on CheckThat!
15:20 – 15:30 Open discussion

Keynote

Speaker: Prof. Dr. Benno Stein
Title: Introduction to Text Watermarking
Abstract:

Digital watermarking refers to the embedding of imperceptible or barely perceptible information into digital media such as images, audio, video, or text. The embedded information can encode authorship, provenance, integrity, or other metadata and remains associated with the content as it is distributed or processed.

The emergence of large language models (LLMs) has enabled the generation of high-quality synthetic text, often indistinguishable from human-written content, at a scale that may substantially affect the information ecosystem. Text watermarking offers one possible approach to identifying and labelling LLM-generated content. It poses a particular challenge, though: unlike images or audio, where information can often be embedded by modifying an underlying signal, watermarking text necessarily involves altering the text itself. This creates a trade-off between detectability and textual quality.

This talk introduces and illustrates two approaches to text watermarking: generative watermarking, in which the watermark is incorporated during text generation, and post-hoc watermarking, in which it is added to existing text. I will also explore related problems and challenges.

Tasks

  • Task 1 Source Retrieval for Scientific Web Claims
  • Task 2 Fact-Checking Numerical Claims
  • Task 3 Generating Full Fact-Checking Articles

Communication

For communication, please join the Discord Server (https://discord.gg/PEMh4a2YHV) and follow the #checkthat lab-channel.

Registration

Please register to participate in the CheckThat! Lab tasks.

Recent Updates

  • 14 Sep, 2026: Program is online.
  • 20 May, 2026: Gold labels for all test datasets are available.
  • 15 May, 2026: All leaderboards are made public.
  • 17 Apr, 2026: an online session will be conducted on 24th of April, 3pm CEST, giving a short overview on each task and a walk-through of the submission system.
  • 17 Apr, 2026: Submission site URLs for Task 1 and 2 are available. Please check task specific page.
  • 17 Feb, 2026: training data was released.
  • 5 Sept, 2025: website is up.

Important Dates

Specific dates will be announced once they are fixed.

  • 17 November 2025: Lab registration opens
  • December 2025: Release of sample data
  • February 2026: Release of the training data
  • 23 April 2026: Lab registration closes
  • 24 April 2026: Beginning of the evaluation cycle (test sets release)
  • 07 May 2026: End of the evaluation cycle (run submission)
  • 28 May 2026: Deadline for the submission of working notes [CEUR-WS]
  • 29 May – 27 June 2026: Review process of participant papers
  • 08 June 2026: Submission of Condensed Lab Overviews [LNCS]
  • 15 June 2026: Notification of Acceptance for Condensed Lab Overviews [LNCS]
  • 22 June 2026: Camera Ready Copy of Condensed Lab Overviews [LNCS] due
  • 30 June 2026: Notification of Acceptance for Participant Papers [CEUR-WS]
  • 06 July 2026: Camera Ready Copy of Participant Papers and Extended Lab Overviews [CEUR-WS] due
  • 10 July 2026: Regular Conference Registration Ends
  • 31 August 2026: Late Conference Registration Ends
  • 21-24 September 2026: CLEF 2026 Conference in Jena, Germany

All deadlines are 23:59 in Anywhere on Earth (AOE) timezone.

Organisers

  • General:
  • Task 1:
    • Stefan Dietze, GESIS - Leibniz Institute for the Social Sciences, Cologne, Germany
    • Konstantin Todorov, LIRMM, CNRS, University of Montpellier, Montpellier, France
    • Salim Hafid, médialab Sciences Po, Paris, France
  • Task 2:
    • Vinay Setty, University of Stavanger, Norway
    • Venktesh V, Delft University of Technology, Netherlands
  • Task 3:
    • Preslav Nakov, MBZUAI, UAE
    • Tanmoy Chakraborty, IIT Delhi, India

PC chairs

  • Julia Maria Struß
  • Firoj Alam
  • Sebastian Schellhammer

Citations

ECIR 2026

@InProceedings{10.1007/978-3-032-21321-1_43,
author="Stru{\ss}, Julia Maria
and Schellhammer, Sebastian
and Dietze, Stefan
and V., Venktesh
and Setty, Vinay
and Chakraborty, Tanmoy
and Nakov, Preslav
and Anand, Avishek
and Chungkham, Primakov
and Hafid, Salim
and Sahnan, Dhruv
and Todorov, Konstantin",
editor="Campos, Ricardo
and Jatowt, Adam
and Lan, Yanyan
and Aliannejadi, Mohammad
and Bauer, Christine
and MacAvaney, Sean
and Anand, Avishek
and Ren, Zhaochun
and Verberne, Suzan
and Bai, Nan
and Mansoury, Masoud",
title="The CLEF-2026 CheckThat! Lab: Advancing Multilingual Fact-Checking",
booktitle="Advances in Information Retrieval",
year="2026",
publisher="Springer Nature Switzerland",
address="Cham",
pages="325--335",
isbn="978-3-032-21321-1"
}

CLEF 2026 LNCS

@InProceedings{clef-checkthat:2026-lncs,
  author = {
     Stru{\ss}, Julia Maria
     and Schellhammer, Sebastian
     and Dietze, Stefan
     and V., Venktesh
     and Setty, Vinay
     and Chakraborty, Tanmoy
     and Nakov, Preslav
     and Anand, Avishek
     and Chungkham, Primakov
     and Hafid, Salim
     and Sahnan, Dhruv
     and Todorov, Konstantin},
  title = {Overview of the {CLEF}-2026 {CheckThat! Lab}: Advancing Multilingual Fact-Checking},
  editor = {
     Hagen, Matthias
     and Potthast, Martin
     and Stein, Benno
     and Schaer, Philipp
     and Zangerle, Eva
     and MacAvaney, Sean
     and Stru{\ss}, Julia Maria
     and Salido, Eva S{\'a}nchez
     and Barr{\'o}n-Cede{\~n}o, Alberto
     and {Alba Garc{\'i}a Seco de Herrera}},
  publisher = {Springer},
  booktitle = {Experimental IR Meets Multilinguality, Multimodality, and Interaction. Proceedings of the Seventeenth International Conference of the CLEF Association (CLEF 2026)},
  year = {2026}
}

CLEF 2026 CEUR papers

Here you find the task-specific papers. They all cross-ref to include information about the volume:

@proceedings{clef2026-workingnotes,
  title = {{CLEF} 2026 Working Notes},
  editor = {
     Salido, Eva S{\'a}nchez
     and Barr{\'o}n-Cede{\~n}o, Alberto
     and {Alba Garc{\'i}a Seco de Herrera}
     and MacAvaney, Sean
     and Stru{\ss}, Julia Maria},
  series = {CLEF~2026},
  address = {Jena, Germany},
  year = 2026
}

Task 1

@inproceedings{clef-checkthat:2026:task1,
   title     = {Overview of the {CLEF-2026 CheckThat!} Lab Task 1 on 
Source Retrieval for Scientific Web Claims},
   author    = {
    Schellhammer, Sebastian and
    Hafid, Salim and
    Kartal, Yavuz Selim and
    Boland, Katarina and
    Dimitrov, Dimitar and
    Todorov, Konstantin and
    Dietze, Stefan
   },
   crossref  = {clef2026-workingnotes}
}

Task 2

@inproceedings{clef-checkthat:2026:task2,
   title     = {Overview of the {CLEF-2026 CheckThat!} Lab Task 2 on 
Fact-Checking Numerical Claims},
   author    = {
      V, Venktesh  and
      Setty, Vinay  and
      Chungkham, Primakov and
      Anand, Avishek and
      Alam, Firoj
   },
   crossref  = {clef2026-workingnotes}
}

Task 3

@inproceedings{clef-checkthat:2026:task3,
   title     = {Overview of the {CLEF-2026 CheckThat!} Lab Task 3 on 
Generating Full Fact-Checking Articles},
   author    = {
     Sahnan, Dhruv and Chakraborty, Tanmoy and Nakov, Preslav
   },
   crossref  = {clef2026-workingnotes}
}

CLEF 2026

This edition of the CheckThat! lab is held within CLEF 2026, part of the CLEF initiative.