Checkworthiness, Subjectivity, Persuasion, Roles, Authorities and Adversarial Robustness
Lab programme
The poster session will occur between CheckThat’s oral sessions 2 and 3 (that is CLEF’s Poster session 3). All papers that have not been selected for a talk are entitled to get presented in poster format. In the programme we include those confirmed by the participants so far (as of Sept. 3rd).
HYBRINFOX at CheckThat! 2024 - Task 2: Enriching BERT Models with the Expert System VAGO for Subjectivity Detection [paper]
14:15
2
Nullpointer at CheckThat! 2024: Identifying Subjectivity from Multilingual Text Sequence [paper]
14:30
2
SSN-NLP at CheckThat! 2024: From Feature-based Algorithms to Transformers: A Study on Detecting Subjectivity [paper]
14:45
5
DEFAULT at CheckThat! 2024: Retrieval Augmented Classification using Differentiable Top-K Operator for Rumor Verification based on Evidence from Authorities [paper]
15:00
5
SEUPD@CLEF: Team Axolotl on Rumor Verification using Evidence from Authorities [paper]
15:15
5
AuthEv-LKolb at CheckThat! 2024: A Two-Stage Approach To Evidence-Based Social Media Claim Verification [paper]
We only have one poster session for CheckThat!, which is CLEF’s session 3.
Task
Title
1
HYBRINFOX at CheckThat! 2024 - Task 1: Enhancing Language Models with Structured Information for Check-Worthiness Estimation [paper]
1
OpenFact at CheckThat! 2024: Cross-Lingual Transfer Learning for Check-Worthiness Detection [paper]
1
SINAI at CheckThat! 2024: Transformer-based approaches for Check-Worthiness Classification [paper]
2
JK_PCIC_UNAM at CheckThat! 2024: Analysis of Subjectivity in News Sentences Using Transformers-Based Models [paper]
6
SINAI at CheckThat! 2024: Stealthy character-level adversarial attacks using homoglyphs and search, iterative [paper]
6
TurQUaz at CheckThat! 2024: Creating Adversarial Examples using Genetic Algorithm [paper]
Oral session 3: Wednesday 11th September, 16:30 to 18:00 (Chair: P. Przybyła)
Time
Task
Title
16:30
3
UniBO at CheckThat! 2024: Multi-lingual and Multi-label Persuasion Technique Detection in News with Data Augmentation and Sequence-Token Classifiers [paper]
16:45
6
OpenFact at CheckThat! 2024: Combining multiple attack methods for effective adversarial text generation [paper]
17:00
6
TextTrojaners at CheckThat! 2024: Robustness of credibility assessment with adversarial examples through beamattack [paper]
17:15
6
MMU NLP at CheckThat! 2024: Homoglyphs are Adversarial Attacks [paper]
17:30
Invited talk. Salim Hafid. Claims and Sources in Scientific Web Discourse (SciWeb)
17:45
Closing discussion
Best of labs plenary: Thursday 12th September
Time
Title
16:00
Under-sampling strategies for better transformer-based classifications models. M. Sawinski, K. Węcel, E. Księżniak [paper]
Firoj Alam, Qatar Computing Research Institute, HBKU, Qatar
Citations
All papers from the 2024 edition are now published. We include the ECIR 2024 lab introduction paper, the general lab overview CLEF 2024 LNCS paper, and the task-specific overview CEUR papers.
The bib entries are ready for them all, and they are included below and in this bib file.
ECIR 2024
Barrón-Cedeño, A. et al. (2024). The CLEF-2024 CheckThat! Lab: Check-Worthiness,
Subjectivity, Persuasion, Roles, Authorities, and Adversarial Robustness. In:
Goharian, N., et al. Advances in Information Retrieval. ECIR 2024. Lecture Notes
in Computer Science, vol 14612. Springer, Cham.
https://doi.org/10.1007/978-3-031-56069-9_62
@InProceedings{10.1007/978-3-031-56069-9_62,
author="Barr{\'o}n-Cede{\~{n}}o, Alberto
and Alam, Firoj
and Chakraborty, Tanmoy
and Elsayed, Tamer
and Nakov, Preslav
and Przyby{\l}a, Piotr
and Stru{\ss}, Julia Maria
and Haouari, Fatima
and Hasanain, Maram
and Ruggeri, Federico
and Song, Xingyi
and Suwaileh, Reem",
editor="Goharian, Nazli and Tonellotto, Nicola and He, Yulan and Lipani, Aldo and McDonald, Graham and Macdonald, Craig and Ounis, Iadh",
title="The CLEF-2024 CheckThat! Lab: Check-Worthiness, Subjectivity,
Persuasion, Roles, Authorities, and Adversarial Robustness",
booktitle="Advances in Information Retrieval",
year="2024",
publisher="Springer Nature Switzerland",
address="Cham",
pages="449--458",
isbn="978-3-031-56069-9"
}
@InProceedings{clef-checkthat:2024-lncs,
author="Barr{\'o}n-Cede{\~{n}}o, Alberto
and Alam, Firoj
and Stru{\ss}, Julia Maria
and Nakov, Preslav
and Chakraborty, Tanmoy
and Elsayed, Tamer
and Przybyła, Piotr
and Caselli, Tommaso
and Da San Martino, Giovanni
and Haouari, Fatima
and Li, Chengkai
and Piskorski, Jakub
and Ruggeri, Federico
and Song, Xingyi
and Suwaileh, Reem",
title="Overview of the {CLEF}-2024 {CheckThat! Lab}: Check-Worthiness, Subjectivity, Persuasion, Roles,
Authorities and Adversarial Robustness",
editor="Goeuriot, Lorraine
and Mulhem, Philippe
and Quénot, Georges
and Schwab, Didier
and Soulier, Laure
and Di Nunzio, Giorgio Maria
and Galuščáková, Petra
and García Seco de Herrera, Alba
and Faggioli, Guglielmo
and Ferro, Nicola",
booktitle="Experimental IR Meets Multilinguality, Multimodality, and Interaction.
Proceedings of the Fifteenth International Conference of the CLEF Association (CLEF 2024)",
year="2024"
}
CLEF 2024 CEUR papers
Here you find the task-specific papers. They all cross-ref to include information about the volume:
@proceedings{clef2024-workingnotes,
editor = "Faggioli, Guglielmo and Ferro, Nicola and Galuščáková, Petra and {García Seco de Herrera}, Alba",
title = "Working Notes of CLEF 2024 - Conference and Labs of the Evaluation Forum",
booktitle = "Working Notes of CLEF 2024 - Conference and Labs of the Evaluation Forum",
series = "CLEF~2024",
address = "Grenoble, France",
year = 2024
}
@InProceedings{clef-checkthat:2024:task1,
author = {
Hasanain, Maram
and Suwaileh, Reem
and Weering, Sanne
and Li, Chengkai
and Caselli, Tommaso
and Zaghouani, Wajdi
and Barr\'{o}n-Cede\~{n}o, Alberto
and Nakov, Preslav
and Alam, Firoj},
title = "Overview of the {CLEF}-2024 {CheckThat}! Lab Task 1 on Check-Worthiness Estimation of Multigenre Content",
crossref = "clef2024-workingnotes"
}
@InProceedings{clef-checkthat:2024:task2,
author = {Stru\ss, Julia Maria
and Ruggeri, Federico
and Barr\'on-Cede\~no, Alberto
and Alam, Firoj
and Dimitrov, Dimitar
and Galassi, Andrea
and Pachov, Georgi
and Koychev, Ivan
and Nakov, Preslav
and Siegel, Melanie
and Wiegand, Michael
and Hasanain, Maram
and Suwaileh, Reem
and Zaghouani, Wajdi},
title = {Overview of the {CLEF}-2024 {CheckThat}! Lab Task 2 on Subjectivity in News Articles},
crossref = {clef2024-workingnotes}
}
@inproceedings{clef-checkthat:2024:task3,
title={Overview of the {CLEF-2024 CheckThat!} Lab Task 3 on Persuasion Techniques},
author={
Piskorski, Jakub
and Stefanovitch, Nicolas
and Alam, Firoj
and Campos, Ricardo
and Dimitrov, Dimitar
and Jorge, Al{\'\i}pio
and Pollak, Senja
and Ribin, Nikolay
and Fijav{\v{z}}, Zoran
and Hasanain, Maram
and Guimar{\~a}es, Nuno
and Pacheco, Ana Filipa
and Sartori, Elisa
and Silvano, Purifica{\c{c}}{\~a}o
and Zwitter, Ana Vitez
and Koychev, Ivan
and Yu, Nana
and Nakov, Preslav
and Da San Martino, Giovanni},
crossref = {clef2024-workingnotes}
}
Task 4 overview paper
No paper for Task 4 is going to be produced, since it did not attract participants. If you want to learn about it, refer to the LNCS paper of the 2024 edition (which should get published in September 2024).
@InProceedings{clef-checkthat:2024:task5,
author = {
Haouari, Fatima
and Elsayed, Tamer
and Suwaileh, Reem},
title = "Overview of the {CLEF-2024} {C}heck{T}hat! {L}ab {T}ask 5 on {R}umor {V}erification using {E}vidence from {A}uthorities",
crossref = "clef2024-workingnotes"
}
@InProceedings{clef-checkthat:2024:task6,
author = {
Przyby{\l}a, Piotr
and Wu, Ben
and Shvets, Alexander
and Mu, Yida
and Sheang, Kim Cheng
and Song, Xingyi
and Saggion, Horacio},
title = "Overview of the {CLEF}-2024 {CheckThat}! Lab Task 6 on Robustness of Credibility Assessment with Adversarial Examples (InCrediblAE)",
crossref = "clef2024-workingnotes"
}
