CheckThat! Lab at CLEF 2023

Home

Editions

Tasks

Contents

Task 5: Authority Finding in Twitter

Definition

In this task, the systems are challenged to retrieve a set of authority Twitter accounts for a given rumor propagating in Twitter.

Given a tweet stating a rumor, a model has to retrieve a ranked list of authority Twitter accounts that can help verify the rumor; i.e. they may tweet evidence that supports or denies the rumor.

This task is offered in Arabic.

Datasets

The training set comprises 150 rumors expressed in tweets associated with 1044 authorities’ Twitter accounts, a user collection of 395,231 Twitter accounts, and about 1.2M unique Twitter lists.

The data will be released soon.

Evaluation

The official evaluation measure is P@5 to evaluate how systems are able to retrieve authorities at the top of a short retrieved list.

Other measures, such as P@1 and nDCG@5, will also be used.

Submission

Will be available soon.

Format checker

Scorer

Baseline script

Submission site

Leaderboard

Will be available soon.

Organizers

  • Tamer Elsayed, Qatar University, Qatar
  • Fatima Haouari, Qatar University, Qatar