Definition

With an upsurge in social media, users have been exposed to many misleading claims. However, the ubiquitous noise in these posts makes it difficult for manual fact-checkers to quickly identify specific and precise claims that need verification. Given a noisy, unstructured social media post, the task is to simplify it into a concise form. Therefore, we aim to bridge this gap by decomposing social media posts into simpler, more comprehensible forms, which are referred to as normalized claims.

‘‘Given a noisy, unstructured social media post, the task is to simplify it into a concise form.’’

The task is a generation task offered in 20 languages: English, Arabic, Bengali, Czech, German, Greek, French, Hindi, Korean, Marathi, Indonesian, Dutch, Punjabi, Polish, Portuguese, Romanian, Spanish, Tamil, Telugu, Thai.

Datasets

Training and test datasets will be released on GitLab.

Evaluation

We will employ METEOR score for final evaluation.

Submission

Scorers, Format Checkers, and Baseline Scripts

All scripts can be found on gitlab at CheckThat! Lab Task 2 repository

Submission guidelines

• Make sure that you create one account for each team, and submit it through one account only.
• We will keep the leaderboard private till the end of the submission period, hence, results will not be available upon submission. All results will be available after the evaluation period.
• You are allowed to submit max 200 submissions per day for each subtask.
• The last file submitted to the leaderboard will be considered as the final submission.
• Name of the output file have to be task2_LANGUAGE-CODE.csv with .csv extension (e.g., task2_ara.csv); otherwise, you will get an error on the leaderboard.
• You have to zip the csv, zip task2_ara.zip task2_ara.csv and submit it through the codalab page.

Submission Site

The submission is done through the Codalab platform at https://codalab.lisn.upsaclay.fr/competitions/22801

Leaderboard

TBA

Organizers

• Preslav Nakov, MBZUAI, UAE
• Tanmoy Chakraborty, Indian Institute of Technology Delhi, India
• Megha Sundriyal, Indraprastha Institute of Information Technology Delhi, India

Contact

For queries, please join the Slack channel

Alternatively, please send an email to: clef-factcheck@googlegroups.com