Definition

In this task we ask to identify the factuality of reporting at the media level.
Given the URL to a news outlet (e.g., www.cnn.com), the task asks to predict the factuality of reporting of that news outlet: low, mixed, and high. We offer the task in English

Datasets

Currently under preparation.

Evaluation

This is an ordinal classification task, and we will use mean absolute error as the official measure.

Submission

Format checker

Scorer

Baseline script

Submission site

Leaderboard

Will be available soon.

Organizers

• Preslav Nakov, Mohamed bin Zayed University of Artificial Intelligence
• Firoj Alam, Qatar Computing Research Institute, HBKU
• Giovanni Da San Martino, University of Padova
• Dilshod Azizov, Mohamed bin Zayed University of Artificial Intelligence
• Rabindra Nath Nandi, BJIT Limited

Contact

Please join on Slack channel for any queries: https://join.slack.com/t/newworkspace-qgd1635/shared_invite/zt-1k9lnm0ys-aMeEmUtGY0tfW5HbkXHPJg

Slack Channel (task4-factuality): https://ct-23-participants.slack.com

Or send an email to: clef-factcheck@googlegroups.com