Task 4: Factuality of Reporting of News Media
Definition
In this task we ask to identify the factuality of reporting at the media level.
Given the URL to a news outlet (e.g., www.cnn.com), the task asks to predict the
factuality of reporting of that news outlet: low, mixed, and high.
We offer the task in English
Datasets
Currently under preparation.
Evaluation
This is an ordinal classification task, and we will use mean absolute error as
the official measure.
Submission
Scorer
Baseline script
Submission site
Leaderboard
Will be available soon.
Organizers
- Preslav Nakov, Mohamed bin Zayed University of Artificial Intelligence
- Firoj Alam, Qatar Computing
Research Institute, HBKU
- Giovanni Da San Martino, University of Padova
- Dilshod Azizov, Mohamed bin Zayed University of Artificial Intelligence
- Rabindra Nath Nandi, BJIT Limited
Please join on Slack channel for any queries:
https://join.slack.com/t/newworkspace-qgd1635/shared_invite/zt-1k9lnm0ys-aMeEmUtGY0tfW5HbkXHPJg
Slack Channel (task4-factuality):
https://ct-23-participants.slack.com
Or send an email to: clef-factcheck@googlegroups.com