Task 5: Authority Finding in Twitter
Definition
In this task, the systems are challenged to retrieve a set of authority Twitter
accounts for a given rumor propagating in Twitter.
Given a tweet stating a rumor, a model has to retrieve a ranked list of
authority Twitter accounts that can help verify the rumor; i.e. they may tweet
evidence that supports or denies the rumor.
This task is offered in Arabic.
Datasets
The training set comprises 150 rumors expressed in tweets associated with 1044
authorities’ Twitter accounts, a user collection of 395,231
Twitter accounts, and about 1.2M unique Twitter lists.
The data will be released soon.
Evaluation
The official evaluation measure is P@5 to evaluate how systems are able to
retrieve authorities at the top of a short retrieved list.
Other measures, such as P@1 and nDCG@5, will also be used.
Submission
Will be available soon.
Scorer
Baseline script
Submission site
Leaderboard
Will be available soon.
Organizers
- Tamer Elsayed, Qatar University, Qatar
- Fatima Haouari, Qatar University, Qatar