CLEF CheckThat! 2024 Task 1 — English Check-Worthiness
A CLEF CheckThat! 2024 shared task (english) dataset of 22,501 sentences with binary check-worthiness labels (24.1% check-worthy), collected by CLEF CheckThat! Lab organizers (2024). Each record contains sentence text, binary check-worthiness label (Yes/No), sentence ID, source document. CLEF 2024 CheckThat! Task 1 (english) provides 22,501 sentences from political debates and social media annotated for check-worthiness — whether the claim merits fact-checking. Suitable for check-worthiness detection, fact-checking automation, misinformation research, NLP classification benchmarks, political discourse analysis.
Cite this dataset at
checkthat-2024-task1-english.echo.directory
Analytics
Topic 0
Topic 1
Topic 2
Topic 3
Topic 4
Topic 5
Topic 6
Topic 7
Topic 8
Topic 9
Topic 10
Topic 11
Show all 19 topics
Topic 12
Topic 13
Topic 14
Topic 15
Topic 16
Topic 17
Topic 18
Computed over the full corpus.
Record
- Catalog key
checkthat-2024-task1-english- Authors
- Nakov, Preslav; Barrón-Cedeño, Alberto; Da San Martino, Giovanni; CheckThat! Lab Organizers
- Year
- 2024
- Source paper
- CLEF 2024 CheckThat! Lab: Check-Worthiness Detection
- DOI / arXiv
- 10.1007/978-3-031-56069-9_62
- License
- Creative Commons Attribution-NonCommercial-ShareAlike 4.0 (CC BY-NC-SA 4.0) (CC-BY-NC-SA-4.0)
- Records
- 22,501
- Languages
- en
- Collected
- 2024 (2020s)
- Tasks
- Check-worthiness detection (binary;
is_checkworthy) inferred
Provenance
- Originally published at
- https://gitlab.com/checkthat_lab/clef2024-checkthat-lab link checked
- Hosted copy
- Mirrored on echo.directory on 2026-10-02, 940.1 KB across 1 files. Checksums in MANIFEST.json.
Citations
The CLEF-2024 CheckThat! Lab: Check-Worthiness, Subjectivity, Persuasion, Roles, Authorities, and Adversarial Robustness
Alberto Barrón-Cedeño, Firoj Alam, Tanmoy Chakraborty, Tamer Elsayed, Preslav Nakov
Journal Article · European Conference on Information Retrieval · 2024
Cited by
- SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval
Qiwei Peng, Róbert Móro et al. · SemEval@ACL · 2025 · cited 29× - Overview of the CLEF-2025 CheckThat! Lab Task 4 on Scientific Web Discourse
Salim Hafid, Yavuz Selim Kartal et al. · Conference and Labs of the Evaluation Forum · 2025 · cited 18× - Overview of the CLEF-2024 CheckThat! Lab Task 1 on Check-Worthiness Estimation of Multigenre Content
Maram Hasanain, Reem Suwaileh et al. · Conference and Labs of the Evaluation Forum · 2024 · cited 17× - Attacking Misinformation Detection Using Adversarial Examples Generated by Language Models
P. Przybyla, Euan McGill et al. · Conference on Empirical Methods in Natural Language Processing · 2024 · cited 14× - Overview of the CLEF-2025 CheckThat! Lab Task 2 on Claim Normalization
Megha Sundriyal, Tanmoy Chakraborty et al. · Conference and Labs of the Evaluation Forum · 2025 · cited 11×
Show all 10
- Overview of the CLEF-2024 CheckThat! Lab Task 6 on Robustness of Credibility Assessment with Adversarial Examples (InCrediblAE)
Piotr Przybyla, Ben Wu et al. · Conference and Labs of the Evaluation Forum · 2024 · cited 11× - LlamaLens: Specialized Multilingual LLM for Analyzing News and Social Media Content
Mohamed Bayan Kmainasi, Ali Ezzat Shahroor et al. · North American Chapter of the Association for Computational Linguistics · 2024 · cited 10× - Exploring Multidimensional Checkworthiness: Designing AI-assisted Claim Prioritization for Human Fact-checkers
Houjiang Liu, Jacek Gwizdka et al. · Proc. ACM Hum. Comput. Interact. · 2024 · cited 8× - HYBRINFOX at CheckThat! 2024 - Task 2: Enriching BERT Models with the Expert System VAGO for Subjectivity Detection
Morgane Casanova, Julien Chanson et al. · Conference and Labs of the Evaluation Forum · 2024 · cited 7× - Overview of the CLEF-2024 CheckThat! Lab Task 5 on Rumor Verification using Evidence from Authorities
F. Haouari, Tamer Elsayed et al. · Conference and Labs of the Evaluation Forum · 2024 · cited 7×
Citation data from Semantic Scholar, retrieved 2026-10-19.
How to cite
BibTeX
@misc{echo2026,
title = {ECHO: Exploratory Compendium of Humanity Online},
author = {Switzer, Braden and Zafarani, Reza},
year = {2026},
url = {https://echo.directory},
note = {Syracuse University}
}
@inproceedings{checkthat2024,
title = {CLEF 2024 {CheckThat!} Lab: Check-Worthiness Detection},
author = {Nakov, Preslav and Barr\'on-Cede\~no, Alberto and Da San Martino, Giovanni and others},
booktitle = {CLEF 2024 Working Notes},
year = {2024}
} APA
Switzer, B., & Zafarani, R. (2026). ECHO: Exploratory Compendium of Humanity Online [Data repository]. Syracuse University. https://echo.directory
Nakov, P., Barrón-Cedeño, A., Da San Martino, G., & CheckThat! Lab Organizers (2024). CLEF CheckThat! 2024 Task 1 — English Check-Worthiness [Data set]. https://doi.org/10.1007/978-3-031-56069-9_62
MLA
Switzer, Braden, and Reza Zafarani. ECHO: Exploratory Compendium of Humanity Online. Syracuse University, 2026, echo.directory.
Nakov, Preslav, et al. CLEF CheckThat! 2024 Task 1 — English Check-Worthiness. 2024, doi.org/10.1007/978-3-031-56069-9_62.