Checklist-Prompted Feature Extraction for Interpretable and Robust Fact Check Worthiness Prediction
Warning: foreach() argument must be of type array|object, null given in /usr/share/nginx/html/wp-content/themes/iconic-one/functions.php on line 673
Yuka Teramoto
Warning: foreach() argument must be of type array|object, null given in /usr/share/nginx/html/wp-content/themes/iconic-one/functions.php on line 673
Takahiro Komamizu
Warning: foreach() argument must be of type array|object, null given in /usr/share/nginx/html/wp-content/themes/iconic-one/functions.php on line 673
Mitsunori Matsushita
Warning: foreach() argument must be of type array|object, null given in /usr/share/nginx/html/wp-content/themes/iconic-one/functions.php on line 673
Kenji Hatano
概要
This study explores the use of Large Language Models (LLMs) for Claim Check Worthiness Prediction (CCWP), a critical first step in fact-checking. Building on prior research, we propose a method that utilizes structured checklists to break down CCWP into interpretable and manageable subtasks. In our approach, an LLM answers 52 human-crafted questions for each claim, and the resulting responses are used as features for traditional supervised learning models. Experiments across six datasets show that our method consistently improves performance across key evaluation metrics, including accuracy, F1 score, surpassing few-shot prompting baselines on most datasets. Moreover, our method enhances the stability of LLM outputs, reducing sensitivity to prompt design. These findings suggest that LLM-based feature extraction guided by structured checklists offers a promising direction for more reliable and efficient claim prioritization in factchecking systems.You can access and utilize the program and code at the following GitHub repository:https://github.com/TRMT-Yuka/FactCheck/CPFE in MisD25
引用情報
Yuka Teramoto, Takahiro Komamizu, Mitsunori Matsushita, , Kenji Hatano, Checklist-Prompted Feature Extraction for Interpretable and Robust Fact Check Worthiness Prediction, The Workshop Proceedings of the 19th International AAAI Conference on Web and Social Media, 2025-06-23, DOI: 10.36190/2025.23.