Publications

Automated claim matching with large language models: empowering fact-checkers in the fight against misinformation

Abstract

In today's digital era, the rapid spread of misinformation poses threats to public well-being and societal trust. As online misinformation proliferates, manual verification by fact checkers becomes increasingly challenging. We introduce FACT-GPT (Fact-checking Augmentation with Claim matching Task-oriented Generative Pre-trained Transformer), a framework designed to automate the claim matching phase of fact-checking using Large Language Models (LLMs). This framework identifies new social media content that either supports or contradicts claims previously debunked by fact-checkers. Our approach employs LLMs to generate a labeled dataset consisting of simulated social media posts. This data set serves as a training ground for fine-tuning more specialized LLMs. We evaluated FACT-GPT on an extensive dataset of social media content related to public health. The results indicate that our fine-tuned LLMs …

Date
May 13, 2024
Authors
Eun Cheol Choi, Emilio Ferrara
Conference
WWW '24: Companion Proceedings of the ACM Web Conference 2024
Pages
1441-1449