arXiv:2608.06417v1 Announce Type: new Abstract: The proliferation of misinformation online has driven demand for scalable detection systems. While most existing approaches rely on surface-level linguistic features or external knowledge retrieval, we examine truthfulness as a geometric property of a language model's representation space. We introduce a misinformation detection framework grounded in activation engineering, which leverages the latent geometry of transformer models. Our approach elicits a misinformation direction in the residual stream by contrasting activations from paired truthful and false statements, following the difference-in-means principle of Contrastive Activation Addition (CAA). At inference time, the last-token activation of an unseen claim is projected onto this direction, and the projected representation is fed to an Multilayer Perceptron (MLP) for classification. The procedure requires no fine-tuning of the backbone model, no external evidence retrieval, and no task-specific supervision beyond the contrastive pairs used to estimate the direction. We evaluate the method across 11 models from the Gemma, Llama, and Qwen families, ranging from 270M to 12B parameters, on three fact-checking benchmarks: AVeriTeC, LIAR, and FACTors. The falsehood direction is recoverable across model scales and architectural families, and last-token projection matches or surpasses zero-shot and few-shot prompting baselines on LIAR and FACTors, with the largest gains observed for smaller models. Performance on AVeriTeC is more limited, which we attribute to its evidence-grounded labeling scheme. These findings provide evidence that truthfulness is a structured, linearly separable concept in the latent space of pretrained language models, and point toward interpretability-driven misinformation detection as a practical complement to retrieval-based pipelines. The code is available on https://github.com/Malta-Lab/LaFaCt.
Latent Fact-Checking: Detecting Misinformation through Activation Engineering
Researchers from Malta Lab introduced LaFaCt, a misinformation detection framework that uses activation engineering to identify false claims by projecting last-token activations onto a 'misinformation direction' in a language model's residual stream, requiring no fine-tuning or external evidence retrieval. In evaluations across 11 models from the Gemma, Llama, and Qwen families (270M to 12B parameters) on the AVeriTeC, LIAR, and FACTors benchmarks, the method matched or surpassed zero-shot and few-shot prompting baselines on LIAR and FACTors, with the largest gains for smaller models, though performance on AVeriTeC was more limited. The findings suggest truthfulness is a linearly separable concept in latent space, offering an interpretability-driven complement to retrieval-based detection.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.