{"slug": "contrastive-language-model-clm-an-ultra-fast-system-one-model", "title": "Contrastive Language Model (CLM): An Ultra-Fast System One Model", "summary": "Jacky Kwok announced Contrastive Language Model (CLM), an 8-billion-parameter \"System One\" model trained with a contrastive learning objective linking states and actions, which delivers up to 9× faster inference than Jev while matching Jev's performance on computer-use, gaming, and tool-calling tasks. With lightweight fine-tuning, CLM-8B set new state-of-the-art scores of 81.6% on DeepSWE and 87.6% on Terminal-Bench 2.1, benchmarks on which Jev fails to serve as an effective verifier for long-horizon tasks. The team also disaggregated states and actions so their embeddings can be cached and reused independently, and established scaling laws showing test contrastive loss falls as a power law in training compute, model size, and dataset size.", "body_md": "Jacky Kwok on X: \"Introducing Contrastive Language Model (CLM): an ultra-fast System One Model trained with a contrastive learning objective that connects states and actions.\nCLM-8B is pre-trained on internet-scale data and delivers up to 9× faster inference than Jev ⚡ while achieving comparable p… / X\n\nJacky Kwok on X: \"Introducing Contrastive Language Model (CLM): an ultra-fast System One Model trained with a contrastive learning objective that connects states and actions.\nCLM-8B is pre-trained on internet-scale data and delivers up to 9× faster inference than Jev ⚡ while achieving comparable performance across computer-use, gaming, and tool-calling tasks.\nWith lightweight fine-tuning, CLM-8B sets a new SOTA on challenging agentic coding benchmarks, such as DeepSWE (81.6%) and Terminal-Bench 2.1 (87.6%). In contrast, Jev fails to serve as an effective verifier for these long-horizon tasks.\nWe also build an efficient training and serving infra for CLMs by disaggregating states and actions, allowing their embeddings to be cached and reused independently. This substantially reduces inference latency in settings where the state evolves continuously while the action set remains fixed.\nFinally, we establish scaling laws for CLMs and show that the test contrastive loss decreases predictably as a power law in training compute, model size, and dataset size.\n📄 Blog: https://t.co/zwi9JOHKGx\n💻 Code: https://t.co/rsHRYCGR8I\n🗣️ Discord: https://t.co/Uqtdefvo3J\n🤗 Data & Models: https://t.co/wdSWGGO3hu\nMore details on CLM’s architecture, data recipe, and scaling laws in the thread below 🧵\"\n\nIntroducing Contrastive Language Model (CLM): an ultra-fast System One Model trained with a contrastive learning objective that connects states and actions.\nCLM-8B is pre-trained on internet-scale data and delivers up to 9× faster inference than Jev ⚡ while achieving comparable performance across computer-use, gaming, and tool-calling tasks.\nWith lightweight fine-tuning, CLM-8B sets a new SOTA on challenging agentic coding benchmarks, such as DeepSWE (81.6%) and Terminal-Bench 2.1 (87.6%). In contrast, Jev fails to serve as an effective verifier for these long-horizon tasks.\nWe also build an efficient training and serving infra for CLMs by disaggregating states and actions, allowing their embeddings to be cached and reused independently. This substantially reduces inference latency in settings where the state evolves continuously while the action set remains fixed.\nFinally, we establish scaling laws for CLMs and show that the test contrastive loss decreases predictably as a power law in training compute, model size, and dataset size.\n📄 Blog: contrastive-lm.notion.site\n💻 Code: github.com/Contrastive-LM…\n🗣️ Discord: discord.gg/5dAQEDJBs\n🤗 Data & Models: huggingface.co/Contrastive-LM\nMore details on CLM’s architecture, data recipe, and scaling laws in the thread below 🧵\n\nIntroducing Contrastive Language Model (CLM): an ultra-fast System One Model trained with a contrastive learning objective that connects states and actions.\nCLM-8B is pre-trained on internet-scale data and delivers up to 9× faster inference than Jev ⚡ while achieving comparable performance across computer-use, gaming, and tool-calling tasks.\nWith lightweight fine-tuning, CLM-8B sets a new SOTA on challenging agentic coding benchmarks, such as DeepSWE (81.6%) and Terminal-Bench 2.1 (87.6%). In contrast, Jev fails to serve as an effective verifier for these long-horizon tasks.\nWe also build an efficient training and serving infra for CLMs by disaggregating states and actions, allowing their embeddings to be cached and reused independently. This substantially reduces inference latency in settings where the state evolves continuously while the action set remains fixed.\nFinally, we establish scaling laws for CLMs and show that the test contrastive loss decreases predictably as a power law in training compute, model size, and dataset size.\n📄 Blog: contrastive-lm.notion.site\n💻 Code: github.com/Contrastive-LM…\n🗣️ Discord: discord.gg/5dAQEDJBs\n🤗 Data & Models: huggingface.co/Contrastive-LM\nMore details on CLM’s architecture, data recipe, and scaling laws in the thread below 🧵\n\n🧵(1) Model Architecture\nCLM first trains a state encoder and an action encoder on a large-scale dataset with a contrastive objective, so that each state is pulled toward the ground-truth action and pushed away from all others. The two encoders then serve directly as a zero-shotShow more\n\n🧵(2) Data Recipe\nWe release CLM-8B, which is pre-trained on 60M Nemotron Q&A pairs, mid-trained on 30M synthetic hard negatives, and post-trained on 1M agentic trajectories.\n\n🧵(3) Scaling Laws for Verification\nWe find that the test InfoNCE loss scales as a power law with training compute, dataset size, projection-head size, and encoder size. These dimensions must be scaled jointly to achieve optimal performance. Notably, scaling the encoder sizeShow more\n\n🧵(4) Latency vs. Jev and Constrained Decoding\nThe key difference between CLM and Jev is that Jev only supports state caching, whereas CLM’s dual-encoder architecture allows state and action embeddings to be cached independently.\nThis is particularly useful in applications suchShow more\n\n🧵(5) Zero-Shot Evaluation\nAcross computer-use, gaming, and tool-calling tasks, CLM-8B performs on par with Jev while running up to 9× faster. The speedups are most pronounced when the number of candidates is large (e.g., WikiRacing) or when actions can be reused frequentlyShow more\n\n🧵(6) Agentic Benchmarks\nWe find that Jev fails to serve as a verifier for long-horizon tasks, performing below the random-selection (Pass@1) baseline.\nIn contrast, with lightweight fine-tuning, CLM achieves SOTA performance on challenging agentic benchmarks, including DeepSWEShow more\n\nCLM-8B is part of our scaling ladder, where we train models across multiple scales to establish scaling laws and predict performance at larger scales. A multimodal CLM-35B is now in training with more data, compute, and parameters. Stay tuned for the release early next month 🚀\n\nthe disaggregation is the part builders should steal: a loop scores the same state against many candidate actions, so the state embedding caches perfectly and each candidate collapses to a cheap dot product. that's the economics that makes per-turn decisions affordable.", "url": "https://wpnews.pro/news/contrastive-language-model-clm-an-ultra-fast-system-one-model", "canonical_source": "https://twitter.com/jackyk02/status/2102905335925424285", "published_at": "2026-09-24 06:54:44+00:00", "updated_at": "2026-09-24 07:01:30.555321+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-agents", "ai-research", "machine-learning"], "entities": ["Jacky Kwok", "Contrastive Language Model (CLM)", "CLM-8B", "Jev", "DeepSWE", "Terminal-Bench 2.1"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/contrastive-language-model-clm-an-ultra-fast-system-one-model", "markdown": "https://wpnews.pro/news/contrastive-language-model-clm-an-ultra-fast-system-one-model.md", "text": "https://wpnews.pro/news/contrastive-language-model-clm-an-ultra-fast-system-one-model.txt", "jsonld": "https://wpnews.pro/news/contrastive-language-model-clm-an-ultra-fast-system-one-model.jsonld"}}