Runtime Intervention for LLMs: How Mentat Steers Agent Reasoning Without Fine-Tuning
Mentat, a YC F24 launch, introduces runtime intervention for LLMs that modifies token probabilities mid-generation without fine-tuning, offering a third path for controlling model behavior. The technique, which adds 10-3…