Runtime Intervention for LLMs: How Mentat Steers Agent Reasoning Without Fine-Tuning

Most production LLM control sits between two extremes: prompt engineering (brittle, context-dependent) and fine-tuning (expensive, slow iteration). Mentat, a YC F24 launch, introduces a third path: runtime intervention that modifies token probabilities mid-generation without retraining weights. For financial agents that need deterministic behavior and auditable reasoning, this matters.

The core claim is simple. You send a request to their API with steering rules, and the model adjusts its reasoning path in real time. No gradient descent. No dataset curation. No waiting for training runs.

Traditional inference generates tokens by sampling from a probability distribution over the vocabulary. Runtime intervention modifies that distribution before sampling, based on rules you define.

The mechanics:

This is not prompt injection. The steering happens inside the model's computation graph, not in the input text. You're changing how the model thinks, not what it reads.

Key difference from fine-tuning:

Fine-tuning bakes behavior into weights through backpropagation. Runtime steering applies temporary adjustments per request. Weights stay frozen. Rules are ephemeral.

Every intervention adds compute. The question is how much.

Latency penalty sources:

Mentat has not published benchmarks, but similar techniques (representation engineering, activation steering) typically add 10-30% latency overhead per token. For multi-turn agent workflows with hundreds of tokens per turn, this compounds.

Scaling considerations:

For financial agents running compliance checks or risk assessments, the latency cost may be acceptable if it eliminates the need for separate fine-tuned models per use case.

When steering rules live outside model weights, you need a different versioning strategy.

What changes between requests:

Compliance implications for financial agents:

Practical architecture:

import mentat_client

steering_config = {
    "version": "2.3.1",
    "rules": [
        {
            "id": "conservative_estimates",
            "type": "bias_suppression",
            "target_layers": [12, 16, 20],
            "pattern": "optimistic_financial_projection",
            "strength": 0.7
        },
        {
            "id": "jargon_removal",
            "type": "vocabulary_constraint",
            "target_layers": [24, 28],
            "forbidden_tokens": ["synergy", "paradigm", "disruptive"],
            "strength": 0.9
        }
    ],
    "metadata": {
        "use_case": "client_facing_risk_report",
        "compliance_framework": "SEC_regulation_best_interest"
    }
}

audit_log.record(
    request_id=req_id,
    timestamp=now(),
    config=steering_config,
    input_hash=hash(prompt)
)

response = mentat_client.chat_completion(
    model="gpt-4",
    messages=[{"role": "user", "content": prompt}],
    steering=steering_config
)

audit_log.record(
    request_id=req_id,
    output=response.content,
    config_version=steering_config["version"]
)

This gives you a paper trail: input, rules, output. If a regulator asks why the model avoided certain language or emphasized conservative estimates, you can point to the exact rule and its strength parameter.

Use runtime steering when:

Stick with fine-tuning when:

Avoid both when:

Coherence collapse:

If you steer too aggressively, the model may generate incoherent text. Suppressing financial jargon might force it into awkward circumlocutions. Biasing toward conservative estimates might make it refuse to answer legitimate questions.

Rule conflict:

Multiple steering rules can interfere. If one rule says "avoid technical terms" and another says "prioritize precision," the model may oscillate or produce generic mush.

Invisible drift:

If you update steering rules without versioning, you lose the ability to reproduce past outputs. A client asks why last month's report said X, and you can't recreate the exact reasoning path.

Latency budget exhaustion:

In a multi-agent workflow with 10 turns and 200 tokens per turn, a 20% latency penalty per token adds up. Your agent loop may time out or miss SLA targets.

Use Mentat-style runtime steering when:

Avoid it when:

Runtime intervention fills the gap between brittle prompts and expensive fine-tuning. For financial agents navigating shifting compliance rules and client-specific requirements, that gap is wide enough to matter.