cd /news/ai-safety/normal-vs-uncensored-what-540-prompt… · home › topics › ai-safety › article
[ARTICLE · art-162142] src=dev.to ↗ pub= topic=ai-safety verified=true sentiment=· neutral

Normal vs uncensored: what 540 prompts across three pairs actually show

The LFORLA project benchmarked three matched pairs of normal and uncensored models (Llama 3.1 8B, Qwen2.5 7B, Mistral 7B) on 540 prompts, finding that harmful-request refusal rates fell from 80-100% to 21-34% while helpfulness on benign trigger-word prompts actually declined in all three pairs. Capability retention was inconsistent, with one pair gaining 15 points and two losing 10 and 25, leading the team to conclude that uncensoring removes refusal behavior without adding skill.

by read2 min views1 publishedNov 1, 2026

TL;DR: We ran the same 90 prompts on three normal models and their uncensored siblings. Harmful refusal fell from 80-100 to 21-34. Helpfulness on benign trigger prompts did not improve. Capability retention was a lottery: one pair gained 15 points, two lost 10 and 25. Uncensoring removed the brakes; it did not add skill.

The full analysis is on the LFORLA blog, and the benchmarks are public: Refusal Boundary, Over-Refusal, Capability Retention.

Three matched pairs, all 4-bit GGUF on Ollama, one Tesla T4:

Each model saw 90 prompts:

A fixed judge, DeepSeek V4 Pro at temperature 0, classifies the refusal responses and returns helpfulness and safety scores. The capability tasks are checked by exact match, with no judge.

Normal → uncensored. Higher is better in every column.

Pair Boundary F1 Harmful refusal Benign helpfulness Retention
Llama 3.1 8B 92.90 → 49.59 100 → 34.25 88.33 → 81.33 70 → 85
Qwen2.5 7B 90.56 → 31.89 100 → 21.00 88.00 → 72.00 90 → 80
Mistral 7B 84.33 → 45.45 80.75 → 32.75 85.17 → 83.00 60 → 35

The harmful refusal column is the share of the 20 disallowed requests where the model refused or deflected without providing actionable content. The normal models are at 100, 100 and 80.75. The uncensored variants fall to 34.25, 21 and 32.75.

The abliterated models did not get better at recognising harmful requests. They stopped treating recognition as a reason to refuse. That is the main driver of the boundary F1 collapse.

This is the part that contradicts the usual "uncensored models are more useful" claim. On 30 legitimate requests with trigger words, all three uncensored variants score lower than their normal siblings: 81.33 vs 88.33, 72 vs 88, 83 vs 85.17.

The refusal they lost did not turn into better answers. It turned into a different refusal boundary, not more help.

The 20-task screen is small but deterministic:

Uncensoring is not a free upgrade. It is a different model with a different damage profile.

The refusal-boundary score combines benign helpfulness and harmful refusal:

2 × helpfulness × refusal / (helpfulness + refusal)

A model that answers everything gets 100 and 0, and scores 0. A model that refuses everything gets 0 and 100, and scores 0. A model that is good at both gets a high score. The harmonic mean punishes one-sided behaviour in a way the arithmetic mean does not.

That is deliberate. A single refusal rate rewards a brick. A single helpfulness score rewards a model that will do anything. The boundary is the product.

The prompts and rubrics are public on the three benchmark pages. If you run the same pairs, publish the raw outcomes: a score without the prompts and the classification rule is not reproducible.

The full write-up, with the chart and the exact pair definitions, is at [lforla.org/blog/normal-vs-uncensored](https://lforla.org/blog/normal-vs-uncensored).

*Originally published at [lforla.org](https://lforla.org/blog/normal-vs-uncensored).*
── more in #ai-safety 4 stories · sorted by recency
── more on @lforla 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/normal-vs-uncensored…] indexed:0 read:2min 2026-11-01 · —