cd /news/ai-safety/how-would-you-evaluate-a-personal-ai… · home › topics › ai-safety › article
[ARTICLE · art-151815] src=discuss.huggingface.co ↗ pub= topic=ai-safety verified=true sentiment=· neutral

How would you evaluate a personal AI for invented memories and revoked consent?

A practitioner proposal argues that personal AI memory systems should be scored on retrieval and final-answer stages separately, since an invented memory can originate in either, and should be evaluated on abstention alongside accuracy so a system that refuses everything does not appear perfect. The proposal cites LongMemEval (arXiv 2410.10813), which tests information extraction, multi-session reasoning, temporal reasoning, knowledge updates and abstention and splits memory into indexing, retrieval and reading, and TOFU (arXiv 2401.06121), which uses 200 diverse synthetic author profiles with a forget set, as the nearest setup for testing revoked consent by treating a revoked fact as forget-set data and checking it never returns in answers or the store.

read1 min views3 publishedOct 17, 2026

Two baselines that cover parts of this:

LongMemEval ( [2410.10813] LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memory ) tests “information extraction, multi-session reasoning, temporal reasoning, knowledge updates, and abstention”, and splits memory into “indexing, retrieval, and reading”. That split answers whether to score retrieval and the final answer separately: I think you should, since an invented memory can come from either stage.

For revoked consent, TOFU ( [2401.06121] TOFU: A Task of Fictitious Unlearning for LLMs ) is the nearest setup: “200 diverse synthetic author profiles” with a “forget set that serves as the target for unlearning”. You can treat a revoked fact as forget-set data and check that it never comes back in answers; not only that, but it is gone from the store. One suggestion from my side: score abstention on questions the system should not know, together with accuracy on ones it should. Otherwise, a system that refuses everything looks perfect on invented memories.

── more in #ai-safety 4 stories · sorted by recency
── more on @longmemeval 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/how-would-you-evalua…] indexed:0 read:1min 2026-10-17 · —