cd /news/artificial-intelligence/we-achieved-94-7-in-longmemeval-with… · home topics artificial-intelligence article
[ARTICLE · art-74214] src=github.com ↗ pub= topic=artificial-intelligence verified=true sentiment=↑ positive

We achieved 94.7% in Longmemeval with no hacks lol, everything open sourced

Swafra, an open-source semantic memory system for AI assistants, achieved 94.7% recall_all@10 on the LongMemEval benchmark for long-term memory. The tool works as an MCP server with Claude Desktop, Claude Code, and VS Code Copilot, using local embeddings and hybrid retrieval without requiring a database or cloud service.

read2 min views1 publishedJul 26, 2026
We achieved 94.7% in Longmemeval with no hacks lol, everything open sourced
Image: source

Semantic memory for AI — ingest anything, retrieve what matters.

94.7% recall_all@10 on LongMemEval — the standard benchmark for long-term memory in AI assistants.

Works as an MCP server with Claude Desktop, Claude Code, VS Code Copilot, and any MCP-compatible AI.

pip install swafra

Or with Node.js:

npm install -g swafra

Add to ~/Library/Application Support/Claude/claude_desktop_config.json

:

{
  "mcpServers": {
    "swafra": {
      "command": "swafra"
    }
  }
}

Restart Claude Desktop — the tools appear automatically.

claude mcp add swafra swafra

Add to .vscode/mcp.json

in your project:

{
  "servers": {
    "swafra": {
      "command": "swafra"
    }
  }
}

Once connected, Claude can use swafra to remember and retrieve anything:

"Remember this meeting transcript: ..."
"What did we decide about the API design?"
"What are my editor preferences?"
"Forget everything from the project X sessions"
Tool What it does
add_knowledge
Store text — chunked, embedded, and graph-linked
search_knowledge
Find relevant chunks by natural language query
get_context
Search + graph walk combined (recommended)
graph_walk
Explore connected chunks from a starting point
list_sources
See everything stored
delete_source
Remove a source and all its data

1. Chunking Text is split into semantically coherent chunks using Leiden community detection — a graph algorithm that groups sentences by topic. Falls back to conversation-aware chunking if Leiden deps aren't available (Python 3.13+).

2. Local embeddings Uses fastembed (ONNX, CPU-only, no API key) with BAAI/bge-small-en-v1.5

. Falls back to deterministic hash vectors if fastembed isn't installed.

3. Hybrid retrieval 4-signal fused scoring: BM25 + vector cosine + entity/date overlap + character n-gram. Returns the best chunk per source so you get diverse, non-redundant context.

4. Knowledge graph Chunks are connected with sequential (next/prev), similarity, and entity co-occurrence edges. Graph walk expands retrieval beyond what search alone finds.

5. Storage JSON files in ~/.scimap/

. No database, no server, no cloud.

94.7% recall_all@10 on LongMemEval-S — 500 questions across 6 categories, 53 sessions each.

Category recall_all@10
knowledge-update 100.0%
single-session-user 100.0%
single-session-preference 100.0%
single-session-assistant 100.0%
temporal-reasoning 99.2%
multi-session 93.3%

Full benchmark details and reproduction steps →

Variable Default Description
SCIMAP_DATA_DIR
~/.scimap
Where knowledge is stored
SCIMAP_EMBED_MODEL
BAAI/bge-small-en-v1.5
Embedding model
── more in #artificial-intelligence 4 stories · sorted by recency
── more on @swafra 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/we-achieved-94-7-in-…] indexed:0 read:2min 2026-07-26 ·