cd /news/machine-learning/splatrag-3-visualizer-scifact-0-8804… Β· home β€Ί topics β€Ί machine-learning β€Ί article
[ARTICLE Β· art-105505] src=discuss.huggingface.co β†— pub= topic=machine-learning verified=true sentiment=Β· neutral

SplatRAG 3+ Visualizer: SciFact 0.8804 / 0.7624 with 5,000 slang rows in the same memory

SplatRAG 3, a retrieval system using local Gaussian-splat memory, achieved a SciFact (BEIR test, 300 claims, k=10) recall@10 of 0.8804 and nDCG@10 of 0.7624 on a store that also contains 5,000 Urban Dictionary rows, surpassing its own floors of 0.88 and 0.75. The improvement over the previous public SplatRagBench hybrid (0.7822 nDCG@10 on the first 50 claims) comes from adding a third reciprocal rank fusion arm using the query's full 4096-d Qwen3-Embedding-8B cosine, while the 64-d HNSW and BM25 remain in the hybrid. The eval filters domain=scifact so slang cannot rank as a false positive, but the science documents still share the same memory field as the junk.

read1 min views2 publishedAug 21, 2026

splatRAG 3 teaser β€” SciFact, poisoned store

Local Gaussian-splat memory. Append-only cold log. BM25 + 64-d HNSW. The 3-d field is PCA of those 64-d vectors β€” the picture, not the index.

SciFact (BEIR test, 300 claims, k=10) on a store that also holds 5,000 Urban Dictionary rows, dreamed together:

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”

β”‚ β”‚ R@10 β”‚ nDCG@10 β”‚

β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€

β”‚ Floors we set β”‚ 0.88 β”‚ 0.75 β”‚

β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€

β”‚ This run β”‚ 0.8804 β”‚ 0.7624 β”‚

β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Handshake: splatrag handshake --k 10 --no-ingest. Eval filters domain=scifact so slang cannot rank as a false positive. The science documents still sat in the same field as the junk.

The old public SplatRagBench hybrid 0.7822 nDCG@10 is the first 50 claims (Nomic). Honest full-300 on that binary was 0.6664.

What moved v3 over the floors: RRF (BM25Γ—1.3, k=10) on the top 30, then a third RRF arm from the query’s full 4096-d Qwen3-Embedding-8B cosine. 64-d was already in hybrid; the leftover 4032 dimensions were sitting unused. Pure cosine rerank of that pool died (0.7174). SciFact is still lexical first.

Basins pack in 64-d (k-NN, cosine 0.80). 3-d union-find had mashed 4,035 papers into one unlabeled well. Below is example of AI’s memory. On below you see one big color cause basins still need to settle.

── more in #machine-learning 4 stories Β· sorted by recency
── more on @splatrag 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain β€” perfect for shipping the agent you just read about.

$git push zahid main
β†’ Live at https://your-agent.zahid.host βœ“
Get free account β†’ Pricing
from €0/mo Β· no card required
LIVE [news/splatrag-3-visualize…] indexed:0 read:1min 2026-08-21 Β· β€”