cd /news/artificial-intelligence/carousel-gpu-accelerated-private-vec… · home › topics › artificial-intelligence › article
[ARTICLE · art-147830] src=eprint.iacr.org ↗ pub= topic=artificial-intelligence verified=true sentiment=↑ positive

CAROUSEL: GPU-Accelerated Private Vector Search via Homomorphic Sketching

Carousel, a new homomorphic-encryption vector search system, scores an entire corpus under encryption and compresses results for client-side ranking, achieving recall@100 of 0.9715 across 1 billion BIGANN SIFT1B vectors on multiple GPUs. At 100 million SIFT vectors, Carousel reaches recall@100 of 0.9845 with a query latency of 3.735 seconds on a single GPU, with no recall loss from discarding candidates and immediate effect for insertions and deletions at the cost of a single vector write.

by read1 min views27 publishedOct 1, 2026

Vector search on untrusted infrastructure exposes the \emph{query embedding}, a faithful summary of the user's intent. Fully homomorphic encryption can hide the query, but existing approaches still require a full scan followed by ranking of encrypted scores. Scalable private systems avoid encrypted ranking by either sending scores from a single cluster to the client or moving the search to the client, which must first stream the entire vector index for preprocessing. We present Carousel, which instead scores the full corpus under encryption and compresses the results for client-side ranking. The server scores every vector under encryption, raises the scores to a power that preserves their order by magnitude while suppressing all but a handful, and compresses the resulting sparse vector into a logarithmic number of ciphertexts using homomorphic additions alone. Because every vector is scored, Carousel incurs no recall loss from discarding candidates. Since clients hold no database-dependent state, insertions and deletions take effect immediately at the cost of a single vector write. Carousel searches $1$ billion vectors of BIGANN SIFT1B across multiple GPUs and achieves recall@100 of $0.9715$. At $100$ million SIFT vectors, it achieves recall@100 of $0.9845$ with a query latency of $3.735$ seconds on a single GPU.

── more in #artificial-intelligence 4 stories · sorted by recency
── more on @carousel 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/carousel-gpu-acceler…] indexed:0 read:1min 2026-10-01 · —