arXiv:2610.29223v1 Announce Type: new Abstract: Retrieval-augmented generation can expose unwanted concepts through retrieved evidence even when the generator is moderated. We study query-side concept suppression with a fixed encoder and document index. Compositional Concept Unlearning (C$^2$U) routes a profile-derived direction through an augmented atom bank, adding only a bounded edited-minus-original delta to the raw query. Across five datasets, four encoders, and three seeds, the validation-selected configuration reduces pooled binary target Hit@5 by 4.25 percentage points with non-positive control degradation and target-exposure changes. Under the evaluated query transforms, it suppresses target density without increasing budgeted control-query exposure. Separately, ArXiv four-concept composition improves over an averaged-direction comparator after independent validation gates and first-use test evaluation.
C$^2$U in RAG: Compositional Concept Unlearning in Retrieval-Augmented Generation
A new arXiv paper (2610.29223v1) introduces Compositional Concept Unlearning (C²U), a query-side method that suppresses unwanted concepts in retrieval-augmented generation while keeping the encoder and document index fixed. Across five datasets, four encoders, and three seeds, the validation-selected C²U configuration reduced pooled binary target Hit@5 by 4.25 percentage points with non-positive control degradation, and on ArXiv four-concept composition it outperformed an averaged-direction comparator after independent validation gates and first-use test evaluation. The method adds only a bounded edited-minus-original delta to the raw query, routing a profile-derived direction through an augmented atom bank, and the authors report it suppresses target density without increasing budgeted control-query exposure.
Run your AI side-project on zahid.host
EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.