Beyond "What to Retrieve": Uncertainty in Retrieval-Augmented Code Generation

A new uncertainty-aware framework, OpenCoder, improves GPT selected-output correctness in repository-level code generation from 56.25% to 78.13% on the RepoExec-inline benchmark, according to a preprint on arXiv (2607.24884v1). The framework, developed by researchers, estimates source-specific uncertainty to filter and rank heterogeneous evidence such as similar-code examples, repository context, and project-specific APIs, though benefits are backend-dependent and not statistically supported for Gemini.

arXiv:2607.24884v1 Announce Type: cross Abstract: Repository-level code generation relies on heterogeneous evidence whose relevance, compatibility, and completeness are inherently uncertain. Similar-code examples, repository context, and project-specific APIs may provide complementary information, but can also introduce noisy, redundant, or conflicting signals. Existing retrieval-augmented approaches primarily optimize retrieval relevance without explicitly modeling how uncertainty in retrieved evidence affects downstream generation. We introduce OpenCoder, an uncertainty-aware framework that estimates source-specific uncertainty, uses it to filter and rank heterogeneous evidence, and guides generation, verification, and repair. A factorial analysis over API knowledge, repository context, and similar-code evidence reveals no universal additive source ranking; instead, significant cross-source interactions depend on the accompanying evidence and LLM backend. On an expanded 32-task RepoExec-inline evaluation, OpenCoder improves GPT selected-output correctness over Baseline RAG from 56.25\% to 78.13\%. However, it matches a verification-and-repair control, and the corresponding Gemini improvement is not statistically supported, indicating backend-dependent benefits. Target-aware API refinement also substantially improves API-set retrieval. These findings support treating uncertainty as an actionable control signal for repository-level retrieval, verification, and repair.