cd /news/natural-language-processing/greekbarretrieval-a-benchmark-for-gr… · home topics natural-language-processing article
[ARTICLE · art-104051] src=machinebrief.com ↗ pub= topic=natural-language-processing verified=true sentiment=· neutral

GreekBarRetrieval: A Benchmark for Greek Statutory Retrieval

GreekBarRetrieval, a new public benchmark for Greek statutory retrieval derived from GreekBarBench, comprises 283 bar-exam questions and 6,308 candidate statutory articles. Testing three BM25 variants and nine dense retrievers, the study found that vanilla dense retrieval outperforms vanilla sparse retrieval in Recall@100, but LLM-based query reformulation helps BM25 close the gap and improves dense retrieval. A ten-round ReAct-like LLM reformulation loop yields the best nDCG and MAP scores among all tested retrievers.

read1 min views1 publishedAug 20, 2026

arXiv:2608.18752v1 Announce Type: cross Abstract: Statutory retrieval is necessary for citation-grounded legal question answering, but remains underexplored for Greek. We introduce GreekBarRetrieval, a public retrieval benchmark derived from, and complementing GreekBarBench, which did not include retrieval. The new benchmark comprises 283 bar-exam questions, each accompanied by the facts of the case it refers to, and 6,308 candidate statutory articles to retrieve from. Questions and facts are stated in everyday language, but need to be mapped to the formal terminology of statutes and their abstract legal concepts. A further complication is that not all of the case facts are relevant to each question of a case. Experimenting with three BM25 variants and nine dense retrievers, we find that vanilla dense retrieval far outperforms vanilla sparse retrieval in Recall@100. However, LLM-based query reformulation helps BM25 close that gap, while also improving dense retrieval. With a ten-round ReAct-like LLM reformulation loop that we introduce, BM25 improves further in Recall@100 and obtains the best nDCG and MAP scores of all tested retrievers. Query reformulation also outperforms pseudo-relevance feedback, sparse-dense fusion, and English translation.

── more in #natural-language-processing 4 stories · sorted by recency
── more on @greekbarretrieval 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/greekbarretrieval-a-…] indexed:0 read:1min 2026-08-20 ·