ESQ-Bench

Four papers published today challenge the reliability of LLM-as-judge, showing that judge annotations can mark working code as failures, leak across rubric dimensions, and misalign with human creativi…

Researchers introduced ESQ-Bench, an Oracle-first NL2SQL benchmark with six populated schemas (465 tables, 164,682 rows) and 550 gold-validated question-query pairs, finding that GPT-4o schema-linked …