A field guide to LLM-as-a-judge reveals that five novel proposals for improving the technique were all refuted by prior art published within the last twelve weeks, according to a research synthesis co…
G-Eval, a prompting framework from Microsoft researchers that uses a large language model as a reference-free evaluator of generated text, scores open-ended outputs in a way that aligns with human jud…
Researchers propose BINEVAL, a framework that decomposes LLM evaluation into atomic binary questions for interpretable, multi-dimensional scoring. The method matches or outperforms strong baselines on…
A developer evaluated six LLM-as-judge tools—DeepEval, Confident AI, Evidently, Braintrust, Promptfoo, and Future AGI—and found that none of them prioritize validating judge outputs against human labe…