Zheng

LLM-as-a-Judge is a technique that uses a large language model to evaluate the output of another model, offering a scalable and explainable proxy for human preference. The approach was formalized in a…

A PhD student released CMG, an open-source tool that audits LLM-based judges by requiring them to back each verdict with explicit claims tied to evidence, flagging untrustworthy decisions without usin…