ROUGE

LLM-as-a-Judge is a technique that uses a large language model to evaluate the output of another model, offering a scalable and explainable proxy for human preference. The approach was formalized in a…

A practical guide for benchmarking fine-tuned models recommends starting with a held-out test set matching the actual task rather than relying solely on public benchmarks. The workflow includes defini…

A user training a T5 model asked for alternative metrics to Exact Match for evaluating text generation. Community members suggested ROUGE-1, ROUGE-2, and BLEU, and recommended Braintrust for running e…