Home / Glossary / LLM-as-a-judge

LLM-as-a-judge

Using a language model, armed with a written rubric, to score or compare outputs the way a human reviewer would—the standard escape from graders that read at human speed and bill at human rates. A judge is an instrument that must itself be calibrated against human judgment before it is trusted (Chapter 16).