AltRA-Test: An Alternative Annotator Test for LLM Judges Without Shared Annotators Researchers introduced the Alternative Annotator Test (Alt-Test), a statistical method for deciding when an LLM judge can justifiably replace human annotators, aimed at dense settings where all items are annotated. The Alt-Test is designed to work without shared annotators between the human and model ratings, addressing a gap in existing approaches to validating LLM-as-judge pipelines. Large language models LLMs are increasingly used as judges and graders to replace human annotators, raising the question of when such replacement is statistically justified. To support such decisions, the Alternative Annotator Test Alt-Test was introduced for dense settings where all items are a