CPA Method Improves Small LLM Judges via Counterfactual Augmentation
November 2, 2026
Counterfactual Pairwise Augmentation (CPA) improves small pointwise LLM judges by synthesizing and auditing counterfactual responses to create explicit decision boundaries. Fine-tuning on these paired datasets allows small models to more accurately score single responses in deployment.
HOW THIS AFFECTS YOU
●
builderYou can use CPA to deploy smaller, more efficient models as high-accuracy evaluators in your agentic workflows.
●
researcherThis method provides a way to resolve label under-determination during fine-tuning of pointwise judges.