Counterfactual Pairwise Augmentation Improves Small Pointwise LLM Judges
Agentic systems increasingly gate individual steps with a pointwise judge that scores a response against a criterion. Small language models are attractive for this role because they can be served and specialized efficiently. Such a judge must locate the criterion's decision boundary, but pointwise labels under-determine that boundary in fine-tuning: labeled responses to different queries differ…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
