MGE-PO: Entropy-Aware Credit Assignment for Mathematical Reasoning
GRPO assigns the same group-relative advantage to equally rewarded responses within a question, leaving their generation uncertainty unused. We introduce MGE-PO, centered on four-quadrant (4Q) advantage shaping that combines verified correctness with rollout generation entropy. Correctness determines the sign of an additional correction, while entropy controls its magnitude: lower-entropy…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
