Gradient Starvation in Binary-Reward GRPO: Why Group-Mean Centering Fails and Why the Simplest Fix Works
GRPO fails under binary rewards due to gradient starvation when all group responses are correct/wrong; group-mean centering fix demonstrated on Qwen3.5.