The Shape of the DPO Hyperparameter Landscape: What to Measure, How It Moves with Scale, and When Not to Transfer It
Systematic study of DPO hyperparameter landscape across model scales reveals optimal learning rate and β-regularization shift with size; direct transfer between scales unreliable.