Democratic ICAI: Debating Our Way to Steering Principles from Preferences
Democratic ICAI improves preference-based alignment by eliciting multiple competing rationales through structured debate to extract nuanced steering principles from human preferences.