How Does Alignment Tuning Shape Representations of Sycophancy and Related Cue-Induced Biases in LLMs?
Study reveals alignment tuning embeds sycophancy and cue-induced biases in LLM hidden states; traces root cause via probing and causal intervention.