From Value Conditioning to Behavioral Shift: Lightweight Value Alignment of LLMs

Fine-tuning open-source LLMs on survey-style supervision shifts model outputs toward specific Schwartz values without requiring large paired preference datasets. This lightweight alignment method targets specific value ratings while maintaining baseline responses for non-target values, demonstrating measurable transfers to out-of-domain behavioral proxies.