PrefReward Framework for Personalized Text Generation via Preference Matrices

PrefReward explicitly models user styles using a structured preference matrix and a KL-divergence-based reward signal during decoding. It outperforms retrieval-based baselines on the LongLaMP dataset by making user preferences interpretable and decoupled from model parameters.