Amortizing Bayesian Experimental Design via Information-Gain Rewards
October 13, 2026
This method trains reasoning LLMs to perform sequential Bayesian experimental design by optimizing for expected information gain. The approach decouples the experimental generative model from the LLM's internal beliefs, enabling targeted action selection through explicit reasoning training.
HOW THIS AFFECTS YOU
●
researcherYou can optimize information-seeking behaviors in LLMs using independent generative models and information-gain rewards.