PreSTO Accelerates LLM Power Sampling via Subtree Prefetching
October 12, 2026
PreSTO speeds up Metropolis-Hastings updates in PowerMH samplers by batch-generating proposals from a prefetched decision tree. This method maintains the original transition kernel while reducing the latency typical of sequential sampling during LLM reasoning.
HOW THIS AFFECTS YOU
●
builderYou can potentially achieve faster test-time reasoning performance without altering the underlying sampling distribution.
●
researcherThis provides a way to accelerate power sampling while provably preserving the MH transition kernel.