Windowed A-K-MDP Fixes Discretization Errors in Abstract MDPs
September 15, 2026
Windowed A-K-MDP addresses limitations in previous K-MDP algorithms by evaluating every distinct feasible partition within a declared divisor window. This method avoids skipping optimal abstract states, improving results in 25 out of 33 tested instances.
HOW THIS AFFECTS YOU
●
researcherYou can use this method to ensure more accurate state abstraction in Markov decision processes.