MirrorCraft Benchmark Evaluates Agent Robustness to Hidden Rule Changes
August 3, 2026
MirrorCraft introduces a paired evaluation framework for Minecraft agents using mirrored worlds where server-side rules like recipes and resource placement are modified. The benchmark uses a shared Mineflayer interface across five biomes and six rule suites to test if agents can adapt to mechanic shifts rather than just memorizing fixed environments.
HOW THIS AFFECTS YOU
●
researcherYou can use this to test if your agents rely on environmental memorization or actual reasoning.