Let the Mind Conceive, Let the Hand Achieve: Following Multimodal Instructions for Long-Horizon Robotic Manipulation

Orchestra decouples task planning from execution management by using a progress evaluator to transition between subtasks within a multimodal instruction. The agent harness maintains a shared context of spatial grounding and recent observations to guide an action policy through long-horizon manipulation tasks.