[arXiv]score: 0.35

SceneActBench Evaluates VLM Agent Actions in 3D Environments

July 27, 2026

SceneActBench tests vision-language model (VLM) agents on five 3D tasks using a unified agent-environment loop with geometric ground truth. Current proprietary VLMs score between 38.6% and 50.2%, showing significant limitations in consistent multi-object 3D scene manipulation.

HOW THIS AFFECTS YOU

●

builderUse this benchmark to test the capability of your VLMs to move beyond description into active 3D environment manipulation.

●

researcherThis highlights the gap between textual scene description and precise geometric action in current VLM architectures.

●

designerThis signals that high-fidelity 3D interactive AI experiences are still limited by current VLM performance.

read original ↗arxiv.org

DAILY DIGEST

you don't check 9 sources — we do. one email every morning, read in 2 min. free. unsubscribe anytime. privacy

← back to feed