Work2Skill Framework Captures GUI Experience for Agent Training
October 8, 2026
The Work2Skill framework uses WorkRecorder to align screen recordings, mouse/keyboard events, and accessibility trees to capture human GUI workflows. It introduces WorkDemo-350, a synchronized multimodal dataset designed for inducing reusable skills in computer-use agents.
HOW THIS AFFECTS YOU
●
builderYou can use the WorkDemo-350 dataset to train agents on complex, domain-specific software workflows.
●
designerThis provides a structured way to translate human UI interaction patterns into machine-usable skills.