Work2Skill Framework for Human GUI Demonstration Induction
October 12, 2026
Work2Skill captures human GUI interactions by synchronizing screen recordings, input events, and accessibility tree data via the WorkRecorder infrastructure. The framework introduces WorkDemo-350, a dataset of 350 validated multimodal desktop demonstrations designed to help agents learn reusable procedural skills from human workflows.
HOW THIS AFFECTS YOU
●
builderYou can use the WorkDemo-350 dataset to train agents on complex desktop software workflows.
●
researcherThis provides a new multimodal benchmark for evaluating agentic skill induction from human demonstrations.