A diffusion model that uses copula score correction to generate whole-body gestures synchronized with audio and text. It achieved a semantic fidelity of 0.9916 (SRGR) and a beat alignment of 0.1826 on the BEAT dataset.
HOW THIS AFFECTS YOU
●
researcherYou can improve cross-modal motion generation by modeling the specific interactions between audio and text during inference.
●
designerYou can generate more realistic and rhythmic character animations using text and audio inputs.