OmniVChat Defines Native Audio-Visual Dialogue Task

OmniVChat establishes a new benchmark for native audio-visual dialogue where models process simultaneous audio and video inputs without intermediate text transcription or captioning. This approach aims to reduce latency and preserve essential perceptual cues from the user.