[arXiv]score: 0.24
V\={a}kQA: A Benchmark and Evaluation Study for Telugu Spoken Factoid Question Answering
September 18, 2026
VakQA introduces a Telugu spoken factoid question-answering benchmark comprising 2,001 pairs across six domains and 2.53 hours of audio. Evaluation studies show Gemini-as-a-judge most closely approximates human ratings, whereas open-weight models struggle with surface-form variations in Telugu answers.
DAILY DIGEST
you don't check 9 sources — we do. one email every morning, read in 2 min. free. unsubscribe anytime. privacy