New Speech Recognition Benchmark Targets Real-World Vocabulary Gaps

Researchers introduced Contextual Earnings-22, a speech-to-text benchmark featuring custom vocabulary in realistic contexts, addressing why academic models underperform on specialized terms in high-stakes domains. The dataset reveals that both keyword prompting and boosting techniques significantly improve accuracy on rare, contextually-relevant vocabulary—highlighting the gap between benchmark performance and practical deployment.