A Curious Case of the Missing Measure: Better Scores and Worse Generation
Joseph Turian · Jordie Shier
2025 Blog Track Poster
Abstract
Our field has a secret: nobody fully trusts audio evaluation measures. As neural audio generation nears perceptual fidelity, these measures fail to detect subtle differences that human listeners readily identify, often contradicting each other when comparing state-of-the-art models. The gap between human perception and automatic measures means we have increasingly sophisticated models while losing our ability to understand their flaws.
Video
Chat is not available.
Successful Page Load