A Voice Is Not an MRI: What Fast Acoustic Simulation Can Recover
TL;DR for operators A pronunciation tool can assess how closely recorded speech matches a reference. Explaining how that sound was physically produced is harder: collecting synchronized recordings of speech and moving vocal tract anatomy requires specialized equipment. Chen, Lee, and Sitzmann1 investigate an alternative: using a physical sound simulator to reconstruct vocal tract geometry directly from speech. On an RTX 4090, their frequency-domain simulator synthesizes one second of speech in approximately 14.2 milliseconds, compared with 1.08 seconds for the tested time-domain baseline, while improving acoustic reconstruction metrics. ...