Speech Inversion

Question, could you listen to others talking by hearing and/or by looking, i.e., lip reading?

Why is it important

Speech inversion is also known as acoustic-to-articulatory mapping.

What has been done:

  • HMM-GMM
  • Deep Neural Networks
  • Corpus

So, how to do Speech Inversion:

Researchers

  • https://homepages.inf.ed.ac.uk/korin/site/home/
  • https://home.ttic.edu/~klivescu/

Corpora

  • https://www.cstr.ed.ac.uk/downloads/
  • http://www.mspkacorpus.it/

What do the results tell you?

Written on November 5, 2016