Applied Math And Analysis Seminar
Monday, March 9, 2009, 4:30pm, 119 Physics
Jean-Philippe Thiran (Ecole Polytechnique Fédérale de Lausanne)
Multimodal signal analysis for audio-visual speech recognition

Abstract:

After a short introduction presenting our group and our main research topics, I will address the problem of audio-visual speech recognition, i.e. a typical example of multimodal signal analysis, when we want to extract and exploit information coming from two different but complementary signals: an audio and a video channel. We will discuss two important aspects of this analysis. We will first present a new feature extraction algorithm based in information theoretical principles, and show its performances, compared to other classical approaches, in our multimodal context. Then we will discuss multimodal information fusion, i.e. how to combine information from those two channels for optimal classification. [video]

---

Generated at 7:29am Thursday, April 25, 2024 by Mcal.   Top * Reload * Login