Virtual worlds are developing rapidly over the Internet. They are visited by avatars and staffed with Embodied Conversational Agents (ECAs). An avatar is a representation of a physical person. Each person controls one or several avatars and usually receives feedback from the virtual world on an audio-visual display. Ideally, all senses should be used to feel fully embedded in a virtual world. Sound, vision and sometimes touch are the available modalities. This paper reviews the technological developments which enable audio-visual interactions in virtual and augmented reality worlds. Emphasis is placed on speech and gesture interfaces, including talking face analysis and synthesis
Gérard Chollet, Anna Esposito, Annie Gentes, Patrick Horain, Walid Karam, et al.. Multimodal human machine interactions in virtual and augmented reality. Multimodal Signals : Cognitive and Algorithmic Issues : COST Action 2102 and euCognition International School Vietri sul Mare, Italy, April 21-26, 2008 Revised Selected and Invited Papers, 5398, Springer-Verlag, pp.1 - 23, 2009, Lecture Notes in Computer Science, 978-3-642-00524-4. ⟨10.1007/978-3-642-00525-1_1⟩ - lien externe. ⟨hal-00472794⟩ - lien externe
Citations
Chollet, G., Esposito, A., Gentes, A., Horain, P., Karam, W., Li, Z., Pelachaud, C., Perrot, P., Petrovska-Delacrétaz, D., Zhou, D., & Zouhari, L. (2009). Multimodal human machine interactions in virtual and augmented reality. https://api.istex.fr/ark:/67375/HCB-KP12800P-W/fulltext.pdf?sid=hal
Chollet, Gérard, et al. Multimodal Human Machine Interactions in Virtual and Augmented Reality. Jan. 2009, https://api.istex.fr/ark:/67375/HCB-KP12800P-W/fulltext.pdf?sid=hal.
Chollet, Gérard, Anna Esposito, Annie Gentes, Patrick Horain, Walid Karam, Zhenbo Li, Catherine Pelachaud, et al. 2009. “Multimodal Human Machine Interactions in Virtual and Augmented Reality.” https://api.istex.fr/ark:/67375/HCB-KP12800P-W/fulltext.pdf?sid=hal.
Chollet, G. et al. (2009) “Multimodal human machine interactions in virtual and augmented reality.” Available at: https://api.istex.fr/ark:/67375/HCB-KP12800P-W/fulltext.pdf?sid=hal.
CHOLLET, Gérard, ESPOSITO, Anna, GENTES, Annie, HORAIN, Patrick, KARAM, Walid, LI, Zhenbo, PELACHAUD, Catherine, PERROT, Patrick, PETROVSKA-DELACRÉTAZ, Dijana, ZHOU, Dianle and ZOUHARI, Leila, 2009. Multimodal human machine interactions in virtual and augmented reality [en ligne]. January 2009. Disponible à l'adresse : https://api.istex.fr/ark:/67375/HCB-KP12800P-W/fulltext.pdf?sid=hal