Modeling sound gestures in multimodal human-computer interaction.

Speaker:  Antonio Rodà - Università di Udine
  Tuesday, July 10, 2007 at 5:00 PM Aula Verde (Ciclo COVAR)

Multimodal interfaces, since they provide the user with multiple modes of interaction with a system, require to combine signals acquired from different kinds of sensors. The talk will focus on an interaction paradigm combining movement and sound in a multimodal environment. This paradigm is based on the extension of the gesture concept to sounds and is validated by several experiments that investigate the communication capabilities of sound gestures. The use of multivariate analysis and pattern recognition methods will be also discussed, for defining a semantic space that allows to represent qualities of sound and gestures at a higher level of abstraction.

Ca' Vignal - Piramide, Floor 0, Hall Verde

Programme Director
Marco Squassina

External reference
Publication date
June 27, 2007