Digital Image and Sound Processing - Suoni (2007/2008)

Learning outcomes

The class gives the basic theoretical fundamentals and some methods for the generation and processing of sound.
Sound processing is important for designing multimedia systems. The auditory channel is always open and able to discriminate or integrate acoustic events. Vice versa, the visual system is suited for detecting and organizing spatial information. This gives importance to audio-visual communication in contemporary computer science.
After a short introduction to psycho-acoustics, the main techniques for analyzing, processing, and synthesizing sounds by computer are presented.
The course gives the tools and fundamental techniques for understanding and manipulating sounds for the purpose of creating interfaces, compressing and transmitting information, analyzing scenes, etc. .

Sound Module

* Elements of psychoacoustics and auditory perception
* Discretization of continuous-time signals and systems
* Transforms: Laplace, Fourier, Zeta
* Sound analysis: Short-Time Fourier Transform, Correlograms
* Digital filters: first and second-order filters. Allpass filters. Complementary filters. Filter banks. Frequency warping.
* Sound synthesis: classic techniques, physical models, analysis-based synthesis.
* Digital audio effects: processing in time and frequency. Sound spatialization and reverberation.
* Computational auditory scene analysis.
* Languages and standards for sound processing: the Music V family, MPEG audio.

The course coordinates with the following module on Images. In the first module we work on one-dimensional signals (sounds), while in the second we work on two-dimensional signals (images). In total, in the two periods we give 64 hours of front lectures and 24 hours of laboratory. The lab activities are done with softwares such as MATLAB or Octave.

A written test for each module, where questions aim at verifying the understanding of theoretical concepts and the mastering of the mathematical and computer tools.
Students that are exceptionally motivated can develop a project and defend it, after negotiation with the teacher.