System theory - TEORIA DELL'INFORMAZIONE (2009/2010)

Course code
Name of lecturer
Vincenzo Manca
Number of ECTS credits allocated
Academic sector
Language of instruction
1st Semester dal Oct 1, 2009 al Jan 31, 2010.

To show the organization of the course that includes this module, follow this link * Course organization

Lesson timetable

1st Semester
Day Time Type Place Note
Monday 2:30 PM - 4:30 PM lesson Lecture Hall I from Oct 1, 2009  to Nov 21, 2009
Wednesday 2:30 PM - 4:30 PM lesson Lecture Hall I from Oct 1, 2009  to Nov 21, 2009
Thursday 10:30 AM - 12:30 PM lesson Lecture Hall I from Oct 1, 2009  to Nov 21, 2009

Learning outcomes

The course intends provide the foundamental notion of information theory, by starting from the classical approach of Shannon, and by arriving to the recent developments of the theory of codes, compression and cryptography (outlines).


Informatio and data. Digital and probabilistic approach to information. Informational and physical information. Types of codes. Univoc and instantaneous codes. Kraft norm and equivalences between univocity and instantaneity. Optimal codes. First Shannon theorem. Conjunt and conditional entropy. Mutual information and its entropic representation. Typical sequences and equipartition property. Linguistic, stochastic, stationary, and marcovian sources. Transmission, rate, capacity and second Shannon theorem. Hamming codes and autocorrecting codes. Emission, signals, and Fourier representation in Hilbert spaces. Fourier transform and sampling theorem. Differential entropy, and continuous extension of mutual information. Third Shannon theorem. Principal notions of cryptography.

Assessment methods and criteria

Written examination.