Information Theory (2007/2008)

Course partially running

Course code
4S00039
Name of lecturer
Vincenzo Manca
Number of ECTS credits allocated
5
Other available courses
Academic sector
INF/01 - INFORMATICS
Language of instruction
Italian
Period
2° Q dal Jan 10, 2008 al Mar 12, 2008.

Lesson timetable

2° Q
Day Time Type Place Note
Monday 2:30 PM - 4:30 PM lesson Lecture Hall I  
Tuesday 11:30 AM - 1:30 PM lesson Lecture Hall I  
Wednesday 8:30 AM - 10:30 AM lesson Lecture Hall I  

Learning outcomes

Course objective is to present fundamentals of information and communication theory, and in particular, encoding, compression, entropy, transmission, transduction, security, and algorithmic complexity.

Syllabus

1. Encoding
---------------
1.1. Introduction.
1.2. Information, information measures, and entropy.
1.3. Types of codes and main characteristics.
1.4. Information sources and optimal codes..

2. Compression
-------------------
2.1. Kraft Norm and McMillan Theorem.
2.2. Huffman, LZ, Arithmetic, Shannon-Fano, Burrow-Weeler.
2.3. First Shannon Theorem.

3. Entropy
-----------------------
3.1. Types of entropy and their relationships.
3.2. Information Distance and Mutual Information.
3.2. Stocastic and e marcoviane sources.

4. Tipicality
---------------------
4.1. Typical Sequences and AEP (Asintotic Equipartition Propety).

5. Transmission
---------------------
5.1. Trasmission Codes, channel capacity and transmission rate.
5.2. Second Shannon Theorem.
5.3. Hamming Codes.

6. Transduction
-------------------------
6.1. Continuous entropic concepts.
6.2. Sampling Theorem.
6.3. Maxwell Theorem
6.4. Third Shannon Theorem.

7. Security
------------------
7.1. Private Key Criptografy. Historical Developments and the key distribution problem.
7.2. Diffie-Hellman Protocol.
7.3. Public Key Criptografy.
7.4. Autenticazione, signature and certificate schemata.
Bennet-Brassard Protocol.

7. Complessity
------------------
8.1. Kolmogorov-Chaitin algorithmic complexity.
8.2. Random strings and elegant programs.
8.3. Chaitin Elegance Theorem.

Assessment methods and criteria

Oral Examination