Class Description

Course_ID: MYE015

Weekly Hours: 5

Semester: >=6

ECTS Credits: 5

Course Homepage:http://www.cs.uoi.gr/~cnikou/Information_Theory.html

Description: Information, Entropy, Joint Entropy, Conditional Entropy, Mutual Information, Extensions of Information Sources, Information Sources with Memory, Memoryless Information Sources, Markov chains, Continuous Information Source. Information Channel, Channel Capacity (Maximum Mutual Information), Muroga Method. Coding in Noiseless environment, the Kraft inequality, Shannon’s Noiseless Coding Theorem, Shannon Coding, Shannon-Fano Coding, Huffmann Code, Shannon’s Fundamental Coding Theorem, Error Correcting Codes, Hamming Code. Algebraic Coding, Groups, Fields, Rings, Vector Spaces, modulo-ρ and modulo-k(x) algebra, Error Correcting Codes, Group Codes (Hamming, Hadamard, Golay), Cyclic Codes (Hamming, Golay, BCH), Convolutional Codes.