ELEC97049 (EE9-CS7-26) Information TheoryLecturer(s): Dr Cong Ling Aims
This course is designed to introduce students to the main concepts of information theory and to demonstrate its implications to communications.
Learning Outcomes
At the end of the course, students are expected to have understood the concept and properties of entropy and mutual information, the source coding theorem, the notions of channels and channel capacity, the fundamental coding theorem for noisy channels and its implications, the theory of rate-distortion, and basics of network information theory.
Syllabus
Elements of information theory of discrete systems; information measures, memoryless and memory sources, the noiseless coding theorem. Methods of source coding. Information theory of continuous systems. Shannon's capapcity theorem and its interpretation. Lossy source coding and rate-distortion theory. Network information theory.
Exam Duration: 3:00hrs Coursework contribution: 0% Term: Spring Closed or Open Book (end of year exam): Closed Coursework Requirement: Nil Oral Exam Required (as final assessment): no Prerequisite module(s): None required Course Homepage: http://www.commsp.ee.ic.ac.uk/~cling/IT/InformationTheory.htm Book List: Please see Module Reading list
|