EE Department Intranet - intranet.ee.ic.ac.uk
Close window CTRL+W

ELEC97049 (EE9-CS7-26) Information Theory


Lecturer(s): Dr Cong Ling

Aims

This course is designed to introduce students to the main concepts of information theory and to demonstrate its implications to communications.

Learning Outcomes

At the end of the course, students are expected to have understood the concept and properties of entropy and mutual information, the source coding theorem, the notions of channels and channel capacity, the fundamental coding theorem for noisy channels and its implications, the theory of rate-distortion, and basics of network information theory.

Syllabus

Elements of information theory of discrete systems; information measures, memoryless and memory sources, the noiseless coding theorem. Methods of source coding. Information theory of continuous systems. Shannon's capapcity theorem and its interpretation. Lossy source coding and rate-distortion theory. Network information theory.
Assessment
Exam Duration: 3:00hrs
Coursework contribution: 0%

Term: Spring

Closed or Open Book (end of year exam): Closed

Coursework Requirement:
         Nil

Oral Exam Required (as final assessment): no

Prerequisite module(s): None required

Course Homepage: http://www.commsp.ee.ic.ac.uk/~cling/IT/InformationTheory.htm

Book List:
Please see Module Reading list