EE Department Intranet -
Close window CTRL+W

ELEC97049 (EE9-CS7-26) Information Theory

Lecturer(s): Dr Cong Ling


This course is designed to introduce students to the main concepts of information theory and to demonstrate its implications to communications.

Learning Outcomes

At the end of the course, students are expected to have understood the concept and properties of entropy and mutual information, the source coding theorem, the notions of channels and channel capacity, the fundamental coding theorem for noisy channels and its implications, the theory of rate-distortion, and basics of network information theory.


Elements of information theory of discrete systems; information measures, memoryless and memory sources, the noiseless coding theorem. Methods of source coding. Information theory of continuous systems. Shannon's capapcity theorem and its interpretation. Lossy source coding and rate-distortion theory. Network information theory.
Exam Duration: 3:00hrs
Coursework contribution: 0%

Term: Spring

Closed or Open Book (end of year exam): Closed

Coursework Requirement:

Oral Exam Required (as final assessment): no

Prerequisite module(s): None required

Course Homepage:

Book List:
Please see Module Reading list