This course is designed to introduce students to the main concepts of information theory and to demonstrate its implications to communications.

At the end of the course, students are expected to have understood the concept and properties of entropy and mutual information, the source coding theorem, the notions of channels and channel capacity, the fundamental coding theorem for noisy channels and its implications, the theory of rate-distortion, and basics of network information theory.

Elements of information theory of discrete systems; information measures, memoryless and memory sources, the noiseless coding theorem. Methods of source coding. Information theory of continuous systems. Shannon's capapcity theorem and its interpretation. Lossy source coding and rate-distortion theory. Network information theory.