Skip to main content

ES4E7 - Information Theory and Coding

  • Module code: ES4E7
  • Module name: Information Theory and Coding
  • Department: School of Engineering
  • Credit: 15

Content and teaching | Assessment | Availability

Module content and teaching

Principal aims

To provide the understanding and analytical tools necessary to apply information theory to a range of relevant modern problems in communication engineering. In particular: to convey the source coding and noisy channel theorems; to furnish students with the means to compute information theoretic quantities; to deliver the principles and applications of source codes; to convey the principles and applications of channel codes; to provide exposure to the latest developments in the area. Students will gain: Substantial knowledge of information and entropy, and their use in information theory. Principles and practice of data compression. Channel capacity of common communication channels. Design and performance evaluation of error correcting codes. Knowledge of lossy compression. Emerging topics in information theory, coding and compression.

Principal learning outcomes

By the end of the module students will be able to: • Demonstrate advanced knowledge and understanding of information and entropy, and their use in information theory. Principles and practice of data compression. • Comprehend the principles of data compression, and use these to design and evaluate specific data compression techniques. • Design and evaluate the error performance of specific error correcting codes. • Apply the principles of noisy channel analysis to calculate the capacity of common communication channels. • Demonstrate sound and systematic comprehension of the principles and implementations of lossy compression. • Critically evaluate an area of the subject and produce a professional literature review of it. • Evaluate the operation and potential of emerging topics in information theory, coding and compression, and appreciate their significance in communication systems.

Timetabled teaching activities

20 x 1 hr lectures; 5 x 1 hr tutorials, 2 x 1 hr revision sessions Total 27 hrs

Departmental link

http://www.warwick.ac.uk/eng/eso/modules/year4/es4e7/

Other essential notes

Advice and feedback hours are available for answering questions on the lecture material (theory and examples).

Module assessment

Assessment group Assessment name Percentage
15 CATS (Module code: ES4E7-15)
D (Assessed/examined work) Research Assignment (2000 words) 20%
  3 hour examination (Summer) 80%

Module availability

This module is available on the following courses:

Core

N/A

Optional Core
  • MEng Engineering (H10G) - Year 4
  • MEng Electronic Engineering (H60D) - Year 4
Optional
  • MEng Engineering (H107) - Year 4
  • MEng Engineering with Intercalated Year (H109) - Year 5
  • MEng Engineering (H10C) - Year 4
  • MEng Engineering (H10D) - Year 4
  • MEng Engineering (H10K) - Year 4
  • MEng Engineering (H10L) - Year 4
  • MEng Engineering (H10M) - Year 4
  • MEng Engineering with Year in Research (H110) - Year 5
  • MEng Electronic Engineering (H60C) - Year 4
  • MEng Electronic Engineering (H635) - Year 4
  • MEng Electronic Engineering with Intercalated Year (H636) - Year 5
  • MEng Electronic Engineering with Year in Research (H637) - Year 5
  • MEng Electronic Engineering with Exchange Year (H64Z) - Year 4