ENGN8534 Information Theory
Not offered in 20246 units8000-level
This course will introduce students to the main concepts of information theory. Information theory has many applications in communications theory and practice, computer science, and statistics. For example, it quantifies fundamental limits of reliable communications in the presence of noise without restricting the treatment to a particular method of transmission or reception. Specific topics include: Entropy, Relative Entropy, Mutual Information. Entropy Rates of a Stochastic Process. Data Compression and Source Coding. Channel Capacity and Channel Coding Theorem. Differential Entropy. Capacity of Gaussian Channels. Network Information Theory (such as Multiple-access Channel, Broadcast Channel, Relay Channel). Introduction to Network Coding (if time allows).
- 2024not offered
- 2025not listed
- 2026not listed
- 2027not listed
Prerequisites in 2024
Read automatically from the handbook's wording
Incompatible with COMP2610, COMP6261: you can't count both.
The handbook's original wording (2024)
To enrol in this course you must have completed ENGN8538 . You are not able to enrol in this course if you have completed COMP2610 or COMP6261 .
What it leads to in 2024
No course names ENGN8534 in its 2024 prerequisites.