CUHK - Information Theory
- Offered byCoursera
- Public/Government Institute
Information Theory at Coursera Overview
Duration | 33 hours |
Total fee | Free |
Mode of learning | Online |
Official Website | Explore Free Course  |
Credential | Certificate |
- Overview
- Highlights
- Course Details
- Curriculum
Information Theory at Coursera Highlights
- Shareable Certificate Earn a Certificate upon completion
- 100% online Start instantly and learn at your own schedule.
- Flexible deadlines Reset deadlines in accordance to your schedule.
- Approx. 33 hours to complete
- English Subtitles: French, Portuguese (European), Russian, English, Spanish
Information Theory at Coursera Course details
- The lectures of this course are based on the first 11 chapters of Prof. Raymond Yeung?s textbook entitled Information Theory and Network Coding (Springer 2008). This book and its predecessor, A First Course in Information Theory (Kluwer 2002, essentially the first edition of the 2008 book), have been adopted by over 60 universities around the world as either a textbook or reference text.
- At the completion of this course, the student should be able to:
- 1) Demonstrate knowledge and understanding of the fundamentals of information theory.
- 2) Appreciate the notion of fundamental limits in communication systems and more generally all systems.
- 3) Develop deeper understanding of communication systems.
- 4) Apply the concepts of information theory to various disciplines in information science.
Information Theory at Coursera Curriculum
Course Preliminaries
About this course
Grading Scheme
Week 1 Introduction
Chapter 1
Chapter 2 - Section 2.1 A
Chapter 2 - Section 2.1 B
Chapter 2 - Section 2.1 C
Chapter 2 - Section 2.2
Chapter 2 - Section 2.3
Assignment 1 Video Preview
Homework Assignment 1 Solution
Chapter 2 Information Measures - Part 2
Week 2 Introduction
Chapter 2 - Section 2.4
Chapter 2 - Section 2.5
Chapter 2 - Section 2.6
Chapter 2 - Section 2.7
Chapter 2 - Section 2.8
Chapter 2 - Section 2.10
Assignment 2 Video Preview
Homework Assignment 2 Solution
Chapter 3 The I-Measure - Part 1
Week 3 Introduction
Chapter 3 - Section 3.1
Chapter 3 - Section 3.3 A
Chapter 3 - Section 3.3 B
Chapter 3 - Section 3.4
Chapter 3 - Section 3.5 A
Assignment 3 Video Preview
Homework Assignment 3 Solution
Chapter 3 The I-Measure - Part 2
Week 4 Introduction
Chapter 3 - Section 3.5 B
Chapter 3 - Section 3.6 A
Chapter 3 - Section 3.6 B
Chapter 4 - Section 4.1
Chapter 4 - Section 4.2 A
Assignment 4 Video Preview
Homework Assignment 4 Solution
Chapter 4 Zero-Error Data Compression - Part 2
Week 5 Introduction
Chapter 4 - Section 4.2 B
Chapter 4 - Section 4.2 C
Chapter 4 - Section 4.3
Chapter 5 - Section 5.1
Chapter 5 -Section 5.2
Assignment 5 Video Preview
Homework Assignment 5 Solution
Chapter 6 Strong Typicality
Week 6 - Introduction
Chapter 6 - Section 6.1 A
Chapter 6 - Section 6.1 B
Chapter 6 - Section 6.2
Chapter 6 - Section 6.3 A
Chapter 6 - Section 6.3 B
Chapter 6 - Section 6.4
Assignment 6 Video Preview
Homework Assignment 6 Solution
Chapter 7 Discrete Memoryless Channels - Part 1
Week 7 Introduction
Chapter 7 - Section 7.1 A
Chapter 7 - Section 7.1 B
Chapter 7 - Section 7.2
Chapter 7 - Section 7.3 A
Chapter 7 - Section 7.3 B
Assignment 7 Video Preview
Homework Assignment 7 Solution
Chapter 7 Discrete Memoryless Channels - Part 2
Week 8 Introduction
Chapter 7 - Section 7.4 A
Chapter 7 - Section 7.4 B
Chapter 7 - Section 7.5
Chapter 7 - Section 7.6
Chapter 7 - Section 7.7
Assignment 8 Video Preview
Homework Assignment 8 Solution
Chapter 8 Rate-Distortion Theory - Part 1
Week 9 Introduction
Chapter 8 - Section 8.1
Chapter 8 - Section 8.2
Chapter 8 - Section 8.3 A
Chapter 8 - Section 8.3 B
Chapter 8 - Section 8.4
Assignment 9 Video Preview
Homework Assignment 9 Solution
Chapter 8 Rate-Distortion Theory - Part 2
Week 10 Introduction
Chapter 8 - Section 8.5 A
Chapter 8 - Section 8.5 B
Chapter 9 - Section 9.1
Chapter 9 - Section 9.2 A
Chapter 9 - Section 9.2 B
Assignment 10 Video Preview
Homework Assignment 10 Solution
Chapter 9 The Blahut-Arimoto Algorithms - Part 2
Week 11 Introduction
Chapter 9 - Section 9.2 C
Chapter 9 - Section 9.3
Chapter 10 - Section 10.1 A
Chapter 10 - Section 10.1 B
Assignment 11 Video Preview
Homework Assignment 11 Solution
Chapter 10 Differential Entropy - Part 2
Week 12 Introduction
Chapter 10 - Section 10.2
Chapter 10 - Section 10.3 A
Chapter 10 - Section 10.3 B
Chapter 10 - Section 10.4
Chapter 10 - Section 10.5
Chapter 10 - Section 10.6
Assignment 12 Video Preview
Homework Assignment 12 Solution
Chapter 11 Continuous-Valued Channels - Part 1
Week 13 Introduction
Chapter 11 - Section 11.1
Chapter 11 - Section 11.2
Chapter 11 - Section 11.3 A
Chapter 11 - Section 11.3 B
Assignment 13 Video Preview
Homework Assignment 13 Solution
Chapter 11 Continuous-Valued Channels - Part 2
Week 14 Introduction
Chapter 11 - Section 11.4
Chapter 11 - Section 11.5
Chapter 11 - Section 11.6
Assignment 14 Video Preview
Homework Assignment 14 Solution
Chapter 11 Continuous-Valued Channels - Part 3
Week 15 Introduction
Chapter 11 - Section 11.7 A
Chapter 11 - Section 11.7 B
Chapter 11 - Section 11.8
Chapter 11 - Section 11.9
Assignment 15 Video Preview
Homework Assignment 15 Solution
Other courses offered by Coursera
Student Forum
Anything you would want to ask experts?
Useful Links
Know more about Coursera
Know more about Programs
- Engineering
- Instrumentation Technology
- Food Technology
- BTech Chemical Engineering
- Aeronautical Engineering
- AI & ML Courses
- BTech Petroleum Engineering
- Metallurgical Engineering
- MTech in Computer Science Engineering
- VLSI Design
- Petroleum Engineering
- BTech Robotics Engineering
- Aerospace Engineering
- BTech in Biotechnology Engineering
- BTech Mechatronics Engineering