课程介绍

The lectures are based on the first 11 chapters of Prof. Raymond Yeung's textbook entitled Information Theory and Network Coding (Springer 2008).
http://iest2.ie.cuhk.edu.hk/~whyeung/book2/

This book and its predecessor, A First Course in Information Theory (Kluwer 2002, essentially the first edition of the 2008 book), have been adopted by over 100 universities around the world. The electronic version of the 2008 book can be downloaded for free (with institutional subscription).
http://link.springer.com/book/10.1007/978-0-387-79234-7/page/1

课程大纲

学习目标

At the completion of this course, the student should be able to:
1. Demonstrate knowledge and understanding of the fundamentals of information theory.
2. Appreciate the notion of fundamental limits in communication systems and more generally all systems.
3. Develop deeper understanding of communication systems.
4. Apply the concepts of information theory to various disciplines in information science.

学习要求

Solid undergraduate-level probability

考核标准

Your grade of this course is based on your homework performance.

Homework Assignments (100%)

There will be a total of 15 homework assignments. Some of these problems in the homework assignments are not easy, and you are not expected to be able to solve all of them. However, to get the most out of this course, you should make effort to solve these problems as much as you can. The assignments will be graded in a liberal manner. You will get the mark for a problem as long as you show that you have made a reasonable effort to solve the problem.

教材教参

Information Theory and Network Coding (Springer 2008)
http://iest2.ie.cuhk.edu.hk/~whyeung/book2/

The lectures are based on the first 11 chapters of "Information Theory and Network Coding" (Springer 2008).  If you are with a university or some other institution with institutional subscription to Springer's e-book series, you can download the electronic version of the book for free.
http://link.springer.com/book/10.1007/978-0-387-79234-7/page/1

Note that :(i) you need to refer to the textbook when attempting the homework assignments and (ii) there is a chapter summary at the end of each chapter which is very useful for studying.

Other than the textbook for this course, an excellent reference is Elements of Information Theory, 2nd Edition by T. M. Cover and J. A. Thomas (Wiley 2006).
http://chggtrx.com/click.track?CID=267582&AFID=301076&ADID=1088031&SID=informationtheory&isbn_ean=9780471241959