Information Theory



  • 2019 Spring/Summer (Jan - May)

Data compression and reliable communication
Information theory, statistics, machine learning
Privacy and information theoretic cryptography (time permitting)

Textbook: T. M. Cover and J. A. Thomas, Elements of Information Theory, Wiley, 2006.
Additional references:
R. Gallager, Information Theory and Reliable Communication, Wiley, 1968.
J. M. Wozencraft and I. M. Jacobs, Principles of Communication Engineering, Wiley, 1965.
C. E. Shannon, The Mathematical Theory of Communication, University of Illinois Press, 1949.
I. Csiszár and J. Körner, Information Theory, Cambridge, 2011.
R. Yeung, Information Theory and Network Coding, Springer, 2008.
A. Dembo and O. Zeitouni, Large Deviations, Springer 1998.
D. Mackay, Information Theory, Inference, and Learning, Cambridge 2003.
Y. Polynaskiy and Y. Wu, Lecture Notes on Information Theory (online).