Adv. Information Theory



  • 2016 Autumn/Monsoon (Aug - Dec)

In 1948 Shannon established information theory and this theory provides the theoretical underpinnings of all modern communication systems. Shannon’s theory focused mostly on the point-to-point communication problem. Recently significant progress has been made in understanding information flow over networks. The course will cover progress made in the past 2-3 decades with particular focus on more recent results. Topics include network coding (which shows the surprising result that even in noiseless wireline networks, coding across packets is strictly superior to routing), state-of-the-art results on models for wireless communication networks (multiple-access, broadcast, relay, interference networks), distributed source coding (which studies compression & dissemination of dependent data spread out over a network, e.g., sensor networks), and information theoretic cryptography. Apart from current literature we will use the following references


  A. El Gamal and Y-H. Kim, Network Information Theory, Cambridge (2011).

  I. Csiszár and J. Körner, Information Theory, Cambridge (2011).

  R. Yeung, Information Theory and Network Coding, Springer (2008).