Advanced Information Theory

 

Announcements & News

  • Classes on Wednesdays 9:00am-11:00am
  • The Class-room is EE G-303
 

General Information

  • Course information leaflet: .pdf.
 

Course Staff
Professor E-mail Phone Office Office Hours
Sibi Raj B Pillai
EE dept 		bsraj att ee 022 2576 7419 Third Floor
(EE MB)		 9am -5pm
B K Dey
 bikash att ee 022 2576 7429 Electrical Engg
xx
Mukul Agarwal
Magar atat MIT Visiing Faculty Electrical Engg
xx
Vinod Prabhakaran
Vinodmp atat TIFR TIFR STC
xx
   

Time & Place

Type Day Hour Room
Class Wednesday 9:00am-11:00am EE G-303
 

Lecture Notes & Schedule

Date Course Material
 

Course Projects

Ser Nr Project
1 DIstributed storage and caching
A.G. Dimakis, K. Ramchandran, Y. Wu, and C. Suh, A Survey on Network Codes for Distributed Storage, Proceedings of the IEEE, Vol. 99, No. 3, March 2011. (a slightly dated tutorial survey)
M. Maddah-Ali and U. Neisen, “Fundamental Limits of Caching,” to appear in IEEE Trans. Inf. Theory, 2014. http://arxiv.org/abs/1209.5807
R. Pedarsani, M. Maddah-Ali and U. Neisen, “Online Coded Caching,” arXiv 2013. http://arxiv.org/abs/1311.3646 (and references therein)
2 Converses via Hypercontractivity
C. Nair, An extremal inequality related to hypercontractivity of Gaussian random variables, ITA 2014. http://ita.ucsd.edu/workshop/14/files/paper/paper_688.pdf (and references therein)
3 Interactive source coding (rate-loss)
Nan Ma; Ishwar, P., "The Infinite-Message Limit of Two-Terminal Interactive Source Coding," Information Theory, IEEE Transactions on , vol.59, no.7, pp.4071,4094, July 2013. http://arxiv.org/abs/0908.3512 (and references therein)
Zamir, R, “The rate loss in the Wyner-Ziv problem,” IEEE Transactions on Information Theory, 42(6), 2073-2084, 1996.
4 Heegard-Berger problem & index coding
C. Heegard and T. Berger, “Rate distortion when side information may be absent,” IEEE Trans. Inf. Theory, vol. IT-31, no. 6, pp. 727–734, Nov. 1985 [also see the book]
B. Vellambi and R. Timo, “The Heegard-Berger problem with common receiver constructions,” IEEE Information Theory Workshop, September 9-13, 2013, Seville, Spain http://roytimo.wordpress.com/pub/itw2013/
S. Unal and A. Wagner, “General index coding with side information: Three decoder case,” ISIT 2013. (also see the references for pointers to index coding) http://ieeexplore.ieee.org/xpl/login.jsp?tp=&arnumber=6620404
5 Source-Channel Broadcast
V. M. Prabhakaran, R. Puri, & , K. Ramchandran, “Hybrid digital-analog codes for source-channel broadcast of Gaussian sources over Gaussian channels.” IEEE Transactions on Information Theory, 57(7), 4573-4588, 2011. (and references therein)
Reznic, Z., Feder, M., & Zamir, R. (2006). Distortion bounds for broadcasting with bandwidth expansion. Information Theory, IEEE Transactions on, 52(8), 3778-3788.
E. Koken and E. Tuncel, “On robustness of hybrid digital/analog source-channel coding with bandwidth mismatch,” submitted to IEEE International symposium on Information Theory. http://www.ee.ucr.edu/~ertem/Publications_files/Robust_HDA_14.pdf (and references therein)
6 Network coding & function computation
B.K.Rai and B.K.Dey, "On network coding for sum-networks," IEEE Trans. on Information Theory, Vol. 58, no. 1, Jan'2012.
Appuswamy, Franceschetti, Karamchandani, Zeger, "Network coding for computing: cut-set bounds," IEEE Trans. on Information Theory, Vol 57, no. 2, Feb'2011.
Suh, Goela, Gastpar, "Computation in multicast networks: function alignment and converse theorems," http://arxiv.org/abs/1209.3358
7 Network equivalence
Koetter, Effros, Medard, "A theory of network equivalence, Part I: point-to-point channels" IEEE Trans. on Information Theory, Vol 57, no. 2, Feb'2011.
Koetter, Effros, Medard, “A theory of network equivalence— Part II: Multiterminal channels,” 2010, arXiv.org:1007.1033.


References

Ref Nr. Details
1 A. ElGamal and Y. H. Kim, Network Information Theory, Cambridge, 2011.
2 T. COver and J A Thomas, Elements of Information Theory., Wiley 1991.
3 D. Tse and P. Viswanath, Fundamentals of wireless communication., Cambridge 2004.
4 Cziszar and Korner,Information Theory., Cambridge 2010, Second Edition.
5 Selected publications and other monographs.

Send suggestions and/or comments to: bsraj att ee . Better to use the Right to Information (RTI) act in the class than later.