Information Theory and Coding

 

Announcements & News

  • We are in SLOT 14: Tuesdays and Fridays 5:30-7:00pm
  • In EEG 102, have your tea/tiffin and come!
  • Classes start on: 5 January 2018
 

General Information

  • Course information leaflet: .pdf.
 

Course Staff
Professor E-mail Phone Office Office Hours
Sibi Raj B Pillai
EE dept 		bsraj att ee 022 2576 7419 Third Floor
(EE MB)		 9am -5pm
TAs E-mail Phone Office Office Hours
Haseen Rahman
144070031 at iitb Bharti Lab Electrical Engg
xx
Arijit Dutta
154070004 at iitb Bharti Lab Electrical Engg
xx

Avirup Mandal avirupmandal at iitb Electrical Engg
xx
TBA
xx Electrical Engg
xx
   

Time & Place

Type Day Hour Room
Class Tuesday 5:30-7:00pm EEG-102
Class Friday 5:30-7:00pm EEG-102
 

Lecture Notes & Schedule

Date Course Material
02-01-2018 Please do not print the notes/slides
(primarily to save paper, also that these are prepared on the fly, often in an ad hoc manner. Your print may not reflect the corrections/changes.)
05-01-2018 Background, Motivation, Examples : Lecture Set1.pdf
 

Topics for Reading

Topic Nr. Title
1) "A Mathematical Theory of Communication" : Shannon's original paper itself is a mighty reference
2) A.Lapidoth,Nearest Neighbour Decoding for non-gaussian noise channels, IEEE Transactions on Information Theory,September 1996
3) Richard E. Blahut; Computation of channel capacity and rate-distortion functions Jul 1972 pp. 460 - 473
 

Homeworks

Homework Nr. Assign Date Due Date Solutions
   Homework 1: .pdf 16-01-2018 23-01-2018 .pdf
   Homework 2: .pdf 02-02-2018 09-02-2018 .pdf
   Homework 3: .pdf 27-03-2018 03-04-2018 .pdf
 

Tutorials

Date
14-01-2018 Tutotial 1: Tutorial1.pdf
09-02-2018 Tutotial 1: Tutorial2.pdf
 

Exams

Exam Date Room Solutions
Quiz1, 11 February 2017 EEG 002 .pdf


References

Ref Nr. Details
1 "A Mathematical Theory of Communication" : Shannon's original paper
2 Elements of Information Theory, T.M. Cover and J.A.Thomas, Wiley 1991
3 Information Theory and Reliable Communication, R.G.Gallager, Wiley 1967
4 Network Information Theory, El Gamal and Kim, Cambridge 2011
5 Information Theory, Csiszar and Korner, Hungarian Acad. Sciences 1983
6 Information Theory, Robert Ash, Dover 1960
7 A Diary on Information Theory, A. Renyi, Wiley 1983 (Original 1969)
8 Mathematical Foundation of Information Theory, A.I.Khinchin, Dover 1957
9 Entropy and Information Theory : Bob Gray (more mathematical, available online)

Videos

Ref Nr. Details
1 Shannon Limit: Bell labs
2 Tech Icons
3 Juggling Machine
4 Machine Learning
5 Father of Information Age
6 Entropy Video

Send suggestions and/or comments to: bsraj att ee . Better to use the Right to Information (RTI) act in the class than later.