SMutual information, entropy for discrete ensembles, Shannon’s noiseless coding theorem, Encoding of discrete sources. Markov sources; Shannon’s noisy coding theorem and converse for discrete channels, Calculation of channel capacity and bounds for discrete channels, Application to continuous channels. Techniques of coding and decoding, Huffman codes and uniquely detectable codes, Cyclic codes, convolutional arithmetic codes.