UNIT 1:
Introduction : Information Theory, Information and entropy, joint and conditional entropy, differential entropy, relative entropy, mutual information, relationship between entropy and mutual information.

UNIT 2:
Source coding: Shannon’s source coding theorem, Huffman coding, Shannon Fano coding. Channel Coding Channel capacity, binary symmetric channel, binary erasure channel, Shannon’s channel coding theorem.

UNIT 3:
Linear Block Codes: Definition, properties, matrix description of linear block codes, generator and parity check matrix, encoding of linear block codes, decoding of linear block codes, syndrome decoding, standard array, co-sets, perfect codes, systematic block code, Hamming code.

UNIT 4:
Cyclic Codes: Introduction, properties of cyclic codes, polynomials and division algorithm, and decoding of cyclic codes, matrix description of cyclic codes, burst error correction, cyclic redundancy check. Circuit implementation of cyclic codes.

UNIT 5:
Convolution Codes: Introduction, tree codes and trellis codes, polynomial description of convolution codes, distance notation, generating function, matrix description, viterbi decoding. Course Outcomes: After successfully completing the course students will be able to understand concept of fundamental of Information Theory and Coding. Evaluation: Evaluation will be continuous and integral part of the class followed by final examination.