IT2302 INFORMATION THEORY AND CODING ANNA UNIVERSITY SYLLABUS

IT2302 INFORMATION THEORY AND CODING

UNIT I INFORMATION THEORY
Information – Entropy, Information rate, classification of codes, Kraft McMillan inequality,
Source coding theorem, Shannon-Fano coding, Huffman coding, Extended Huffman
coding - Joint and conditional entropies, Mutual information - Discrete memoryless
channels – BSC, BEC – Channel capacity, Shannon limit.

UNIT II SOURCE CODING: TEXT, AUDIO AND SPEECH
Text: Adaptive Huffman Coding, Arithmetic Coding, LZW algorithm – Audio: Perceptual
coding, Masking techniques, Psychoacoustic model, MEG Audio layers I,II,III, Dolby
AC3 - Speech: Channel Vocoder, Linear Predictive Coding

UNIT III SOURCE CODING: IMAGE AND VIDEO
Image and Video Formats – GIF, TIFF, SIF, CIF, QCIF – Image compression: READ,
JPEG – Video Compression: Principles-I,B,P frames, Motion estimation, Motion
compensation, H.261, MPEG standard

UNIT IV ERROR CONTROL CODING: BLOCK CODES
Definitions and Principles: Hamming weight, Hamming distance, Minimum distance
decoding - Single parity codes, Hamming codes, Repetition codes - Linear block codes,
Cyclic codes - Syndrome calculation, Encoder and decoder - CRC

UNIT V ERROR CONTROL CODING: CONVOLUTIONAL CODES
Convolutional codes – code tree, trellis, state diagram - Encoding – Decoding:
Sequential search and Viterbi algorithm – Principle of Turbo coding

TEXT BOOKS:
1. R Bose, “Information Theory, Coding and Crptography”, TMH 2007
2. Fred Halsall, “Multidedia Communications: Applications, Networks, Protocols and
Standards”, Perason Education Asia, 2002
REFERENCES:
1. K Sayood, “Introduction to Data Compression” 3/e, Elsevier 2006
2. S Gravano, “Introduction to Error Control Codes”, Oxford University Press 2007
3. Amitabha Bhattacharya, “Digital Communication”, TMH 2006