Scribd
Upload
97 views2 pages

A G1002 Pages: 2: Answer Any Two Full Questions, Each Carries 15 Marks

This document is a past exam paper for a course on Information Theory and Coding. It contains 3 parts - Part A with 2 short answer questions, Part B with 2 longer answer questions, and Part C with 2 even longer answer questions. The questions cover various topics in information theory and coding including entropy, channel capacity, linear block codes, convolutional codes, and BCH and Reed-Solomon codes.

Uploaded by

Adithyan J
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
97 views2 pages

A G1002 Pages: 2: Answer Any Two Full Questions, Each Carries 15 Marks

This document is a past exam paper for a course on Information Theory and Coding. It contains 3 parts - Part A with 2 short answer questions, Part B with 2 longer answer questions, and Part C with 2 even longer answer questions. The questions cover various topics in information theory and coding including entropy, channel capacity, linear block codes, convolutional codes, and BCH and Reed-Solomon codes.

Uploaded by

Adithyan J
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 2

A G1002 Pages: 2

Reg No.:_______________ Name:__________________________

APJ ABDUL KALAM TECHNOLOGICAL UNIVERSITY


SEVENTH SEMESTER B.TECH DEGREE EXAMINATION(S), MAY2019
Course Code: EC401
Course Name: INFORMATION THEORY & CODING
Max. Marks: 100 Duration: 3 Hours

PART A
Answer any two full questions, each carries 15 marks. Marks

1 a) Define the term: Amount of information. Find out the information conveyed by (3)
one of the two equally probable messages.
b) Joint probability matrix of a discrete channel is given by, (12)
P(X,Y)= 0.05 0.05 0.02 0.05
0.15 0.16 0.01 0.09
0.12 0.03 0.02 0.05
0.01 0.12 0.01 0.06
Compute marginal, conditional and joint entropies and verify their relation.
2 a) Given an AWGN channel with 5 K Hz bandwidth and the noise power spectral density (5)
η/2 =10-9 W/Hz. The signal power required at the receiver is 1mW.Calculate the
capacity of this channel.
b) Given a telegraph source having two symbols, dot and dash. The dot duration is (6)
0.6 sec. The dash duration is half the dot duration. The probability of the dots
occurrence is thrice that of the dash and the time between symbols is 0.1 sec.
Calculate the information rate of the telegraph source.
c) What is the joint entropy H(X, Y), and what would it be if the random variables X (4)
and Y were independent?
3 a) State and establish Kraft’s inequality. (7)
b) Determine the Huffman coding for the following message with their probabilities (8)
given p(x1) =0.05, p(x2)=0.15, p(x3) =0.2, p(x4) =0.05, p(x5) =0.15, p(x6) =0.3,
p(x7) =0.1. Find the efficiency and redundancy of the code.
PART B
Answer any two full questions, each carries 15 marks.
4 a) Draw the bandwidth –SNR trade off graph and explain. (7)
b) The parity bits of a (7,4) linear systematic block code are generated by (8)
c5 = d1+d3+d4
c6=d1+d2+d3
c7=d2+d3+d4
(+ sign denotes modulo-2 addition)
where d1, d2, d3 and d4 are message bits and c5, c6, c7 are parity bits. Find generator
matrix G and parity check matrix H for this code. Draw the encoder circuit.
Page 1of 2
A G1002 Pages: 2
5 a) Find the capacity of a channel with infinite bandwidth. Discuss Shannon’s limit. (7)
b) The parity matrix of a (6, 3) linear systematic block code is given below. (8)
1 0 1
P = [1 1 0 ]
0 1 1
Find all the possible code vectors.
a) Find out the minimum distance of the code.
b) How many errors can be detected and corrected by this code?
6 a) Explain the properties of a field. Cite any two examples. (5)
b) Alphanumeric data are entered into a computer from a remote terminal through a (10)
voice grade telephone channel. The channel has a bandwidth of 3.4 KHz and
output signal to noise power ratio of 20 dB. The terminal has a total of 128
symbols which may be assumed to occur with equal probability and that the
successive transmissions are statistically independent.
a) Calculate the channel capacity.
b) Calculate the maximum symbol rate for which error free transmission over
the channel is possible.
PART C
Answer any two full questions, each carries 20 marks.
7 Draw a (2, 1, 2) convolutional encoder with the feedback polynomials as (20)
g1(X)=1+X+X2 and g2(X)= 1+X2. Draw Trellis and find the output sequence for
input sequence [1 0 0 1 1]. Do Viterbi decoding on this trellis for the received
sequence {01, 10, 10, 11, 01, 01, 11} and obtain the estimate of the transmitted
sequence and the message sequence.
8 a) A channel encoder uses a (7, 4) linear systematic cyclic code in the systematic (8)
form, generator polynomial being X3 + X + 1. Determine the correct codeword
transmitted if the received word is
(i) 1011011 (ii) 1101111

b) Draw a (3,2,1) convolutional encoder with impulse responses given as g1(1)=[1,1], (7)
g1(2)=[1,0], g1(3)=[1,0], g2(1)=[0,1], g2(2)=[1,1], g2(3)=[0,0].
c) Mention the parameters of BCH codes. (5)
9 a) Discuss the procedure for generation of a systematic cyclic code. Draw and (8)
explain the systematic cyclic encoder circuit for a (15, 9) cyclic code with
generator polynomial g(X)= 1+ X3+ X4+ X5+ X6.
b) Draw a (2,1,2) convolutional encoder with the feedback polynomials as (7)
g1(X)=1+X+X2 and g2(X)= 1+X2. Draw the code tree and trace output for input
sequence 10011.
c) What are Reed Solomon Codes? Discuss properties. (5)
****

Page 2of 2

You might also like