Scribd
Upload
58 views4 pages

Ec-3064 (Itc) - CS Mid Sept 2023

This document contains the questions and solutions for a mid-semester exam on Information and Coding Theory. It includes 5 questions assessing students' knowledge of key terms, channel models, source coding techniques like Huffman and Shannon-Fano coding, channel capacity, and mutual information calculations. The questions range from short answer definitions to longer problems involving constructing codes, drawing channel diagrams, and performing information-theoretic calculations.

Uploaded by

shivamjana40
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
58 views4 pages

Ec-3064 (Itc) - CS Mid Sept 2023

This document contains the questions and solutions for a mid-semester exam on Information and Coding Theory. It includes 5 questions assessing students' knowledge of key terms, channel models, source coding techniques like Huffman and Shannon-Fano coding, channel capacity, and mutual information calculations. The questions range from short answer definitions to longer problems involving constructing codes, drawing channel diagrams, and performing information-theoretic calculations.

Uploaded by

shivamjana40
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 4

AUTUMN MID SEMESTER EXAMINATION-2023

School of Computer Engineering


5th__ Semester
Subject: ITC ( EC 3064) (Regular )_Sample solution

Time: 1.5 hours Full Marks: 40


The figures in the right-hand side indicate full marks.
All parts of a question should be answered at one place only.

Questio Section Question Mark


n No -A s
Q1. Answer the following questions in short. [2x5]
Define the terms : Average mutual information, and Kraft inequality.
Solution :
 Average mutual information:

 Kraft inequality:

Questi Differentiate between lossless channel and noiseless channel.


on Solution :
Type  lossless channel:one nonzero element in each column
b (SAT)  noiseless channel: nonzero element in each row and in each
column
 With example

A DMS emits symbols x1 and x2 with probabilities 0.65 and 0.35


respectively. Find the code efficiency.

Solution :
code efficiency =93.3%
c

A voice grade channel of the telephone network has a bandwidth of


6 kHz. Calculate the channel capacity of the telephone channel for a
d
signal to noise ratio of 100.
Solution :

=39.95kHz

For a block code if the hamming distance is 9, then calculate how


many errors can be detected and corrected ?
Solution :

e

=s<= 8 and t<=4

A DMS ‘X’ emits five symbols A, B, C, D and E with probabilities


0.22, 0.25, 0.18, 0.15 and 0.2.
(i)Construct the Huffman code.
(ii)Construct the Shannon-Fano code.
Also compare its result in terms of code efficiency .

Solution :
 Both coding , ……………………………….……[5]
 Both code efficiency and comparison result……..[5]
 code efficiency = 2.29/2.33=98.2%

Q2. [10]
A DMS transmits three symbols with probabilities 0.15, 0.35 and 0.5
respectively. The channel has following channel matrix.
0.2 0.25 0.55
[P(Y/X)]=
0.4 0.5 0.10

0.45 0.35 0.2

i. Draw the channel diagram.


ii. Find H(Y).
iii. Find H(Y/X) .

Solution :
 channel diagram…………………………..…..[1]
 [P(X)],[P(Y)] and H(Y)…………………...….[4]
 [P(X,Y)], and H(Y/X)……………………..... .[5]

Q3. [10]

Define channel capacity per symbol.

Verify the expression,is it true or false ?


Cs= 1+p log2 p+(1-p) log2 (1-p)
Where Cs is the channel capacity of a binary symmetric channel.

Q4 Solution : [10]
 Defination and True……………………….………..[2]
 channel diagram ,[P(X)],[P(Y)] and H(Y)=1…..…[3]
 [P(X,Y)], H(Y/X) and I(X,Y)…………………….. .[5]
I(X,Y) =H(Y)- H(Y/X),
I(X,Y) =H(Y)+p log2 p+(1-p) log2 (1-p) ,
Cs
A binary symmetric channel is given with P(x1)=α and P(x2)=(1-α)
(i) Show that the mutual information I(X:Y) is given by
I(X:Y)= H(Y)+P log2 P+(1-P) log2 (1-P)
(ii) Calculate I(X:Y) for α=0.5 and P=0.1
Solution :
 channel diagram ,[P(X)],[P(Y)] and H(Y)=1…..…[4]
 [P(X,Y)], H(Y/X) and I(X,Y)…………………….. .[4]
 I(X,Y) =H(Y)- H(Y/X) =1-0.46=0.54…………...…[2]

Q5 [10]

You might also like