Sma 460
Sma 460
Pn (t ) = −λ n Pn (t ) + λ n −1 Pn −1 (t ) , n ≥ 1
'
and
P0 (t ) = − λ0 P0 (t ) , n=0
'
i. λ n = nλ (2 marks)
1 + an
ii. λn = λ (2 marks)
1 + λ at
b) Define the following terms as used in Markov chains:
i. Persistent state.
ii. Transient state
iii. Ergodic markov chain (6 marks)
d) Let X and Y be two independent random variables with probability generating functions
(P.g.f) PX ( s ) and PY ( s) respectively. Find the p.g.f of the random variable Z = X − Y
(4 marks)
e) A markov chain whose states are has the following transition probability matrix. Classify the
states.
1 1
0 2 2
1 1
P= 0 (8 marks)
2 2
1 1
0
2 2
QUESTION TWO
a) Given the difference, differential equations for a Poisson process are:
Pn (t ) = −λPn (t ) + λPn −1 (t ) , n ≥ 1
'
and
P0 (t ) = − λP0 (t ) , n=0
'
Use Feller’s method to determine the mean and variance of this process, given the initial
conditions are Pn (0) = 1 for n = 0 and zero otherwise. (11 marks)
1 − a a
P= , 0 < a,b < 1
b 1 − b
Obtain the stationary distribution. (9 marks)
QUESTION THREE
a) Define the following terms :
i. Stochastic matrix. (2 marks)
ii. An irreducible markov chain (3 marks)
and
P0 (t ) = 0 , n=0
'
Given the initial conditions are Pn (0) = 1 when n = 1 and zero otherwise.
Show by the generating function method, that the solution of the equation is given by
Pn (t ) = e − λt (1 − e − λt ) n −1 , n ≥ 1 (14 marks)
b) Using probability generating function of the distribution in (a) show that the mean and
variance are e λt and e λt (e λt − 1) respectively. (6 marks)
QUESTION FIVE
Obtain
i. the bivariate probability generating function of X and Y. (3 marks)