Chapter 3 Analysis of Linear Time Invariant Systems(Complete)-Updated
Chapter 3 Analysis of Linear Time Invariant Systems(Complete)-Updated
3.1. Introduction
In this chapter, we will focus on understanding the behaviour of linear time-invariant (LTI)
systems. As we have established in chapter 2, linearity and time-invariance properties provide
a nice way to understand the input-output relationship of system. Detail description of these
systems (both discrete time and continuous time) is done in this chapter. We will begin by
describing discrete-time LTI system and then finally conclude with continuous-time LTI
systems.
Considering an arbitrary signal x[n]. Recall from the shifting property of the impulse function
that.
∞
𝑥[𝑛] = ∑ 𝑥[𝑘]δ[𝑛 − 𝑘]
𝑘=−∞
i.e., x[n] can be written as a superposition of scaled and shifted impulse functions. Since the
system is time-invariant, the response of the system to the input δ[𝑛 − 𝑘] is h[𝑛 − 𝑘] . yy
linearity (and specifically the scaling property), the response to 𝑥[𝑘]δ[𝑛 − 𝑘] is 𝑥[𝑘]δ[𝑛 − 𝑘].
yy the additivity property, the response to:
∑ 𝑥[𝑘]δ[𝑛 − 𝑘]
𝑘=−∞
Is then,
∞
𝑦[𝑛] = ∑ 𝑥[𝑘]h[𝑛 − 𝑘]
𝑘=−∞
1|Pa ge
The above is called the convolution sum: the convolution of the signals x[n] and h[n] is
denoted by:
∞
Thus, we have the following very important property of discrete-time LTI systems:
If x[n] is the input signal to an LTI system, and h[n] is the impulse response of the system, then
the output of the system is given as:
Example:
Consider an LTI system with impulse response:
1 𝑖𝑓 0 ≤ 𝑛 ≤ 3
ℎ [𝑛 ] = {
0 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒
Suppose the input signal is:
1 𝑖𝑓 0 ≤ 𝑛 ≤ 3
𝑥 [𝑛 ] = {
0 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒
Then we have:
∞
𝑦[𝑛] = ∑ 𝑥[𝑘]h[𝑛 − 𝑘]
𝑘=0
When n = 1, we have:
2|Pa ge
1
Similarly:
y[2] = 3; y[3] = 4; y[4] = 3; y[5] = 2; y[6] = 1; and y[n] = 0 for n ≥ 7
Example:
Consider an LTI system with unique response h[n] = u[n]. Suppose the input signal is x[n] =
αnu[n] with 0 < α < 1. Then we have:
∞
Since both x[k] = 0 for k < 0 and h[n – k]n= 0 for k > n, we have:
n n
1 − α𝑛+1
𝑦[𝑛] = ∑ 𝑥[𝑘]h[𝑛 − 𝑘] = ∑ α𝑘 =
1−α
𝑘=0 𝑘=0
ꝏ
𝑦(𝑡) = ∫ 𝑥(𝜏)𝛿(𝑡 − 𝜏)𝑑𝜏
−ꝏ
The expression on the right-hand side is a superposition of scaled and shifted impulse functions. Thus,
when this signal is applied to an LTI system, the output will be a superposition of scaled and shifted
impulse responses. More specifically, if h(t) is the output of the system when the input is x(t) = 𝛿 (t),
then the output for a general input x(t) is given by:
3|Pa ge
ꝏ
𝑦(𝑡) = ∫ 𝑥(𝜏)ℎ(𝑡 − 𝜏)𝑑𝜏
−ꝏ
Example 1
Suppose 𝑥(𝑡) = 𝑒 −αt u(t) with α ∈ R >0 and ℎ(𝑡) = 𝑢(𝑡) hhnn thn uutuut u thn Th
systnm with imuulsn rnsuunsn h(t) is givnn as:
ꝏ
𝑦(𝑡) = 𝑥 (𝑡) ∗ ℎ(𝑡) = ∫ 𝑥 (𝜏)ℎ(𝑡 − 𝜏)𝑑𝜏
−ꝏ
ꝏ
= ∫ 𝑒−α𝜏 u(𝜏)ℎ(𝑡 − 𝜏)𝑑𝜏
−ꝏ
𝑡
= ∫ 𝑒−α𝜏 𝑑𝜏
0
1
(1 − 𝑒 −α𝑡 ) 𝑖𝑓 𝑡 ≥ 0
𝑦(𝑡) = { α
0 𝑖𝑓 𝑡 < 0
Example 2
Cunsidnr thn signals:
1 𝑖𝑓 0 < 𝑡 < 𝑇 𝑡 𝑖𝑓 0 < 𝑡 < 2𝑇
𝑥(𝑡) = { , ℎ(𝑡) = {
0 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒 0 𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒
Where T > 0 is some constant. The convolution of these signals is easiest to do graphically
and by considering different regions of the variable t. The results are:
0 𝑡<0
1 2
𝑡 0<𝑡<𝑇
𝑦(𝑡) = 2
1
𝑇𝑡 − 𝑇 2 𝑇 < 𝑡 < 2𝑇
{ 2
4|Pa ge
1 3
− 𝑡 2 + 𝑇𝑡 + 2 𝑇 2 2𝑇 < 𝑡 < 3𝑇
𝑦(𝑡) = { 2
0 𝑡 > 3𝑇
𝑟 = 𝑛−𝑘
This gives:
∞ ∞
The same holds for continuous-time convolution. Thus, it does not matter which of the
signals we choose to flip and shift in the convolution operation.
The distributive property has implications for LTI systems connected in parallel:
5|Pa ge
Figure 3.1(a). Parallel Connection (distributive property)
Let h1[n] be the impulse response of system 1, and let h2[n] be the impulse response of system 2.
Then we have:
The above expression indicates that the parallel interconnection can equivalently be viewed as x[n]
passing through a single system whose impulse response is ℎ1 [𝑛] + ℎ2 [𝑛]
In other words, it does not matter which order we do the convolutions. The above relationships can be
proved by manipulating the summations (or integrals).
6|Pa ge
Just as the distributive property had implications for parallel interconnections of systems, the associative
property has implications for serios interconnections of systems. Specifically, consider the series
interconnection in figure 3.2, we have:
𝑦[𝑛] = 𝑦1 [𝑛] ∗ ℎ2 [𝑛] = (𝑥[𝑛] ∗ ℎ1 [𝑛]) ∗ ℎ2 [𝑛] = 𝑥[𝑛] ∗ (ℎ1 [𝑛] ∗ ℎ2 [𝑛])
Thus, the series interconnection is equivalent to a single system with impulse response ℎ1 [𝑛] ∗ ℎ2 [𝑛],
as shown in figure 3.2(b)
In addition, note that since ℎ1 [𝑛] ∗ ℎ2 [𝑛] = ℎ2 [𝑛] ∗ ℎ1 [𝑛] , we can also interchange the order of the
systems in the series interconnection as shown in figure 3.3.(c), without changing the overall input-
output relationship between x[n] and y[n].
We see that y[n] will depend on a value of the input signal other than at time-step n unless h[k] = 0 for
k ≠ 0. In order words, for an LTI system to be memoryless, we require h[n] = K δ[n] for some constant
K. Similarly, a continuous-time LTI system is memoryless if and only if h(t) = K δ(t)
7|Pa ge
3.4.5. Invertibility Property
Consider an LTI system with impulse response h[n] (or h(t)). Recall (in chapter 2), a system is said to
be invertible if the output of the system uniquely specifies the input. If a system is invertible, there is
another system (known as the inverse system) that takes the output of the original system and outputs
the input to the original system as shown in figure 3.4.
In other words, if we have an LTI system with impulse response h[n], and another LTI system with impulse
response hI[n] such that ℎ[𝑛] ∗ ℎ𝐼 [𝑛] = δ[n], then those systems are inverse of each other. This analogous
statement holds in continuous-time as well.
Example
Consider the LTI system with impulse response ℎ[𝑛] = αn u[n]. nne can verify that this impulse
response corresponds to the system:
8|Pa ge
ℎ𝐼 [𝑛] = δ[n] − αδ[n − 1]
We have:
ℎ[𝑛] ∗ ℎ𝐼 [𝑛] = αn u[n] ∗ (δ[n] − αδ[n − 1])
= αn δ[n]
= δ[n]
Thus, the system with impulse response hI[n] is the inverse of the system with impulse response h[n]
Where the second expression follows from the commutative property of the convolution. In order for
y[n] to not depend on x[n +1], x[n + 2],….., we see that h[k] must be zero for k < 0. The same theory
applies for continuous-time systems; hence we can consider a continuous-time LTI systems to be
casual if and only if its impulse response h(t) is zero for all t < 0. A discrete-time LTI system is causal
if and only if its impulse response h[n] is zero for all n < 0.
𝑦[𝑛] = ∑ 𝑥[𝑘]ℎ[𝑛 − 𝑘]
𝑘=−∞
Note that:
∞ ∞
= ∑ |𝑥[𝑘]||ℎ[𝑛 − 𝑘]|
𝑘=−∞
Now suppose that x[n] is bounded, i.e., there exists some B ∈ R ≥0 such that |𝑥[𝑛]| ≤ 𝐵 for all n ∈
Z . Then the above expression becomes:
9|Pa ge
∞
Thus if ∑∞
𝑘=−∞ |ℎ[𝑛 − 𝑘 ]| < ∞ (which means that h[n] is absolutely summable), then |y[n]| will
also be bounded for all n. it turns out that this is necessary condition as well: if ∑∞
𝑘=−∞ |ℎ[𝑛 − 𝑘]| = ∞
Then there is a bounded input that causes the output to be bounded. This same condition applies for
continuous-time signals as well. Thus, in summary we can:
ꝏ
A continuous-tie LTI system is stable if and only if ∫−ꝏ |𝒉(𝝉)|𝒅𝝉 < ∞
Example
Consider the system with impulse response ℎ[𝑛] = αn u[n] where α ∈ R. We have
1
𝑖𝑓 |α| < 1
∑∞ ∞ k
𝑘=−∞ |ℎ[𝑘 ]| = ∑𝑘=0 |α| = {
1−|α|
∞ 𝑖𝑓 |α| ≥ 1
Thus, the system is stable if and only if |α| < 1
Similarly, consider the continuous-time LTI system with impulse response ℎ(𝑡) = 𝑒αt u(t) where α ∈
R. We have
1
ꝏ ꝏ −α 𝑖𝑓 α < 0
∫−ꝏ |ℎ(𝜏)|𝑑𝜏 = ∫−ꝏ 𝑒α𝜏 |𝑑𝜏 = {
∞ 𝑖𝑓 α ≥ 0
Thus, the system is stable if and only if α < 0
∞ ∞ n
This is equivalent to 𝑠 [𝑛] = 𝑠[𝑛 − 1] + ℎ[𝑛]. Thus, the step response of a discrete-time LTI
system is the running sum of the impulse response.
10 | P a g e
ꝏ ꝏ 𝑡
𝑠 (𝑡) = ∫ 𝑢 (𝜏)ℎ(𝑡 − 𝜏)𝑑𝜏 = ∫ 𝑢 (𝑡 − 𝜏)ℎ(𝜏)𝑑𝜏 = ∫ ℎ(𝜏)𝑑𝜏
−ꝏ −ꝏ −ꝏ
3.4. Differential and Difference Equation Models for Casual LTI Systems
As earlier established above, many systems can be described using differential equation (for continuous-
time systems) or difference-equation (in discrete-time) models, capturing the relationship between the
input and the output. For example, for a vehicle with velocity v(t) and input acceleration a(t), we have:
𝑑𝑣
= 𝑎(𝑡)
𝑑𝑡
If we include wind resistance or friction (which produces a force that is proportional to the velocity in
the opposite direction of travel), we will have:
𝑑𝑣
= −αv(t) + 𝑎(𝑡)
𝑑𝑡
Where α > 0 is the coefficient of friction. Similarly, given an RC circuit, if we define the voltage across
the capacitor as the output, and the source voltage as the input, then the input and output are again
related via a differential equation of the above form.
In discrete-time, consider a bank-account where earnings are deposited at the end of each month. Let
the amount in the account at the end of the month n be denoted by s[n]. Then we will have:
Since such differential and difference equations play a fundamental role in analysis of LTI systems, it
is vital we review some methods that can be used to solve such equations.
Where: 𝑦𝑝 (𝑡) is a particular solution to the above equation, and 𝑦ℎ (𝑡) is a homogeneous solution
satisfying the differential equation:
𝑑𝑦ℎ
+ 2𝑦ℎ (𝑡) = 0
𝑑𝑡
The above differential equation is called the homogeneous as it has no driving function x(t).
Let us first solve the homogeneous equation. For equations of this form (where a sum of derivatives of
𝑦ℎ (𝑡) have to sum to zero), a reasonable guess would be that takes 𝑦ℎ (𝑡) the form:
𝑦ℎ (𝑡) = 𝐴𝑒 𝑚𝑡
not been determined yet, hence in order to do so, we need more information about the solutions to
differential equation, typically in the form of initial conditions. For example, if we know that the system
is at rest until an input is applied, we will have: y(t) = 0 for t < 0. Suppose we are given the initial
condition y(0) = 0. Then:
𝐾
𝑦(0) = 𝐴 + =0
5
𝐾
𝐴=−5
12 | P a g e
𝐾
𝑦(𝑡) = 5 (𝑒 3𝑡 − 𝑒 −2𝑡 ) 𝑢(𝑡)
The above example illustrates the general approach to solving linear differential equations of the
form:
𝑁 𝑀
𝑑𝑘 𝑦 𝑑𝑘 𝑥
∑ 𝑎𝑘 𝑘 = ∑ 𝑏𝑘 𝑘
𝑑𝑡 𝑑𝑡
𝑘=0 𝑘=0
yy hypothesizing that 𝑦ℎ (𝑡) = 𝐴𝑒 𝑚𝑡 for some 𝒎 ∈ C. If there are N different values of m, denoted as
m1, m2, ……., mN for which the proposed form holds, then we take the homogeneous solution to be:
Example
Consider the differential equation:
𝑦ℎ′′ (𝑡) + 𝑦ℎ′ (𝑡) − 6𝑦ℎ (𝑡) = 𝑥 ′ (𝑡) + 𝑥(𝑡)
Where:
𝑥 (𝑡) = 𝑒 4𝑡 𝑢(𝑡)
𝑚 2 𝐴𝑒 𝑚𝑡 + 𝑚𝐴𝑒 𝑚𝑡 − 6𝐴𝑒 𝑚𝑡 = 0
𝑚2 + 𝑚 − 6 = 0
This yields m= -3 or m=2. Thus, the homogeneous solution is of the form:
𝑦ℎ (𝑡) = 𝐴1 𝑒 −3𝑡 + 𝐴2 𝑒 2𝑡
13 | P a g e