Signals and Systems: Lecture Notes by Mohamed-Yahia Dabbagh
Signals and Systems: Lecture Notes by Mohamed-Yahia Dabbagh
Lecture Notes
By
Mohamed-Yahia Dabbagh
2020
Note: All rights for these lecture notes are reserved by the author. The lecture notes are intended
for the exclusive use and learning purposes by teaching assistants and students who are enrolled
in the course ECE 207 at the University of Waterloo. Distribution of these lecture notes in any
form is not allowed.
© M.-Y. Dabbagh
Chapter 3
Time-Domain Analysis of Discrete-Time Systems
3.1 Introduction
Systems whose inputs and outputs are discrete-time signals are called discrete-
time (DT) systems. For example, digital circuits and digital computers are DT
systems.
Figure 1
Discrete-time signals can be naturally discrete such as census data and stock
prices. They are also obtained by sampling continuous-time (CT) signals such as
voice or image. There are several advantages in processing CT signals by DT
systems. This is achieved by converting the CT signal 𝑥(𝑡) to a DT signal 𝑥[𝑛]
which is processed by the DT system to produce the output signal 𝑦[𝑛] which is
converted to a CT signal 𝑦(𝑡). The conversion of a CT signal to a DT signal is
achieved by a system called a continuous-to-discrete (C/D) converter, also called
an analog-to-digital (A/D) converter. The conversion of a DT signal to a CT
Several DT systems are discussed where their system models are derived and their
realizations are shown.
This difference equation (DE) is the system model. It is in advance form since
the signals are in terms of the current or future time, here the time indices 𝑛 and
𝑛 + 1. The difference equation can be re-written differently by replacing 𝑛 by
(𝑛 − 1):
This is the difference equation in delay form since the signals are in terms of the
current or past time, here the time indices 𝑛 and 𝑛 − 1. As we will see later, the
advance form is more convenient for mathematical analysis while the delay form
is more convenient for system realization (in software or hardware).
Difference equations with constant coefficients can be realized using three basic
digital circuit elements: a time delay (D), a digital multiplier, and a digital adder.
The delay can be implemented using flip-flops.
For example, the last difference equation in delay form can be rewritten:
where 𝑎 = 1 + 𝑟
Figure 3
If 𝑥(𝑡) is slowly changing and T is relatively small, this can be approximated by:
1
𝑦[𝑛] ≅ [𝑥[𝑛] − 𝑥[𝑛 − 1]]
𝑇
𝑥[𝑛] 𝑦[𝑛]
+
- 1/𝑇
Figure 4
For small 𝑇:
𝑛
𝑦[𝑛] = 𝑇 ∑ 𝑥[𝑘]
𝑘=−∞
This difference equation is in non-recursive form since it involve the current value
of 𝑦[𝑛] only. This form is not easy to implement since it involves the storage of
all current and past values of 𝑥[𝑛]. The last equation can be re-written as:
𝑛−1
𝑥[𝑛] 𝑦[𝑛]
T +
Figure 5
𝑑𝑦
A CT system described by the differential equation + 𝑎𝑦(𝑡) = 𝑥(𝑡) an be
𝑑𝑡
𝑦[𝑛] − 𝑦[𝑛 − 1]
lim + 𝑎𝑦[𝑛] = 𝑥[𝑛]
𝑇→0 𝑇
For small 𝑇:
1 + 𝑎𝑇 1
𝑦[𝑛] − 𝑦[𝑛 − 1] = 𝑥[𝑛]
𝑇 𝑇
or
−1 𝑇
where 𝛼 = and 𝛽 = . This is a first order difference equation with
1+𝑎𝑇 1+𝑎𝑇
constant coefficients.
Remark: From above examples, we notice that all of them are described by
difference equations with constant coefficients. Most practical systems are of this
class. Therefore, in this course, this class of systems is considered.
The properties of linearity, time-invariance, and causality for DT systems are the
same as for CT systems.
Examples:
𝑦[𝑛 + 1] + ⏟ [𝑛 + 2] ⏟
𝑛 𝑦[𝑛] = 𝑥 ⏟ . 𝑥[𝑛]
time non non−
varying causal linear
This last system is a 2nd order difference equation (DE) with constant coefficients
which is LTI and causal.
𝑦[𝑛 + 2] + 𝑦[𝑛] = ⏟
⏟ 𝑥[𝑛 + 2] + 𝑥[𝑛 + 1]
order 𝑁=2 order 𝑀=2
So, the order of the system is 𝑀 = 𝑁 = 2. This system is LTI and causal.
A large class of practical LTI systems are described by difference equations (DEs)
with constant coefficients. The general difference equation in advance form is
given by:
Remark: Some of the coefficients can be zero. However, if 𝑎0 and 𝑏0 are both
zero at the same time, then the time index 𝑛 can be replaced by 𝑛 − 1 which results
in a DE with order (𝑁 − 1) and at least one non-zero new coefficients 𝑎0 and 𝑏0 .
This means the terms of 𝑦[𝑛] or 𝑥[𝑛] or both must exist for the equation to be in
standard form.
𝐸𝑥[𝑛] = 𝑥[𝑛 + 1]
𝐸 2 𝑥[𝑛] = 𝑥[𝑛 + 2]
𝐸 𝑁 𝑥[𝑛] = 𝑥[𝑛 + 𝑁]
Using the E-operator, the general difference equation can be rewritten as:
or
𝑄(𝐸)𝑦[𝑛] = 𝑃(𝐸)𝑥[𝑛]
where
Remark: There are two causes for the system response 𝑦[𝑛], namely the
existence of initial conditions (ICs) and the application of the input 𝑥[𝑛]. Since
the system is linear, the total system response can be written as:
where
𝑦𝑧𝑖 [𝑛] = Zero-input response due to IC’s only (with 𝑥[𝑛] = 0, for all n)
Remark: There are two methods for solving the DE (finding 𝑦[𝑛]):
Solution:
1
𝑦[𝑛] = − 𝑦[𝑛 − 1] + 𝑥[𝑛 − 1]
2
Compute 𝑦[𝑛] point-by-point by iteration:
0
1 ⏞ 1 1
𝑛 = 0 ⇒ 𝑦[0] = − 𝑦[−1] + 𝑥[−1] =− −0=−
2 2 2
1 1 1 1
𝑛 = 1 ⇒ 𝑦[1] = − 𝑦[0] + 𝑥[0] = − (− ) + 0 =
2 2 2 4
1 1 7 25
𝑛=3 ⇒ 𝑦[3] = − 𝑦[2] + 𝑥[2] = − ( ) + 2 =
2 2 8 16
25/16
𝑦[𝑛]
1 7/8
1/4
…
-1 0 1 2 3 n
-1/2
Figure 6
Remark: Iterative solution is useful for computer computation or for finding few
initial values {𝑦[0], 𝑦[1], ⋯ }. It is difficult to apply for large values of 𝑛, say
finding 𝑦[1000] by hand computation without a computer. The other major
disadvantage is that it does not reveal the behavior of the system, such as the
stability of the system.
where
𝑦𝑧𝑖 [𝑛] = Zero-input response due to ICs only (with 𝑥[𝑛] = 0, for all n)
𝑦𝑧𝑠 [𝑛] = Zero-state response due to the input 𝑥[𝑛], 𝑛 ≥ 0 (with ICs=0)
Given the DT system 𝑄(𝐸)𝑦[𝑛] = 𝑃(𝐸)𝑥[𝑛], the zero-input response 𝑦𝑧𝑖 [𝑛] is
the system response due to non-zero initial conditions with 𝑥[𝑛] = 0 for all n, i.e.
or
𝑦𝑧𝑖 [𝑛] = 𝐶𝑟 𝑛
(𝑟 𝑁 + 𝑎𝑁−1 𝑟 𝑁−1 + ⋯ + 𝑎1 𝑟 + 𝑎0 ) 𝐶
⏟ 𝑟⏟𝑛 = 0
≠0 ≠0
This is the characteristic equation that can be factored in the product form:
𝑄(𝑟) = (𝑟 − 𝑟1 )(𝑟 − 𝑟2 ) ⋯ (𝑟 − 𝑟𝑁 ) = 0
When the roots {𝑟1 , 𝑟2 , ⋯ , 𝑟𝑁 } are distinct, the characteristic modes of the system
are {𝑟1𝑛 , 𝑟2𝑛 , ⋯ , 𝑟𝑁𝑛 }. The system has 𝑁 possible solutions, and the sum is the
general solution:
{𝑟𝑖𝑛 , 𝑛𝑟𝑖𝑛 , 𝑛2 𝑟𝑖𝑛 , ⋯ , 𝑛𝑚−1 𝑟𝑖𝑛 }, and the general solution for this root is:
For real systems (real coefficients of DE), complex roots occur in pairs of
conjugate; i.e. if 𝑟1 = 𝛼 + 𝑗𝛽 = |𝑟|𝑒 𝑗Ω is a root of the system, then 𝑟2 = 𝑟1∗ =
𝛼 − 𝑗𝛽 = |𝑟|𝑒 −𝑗Ω is also a root. For these two distinct roots, the solution is:
Also, for real systems, 𝑦𝑧𝑖 [𝑛] must be real, for which the constants 𝐶1 and 𝐶2
𝐶 𝐶
must be complex conjugates, i.e. if 𝐶1 = 𝑒 𝑗𝜃 , then 𝐶2 = 𝐶1∗ = 𝑒 −𝑗𝜃 . And,
2 2
above complex form of the solution can be written in the real form:
Solution:
To find the constants 𝐶1 and 𝐶2 we compute 𝑦[0] and 𝑦[1] from the system
equation, iteratively:
𝑦𝑧𝑖 [0] = 𝐶1 + 𝐶2 = −1
1 6
⇒ 𝑦𝑧𝑖 [𝑛] = [− (0.2)𝑛 − (−0.5)𝑛 ] 𝑢[𝑛]
7 7
Remark: The initial conditions 𝒚[−𝟏] and 𝒚[−𝟐] are given on the total
response. However, the zero-state response 𝒚𝒛𝒔 [𝒏] = 𝟎 for 𝒏 < 𝟎 since 𝒙[𝒏] =
𝟎 for 𝒏 < 𝟎. Therefore, we have 𝒚[−𝟏] = 𝒚𝒛𝒊 [−𝟏] and 𝒚[−𝟐] = 𝒚𝒛𝒊 [−𝟐].
So, the constants 𝑪𝟏 and 𝑪𝟐 can be found from 𝒚𝒛𝒊 [𝒏] equation by setting
𝒏 = −𝟏 and 𝒏 = −𝟐, and ignoring 𝒖[𝒏]:
1 6
Solution of these equations gives {𝐶1 = − , 𝐶2 = − } which are the same as we
7 7
Solution:
Roots: 𝑟1 = 𝑟2 = 2 (repeated)
Compute 𝐶1 and 𝐶2 :
Solution:
𝜋
⇒ 𝑦𝑧𝑖 [𝑛] = 𝐶(2)𝑛 cos ( 𝑛 + 𝜃) 𝑢[𝑛]
2
To find 𝐶 and 𝜃, compute 𝑦[0] and 𝑦[1] first from the system equation by
iteration:
𝑛 = −2 ⇒ 𝑦[0] = −4 𝑦[−2]
⏟ + 2 𝑥[−2]
⏟ = −4
1 0
𝑛 = −1 ⇒ 𝑦[1] = −4 𝑦[−1]
⏟ + 2 𝑥[−1]
⏟ =0
0 0
𝜋
𝑦[0] = 𝑦𝑧𝑖 [0] = 𝐶(2)0 cos ( 0 + 𝜃) = 𝐶 cos(𝜃) = −4
2
𝜋
⇒ 𝑦𝑧𝑖 [𝑛] = [−4(2)𝑛 cos ( 𝑛)] 𝑢[𝑛]
2
𝑄(𝐸)𝑦[𝑛] = 𝑃(𝐸)𝑥[𝑛]
The unit impulse response ℎ[𝑛] is the sytem response when the input is 𝑥[𝑛] =
𝛿[𝑛] with all initial conditions are zero (system at rest), that is 𝑦[𝑛] = ℎ[𝑛] when
𝑥[𝑛] = 𝛿[𝑛]:
𝑄(𝐸)ℎ[𝑛] = 𝑃(𝐸)𝛿[𝑛]
Find ℎ[𝑛]?
Solution:
Write the system equation in delay form and set 𝑥[𝑛] = 𝛿[𝑛] and 𝑦[𝑛] = ℎ[𝑛]:
Remark: Iterative solution is tedious and does not reveal the behavior of ℎ[𝑛].
We have 𝑥[𝑛] = 𝛿[𝑛] ⇒ 𝑦[𝑛] = ℎ[𝑛]. Since 𝑥[𝑛] = 0 for 𝑛 > 0, then ℎ[𝑛]
contains characteristic modes for 𝑛 > 0. At 𝑛 = 0, ℎ[𝑛] may have 𝛿[𝑛]
component, i.e.
where 𝑦𝑐 [𝑛] is the linear combination of the characteristic modes of the system
with N unknown coefficients {𝑐1 , 𝑐2 , ⋯ , 𝑐𝑁 } in 𝑦𝑐 [𝑛].
𝑏0
Remark: It is shown in the textbook that 𝐴0 = where 𝑎0 is the coefficient of
𝑎0
𝑏0
ℎ[𝑛] = 𝛿[𝑛] + 𝑦𝑐 [𝑛]𝑢[𝑛]
𝑎0
Solution:
Roots: 𝑟1 = 𝑟2 = 1 (repeated)
Find new ICs iteratively using ℎ[−1] = ⋯ = ℎ[−𝑁] = 0. From the system
equation with 𝑥[𝑛] = 𝛿[𝑛] → 𝑦[𝑛] = ℎ[𝑛]:
ℎ[0] = 2 ℎ[−1]
⏟ − ℎ[−2]
⏟ + 3 𝛿[0]
⏟ + 2 𝛿[−2]
⏟ =3
0 0 1 0
ℎ[1] = 2 ℎ[0]
⏟ − ℎ[−1]
⏟ + 3 𝛿[1]
⏟ + 2 𝛿[−1]
⏟ =6
3 0 0 0
ℎ[2] = 2 ℎ[1]
⏟ − ℎ[0]
⏟ + 3 𝛿[2]
⏟ + 2 𝛿[0]
⏟ = 11
6 3 0 1
𝑐1 = 1
ℎ[0] = 3 = 𝐴0 + 𝑐1
𝑐2 = 5
ℎ[1] = 6 = 𝑐1 + 𝑐2 } ⇒ 𝑏0
ℎ[2] = 11 = 𝑐1 + 2𝑐2 𝐴0 = 2 =
{ 𝑎0
𝑏0
If 𝑎0 = 0, then the coefficient 𝐴0 = in the relation for ℎ[𝑛] does not apply.
𝑎0
Similarly, if 𝑎0 = 𝑎1 = 0, then:
Substituting in 𝑦[𝑛]:
𝑦[𝑛] = ∑ 𝑥[𝑚] ⏟
𝑆{𝛿[𝑛 − 𝑚]}
𝑚=−∞ ℎ[𝑛−𝑚]
This is the convolution sum for DT systems, similar to the convolution integral
for CT systems. It is valid for all 𝑛 ( −∞ < 𝑛 < +∞).
Remark: Properties of the convolution sum are similar to the convolution integral.
Example: Let 𝑥1 [𝑛] = 𝑟1𝑛 𝑢[𝑛] and 𝑥2 [𝑛] = 𝑟2𝑛 𝑢[𝑛], where 𝑟2 ≠ 𝑟1 . Find the
convolution 𝑥1 ∗ 𝑥2 ?
Solution:
∞ ∞
For 𝑛 < 0: 𝑥1 ∗ 𝑥2 = 0
For 𝑛 ≥ 0:
𝑛 𝑛
𝑟1 𝑚
𝑥1 ∗ 𝑥2 = ∑ 𝑟1𝑚 . 𝑟2𝑛−𝑚 = 𝑟2𝑛 ∑( )
𝑟2
𝑚=0 ⏟
𝑚=0
geometric sum
𝑧 𝑛+1 −1
Using the geometric sum formula ∑𝑛𝑚=0 𝑧 𝑚 = , 𝑧 ≠ 1 gives:
𝑧−1
𝑟 𝑛+1
(𝑟1 ) −1 1
𝑛 2
𝑥1 ∗ 𝑥2 = 𝑟2 𝑟1 = (𝑟1 𝑛+1 − 𝑟2 𝑛+1 ), 𝑛≥0
(𝑟 ) − 1 𝑟1 − 𝑟2
2
1
⇒ 𝑥1 ∗ 𝑥2 = (𝑟 𝑛+1 − 𝑟2 𝑛+1 )𝑢[𝑛]
𝑟1 − 𝑟2 1
Find the output 𝑦[𝑛], 𝑛 ≥ 0 when 𝑦[−1] = −1, 𝑦[−2] = 1, and 𝑥[𝑛] = 𝑢[𝑛].
Solution:
𝑄(𝑟) = 𝑟 2 − 2𝑟 + 1 = (𝑟 − 1)2 = 0
𝑛 𝑛
=2+ ∑ 1+5 ∑ 𝑚
⏟
𝑚=0 ⏟
𝑚=0
𝑛+1 𝑛(𝑛+1)/2
5
⟹ 𝑦𝑧𝑠 [𝑛] = {2 + (𝑛 + 1) + 𝑛(𝑛 + 1)} 𝑢[𝑛]
2
5
𝑦[𝑛] = (−3 − 2𝑛)𝑢[𝑛] + {2 + (𝑛 + 1) + 𝑛(𝑛 + 1)} 𝑢[𝑛]
2
3 5
⟹ 𝑦[𝑛] = ( 𝑛 + 𝑛2 ) 𝑢[𝑛]
2 2
(See example 3.21 in textbook for using the convolution Table 3.1).
then
𝑔[𝑛] = ∑ ℎ[𝑚]
𝑚=−∞
Proof: From
∞ 𝑛
⇒ 𝑔[𝑛] = ∑ ℎ[𝑚] ⏟
𝑢[𝑛 − 𝑚] = ∑ ℎ[𝑚]
𝑚=−∞ 1, 𝑚≤𝑛 𝑚=−∞
={0, 𝑚>𝑛
= ∑𝑛−1 𝑛−1
𝑚=−∞ ℎ[𝑚] + ℎ[𝑛] − ∑𝑚=−∞ ℎ[𝑚] = ℎ[𝑛]
Let the input be the everlasting exponential 𝑥[𝑛] = 𝑧 𝑛 , −∞ < 𝑛 < ∞ where 𝑧
is a complex constant. The output is given by:
∞ ∞
⇒ 𝑦[𝑛] = 𝐻(𝑧)𝑧 𝑛
The function 𝐻(𝑧) is called the transfer function of the system. For a given value
of 𝑧, 𝐻(𝑧) is a constant, not a function of time 𝑛. Therefore, the output 𝑦[𝑛]
is also an everlasting exponential, i.e.
𝑄(𝐸)𝑦[𝑛] = 𝑃(𝐸)𝑥[𝑛]
𝑃(𝑧)
𝐻(𝑧) =
𝑄(𝑧)
Similar to CT systems.
Parallel Connection:
ℎ1 [𝑛]
𝑥[𝑛] 𝑦[𝑛]
+
ℎ2 [𝑛]
Figure 7
Cascade Connection:
𝑥[𝑛] 𝑦[𝑛]
ℎ1 [𝑛] ℎ2 [𝑛]
Figure 8
(3) The system is marginally stable (MS) if some modes are bounded, while the
remaining modes → 0 as 𝑡 → ∞.
𝑟1 , 𝑟2 , ⋯ , 𝑟𝑁 (Complex in general)
0 if |𝑟𝑖 | < 1
lim |𝑟𝑖𝑛 | = lim |𝑟𝑖 |𝑛 |𝑒
⏟
𝑗𝛽𝑛
| = lim |𝑟𝑖 |𝑛 = {
𝑛→∞ 𝑛→∞ 𝑛→∞ ∞ if |𝑟𝑖 | > 1
=1
This is also valid for the repeated modes 𝑛𝑘 𝑟𝑖𝑛 . Therefore, we conclude:
lim |𝑛𝑘 𝑟𝑖𝑛 | = lim |𝑛|𝑘 |𝑟𝑖 |𝑛 = lim |𝑛|𝑘 (1)𝑛 = lim |𝑛|𝑘 → ∞
𝑛→∞ 𝑛→∞ 𝑛→∞ 𝑛→∞
Therefore, we conclude:
System is marginally stable (MS) if for some roots |𝑟𝑖 | = 1 and unrepeated,
while the remaining roots are inside the unit circle, i.e. |𝑟𝑖 | < 1.
𝐼𝑚(𝑟𝑖 )
j Unstable
xx
x
x xx
x x xx
x x x x
-1 xx 1 𝑅𝑒(𝑟𝑖 )
x x xx
AS x
Unstable x
xx
-j Unstable
MS
Figure 9
⟹ System is AS since |𝑟1 | < 1 and |𝑟2 | < 1 (inside the unit circle)
Example:
Roots: 𝑟1 = 0.5, 𝑟2 = −2
Example: (Oscillator)
1 √3 1 √3
𝑄(𝑟) = 𝑟 2 − 𝑟 + 1 = (𝑟 − − 𝑗 ) (𝑟 − + 𝑗 )
2 2 2 2
𝜋
1 √3 ±𝑗
Roots: 𝑟1 , 𝑟2 = ± 𝑗 = 1𝑒 3 (complex on the unit circle)
2 2
∞ ∞
|𝑦[𝑛]| ≤ 𝐾1 ∑ |ℎ[𝑚]|
𝑚=−∞
∑ |ℎ[𝑚]| ≤ 𝐾2 < ∞
𝑚=−∞
Remark: The relationships between asymptotic stability and BIBO stability for
DT systems are similar to CT systems:
Example:
∞ ∞ ∞
∞ ∞
1 1
= ∑ (0.2)𝑛 + ∑ (0.8)𝑛 = + = 6.25
1 − 0.2 1 − 0.8
𝑛=0 𝑛=0
Example: (Oscillator)
∞
𝜋
ℎ[𝑛] = 6 cos ( 𝑛) 𝑢[𝑛] ⇒ ∑ |ℎ[𝑛]| → ∞
3
𝑛=−∞
𝜋
Bad input: 𝑥[𝑛] = 𝑐 cos ( 𝑛) 𝑢[𝑛]
3
(External resonance: The output is unbounded even though the input is bounded)