7.1 Solving Linear Differential Equations
7.1 Solving Linear Differential Equations
where and represent, respectively, the system input and output signals,
and are constant coefficients.
assumed to be known. The reason for specifying the system initial conditions at
instead of at is twofold. Firstly, we have to be able to find the
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–1
system impulse response due to the impulse delta signal located at the time origin,
the impulse delta signal within the integration limits. Secondly, the system zero-
input response is contributed by the system initial conditions that are present in the
system before the input is applied to the system. Assuming that the initial time at
which the system input is applied is , the system initial conditions must be
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–2
The homogeneous solution satisfies the corresponding homogeneous differential
The particular solution is any solution that satisfies the given differential equation
Homogeneous Solution
) are called the system characteristic values. The characteristic values are
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–3
also known under the name system eigenvalues.
Let us first assume that the solutions of the characteristic equation are distinct,
that is
! "
solution given by
system initial conditions in the manner explained later on in this section. It can be
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–4
shown that the form of the given homogeneous solution guarantees the existence
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–5
Note that a pair of complex characteristic values, say 89;: , represents
two distinct characteristic values. Hence, we can use the previously given formula
However, this solution can be further simplified by using Euler’s formula and
determining the constants 8 and : from the initial conditions. Since <
is a real function of time, its final expression can not contain complex numbers. In
response so that we must obtain sine and cosine functions in the final expression
for < . That is why, a more convenient form for the homogeneous solution in
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–6
Example 7.2: The homogeneous linear differential equation given below has
that is
L
solution is given by
M L O6P
N O6P
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–7
In the case when we have a multiple root, say the characteristic value Q has
multiplicity , and the remaining characteristic values are distinct, the homogeneous
d d] Q ]d UfegV S U e V S ]d UhegV Q U e V Q X e[
shown that the chosen form for R facilitates the existence of unique coefficients
i .
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–8
In the case of multiple complex characteristic values, for example the charac-
jk lnm\o jp jq
j j
lrmso tj uj
j j
q
l mo jv wj
j j
p
xWy lrmzo jq p jq lrmzo
xWy j x j
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–9
Example 7.3: The homogeneous linear differential equation
{ | } | |
|
{ }
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–10
Example 7.4: Consider the homogeneous linear differential equation with a
homogeneous solution is
6
6
6
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–11
Particular Solutions
contains the impulse delta function at the origin, as demonstrated in the next
example. The delta impulses can also be generated due to the system differentiation
the particular solution defined by the convolution integral represents the system
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–12
zero-state response, .
In general, the particular solution, , is any solution that satisfies the given
This formula requires a bit more explanation, since the system initial conditions
are specified at . Let us solve a simple first-order example in order to get
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–13
Example 7.5: Consider the following linear differential equation
We first solve this differential equation by using the Laplace transform method
the initial condition is contributed by the system differentiation of the input signal,
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–14
the system. The impulse delta function is able to change system initial conditions
Let us now find the homogeneous and particular solutions of the given differential
¦
¦
¦ © § £ ¨¥ £ ¤¥
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–15
If we use information about ª we will get either « (if we assume
that the particular solution is not present at ª ) or « , which
hence they produce wrong expressions for . The way to get the correct answer
in general.
It seems that we are in a trouble while using the classical method for solving a
linear differential equation that corresponds to a real physical linear system since
to obtain the particular solution. In such a case, the particular solution represents
the zero-state solution (it does not depend on the system initial conditions) and the
homogeneous solution represents the zero-input solution (it depends only on the
so that the particular solution obtained from the convolution integral is given by
° °
± ¯¶µ ·^¸°fµ`¹
²^³ ²´³
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–17
We can find the constant ¼ in the expression for the homogeneous solution as
½ ¾ ¼ ¾ ¼ ½ ¾ ¿À Á´Â
We can conclude from this example that in the case when the system differentiates
the input signal, the classical method for solving linear differential equations with
constant coefficients can be used for finding the response of time invariant linear
systems only if either the particular solution is obtained by using the convolution
at ¾ ).
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–18
Hence, in the process of finding the system response, we have to use the
that direction, we will present in Section 7.4 a time domain method for finding
the continuous-time system impulse response. Note that the frequency domain
technique for finding the continuous-time system impulse response by using the
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–19
Note that a procedure for obtaining a particular solution of a linear differential
function and its derivatives). However, that procedure is not systematic and some-
times has difficulties finding a particular solution. Another systematic method for
In the next two examples we indicate difficulties that one is faced with while
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–20
Example 7.6: In this example, we demonstrate difficulties one is faced with in
A natural choice will be to take for a candidate for a particular solution the following
Ñ
expression Ò (a linear combination of the forcing function
By taking the first and second derivatives of Ò and plugging them into the
differential equation, it can be checked easily that no exist such that the
Ñ
guessed solution is a particular solution of this differential equation.
We have to try a more complex form that also includes an integral of the forcing
Ñ Ó
function, that is Ò .
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–21
This will produce the required solution as Ô ÖÕ ÖÕ × ØÕ Ù ,
Ô × Ù
In the last formula we have used the upper script to indicate that the particular
solution is obtained through the convolution method. Note that the system impulse
of the system input and the system impulse response carries information about both
the actual system input and the internal system dynamics represented in the system
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–22
impulse response by a weighted sum of Ý`Þàß terms (note the term â á ãä ß in the
particular solution obtained using the convolution formula, and its absence from the
The previous example was not so difficult. However, if we change the original
then the problem of obtaining a particular solution by guessing its form becomes
much more difficult. The students may try several choices. However, we can obtain
the particular solution of this differential equation using the convolution formula in
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–23
Example 7.7: Consider a continuous-time linear system represented by the
ê ì å æ åë å í
è
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–24
From the given initial conditions, we obtain a set of linear algebraic equations
ð ïó ï ô
If we use the particular solution obtained through the convolution, then the
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–25
õ ö õ ÷ ø
ù ÷ú õ ù ÷ú õ ø
ö
ø ÷
which produces and . The solution obtained this way is identical
In conclusion, in the case when the linear time invariant system does not
differentiate the input signal, we can find the system response using any method
differential equation. However, in the case when the system differentiates the input
signal the particular solution need to be found through the convolution procedure.
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–26
7.4 Continuous-Time System Impulse Response
The continuous-time system impulse response is obtained using the impulse delta
function as the system input signal and assuming that the system initial conditions
are zero. It is important to observe that the impulse delta function is present only
at the initial time and that during that time it sets the system zero initial
with
ÿ
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–27
For , we have the homogeneous differential equation (an input free
system)
similarly like in the discrete-time domain by using either the direct method or
the method based on system linearity and time invariance. In the continuous-time
domain, in general, the direct method is pretty cumbersome so that we will limit
our presentation to the method based on the linearity and time invariance principles.
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–28
We define first the elementary continuous-time system impulse response by
Since the delta impulse function sets at some of the system initial con-
ditions to non zero values and then it disappears, the above system becomes the
obtained by using the following reasoning. The right-hand side of the equation for
at is equal to the delta impulse function so that the left-hand side
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–29
Recalling the notion of generalized derivatives from Chapter 2, the above
$%
& $')(*+&
observation means that none of the terms # # # can have
discontinuity produces the impulse delta function. Hence, we must have for all of
$,& ( $,& -
them # # . However, in order to get
$'(% &
the delta impulse function on the left-hand side, the term # must contain
multiplied by one on the left-hand side so that the equality between the left- and
right-hand sides holds. We conclude that the initial conditions for the elementary
-
system impulse response at are given by
- $%
& - $'(*
& - $'(% & -
# # # #
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–30
Using linearity and time invariance, the original impulse response becomes
/ 0 2
0 0
0132
Note that we have assumed that . The case will be discussed soon.
b1 δ ( t )
(1) (1)
Linear b1 h0 ( t )
System
...
.
bmδ ( t )
(m) (m)
Linear bm h0 ( t )
System
Σ bδ Σ bh
m m
(i) (i)
i=0
i ( t) Linear i=0
i 0 ( t )= h ( t )
System
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–31
We need to justify a general claim that the linear time invariant system at rest
under the input signal equal to the th derivative of the system input produces on
its output the th derivative of the original system output. This can be justified as
we will obtain
5 6 578 6 6
5 6 4 5)78 578 6 4 8 6 4
6 6
4 6 4 6
Assuming that all initial conditions are zero, which is the case for the impulse
6 6
response, it follows that 4 is the solution (the system output) of the
6 6
above differential equation due to the forcing function given by .
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–32
The above derivations are also valid when is any differentiable signal (in the
generalized sense) so that we have the following general result valid for continuous
= =
9;:
= =
Note that in the case when , the obtained formula for the impulse
becomes
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–33
?
)@ CED B
@ AB EC F D
?
G )@ CED B
@ AB EC F D
Example 7.19: Consider the problem of finding the system impulse response
solved in Example 4.20 by using the Laplace transform. The system is defined by
H
H
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–34
The impulse response is given by
J J
J M NPO K N KO
Using the initial conditions at L set by the impulse delta function, we obtain
M K . Hence, the elementary system impulse response is given by
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–35
Q RPS RT S
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–36
satisfies the differential equation
W W
W W
X
X
It follows that
W Y Y
Y
W
Y
where the elementary system impulse response is obtained from
W Y Y
Y
W
Y Z
Y Z
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–37
The solution for [ is given by
[ \ ]_^ ` ] `^
[ ]U^
]U^ ]U^
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–38
7.5 Complete Continuous-Time System Response
In Chapter 1, we have initiated discussion about the relationship between the zero-
state and zero-input components of the system response and the particular and
that the particular solution, obtained through the convolution procedure, is equal to
zero-state system response. In such a case, the homogeneous solution that satisfies
Based on the discussion presented at the end of Section 7.1, we conclude that the
classical method for solving linear differential equations with constant coefficients
can be used for finding the complete response of linear time invariant systems even
in the case when the system differentiate the input signal. Even more, the same
method can be used for finding the zero-state and zero-input components of the
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–39
Step 1: Find the impulse response in terms of the elementary system
impulse response.
Step 2: Find the particular solution using the convolution formula, that is
b . That particular solution is the system zero-state response,
b c;d .
Step 3: Find the general form of a homogeneous solution and determine its
The homogeneous solution obtained represents the system zero-input response, that
is, e con .
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–40
Example 7.21: The above steps are demonstrated on the second-order system
The impulse response of this system (Step 1) has been already found in Example
7.20 as
qUs qUs , so that the particular solution (Step 2) obtained
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–41
|
+
z
|
V V V
|
U U
In Step 3, we find the homogeneous solution that satisfies the system initial
U U
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–42
and
jk
Hence
o _ U
Very often in linear system theory and practice, we use the notions of the system
transient response and the system steady state response. Sometimes, they are
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–43
The system transient response is determined by –the complete system
response during the short time interval immediately following the initial time, that
with fast signal changes mostly contributed by o . The system steady state
¡ £¢
Practically, this means that the system response after some large period of time
Usually, the zero-input response decays to zero rapidly, hence the steady state
response).
The slides contain the copyrighted material from Linear Dynamic Systems and Signals, Prentice Hall 2003. Prepared by Professor Zoran Gajic 7–44