1005 Notes
1005 Notes
Pre-knowledge . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
Chapter 1: Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . 3
1.1 Basic concepts . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Chapter 2: First-order Equations . . . . . . . . . . . . . . . . . . . . . 4
2.1 Separable equations . . . . . . . . . . . . . . . . . . . . . . . . 4
2.2 Homogeneous DE . . . . . . . . . . . . . . . . . . . . . . . . . 7
2.3 Linear equations . . . . . . . . . . . . . . . . . . . . . . . . . 8
2.4 Functions of two variables . . . . . . . . . . . . . . . . . . . . 11
2.5 Exact equations . . . . . . . . . . . . . . . . . . . . . . . . . 13
Chapter 3: Second-order Equations . . . . . . . . . . . . . . . . . . . . 16
3.1 Basic Definitions . . . . . . . . . . . . . . . . . . . . . . . . . 16
3.2 Linear Homogeneous Equations . . . . . . . . . . . . . . . . . 16
3.3 Linear Nonhomogeneous Equations . . . . . . . . . . . . . . . 20
Chapter 5: Linear Systems . . . . . . . . . . . . . . . . . . . . . . . . 27
5.1. Homogeneous systems . . . . . . . . . . . . . . . . . . . . . 27
Chapter 6: Sequences and Series . . . . . . . . . . . . . . . . . . . . . 32
6.1 Sequences . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
6.2 Series . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Chapter 7: Taylor Series . . . . . . . . . . . . . . . . . . . . . . . . . . 40
7.1 Power Series . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
7.2 Representations of Functions by Power Series . . . . . . . . . 42
Chapter 8: Fourier Series . . . . . . . . . . . . . . . . . . . . . . . . . 48
8.1 Fourier series of periodic functions . . . . . . . . . . . . . . . 48
8.2 Fourier series of functions on finite intervals . . . . . . . . . . 52
2 MATH1005 NOTES-ERIC HUA
Pre-knowledge
Z b
Fundamental Theorem of Calculus: f (x)dx = F (b) − F (a),
a
where F ′ (x) = f (x).
Z Z
Integration by parts: ′
u(x)v (x)dx = u(x)v(x) − u′ (x)v(x)dx,
Z Z
or udv = uv − vdu.
Z b Z g(b)
Integration by substitution: ′
f (g(x))g (x)dx = f (u)du, where u =
a g(a)
g(x).
akx akx
R kx
akx k ln a
+C R a1 dx = k ln a + C
1
x
ln |x| + C x
dx = ln |x| + C
1
= k1 sin kx + C
R
cos kx k
sin kx + C cos kxdx
1 1
R
sin kx − k cos kx + C R sin 2kxdx = −1k cos kx + C
1
sec2 kx k
tan kx + C sec kxdx = k tan kx + C
1
kx tan kxdx = k1 sec kx + C
R
sec kx tan kx k
sec kx + C sec
√ 1 2 1 √ 1 2 dx = k1 arcsin kx + C
R
k
arcsin kx + C
1−(kx)
1 1
R 1−(kx)
1
1+(kx)2
arctan kx + C dx = k1 arctan kx + C
k R 2
1+(kx) R
R kf (x)dx =R k f (x)dxR
[f (x) + g(x)]dx = f (x)dx + g(x)dx.
MATH1005 NOTES-ERIC HUA 3
Chapter 1: Introduction
First-order DE: f (y ′ , y, x) = 0.
Second-order DE: f (y ′′ , y ′ , y, x) = 0.
SOL:
√ (1) y = cos x (2) y = cos(−x) (3) y = x2 (4) y = ex + e−x (5)
y = 2x.
4 MATH1005 NOTES-ERIC HUA
y 3 + sin y = 2t2 + C,
where C is a constant.
03 + sin 0 = 2π 2 + C,
y 3 + sin y = 2t2 − 2π 2 ,
arctan p = tet − et + c.
arctan 1 = 0 − 1 + C, C = π/4 + 1.
Hence
Solution:
dy
= (1 + t)dt.
y2
1 1
− = t + t2 + c.
y 2
By y(1) = 2, c = −2. Thus
1
y=− 1 2 .
t+ 2
t −2
Other solutions:
p+1
dp = tet dt.
p−1
Solution: y ′ = 3. Solve
dy 1 1 1
= − ′ = − , y = − x + c.
dx y 3 3
Solution:
Step 1: Calculate y ′ :
Method 1: xy = k, y + xy ′ = 0, y ′ = − xy .
Method 2: y ′ = −k/x2 = −(xy)/x2 = −y/x.
Step 2: Then Solve
dy 1
=− ′
dx y
i.e.,
dy x
= ,
dx y
1 2 1 2
y = x + c, y 2 = x2 + c.
2 2
MATH1005 NOTES-ERIC HUA 7
Solution:
y 2y
Step 1: Calculate y ′ : y ′ = 2kx = 2( 2 )x = .
x x
dy
Step 2: Solve the equation dx = − y1′ = − 2y
x
.
1
y 2 = − x2 + c, or x2 + 2y 2 = c.
2
Solution:
x
Step 1: Calculate y ′ : 2x + 2yy ′ = 0, y ′ = − .
y
dy 1 y
Step 2: Solve the equation dx = − y′ = x .
1 1
dy = dx, ln |y| = ln |x| + c, y = cx.
y x
2.2 Homogeneous DE
Definition 1. A function z = f (x, y) is said to be a homogeneous function of
degree n, if f (tx, ty) = tn f (x, y).
For example, f (x, y) = xy 2 + x3 is homogeneous function of degree 3.
Integrating factors
Consider a first-order linear differential equation
dy
+ P (x)y = Q(x).
dx
This equation may be solved by multiplying both sides by the function
R
P dx
I(x) = e ,
which
R is called an integrating factor. The left side becomes the derivative of
P dx
ye . Integration of both sides will yield the solution.
Theorem 2. The general solution of a first order linear equation is given by
Z
1 R
y= I(x)Q(x)dx , I(x) = e P dx .
I(x)
Example 12. Solve y ′ + xy = x.
Solution:
This is a linear first order ODE in standard form with p(x) = q(x) = x. The
integrating factor is
2
R
I(x) = e xdx = ex /2 .
Hence, after multiplying both sides of our differential equation, we get
d x2 /2 2
(e y) = xex /2
dx
which, after integrating both sides, yields
Z
x2 /2 2 2
e y = xex /2 dx = ex /2 + C.
2
Hence the general solution is y = 1 + Ce−x /2 . The solution satisfying the
initial condition y(0) = 1 is y = 1 and the solution satisfying y(0) = a is
2
y = 1 + (a − 1)e−x /2 .
Solution:
We bring this linear first order equation to standard form by dividing by x.
We get
−2
y′ + y = x2 sin x.
x
The integrating factor is
R
−2dx/x
I(x) = e = e−2 ln x = 1/x2 .
from which y/x2 = − cos x + C and y = −x2 cos x + Cx2 . Note that the later
are solutions to the DE xy ′ − 2y = x3 sin x and that they all satisfy the initial
condition y(0) = 0. This non-uniqueness is due to the fact that x = 0 is a
singular point of the DE.
1
y −3 y ′ + y −2 = x, ⇒ − u′ + u = x, ⇒
2
u′ − 2u = −2x.(i)
By integration-by-parts,
1 1 1
e−2x u = xe−2x + e−2x + C, ⇒ u = x + + Ce2x , y −2 = x + + Ce2x .
2 2 2
MATH1005 NOTES-ERIC HUA 11
Example 17. Let f (x, y) = 2x2 + 20y 2 . Sketch three level curves for k =
10, 30, 50.
Partial derivatives
∂z ∂f f (x + h, y) − f (x, y)
zx = := := fx (x, y) := Dx f := lim ,
∂x ∂x h→0 h
which is the derivative of f with respect to x;
∂z ∂f f (x, y + h) − f (x, y)
zy = := := fy (x, y) := Dy f := lim ,
∂y ∂y h→0 h
which is the derivative of f with respect to y.
Methods:
(a) Using the definition of a partial derivative (do not differentiate) find fx (0, 0).
(b) Using the definition of a partial derivative (do not differentiate) find fy (0, 0).
Solution:
(a)
∂f f (h, 0) − f (0, 0) 0−0
(0, 0) = lim = lim = 0.
∂x h→0 h h→0 h
(b)
∂f f (0, k) − f (0, 0) 0−0
(0, 0) = lim = lim = 0.
∂y k→0 k k→0 k
Example 19. Let f (x, y) = exy + xy . Calculate fx (0, 1), fy (0, 1).
Solution:
1
fx = yexy + , fx (0, 1) = 2.
y
x
fy = xexy − 2 , fy (0, 1) = 0.
y
Higher derivatives:
∂3f
fxx , ∂z∂y∂x
= fxyz ,...
Solution:
1 x
fx = yexy + , fy = xexy − 2 .
y y
1 2x
fxx = y 2 exy , fxy = exy + xyexy − , fyy = x2 exy + .
y2 y3
dz ∂z dx ∂z dy
= + .
dt ∂x dt ∂y dt
MATH1005 NOTES-ERIC HUA 13
dz
2. dt
means rate of change of z with respect to t along the path x = g(t),
y = h(t), t ∈ D.
Example 21. Suppose z = f (x, y) where x = g(t) and y = h(t). Given the data
g(1) = 1, g ′ (1) = 2,
h(1) = 2, h′ (1) = 3,
fx (1, 2) = −1, fy (1, 2) = 2.
Find dz
dt
when t = 1.
dz ∂z dx ∂z dy
Solution: = + = fx g ′ + fy h′
dt ∂x dt ∂y dt
t = 1 ⇒ (x, y) = (g(1), h(1)) = (1, 2)
dz
|t=1 = fx (1, 2)g ′ (1) + fy (1, 2)h′ (1)
dt
= (−1)(2) + (2)(3) = 4
z = x2 y + ex cos y, x = t3 sin t, y = t2 .
dz
Calculate dt
by using Chain Rule.
Solution:
f (x, y) = C.
dy
Example 23. Solve 2x2 y dx + 2xy 2 + 1 = 0.
∂P ∂Q
= 4xy = .
∂y ∂x
∂f ∂f
= 2xy 2 + 1, = 2x2 y.
∂x ∂y
f (x, y) = x2 y 2 + x + ϕ(y).
∂f
= 2x2 y + ϕ′ (y) = 2x2 y
∂y
using the second equation. Hence ϕ′ (y) = 0 and ϕ(y) is a constant function. The
solution is x2 y 2 + x = C.
∂P ∂Q
∂y
− ∂x
Q
is a function of x only, in which case
∂P ∂Q
I′ ∂y
− ∂x
= .
I Q
We have
∂Q
∂P
!
Z
∂y
− ∂x
I(x) = exp dx .
Q
∂P ∂Q
∂y
− ∂x
−P
is a function of y only. We have
∂Q
∂P
!
Z
∂y
− ∂x
I(y) = exp dy .
−P
Solution: Here
∂P ∂Q
∂y
− ∂x 2 − 2xy −2
= 2
=
Q x y−x x
so that there is an integrating factor I which is a function of x only which
satisfies I ′ /I = −2/x. Hence I = 1/x2 is an integrating factor and 2 + y/x2 +
(y−1/x)y ′ = 0 is an exact equation whose general solution is 2x−y/x+y 2 /2 = C
or 2x2 − y + xy 2 /2 = Cx.
Solution: Here
∂P ∂Q
∂y
− ∂x 1
=
−P y
so that there is an integrating factor which is a function of y only which satisfies
I ′ /I = 1/y. Hence y is an integrating factor and y 2 + (2xy − y 2 ey )y ′ = 0 is an
exact equation with general solution xy 2 + (−y 2 + 2y − 2)ey = C.
16 MATH1005 NOTES-ERIC HUA
Theorem 5. If y1 and y2 are two linearly independent solutions, then the com-
plementary function yh = c1 y1 + c2 y2 is the general solution.
Reduction of order
i.e.,
u[y1′′ + p(x)y1′ + q(x)y1 ] + u′′ y1 + 2u′ y1′ + p(x)u′ y1 = 0.
Since y1 is a solution, y1′′ + p(x)y1′ + q(x)y1 = 0. Thus, y2 is a solution if and only
if
u′′ y1 + u′ [2y1′ + p(x)y1 ] = 0,
i.e.,
u′′ 2y1′ + p(x)y1 y1′
= − = −2 − p(x).
u′ y1 y1
Integration with respect to x then gives
Z
′
ln |u | = −2 ln |y1 | − p(x) dx.
MATH1005 NOTES-ERIC HUA 17
−2 1
Taking the exponential of both sides and using the fact that e−2 ln |y1 | = eln |y1 | = ,
y12
we obtain
1 − R p(x) dx 1 R
|u′ | = 2
e , or u′ = ± 2 e− p(x) dx .
y1 y1
Taking the plus sign and integrating once more, we obtain
Z
1 − R p(x) dx
u(x) = e dx.
y12
x2 y ′′ − 3xy ′ + 4y = 0, x > 0,
Solution:
x3
Z Z Z
1 − R p(x) dx 1 − R −3/x dx
u(x) = e dx = e dx = dx = ln x.
y12 x4 x4
y(x) = C1 x2 + C2 x2 ln x.
ay ′′ + by ′ + cy = 0.
ar2 + br + c = 0.
r1 ̸= r2 : y = C1 er1 x + C2 er2 x .
r1 = r2 : y = (C1 + C2 x)erx .
2. y ′′ + 6y ′ + 9y = 0,
3. y ′′ + 4y ′ + 8y = 0.
18 MATH1005 NOTES-ERIC HUA
Solution:
1) y = c1 e−0.5x + c2 e4x .
2) y = c1 e−3x + c2 xe−3x .
a2 x2 y ′′ + a1 xy ′ + a0 y = 0, x ̸= 0,
a2 r (r − 1) + a1 r + a0 = 0, or, r2 + (A − 1) r + B = 0.
(iii) If r1 , r2 = α±iβ (complex), then y1 = |x|α cos(β ln |x|) and y2 = |x|α sin(β ln |x|).
y ′ = rxr−1 , y ′′ = r (r − 1) xr−2 .
a2 r (r − 1) + a1 r + a0 = 0, or, a2 r2 + (a1 − a2 ) r + a0 = 0.
MATH1005 NOTES-ERIC HUA 19
If r1 , r2 = α±iβ (complex), then y1 = |x|α cos(β ln |x|) and y2 = |x|α sin(β ln |x|).
A B
Since p(x) = and q(x) = 2 are undefined at x = 0, the solution may be
x x
undefined at x = 0. Thus, we assume that x ̸= 0. A Cauchy-Euler equation can
be transformed into a constant-coefficient equation as follows:
For x > 0, let x = et and y(x) = z(t). Then t = ln(x) and, by the chain rule,
dy dz dt 1 dz d2 y 1 dz 1 d2 z dt 1 dz 1 d2 z
= = , = − + = − + ,
dx dt dx x dt dx2 x2 dt x dt2 dx x2 dt x2 dt2
2
2 ′′ ′ d z dz dz
and the equation x y + Axy + By = 0 becomes 2
− + A + Bz = 0,
dt dt dt
or
z ′′ + (A − 1)z ′ + Bz = 0,
which has constant coefficients.
For x < 0, let x = −et and y(x) = z(t). Then t = ln(−x), and the same equation
for z(t) results. In either case, t = ln |x|.
x, x > 0
Since |x| = , replacing x by |x| gives the solutions for any x ̸= 0.
−x, x < 0
Thus,
If r1 , r2 = α±iβ (complex), then y1 = |x|α cos(β ln |x|) and y2 = |x|α sin(β ln |x|).
2. x2 y ′′ + 5xy ′ + 4y = 0, x > 0.
3. x2 y ′′ + 4xy ′ + 4y = 0, x > 0.
G(x) = ekx .
1. If cos kx and sin kx are not solutions of (5), then let yp (x) = A cos kx+
B sin kx.
2. If cos kx or sin kx are solutions of (5), then let yp (x) = x[A cos kx +
B sin kx].
1. If ekx is not a solution of (5), then let yp (x) = Q(x)ekx , where deg Q =
deg P .
2. If ekx is a solution of (5), but xekx not, then let yp (x) = xQ(x)ekx ,
where deg Q = deg P .
3. If both ekx and xekx are solutions of (5), then let yp (x) = x2 Q(x)ekx ,
where deg Q = deg P .
1. If cos kx and sin kx are not solutions of (5), then let yp (x) = Q(x) cos kx+
R(x) sin kx, where deg Q = deg R = deg P .
2. If cos kx or sin kx are solutions of (5), then let yp (x) = x[Q(x) cos kx+
R(x) sin kx], where deg Q = deg R = deg P .
G(x) is a combination of P (x), ekx , cos kx, sin kx. Then use the Principle
of Superposition.
22 MATH1005 NOTES-ERIC HUA
yp = u1 y1 + u2 y2 → yp′ = u′1 y1 + u1 y1′ + u′2 y2 + u2 y2′ = (u′1 y1 + u′2 y2 ) + (u1 y1′ + u2 y2′ ).
yp′ = u1 y1′ + u2 y2′ → yp′′ = u1 y1′′ + u′1 y1′ + u′2 y2′ + u2 y2′′ ,
[u1 y1′′ + u′1 y1′ + u′2 y2′ + u2 y2′′ ] + p(x)[u1 y1′ + u2 y2′ ] + q(x)[u1 y1 + u2 y2 ] = f (x),
i.e.,
u1 [y1′′ + p(x)y1′ + q(x)y1 ] + u2 [y2′′ + p(x)y2′ + q(x)y2 ] + u′1 y1′ + u′2 y2′ = f (x).
u′1 y1 + u′2 y2 = 0
u′1 y1′ + u′2 y2′ = f (x)
for the unknown quantities u′1 and u′2 . The system may be expressed in matrix
form as ′
y1 y2 u1 0
= ,
y1′ y2′ u′2 f (x)
24 MATH1005 NOTES-ERIC HUA
y1 y2
The quantity = y1 y2′ − y1′ y2 is denoted by W (x) = W [y1 (x) y2 (x)] and
y1′ y2′
called the Wronskian of the functions y1 and y2 . Thus,
′
y2′ −y2
u1 1 0 1 −y2 f (x)
= = →
u′2 W (x) −y1′ y1 f (x) W (x) y1 f (x)
−y2 f
Z Z
′ ′ y1 f y2 f y1 f
u1 = and u2 = → u1 = − dx and u2 = dx.
W W W W
Theorem 9. If y1 and y2 are two linearly independent solutions of the equation
y ′′ + p(x)y ′ + q(x)y = 0,
is given by
Z Z
y2 f y1 f
yp = u1 y1 + u2 y2 , W (x) = y1 y2′ − y1′ y2 , u1 =− dx, u2 = dx,
W W
Example 41. Solve the equation
yp = u1 y1 + u2 y2 = u1 sin x + u2 cos x.
′′ ′ ex
y − 2y + y = .
1 + x2
Solution:
y1 = ex , y2 = xex ,
ex
W (y1 , y2 ) = e2x , f (x) = .
1 + x2
1
u1 = − ln(1 + x2 ), u2 = arctan x.
2
Solution:
y1 = x2 , y2 = x6 ,
W (y1 , y2 ) = 4x7 , f (x) = 8x5 ln x.
Z Z
y2 f y1 f
u1 = − dx, u2 = dx.
W W
Solution:
y1 = x, y2 = x3 ,
2
W (y1 , y2 ) = 2x3 , f (x) = 8x3 ex .
Z Z
y2 f y1 f
u1 = − dx, u2 = dx.
W W
MATH1005 NOTES-ERIC HUA 27
Criterion for Linearly Independent Solutions. If the Wronskian W (⃗x1 , ..., ⃗xn ) =
det(⃗x1 , ..., ⃗xn ) ̸= 0 for all t in an interval I, then ⃗xi (i=1,...,n) are linearly inde-
pendent on I.
2 × 2 System Model:
Example 46. Two large tanks, each holding 24 liters of brine, are interconnected
by two pipes. Fresh water flows into tank A at the rate of 6 L/min, and fluid is
drained out tank B at the same rate. Also, 8 L/min of fluid are pumped from
tank A to tank B and 2 L/min from tank B to tank A. The solutions in each tank
28 MATH1005 NOTES-ERIC HUA
are well stirred so that they are homogeneous. If, initially, tank A contains 5kg
salt in the solution and Tank B contains 2kg salt in the solution, find the mass
of salt in the tanks at any time t.
To solve this problem, let x(t) and y(t) be the mass of salt in tanks A and B
respectively. The variables x, y satisfy the system of the first order DE
dx −8 2
x′ = = x + y,
dt 24 24
′ dy 8 6+2
y = = x− y.
dt 24 24
d⃗x
Method to Solve 2 × 2 Homogeneous Linear systems = A⃗x:
dt
If λ is an eigenvalue of A, and ⃗v is an eigenvector, then
⃗x = eλt⃗v
x′ = 3x
Example 48. Find the general solution: .
y ′ = 3y
3 0
Solution: In matrix form, the system is x′ = Ax, where A = .
0 3
Two eigenvalues are
λ1 =λ2 = 3.
1 0
For λ = 3, ⇒ v1 = , v2 = .
0 1
where ⃗u satisfies
(A − λI)⃗u = ⃗v . (7)
′
x = 3x − 18y
Example 49. Find the general solution: .
y ′ = 2x − 9y
′ x
Solution: In matrix form, the system is x = Ax, where x = and
y
3 −18
A= .
2 −9
Two eigenvalues are λ1 = λ2= −3.
3 −3t 3
For λ1 = −3, ⇒ v1 = ⃗v = , ⇒ x1 (t) = e .
1 1
To find a second linearly independent solution, we solve (7),
0.5
(A + 3I)⃗u = ⃗v , ⇒ ⃗u = .
0
30 MATH1005 NOTES-ERIC HUA
λt −3t 3 −3t 0.5
Thus, x2 (t) = te (t⃗v +⃗u) = te +e , and the general solution
1 0
is
x(t) = c1 x1 (t) + c2 x2 (t).
eλt⃗v = eat+bti (⃗v1 + i⃗v2 ) = eat cos(bt) + ieat sin(bt) (⃗v1 + i⃗v2 )
= (⃗v1 cos bt − ⃗v2 sin bt)eat + i (⃗v2 cos bt + ⃗v1 sin bt)eat
⃗x1 = (⃗v1 cos bt − ⃗v2 sin bt)eat , ⃗x2 = (⃗v2 cos bt + ⃗v1 sin bt)eat .
x′ = 6x − y
Example 50. Find the general solution: .
y ′ = 5x + 4y
′ x
Solution: In matrix form, the system is x = Ax, where x = and
y
6 −1
A= .
5 4
Two eigenvalues are λ1 = 5 + 2i, λ2 = 5 − 2i.
The general solution is
5t 1 5t 0
⃗x = e (c1 cos(2t) − c2 sin(2t)) + e (c1 sin(2t) + c2 cos(2t)) .
1 −2
x′ = 2x − y
Example 51. Find the general solution: , x(0) = 5, y(0) =
y ′ = 3x − 2y
11.
′ x
Solution: In matrix form, the system is x = Ax, where x = and
y
2 −1
A= .
3 −2
2−λ −1
det(A − λI) = = λ2 − 1
3 −2 − λ
λ2 − 1 = 0 ⇒ λ1 = 1, λ2 = −1.
MATH1005 NOTES-ERIC HUA 31
a
For λ1 = 1, solve (A − (−1)I) = ⃗0.
b
1
−a + b = 0, a = 1 ⇒ v1 = .
1
a
For λ2 = −1, solve (A − (−1)I) = ⃗0.
b
1
−3a + b = 0, a = 1 ⇒ v2 = .
3
t 1 −t 1
Thus, x1 (t) = e and x2 (t) = e are independent solutions, and
1 3
x(t) = c1 et + c2 e−t
1 1
the general solution is x(t) = c1 et + c2 e−t , i.e., .
1 3 y(t) = c1 et + 3c2 e−t
By x(0) = 2, y(0) = −1, c1 + c2 = 5, c1 + 3c3 = 11, c1 = 2 and c2 = 3. Thus
x(t) = 2et + 3e−t
.
y(t) = 2et + 9e−t
32 MATH1005 NOTES-ERIC HUA
6.1 Sequences
Sequence: a1 , a2 , ..., an , ..., an is the nth term. If limn→∞ an = L, then we say
the sequence converges to L. Otherwise, the sequence diverges.
Solution:
ln n ln x 1/x
lim = lim = lim = 0.
n→∞ n x→∞ x x→∞ 1
n√ √ o
Example 53. Show that the sequence n2 2
+ 3n − 1 − n − 1 converges to
3
2
.
Solution: By conjugate.
Example 54. Show that the sequence {cos n} is divergent; {arctan(−n)} con-
verges to − π2 .
lim an
an
3. lim = n→∞
, if lim bn ̸= 0.
n→∞ bn lim bn
n→∞ n→∞
cos n
Example 56. n
converges 0.
Solution:
1 cos n 1
− ≤ ≤ .
n n n
Solution: (i) We will show that an < 6 by induction: Note that a1 < 6.
Assume that an < 6. Then an+1 = 12 (an + 6) < 12 (6 + 6) = 6.
(ii) an+1 − an = 3 − 21 an > 3 − 62 = 0. Thus the sequence is increasing.
n
Example 58. Show that an = n3 +1
is decreasing, and 0 < an < 1 for any n.
34 MATH1005 NOTES-ERIC HUA
1−2x2
Solution: To check it, let f (x) = x3x+1 . Then f ′ (x) = (x3 +1)2
< 0 when
x ≥ 1. Hence f (x) is decreasing when x ≥ 1.
6.2 Series
∞
X
The sum an = a1 + a2 + a3 + ... is called infinite series.
n=1
Partial sum:
n
X
Sn = aj .
j=1
Then
∞
X
an = S ⇔ lim Sn = S.
n→∞
n=1
k
n(n+k)
= 1
n
− 1
n+k
.
∞
X 1
Harmonic series is divergent.
n=1
n
∞
X
Divergence Test: If limn→∞ an ̸= 0, then an is divergent.
n=1
∞
X ∞
X ∞
X
If an and bn are convergent, c, d ∈ R, then (can + dbn ) =
n=1 n=1 n=1
∞
X ∞
X
c an + d bn .
n=1 n=1
Solution: (a)
∞ ∞ ∞ n+1
X 22n+2 X 22(n+1) X 4
= = .
n=0
3n+1 n=0
3n+1 n=0
3
(b) We have
∞ ∞ ∞ n
X
n+1 −2n
X
n −n
X 3
3 2 = 3·3 4 =3
n=1 n=1 n=1
4
This series is a geometric series with first term a = 9/4 and common ratio
r = 3/4. Since |r| < 1, the series converges and we have
∞
X a 9/4
3n+1 2−2n = = = 9.
n=1
1−r 1/4
(c)
∞ ∞
X 1 X1 1 1 1 1 1 1 1 1 1 5
= − = − + − + − + ··· = .
n=1
(n + 1)(n + 3) n=1 2 n+1 n+3 2 2 4 3 5 4 6 12
∞
X 3
Example 60. Determine if the series converges or diverges .
n=3
n(ln n)3
3
Solution: We use Integral Test. Let f (x) = x(ln x)3
. Then f (x) > 0 for
x ≥ 3. Since
−3[(ln x)3 + 3(ln x)2 ]
f ′ (x) = < 0,
x2 (ln x)6
f (x) is decreasing. By substitution with u = ln x, we have
Z ∞ Z b
3 3
3
dx = lim dx
3 x(ln x) b→∞ 3 x(ln x)3
Z ln b
3
= lim du
b→∞ ln 3 u3
3 1 2
= ( ).
2 ln 3
Hence it is convergent.
36 MATH1005 NOTES-ERIC HUA
∞
X
Example 61. Show that the series n2 e−n is convergent.
n=0
Solution:
∞
2018
X
Example 62. Show that the series n2017 e−n is convergent.
n=0
Solution:
P∞ 1
The p−series: n=1 np is convergent if p > 1 and divergent if p ≤ 1.
convergent?
Solution:
∞ ∞ −p+1
X
p−1
X 1
n = .
n=1 n=1
n
∞
X ∞
X
an is divergent ⇒ bn is divergent.
n=1 n=1
P∞ 1
Example 64. Determine if the series converges or diverges n=1 n(n3 +5)1/3 .
Solution:
P∞ By Comparison
P∞ 1test,
1
0 ≤ n=1 n(n3 +5)1/3 ≤ n=1 n2 < ∞ (p-series, p = 2 > 1), so convergent.
MATH1005 NOTES-ERIC HUA 37
The Limit Comparison test: Suppose that an > 0 and bn > 0 for any n ≥ k,
where k is an positive integer, and
an
lim = L.
n→∞ bn
2. bn decreasing (b1 ≥ b2 ≥ b3 ≥ · · · )
3. limn→∞ bn = 0.
P∞ n−1 n+1
Example 67. Test the series n=1 (−1) n2 +n+1
for convergence or divergence.
n+1
Solution: This is an alternating series. Let bn = n2 +n+2
. Then
1) limn→∞ bn = 0;
2) Let f (x) = x2x+1
+x+1
for x ≥ 1, then
′ −x2 − 2x
f (x) = 2 < 0.
(x + x + 1)2
Therefore f (x) decreases for x ≥ 1. In particular,
f (n) > f (n + 1)
Property:
∞
X ∞
X
|an | is convergent ⇒ an is convergent.
n=1 n=1
P∞ n−1 n+1
Example 68. Determine whether the series is absolutely convergent: n=1 (−1) n2 +n+1
.
Solution: ∞ ∞
X
n−1 n+2 X n+2
(−1) = .
n=1
n2 + n + 1 n=1
n 2+n+1
MATH1005 NOTES-ERIC HUA 39
Note that
n+2 n 1
≥ 2 = .
n2 +n+1 3n 3n
The series
∞
X 1
n=1
3n
P∞ n−1 cos(5n)
Example 69. Show that the series is absolutely convergent: n=1 (−1) n2 +7n+3
.
∞
X an+1
2. Ratio test: Consider the series an , with lim | | = L.
n=1
n→∞ an
∞
X p
n
3. Root test: Consider the series an , with lim |an | = L.
n→∞
n=1
∞
X (−1)n
Example 72. Show that the series √ is absolutely convergent.
n=1
(2 n n + 1)n
p
Solution: limn→∞ n |an | = 2e01+1 = 13 < 1.
By the Root Test, the series is absolutely convergent.
R = 5,
I = (−4, 6].
Example 74. Find the radius and interval of convergence of the following power
series: ∞
X (2x − 3)n
n=1
n2
Solution: Let
(2x − 3)n
an = .
n2
Then
|an+1 | n2
lim = lim · |(2x − 3)| = |2x − 3|.
n→∞ |an | n→∞ (n + 1)2
By Ratio Test, |2x−3| < 1, i.e., |x−1.5| < 0.5. Therefore R = 0.5 and 1 < x < 2.
When x = 1,
∞ ∞
X (2x − 3)n X (−1)n
=
n=1
n2 n=1
n2
which is convergent by Alternating Series Test.
When x = 2,
∞ ∞
X (2x − 3)n X 1
=
n=1
n2 n=1
n2
which is convergent by p−Series Test. Therefore,
I = [1, 2].
∞
X (−1)n (x − 1)3n
Example 75. Find the radius and interval of convergence of .
n=1
n 8n
1
= |x − 1|3 .
8
42 MATH1005 NOTES-ERIC HUA
∞
X
Example 76. Find the radius and interval of convergence of n!xn .
n=0
∞
X xn
Example 77. Find the radius and interval of convergence of .
n=1
n!
Term-by-term differentiation: If
∞
X
f (x) = cn (x − a)n ,
n=0
then ∞
X
f ′ (x) = ncn (x − a)n−1 ,
n=1
′
and f and f have the same radius of convergence.
Term-by-term integration: If
∞
X
f (x) = cn (x − a)n ,
n=0
then Z ∞
X cn
f (x)dx = C + (x − a)n+1 ,
n=0
n + 1
R
and f and f dx have the same radius of convergence.
MATH1005 NOTES-ERIC HUA 43
Example 78. Represent the following functions as power series and determine
the domain of the series.
1
(i) .
1+x
1
(ii) .
1 + 2x2
3
x
(iii) .
6x + 3
Solution:P
1
(i) 1+x = ∞ n n
n=0 (−1) x , |x| < 1.
1 1
P∞ 2 n
P∞ n n 2n
(ii) 1+2x2
= 1−(−2x2 )
= n=0 (−2x ) = n=0 (−1) 2 x , |− 2x2 | < 1.
x3 x3 1 3 P∞ P∞ n 2n
(iii) 6x+3 = 3 1+2x
= x3 n
n=0 (−2x) = n=0 (−1) 3 (x)
n+3
.
By the Ratio Test, when L < 1, we have 2|x| < 1, |x| < 0.5. Hence R = 0.5.
n
When x = ±0.5, (−1)n 23 (x)n+3 ̸→ 0, the series diverge. So I = (−0.5, 0.5).
Example 79. Represent the following functions as power series and determine
the domain of the series.
1
(i) f (x) = (1+x) 2.
1
(ii) f (x) = (1−x) 3.
Solution:
(i)
∞ ∞
1 d −1 d X
n
X
= ( ) = [(−1) (−x) ] = (−1)n−1 nxn−1 , −1 < x < 1.
(1 + x)2 dx 1 + x dx n=0 n=1
Example 80. Represent the following functions as power series and determine
the domain of the series.
(i) f (x) = ln(1 + x).
x2 x3
Solution: ln(1 + x) = x − 2
+ 3
− ..., R = 1. I = (−1, 1].
Solution:
Z Z X∞
1
arctan x = dx = ( (−1)n x2n )dx
1 + x2 n=0
x3 x5 x7
=C +x− + − + ..., R = 1.
3 5 7
Note that C = arctan 0 = 0, we have
x3 x5 x7
arctan x = x − + − + ..., −1 ≤ x ≤ 1.
3 5 7
Remark. It’s difficult to check the two end-points.
3x−1
Example 81. Represent x2 −1
as a power series.
Solution:
∞
3x − 1 2 1 X
= + = [2(−1)n − 1]xn .
x2 − 1 x + 1 x − 1 n=0
1
Example 82. Represent x
as a power series, centered at 1.
Solution: ∞
1 X
= (−1)n (x − 1)n , |x − 1| < 1.
x n=0
Maclaurin series for f (x) = Taylor series for f (x) at the center 0:
∞
X f (n) (0)
xn ;
n=0
n!
Example 83. Find the Taylor series for f (x) = sin x at the center x = π3 .
MATH1005 NOTES-ERIC HUA 45
Solution:
Example 84. Find the coefficient of (x−2)3 in the Taylor series of f (x) = x ln x
at the center a = 2.
Solution:
f ′′′ (2)
c3 = .
3!
x3 x5
sin x = x − 3!
+ 5!
− ..., R = ∞;
x2 x4
cos x = 1 − 2!
+ 4!
− ...,R = ∞;
x2 x3
ln(1 + x) = x − 2
+ 3
− ..., R = 1;
x3 x5 x7
arctan x = x − 3
+ 5
− 7
+ ..., R = 1.
(ii)
sin x sin2 x sin3 x
e = 1 + sin x + + + ...
2! 3!
3 5 3 5
x3 x5 (x − x3! + x5! + ...)2 (x − x3! + x5! + ...)3
= 1 + (x − + + ...) + ( )+( ) + ...
3! 5! 2! 3!
x2
=1+x+ + 0x3 + ...
2!
Binomial series
here
k k(k − 1) · · · (k − n + 1) k
= , = 1.
n n! 0
46 MATH1005 NOTES-ERIC HUA
Example
√ 87. Find the coefficient of x5 in the Maclaurin series of f (x) =
3
1 + x.
Solution:
√ 1 2 2·5 2·5·8 4
3
1 + x = 1 + x − 2 x 2 + 3 x3 − 4 x + ··· .
3 3 2! 3 3! 3 4!
√
Example 88. Let f (x) = 5
1 + x2 . Evaluate f (4) (0).
Solution: Use the binomial series to find the Maclaurin series of f (x).
f (n) (0)
k
=
n! n
Hence
(n) k
f (0) = n! = k(k − 1) · · · (k − n + 1).
n
So f (4) (0) = −0.8064.
Example 89. Find the first 5 non-zero terms in the Maclaurin series for ex cos(3x).
We have
x2 x3 x4
ex cos(3x) = 1 + x + + + + ...
2 6 24
9x2 9x3 9x4
− − − − ...
2 2 4
27x4
+ + ...
8
1 9 1 9 1 9 27
= 1 + x + ( − )x2 + ( − )x3 + ( − + )x4 + ...
2 2 6 2 24 4 8
13 7
= 1 + x − 4x2 − x3 + x4 + ...
3 6
Example 90. Find the first 3 non-zero terms in the Maclaurin series for tan x.
Solution: tan x = x + 31 x3 + 2 5
15
x + ....
Example 91.
1 1 1 π
1− + − + ... = .
3 5 7 4
This series is called the (full) Fourier series for f (x). The coefficients an (n ≥ 0)
are called the Fourier cosine coefficients, and the coefficients bn (n ≥ 1) are called
the Fourier sine coefficients.
Remark. The ”=” occurs at every x ∈ [−L, L] where f is continuous. If we
omit the condition where f is continuous at x, then we may write
∞
a0 X nπx nπx
f (x) ∼ + (an cos( ) + bn sin( )).
2 n=1
L L
1 L
Z
nπx
an = f (x) cos( ) dx n = 0, 1, 2, . . . . (9)
L −L L
1 L
Z
nπx
bn = f (x) sin( ) dx n = 1, 2, 3, . . . . (10)
L −L L
We do the same thing to compute, say, bm , except that first we multiply (17)
through by sin( mπx
L
). We get
Z L Z L
mπx a0 mπx
f (x) sin( ) dx = sin( ) dx +
−L L −L 2 L
∞ Z L Z L
X nπx mπx nπx mπx
an cos( ) sin( ) dx + bn sin( ) sin( ) dx
n=1 −L L L −L L L
Z L
mπx mπx
= bm sin( ) sin( ) dx = bm L. ⇒
−L L L
Z L
1 mπx
bm = f (x) sin( ) dx m = 1, 2, 3, . . . .
L −L L
Likewise we can get the formula for am .
2π-periodic function:
where
1 π
Z
a0 = f (x) dx. (11)
π −π
1 π
Z
an = f (x) cos(nx) dx n = 0, 1, 2, . . . . (12)
π −π
1 π
Z
bn = f (x) sin(nx) dx n = 1, 2, 3, . . . . (13)
π −π
50 MATH1005 NOTES-ERIC HUA
Example 92. Let f (x) = x2 , x ∈ [−π, π), and f (x + 2π) = f (x), i.e., f (x) be
2π-periodic. Compute the Fourier coefficients.
(−1)n · 4
= .
n2
Thus for x ∈ (−π, π),
∞
2 π 2 X (−1)n · 4
x = + 2
cos(nx).
3 n=1
n
3, 0 ≤ x < 1;
Example 95. Let f (x) be 2-periodic and f (x) =
sin(πx), −1 ≤ x < 0.
Find a2 .
Solution:
Z 1 Z 1
1 2πx
a2 = f (x) cos( ) dx = f (x) cos(2πx) dx
1 −1 1 −1
Z 0 Z 1
= sin(πx) cos(2πx) dx + 3 cos(2πx) dx
−1 0
Z 0
1 3
= [sin(3πx) − sin(πx) dx + sin(2πx)|10
−1 2 2π
−1+3
Solution: 2019 = 288R2, fav (2019) = fav (3) = 2
= 1.
Let f (x) be define on (0, L). Three special extensions are important:
(i) Extend f (x) as an odd function on (−L, L) with period 2L:
f (x), x ∈ (0, L);
f˜(x) = fodd (x) =
−f (−x), x ∈ (−L, 0).
Then an = 0 for all n. Thus
∞
X nπx
f (x) ∼ bn sin (15)
n=1
L
Example 97. Let f (x) = 3 + 2x, 0 ≤ x ≤ 2. Find the Fourier sine series,
Fourier cosine series and their values at x = 2.
MATH1005 NOTES-ERIC HUA 53
x, 0 ≤ x < 1.
Example 98. Let f (x) = .
3, 1 ≤ x < 4;
(a) Find the Fourier sine series and Fourier cosine series.
(b) Find the values of the sine and cosine series at x = 4, 1, −1.
2 L 2 2
Z Z
mπx mπx
bm = f (x) sin( ) dx = f (x) sin( ) dx
L 0 L 2 0 2
Z 1 1
mπx 2 mπx 4 mπx
= x sin( ) dx = − x cos( ) + 2 2 sin( )
0 2 mπ 2 mπ 2 0
2 mπ 4 mπ
= − cos( ) + 2 2 sin( ).
mπ 2 mπ 2
The Fourier sine series is
∞
X 2 mπ 4 mπ mπx
f (x) = − cos( ) + 2 2 sin( ) sin( ).
m=1
mπ 2 mπ 2 2
2 L 2 2
Z Z
mπx mπx
am = f (x) cos( ) dx = f (x) cos( ) dx
L 0 L 2 0 2
Z 1 1
mπx 2 mπx 4 mπx
= x cos( ) dx = x sin( ) + 2 2 cos( )
0 2 mπ 2 mπ 2 0
2 mπ 4 mπ 4
= sin( ) + 2 2 cos( ) − 2 2.
mπ 2 mπ 2 mπ
Solution: L = 2.
1 3
Z
a0 = f (x)dx = 6,
2 −1
1 3
Z
nπx 1 nπ 4 nπ 4
an = f (x) cos dx = −3 sin + cos − ,
2 −1 2 nπ 2 nπ 2 nπ
1 3
Z
nπx 1 nπ 4 nπ
bn = f (x) sin dx = −3 − 3 cos − sin .
2 −1 2 nπ 2 nπ 2