IAP Lecture Notes 2024
IAP Lecture Notes 2024
J.H. Deijkers
H. Gelderblom
A.J.M. Mackus
H.C.J. Mulders
C. Visser
2024
All figures without a reference are own images, made by the teachers of this
course.
Contents
1 Variables and dimensions 3
1.1 Dependent and independent variables . . . . . . . . . . . . . . 3
1.2 Dimension analysis . . . . . . . . . . . . . . . . . . . . . . . . . . 6
1.3 Strategies for mastering physics . . . . . . . . . . . . . . . . . . 11
1.4 Sketching graphs of functions . . . . . . . . . . . . . . . . . . . 14
1.5 Mathematical notation . . . . . . . . . . . . . . . . . . . . . . . 19
3 Evolution equations 38
3.1 Water tank . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
3.2 Heating/cooling object . . . . . . . . . . . . . . . . . . . . . . . 42
3.3 Differential equations . . . . . . . . . . . . . . . . . . . . . . . . 44
3.4 Newton’s second law: dynamics . . . . . . . . . . . . . . . . . . 52
3.5 Electrical circuits . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
3.6 Exponential decay and characteristic timescales . . . . . . . . 63
4 Physical models 65
4.1 Defining a physical model . . . . . . . . . . . . . . . . . . . . . . 65
4.2 Nondimensionalization of evolution equations . . . . . . . . . . 66
4.3 Simplifying evolution equations . . . . . . . . . . . . . . . . . . 72
4.4 Scale models and fluid mechanics . . . . . . . . . . . . . . . . . 76
9 Exercises 167
9.1 Exercises chapter 1. . . . . . . . . . . . . . . . . . . . . . . . . . 167
9.2 Exercises chapter 2. . . . . . . . . . . . . . . . . . . . . . . . . . 175
9.3 Exercises chapter 3. . . . . . . . . . . . . . . . . . . . . . . . . . 179
9.4 Exercises chapter 4. . . . . . . . . . . . . . . . . . . . . . . . . . 190
9.5 Exercises chapter 5. . . . . . . . . . . . . . . . . . . . . . . . . . 194
9.6 Exercises chapter 6. . . . . . . . . . . . . . . . . . . . . . . . . . 204
9.7 Exercises chapter 7. . . . . . . . . . . . . . . . . . . . . . . . . . 209
9.8 Exercises chapter 8. . . . . . . . . . . . . . . . . . . . . . . . . . 215
Interpretation
As a starting point, we will show that by making a list of all relevant variables
in a certain system based on their dimensions, we can derive relationships
between the dependent variables (those that describe the dynamic behavior
of the system) and the independent variables (those that define the system,
e.g. lengths, mass, gravitational acceleration). Such an analysis is elegant
and often very effective. Next, we will introduce the use of vectors, as well
as Cartesian and polar coordinate systems to describe motion in space. This
will serve as an administrative framework that will be used in many future
courses.
1
Besides a focus on physics, we want to make several mathematical tools ‘op-
erational’ by applying them in these analyses and descriptions. For example,
things like the aforementioned vector calculus & coordinate systems, sketch-
ing functions, simple differential equations, Taylor series, linearization, etc.
will be introduced and treated in an elementary manner, in order to subse-
quently apply them in the analysis of the aforementioned physical systems.
We do not aim to present derivations and formal proofs of these mathemati-
cal matters - this will happen in the mathematics courses that will run more
or less in parallel with this course.
As the overview illustrates, the mathematical formulation allows for the use
of a variety of analysis tools to obtain better understanding of the system.
The acquired insights thereby help in the interpretation of the physical real-
ity.
Many (physical and non-physical) systems show - when they are brought out
of their equilibrium state - oscillatory behavior. We will pay special attention
to this: besides linear behavior at small oscillation amplitudes we will also
investigate non-linear oscillations at larger amplitudes.
In addition, we will dive into the phenomenon of ‘instability’ and into catas-
trophe theory, where sudden changes in the behavior of the system are being
analyzed. These phenomena show up in numerous systems, varying from
simple mechanical systems to biological populations, economical and socio-
logical systems, and even to the dynamics of an arms race between two hostile
superpowers. Special attention will be given to non-linear oscillations and
to chaos.
These lecture notes are partly based on text written by the previous teachers
of the course Variables, Dimensions & Dynamics, GertJan van Heijst and
Léon Kamp.
August 2024
2
1 Variables and dimensions
In this chapter we will delve into the analysis of various physical systems.
To this end we will not use a detailed description of the dynamic behavior
governed by physical principles or ‘laws’, but instead use information about
the relevant variables in the system and their dimensions. We will start with
several examples of physical systems, but we will also focus on non-physical
systems later on. In addition, we will provide a framework for mastering
physics in a systematic way and discuss how to sketch graphs of functions.
O
g
θ
l
3
Under the influence of gravity the mass can sway back and forth around
its equilibrium position (θ = 0). We assume that the cord (or rod) is rigid
and massless, that there is no air resistance, and that the friction in the
suspension point O is negligible.
When we give the pendulum an excursion from its equilibrium position and
release it, the mass will oscillate around the equilibrium position. The ‘ideal’
pendulum would keep on swaying infinitely long, with a certain frequency ω.
When there is friction in the system (and this will of course always be the
case to some degree), the motion will be damped and after some time the
mass will be back in its equilibrium position and stay there.
We can describe the position of the pendulum (mass + rod) with the angle θ
between the pendulum and the vertical (see figure 1.1). During the motion
this angle θ changes continuously, from positive to negative values. In other
words: the angle is a function of the time: θ = θ(t).
We could measure this time dependence with an experiment quite easily.
If we would then plot the angle θ (vertical axis) as function of the time t
(horizontal axis) we obtain the function θ(t) in a graph form (see figure 1.2).
This graph of θ(t) shows periodic behavior: the mass sways back and forth
between the angles θ = θ0 (initial excursion) and θ = −θ0 with a certain period
T.
θ
θ0
t
-θ0
Figure 1.2: The excursion angle θ of the pendulum as a function of the time
t.
What are the relevant variables (or parameters) in this physical system?
Figure 1.1 shows: mass m, pendulum length l, and the gravitational acceler-
ation g. The ‘behavior’ of the pendulum is described by the excursion angle
4
θ, which shows periodic behavior. A characteristic quantity for this oscilla-
tion is the timescale T, i.e., the period of the motion. Sometimes we prefer
to use the angular frequency, which is defined as ω = 2π/T .
The physical parameters m, l, g we call the independent variables, whereas
the period T (or the frequency ω = 2π/T ) and the angle θ are dependent vari-
ables that describe the dynamic behavior of the system in the non-equilibrium
state.
- mass
- sizes (length, area, volume)
- gravitational acceleration
- heat capacity
- density
5
can do an experiment to find out how the period T (dependent variable) of
a pendulum depends on the rod length l (independent).
The time t does not depend on other variables and can therefore be consid-
ered as independent variable. One of the first experiments to characterize
a physical system is typically to measure a dependent variable as function
of time, as in figure 1.2. Since the variable time does not really describe
inherent properties of a system, it is not considered in dimension analysis as
treated in the next section.
For the mass we use kilograms [kg], a length is expressed in meters [m], the
time in seconds [s], and an acceleration in [m s−2 ]. So, our inventory is:
• independent variables:
m [kg]
l [m]
g [m s−2 ]
• dependent variables:
T [s]
θ [-]
The dimension of the period T is [s], so no mass unit [kg] occurs there. Since
the only variable that has this dimension [kg] is m, we can conclude that the
period T will not depend on the mass m.
The only independent variable that contains the dimension [s] is the gravi-
tational acceleration g, with dimension [m s−2 ]. So, we can conclude that
6
√
T ∼ 1/ g,
√
T∼ l/g. (1.1)
ρ
H
V
diameter of the barrel, the water level decreases very slowly. So, in good
approximation, we can view the height H of the water in the barrel as a
constant. The density ρ of water has the dimension of mass per unit volume,
so [kg m−3 ]. We now want to derive a relationship between the velocity V
7
(the only dependent variable in this problem) and the independent variables
ρ (density), g (gravitational acceleration), and H (water level).
The variables in this problem have the following dimensions:
• independent variables:
ρ [kg m−3 ]
g [m s−2 ]
H [m]
• dependent variable:
V [m s−1 ]
Given the dimensions of V and ρ (the latter contains the mass dimension
[kg]), V will not depend on ρ. That leaves us with g and H, and the only
combination that yields the dimension [m s−1 ] is the following:
√
V ∼ [m s ]
−1
gH. (1.2)
So, the velocity is not dependent on the density ρ, and scales with the square
root of the water level H.
This example illustrates again how powerful this analysis based on dimen-
sions is: we are able to derive relevant relationships without knowing the
dynamic details of the system!
8
1.2.1 Systematic dimension analysis
So far it was relatively straightforward to find a relationship between the vari-
ables of a specific system. However, when multiple variables are involved, it
can sometimes become quite hard to perform dimension analysis. We will
now introduce a systematic method to derive relationships between variables
using a mass-spring system as the example.
g
α
m
Figure 1.4: The mass-spring system.
In this case the weight of the mass (being mg) is in equilibrium with the
upward pointing force of the spring. In good (linear) approximation we can
write the magnitude of the spring force as:
where α is the so-called spring constant. The dimension of the force is [N] =
[kg m s−2 ] and that of the extension is [m]. Consequently, the spring constant
has the following dimension: [kg s−2 ].
If we pull downwards on the mass, the spring force will increase and therefore
will also grow bigger than the weight mg. Upon release the mass will begin
9
moving upwards, and will subsequently begin a vertical oscillation. In the
absence of friction this oscillation will be undamped, and the vertical position
of the mass will progress similar to the excursion angle θ(t) of the pendulum
(see figure 1.2).
So, the oscillation of the mass-spring system is also characterized by a timescale,
the period T of the oscillation.
In this mechanical system we can distinguish the following variables and di-
mensions:
independent variables
m [kg]
g [m s−2 ]
α [kg s−2 ]
dependent variable
T [s]
Question: how does the period T of the mass-spring system (see figure 1.4)
depend on the independent variables m, g, and α?
This can be worked out as three equations corresponding to each of the three
units:
[kg] ∶ 0 = a1 + 0 + a3
[m] ∶ 0 = 0 + a2 + 0 (1.6)
[s] ∶ 1 = 0 − 2a2 − 2a3
These are 3 equations with 3 unknowns. Working out this system of equations
gives the solution
10
a1 = 1/2, a2 = 0, a3 = −1/2, (1.7)
√
m
T ∼m 1/2
⋅g ⋅α
0 −1/2
.= . (1.8)
α
We can easily check whether this relationship is correct
√ by evaluating the
√m
dimension of the result. The dimension of α is [ kg s−2 ] = [s].
kg
I - Identify
In this step you identify all relevant information that is needed to solve the
problem. Try to answer the questions: What is the target variable? What
are known variables? What are relevant concepts (e.g., dimension analysis,
energy conservation) you can use as the starting point? Can you estimate
what the answer roughly should be? How do you expect the physical system
to behave when one of the variables is changed?
1
As supplementary study material, you can find videos on Canvas in which we briefly
explain important concepts.
2
The use of the ISEE approach is inspired on the book “University Physics” by Young
and Freedman.
11
S - Set up
E - Execute
E - Evaluate
Although the Execute step should already give you the answer, you are not
done yet until you have checked whether your answer is correct. Is your
answer consistent with the estimations and expectations formulated during
the Identify step? Does your answer have the correct dimension? In case
your answer is an algebraic expression, you can evaluate what happens if you
take extreme values for one of the variables. Also check whether you found
a realistic value. For example, if you find a velocity that is larger than the
speed of light, you for sure made a mistake somewhere.
Connected to the theme of this chapter, one of the most common ways of
evaluating your answer is to do dimension analysis as a consistency check.
The basic idea here is as follows: if an equation describes a physical process,
then all terms separated by a +, −, = or ∼ sign must have the same dimensions.
Consider for example that you found for the pendulum
√
g
T∼ . (1.9)
l
At first sight, nothing seems wrong with this equation. However, since the
time at the left hand side has dimension [s], g is expressed in [ms−2 ], and l
in [m], equation (1.9) basically tells you that
1
[s] = [ ] (1.10)
s
12
which is clearly not correct. In addition, you can also check whether ex-
ponents and arguments of special functions such as sine and cosine do not
have a dimension. For example sin(meters), or 2seconds are incorrect. We
would strongly encourage you for each expression you write down to con-
vince yourself that it is dimensionally correct. This habit will help you to
quickly identify mistakes in your models or answers to (exam) questions.
We can use the systematic dimension analysis method to derive the relation-
ship between the period T and the independent variables m, l and g of a
pendulum.
I - Identify
The target variable is the period T and the known variables are m , l and g.
S - Set up
First, identify the dimensions of the dependent variable and the
independent variables to find a relationship between them. Our inventory is:
• independent variables:
m [kg]
l [m]
g [m s−2 ]
• dependent variables:
T [s]
θ [-]
The next step is to apply systematic dimension analysis and write the
relationship as follows:
13
a
[s] = [kg] 1 ⋅ [m] 2 ⋅ [ms−2 ] 3 .
1 a a
(1.12)
E - Execute
By looking at the dimensions [kg], [m], and [s] independently we can derive
the following set of equations for the coefficients a1 , a2 , and a3 :
[kg] ∶ 0 = a1 + 0 + 0
[m] ∶ 0 = 0 + a2 + a3 (1.13)
[s] ∶ 1 = 0 + 0 − 2a3
These are 3 equations with 3 unknowns. Solving this set of equations gives
the solution:
E - Evaluate
√
Firstly, the dimension should be checked. The dimension of gl is
√
[ mms−2 ]=[s], which is correct. The found relationship corresponds to
equation (1.1). From the result we can conclude that T is not dependent on
the mass m as expected.
14
other areas. Presenting data using plots is the method of choice to illustrate
relationships between different quantities or variables. An example is fig-
ure 1.2 in which the excursion angle of a pendulum is shown as a function of
time. Although plots are quite often drawn using a computer or a graphical
calculator, one should not underestimate the value of being able to draw a
plot by hand. Making a plot helps you to gain insight into the behavior of
the function under study.
Many types of plots exist, but here we restrict ourselves to plots of (math-
ematical) functions of just one variable, say y = f (x), where x is the inde-
pendent variable, f denotes the function, and y is the dependent variable.
The idea of a graph of this function f (x) is to draw two axes, an x-axis and
a y-axis that are perpendicular to each other. The intersection of these two
axes is the so-called origin where (usually) x = 0 = y. Each axis may be
provided with tick marks that indicate numerical values of the two variables
x and y. The functional dependence between x and y is then illustrated by
a line consisting of the set of all points having coordinates (x, y) = (x, f (x)).
Except for trivial or very simple (basic) functions, it makes sense to first
investigate some properties of the function before graphing it. Here are the
most important properties one can evaluate in order to appreciate the local
and global behavior of the function:
(1) Find the intercepts of any kind. A graph will have a y-intercept at
points (0, f (0)) and x-intercepts are found by setting f (x) = 0 and
solving for x.
There are a couple of additional properties of the function that one might
want to investigate in order to show a reasonable accurate sketch of the graph
of the function:
15
(4) Determine all intervals where f (x) is increasing (f ′ (x) > 0)3 or de-
creasing (f ′ (x) < 0). Here f ′ (x) denotes the derivative of f (x) with
respect to x. Moreover, determine the maximum and minimum values
(the so-called extrema) of the function at those locations where the first
derivative changes sign and f ′ (x) = 0.
(5) The function might be even or odd. A function is even if its graph is
symmetric with respect to the y-axis, i.e. f (−x) = f (x) for all x. A
function is odd if its graph is symmetric with respect to the origin, i.e.
f (−x) = −f (x) for all x.
Once one has sufficient information about the behavior of the function, it can
be graphed. Note that you do not necessarily have to perform all 5 steps.
As soon as you understand the trend of the graph, you can start drawing it.
Special functions
The functions cosh(x) (hyperbolic cosine) and sinh(x) (hyperbolic sine) may
perhaps be new to you. These functions are defined as follows:
3
The prime denotes the derivative of the function, see §1.5.
16
Table 1.1: Derivatives of special functions and related integrals.
d
sin(x) = cos(x) ∫ cos(x) dx = sin(x) + C
dx
d
cos(x) = − sin(x) ∫ sin(x) dx = − cos(x) + C
dx
d
exp(x) = exp(x) ∫ exp(x) dx = exp(x) + C
dx
d 1 1
ln(x) = ∫ x dx = ln(x) + C
dx x
d
sinh(x) = cosh(x) ∫ cosh(x) dx = sinh(x) + C
dx
d
cosh(x) = sinh(x) ∫ sinh(x) dx = cosh(x) + C
dx
I - Identify
The function f (x) can be seen as the product of two functions f (x) = g(x)h(x)
with g(x) = x and h(x) = cosh(x).
S - Set up
The function g(x) = x can be sketched as straight line through the origin
with slope 1. The function h(x) = cosh(x) is a special function as defined in
equation (1.16). It can be helpful to memorize the behavior of the special
functions listed in table 1.1. For the sake of the example we will analyze the
behavior of h(x).
By sketching both g(x) and h(x) in the same graph, the function f (x) can be
obtained by multiplying the y-values of g(x) and h(x) for different x-values.
17
E - Execute
e0 + e0
(1) h(0) = =1
2
The y-intercept is (0,1).
ex + e−x
cosh(x) = = 0 does not have a solution, so there is no x-
2
intercept.
This is enough information to sketch the graph. See figure 1.5 for the result.
Now the graph for f (x) can also be sketched by multiplying the y-values of
g(x) and h(x) for different x-values, see also figure 1.5.
E - Evaluate
The graph can be checked by evaluating some of the properties (1-5) for the
graph f (x) itself. For example, the sketched graph is odd, consistent with
the evaluation f (−x) = −f (x).4
4
Note that since h(x) is even and g(x) is odd, f (x) must be odd.
18
Figure 1.5: The functions f (x), g(x) and h(x).
In this course, when we say sketching a graph we expect you to draw a graph
that contains all details of the graph that are relevant for understanding the
underlying physics. Make sure to show a tidy graph rather than presenting
a sloppy or messy one. Use a ruler to draw the axes, put tick marks on each
of the two axes and show numerical values along the axes. Also make sure
that it is clearly stated which quantity is actually shown along each of the
two axes (and what the dimension of that quantity is, if any). Also indicate
important characteristics of the graph in the sketch, such as the maxima or
asymptotes. For example, in figure 1.5 the slope of the graph at x = 0 is
indicated.
19
will need to be able to read text books and scientific literature, it is helpful to
recognize the differences. So, instead of being fully consistent in the courses
of our bachelor program, we will introduce the various notations here, such
that you will learn to use and appreciate the various notations.
20
A benefit of this notation is that you can also define the nth derivative of a
function:
Sometimes the math can be written even more compactly when using New-
ton’s notation, which is also referred to as the dot-notation. In this notation
you place a dot above the dependent variable to indicate differentiation with
respect to the independent variable. This notation is most commonly used
when the time is the independent variable:
...
ẏ, ÿ, y . (1.25)
As a summary, all these notations refer to the same second order derivative:
d2 y d dy d d ′
2
= ( ) = ÿ = ( ẏ) = f ′′
(x) = (f (x)) = D2 y. (1.27)
dx dx dx dx dt
Since we often use Greek letters when defining variables, it can be useful to
memorize the Greek alphabet, as shown in appendix C.
21
2 Vectors, coordinates and motion
In this chapter we will discuss how to describe the motion of objects in
space. To do this we need to establish a suitable administrative framework,
or maybe a few, so that we have a way to quantitatively describe points in
space.
First we will discuss vectors,5 which are an essential concept to describe many
things that cannot be captured by numbers (scalars) alone. Many concepts
later in these lecture notes and in later courses will use vectors. Then we
will discuss a selection of coordinate systems that fit the most frequently
occurring types of motion. These coordinate systems will be useful again in
e.g. the courses 31MCA and 31EMA. With these frameworks established,
we will finally come to the discussion of motion of objects through space.
2.1 Vectors
2.1.1 Definition
A vector is different from a number. You can think of a vector as a geometric
object that has a magnitude and a direction. Most often it is represented by
an arrow, as shown in figure 2.1, to form a directed line segment: the length
symbolizes the magnitude and the direction is indicated by the arrow. A
vector is distinct from a scalar, which is only a number without a direction.
B C D
A
⃗ B,
Figure 2.1: Vectors A, ⃗ C⃗ and D
⃗ with different magnitudes and directions
We can shift a vector in such a way that the start changes, but the length
and direction remain the same. This new arrow is regarded as another rep-
resentative of the same vector. The vectors in figure 2.1 each have a different
length and direction, so they are different vectors.
5
Parts of this chapter are based on the module “Vectors in two and three dimensions”,
from the Department of Mathematics and Computer Science, TU/e.
22
2.1.2 Representation
To distinguish vectors from scalars, we unfortunately use various representa-
tions, mostly modifications of letters. It is important to familiarize yourself
with all of those representation, because you are most certain to come across
all of them during your studies and in all kinds of scientific literature.
Examples include A, A, ⃗ A, ⇀
A.
⎛w1 ⎞
w⃗ = ⎜w2 ⎟ , (2.2)
⎝w3 ⎠
where the third component indicates the amount of units the vector points
in the z-direction.
Another way to represent the vector is the row representation: v⃗ = (v1 , v2 ).
In literature you can also find different types of brackets: v⃗ =< v1 , v2 > or
v
v⃗ = [ 1 ].
v2
⃗ or simply by w and can be calculated
The length of a vector is denoted by ∣∣w∣∣
from its components:
√
⃗ = w1 2 + w2 2 + w3 2 .
∣∣w∣∣
23
v λv
the vector is reversed. Multiplying v⃗ = [ 1 ] results in λ⃗v = [ 1 ], where λ is
v2 λv2
a scalar. This vector λ⃗v is called a scalar multiple of v⃗.
Calculation rules
For every vector v⃗ and scalars λ and µ holds:
v ) = (λµ)⃗
• λ(µ⃗ v
y y
u’
u +v v’ u-v
v v
u u
0 0 x
x
(a) (b)
Figure 2.2: (a) Vector addition of vector u⃗ and v⃗, (b) vector subtraction of
vector u⃗ and v⃗.
In the column representation you can add two vectors by adding the individ-
ual corresponding components:
24
It is not possible to add or subtract two vectors with different dimensions
(i.e. different number of components).
Calculation rules
For all vectors u⃗, v⃗ and w⃗ holds:
• v⃗ + w⃗ = w⃗ + v⃗
u + v⃗) + w⃗ = u⃗ + (⃗
• (⃗ ⃗
v + w)
Furthermore, there also rules for which scalar multiplication as well as vector
addition plays a role:
⃗ = λ⃗
v + w)
• λ(⃗ v + λw⃗
• (λ + µ)⃗
v = λ⃗
v + µ⃗
v
A line connects two points to each other. In secondary school you learned
that you can write a line in in 2D in the form of
y = ax + b, (2.4)
where a represents the slope or gradient of the line and b is the y-intercept.
More generally you could define a line in 2D as
(y1 − y0 )
(y − y0 ) = (x − x0 ) (2.5)
(x1 − x0 )
25
connecting the points (x0 , y0 ) and (x1 , y1 ). In this representation the slope
(y1 − y0 )
is represented by and the offsets are given by x − x0 and y − y0 .
(x1 − x0 )
a + λv
v
a
26
as parametric representations, or vector representations of lines l and m, re-
spectively. For both lines, v⃗ is the so-called direction vector. The vector a
⃗ is
a supporting vector. Both the direction vector and the supporting vector are
not uniquely defined. Any multiple of v⃗ could also be used. Furthermore,
⃗, any vector on line m could serve as an alternative supporting vec-
besides a
tor.
How do we describe a line through two points, let’s say points P and Q? We
can use the vectors from the origin O to each of the points, p⃗ from O to P
and q⃗ from O to Q. The vector from P to Q is given by q⃗− p⃗ and can be used
to indicate the direction of the line. The vectors p⃗ and q⃗ both end on the
line, and can therefore function as supporting vector. This gives as possible
vector representation of the line:
x⃗ = p⃗ + λ(⃗
q − p⃗). (2.9)
Example
If we consider the points (2,3,-1) en (3,4,1), a direction vector for the lines
through these points is:
⎛3⎞ ⎛ 2 ⎞ ⎛1⎞
v⃗ = ⎜4⎟ − ⎜ 3 ⎟ = ⎜1⎟ . (2.10)
⎝1⎠ ⎝−1⎠ ⎝2⎠
⎛2⎞ ⎛1⎞
x⃗ = ⎜ 3 ⎟ + λ ⎜1⎟ . (2.11)
⎝−1⎠ ⎝2⎠
x a v
l ∶ x⃗ = ( ) = ( 1 ) + λ ( 1 ) (2.12)
y a2 v2
27
If we want to describe the line l with an equation, we have to eliminate the
parameter λ from the two equations:
⎧
⎪
⎪ x = a1 + λv1 ,
⎨ (2.13)
⎪
⎩ y = a2 + λv2 .
⎪
Multiplying the first equation by v2 and the second by v1 and then subtracting
them gives:
v2 x − v1 y = v2 a1 − v1 a2 (2.14)
in which λ is eliminated. After dividing by v1 , this equation can be rewritten
as:
v2 v2
y = x + (a2 − a1 ) (2.15)
v1 v1
which may look more familiar, as it has the form y = ax + b.
⎛a1 ⎞ ⎛v1 ⎞
⃗ = ⎜a2 ⎟, and has direction vector v⃗ = ⎜v2 ⎟.
This line goes through a
⎝a3 ⎠ ⎝v3 ⎠
2.2.2 Planes
In three dimensions we do not only have lines, but we also have planes.
Planes can also be described using vectors. In contrast to a line, we need
one supporting vector and two direction vectors, as illustrated in figure 2.4.
These two direction vectors should not be a scalar multiple of each other.
Furthermore, each of the direction vectors needs its own independent pa-
rameter in order to describe every possible point in the plane. The plane U
going through the origin and with direction vectors u⃗ and v⃗ is given by the
parametric representation:
U ∶ x⃗ = λ⃗
u + µ⃗
v
28
u
u v
v
a
O O
Figure 2.4: Left: plane through the origin, right: plane through supporting
⃗ both with direction vectors u⃗ and v⃗.
vector a
V ∶ y⃗ = a
⃗ + λ⃗
u + µ⃗
v.
Similar to lines, direction and supporting vectors are not uniquely defined
per plane.
29
If we consider a plane V :
⎛ x⎞ ⎛ 2 ⎞ ⎛1⎞ ⎛2⎞
⎜y ⎟ = ⎜ 1 ⎟ + λ ⎜−1⎟ + µ ⎜−1⎟ .
⎝z ⎠ ⎝−2⎠ ⎝0⎠ ⎝−1⎠
x + y + z = 1. (2.17)
30
The base vectors are usually labeled î, ĵ, k̂, for the x, y and z direction,
respectively.
Using the knowledge about adding vectors discussed previously, this means
that every vector can now be described as the sum of 3 vectors
A⃗ = Ax î + Ay ĵ + Az k̂. (2.18)
31
So, for any given point in space (x, y) an equivalent set of coordinates (r, θ)
exists that perfectly describes the same point. This defines the relation be-
tween x, y, r and θ (for positive values of x):
√
r = x2 + y 2 (2.19)
y
θ = arctan (2.20)
x
This also leads to the inverse relation:
x = r cos θ (2.21)
y = r sin θ (2.22)
We can also define base vectors for the polar coordinate system: r̂ and θ̂ for
the r and θ directions.
- Movie - Coordinate systems
2.4 Motion
Now that we have established the administrative framework to describe the
position of an object in space, it is time to start using it to describe motion.
In this course, we will focus specifically on kinematics, which describes the
motion as it happens, but does not cover why it happens (due to what forces,
as covered in dynamics).
2.4.1 Displacement
Describing a position in space is something we can now easily do by using a
vector r⃗. To describe a displacement we need to describe two positions.
For example, imagine an object that is moved from a position r⃗1 to a position
r⃗2 . The displacement S⃗ is then given by r⃗2 − r⃗1 (see figure 2.6).
32
z
r2 S
r1
0
y
v = ∫ adt (2.27)
33
and similarly the position x can be found by integrating the velocity v
x = ∫ vdt. (2.28)
Besides the position x, we can calculate the path length s, i.e., the traveled
distance, of this mass by integrating the absolute value of v over time t:
dx
s = ∫ ∣v∣ dt = ∫ ∣ ∣ dt. (2.29)
dt
If we graph the position, velocity and acceleration as function of time we can
see the same relations as given above. Figure 2.7 shows these graphs in case
of a constant acceleration.
dx dv
x v dt a
dt
∫vdt ∫adt
0 t 0 t 0 t
To expand the 1D definitions to motion in 3D, we will now rewrite the above
equations in terms of 3D position vectors.
d⃗
v dvx dvy dvz d2 r⃗
⃗=
a = î + ĵ + k̂ = 2 (2.33)
dt dt dt dt dt
Of course, it is also possible to describe our motion in polar coordinates. You
can use figure 2.8 to find the velocity and acceleration in polar coordinates.
In exercise 9.2.7 you will show that the radial and azimuthal component of
the velocity are given by:
vr = ṙ,
(2.34)
vθ = rθ̇.
Similarly, in exercise 9.2.8 you will deduce that the radial and azimuthal
component of the acceleration are:
2
ar = r̈ − r (θ̇) ,
(2.35)
aθ = rθ̈ + 2ṙθ̇.
ax = 0 (2.36)
ay = −g (2.37)
x(t) = at + b
} (2.38)
y(t) = − 21 gt2 + ct + d,
35
Figure 2.8: Mass with velocity (a) expressed in Cartesian coordinates, (b)
expressed in polar coordinates, (c) expressed in both coordinates systems and
(d) in Cartesian coordinates projected on the radial direction.
36
We will show this for the case where v0 = 0 (the bullet is shot in a purely
horizontal direction, with initial velocity u0 ≠ 0). In this case (2.40) reduces
to
x(t) = x0 + u0 t
} (2.41)
y(t) = y0 − 12 gt2 .
To find the equation for the trajectory, we are now going to ‘eliminate’ the
time t. This will describe the relationship between x and y for the trajectory
of the projectile. In doing so, we create a single equation that describes
the path of the motion, but we lose all the information about the timing
of the motion. We will achieve this by writing the first equation (2.41) as
t = (x − x0 )/u0 , and substituting this in the second equation (2.41):
g
(y − y0 ) = − 2
(x − x0 )2 . (2.42)
2u0
(x0,y0)
0 x
37
3 Evolution equations
In this chapter we want to make a start with the analysis of the dynamic
behavior of a (physical) system by considering the time dependence of the
dependent variables. The type of equations we use to study this time-
dependence are called evolution equations, as they describe how the system
evolves as time progresses. We will formulate evolution equations for several
examples, ranging from thermodynamics to electrical circuits.
U
A
ρ
h
A0
38
The water volume in the tank
V = A0 h, (3.3)
increases with the water supply (ϕV ). Apparently, the volume V , and there-
fore the water height h, are dependent on time:
In other words, these quantities both are functions of the time. An example
of the course of the water height h(t) in time is illustrated graphically in
figure 3.2. The question now is: how can we determine an expression for the
course of h(t) at a given volume flow rate ϕV ?
h
h(t)
h0
0
t
Figure 3.2: The course of the water height h as a function of the time t.
The volume flow rate ϕV of the added water results in an increase of the water
volume in the tank. During a time span ∆t the water volume increases from
V (t) to V (t + ∆t) according to:6
Figure 3.3 shows the water tank again, but now with the variables we just
defined.
6
Note that this expression is only correct when ϕV is constant.
39
Φv
ΔV = V(t+Δt) -V(t)
h(t+Δt)
h(t)
Figure 3.3: During a time span ∆t the volume flow rate ϕV results in a
volume increase ∆V.
We choose the time span ∆t to be small, but ≠ 0, so we can divide the left
and right hand side of equation (3.6) by ∆t:
∆V V (t + ∆t) − V (t)
= = ϕV . (3.7)
∆t ∆t
dV
In the limit ∆t → 0, the left hand side is equal to the derivative , so:
dt
∆V dV (t)
lim = = ϕV (3.8)
∆t→0 ∆t dt
With this we have derived the evolution equation for V (t): this differential
equation (see §3.3) describes the change in volume V (t) in time resulting
from the incoming water flow rate ϕV .
In the case ϕV = constant this equation can simply be solved for V (t) by
integrating the left and right hand side over t:
dV
∫ dt = V (t) = ϕV t + C. (3.9)
dt
The integration constant C can be determined with an initial condition
t = 0 ∶ V = V0 , (3.10)
which results in
V (t) = V0 + ϕV t. (3.11)
40
We can also perform the integration of equation (3.8) between two bound-
aries, e.g., from t′ = 0 to t′ = t. The result then is
t′ =t dV ′ t′ =t t
∫t′ =0 dt = V ∣ = V (t) − V 0 = ϕV t′
∣ = ϕV t, (3.12)
dt′ t′ =0 0
V0 ϕV
h(t) = + t. (3.13)
A0 A0
With ϕV = U A (see equation (3.1)) this becomes:
UA
h(t) = h0 + t, (3.14)
A0
where h0 = h(t = 0) is the water height at t = 0. The water height h increases
linearly (for constant ϕV ) with t, so similar to what we saw earlier in figure
dh
3.2. The slope of this graph for h(t) is equal to the derivative , and this
dt
quantity describes the change of h in time:
dh ϕV U A
= = . (3.15)
dt A0 A0
Φv
vsur
h(t)
Figure 3.4: The velocity vsur with which the water surface rises is equal to
dh
.
dt
41
So, this quantity is equal to the velocity vsur with which the water surface
rises:
dh
= vsur , (3.16)
dt
as is illustrated in figure 3.4.
T(t)
Φw
Figure 3.5: A solid object that receives a heat flow rate ϕw from the surround-
ings will experience an increase in average temperature.
42
of which the solution can be found by integration:
ϕw
T (t) = t + C. (3.19)
Cw
The integration constant C can be determined by applying the initial condi-
tion T (t = 0) = T0 , which results in C = T0 .
ϕw = −α(T − T∞ ), (3.20)
where T and T∞ are the temperature of the object and the surroundings,
respectively, and α is the so-called heat transfer coefficient [J s−1 K−1 ]. With
this equation (3.17) becomes
dT
Cw = −α(T − T∞ ). (3.21)
dt
In order to solve this equation it is useful to introduce the ‘over temperature’
T ≡ T − T∞ . Since
dT dT
= (3.22)
dt dt
we can rewrite equation (3.21) with this to
dT α
= − T. (3.23)
dt Cw
This evolution equation can be solved (using separation of variables, ex-
plained below in §3.3.5), and has the solution:
α
T = T − T∞ = C exp (− t) . (3.24)
Cw
Again, the constant C follows from the initial condition T (t = 0) = T0 result-
ing in C = T0 − T∞ . With this the solution becomes:
T (t) − T∞ α
= exp (− t) . (3.25)
T0 − T∞ Cw
43
Apparently the temperature T (t) shows an exponential decay to the final
(surrounding) temperature T∞ . The timescale (i.e. lifetime) associated with
this decay is
Cw
τ= . (3.26)
α
This characteristic timescale also follows from an analysis of the dimensions
of the relevant independent physical parameters in this problem, see exercise
9.3.18.
dT
= −α(T − T∞ ) (3.28)
dt
In this section, we discuss some basic properties of differential equations from
a mathematical perspective. Here will introduce some relevant concepts and
terminology that we need to continue our discussion on evolution equations
in the next section. In addition, we will provide some guidelines for solving
differential equations.
44
We discussed above that in case ϕV is constant, the solution can be found
easily by integrating the left and right hand side over t, as demonstrated in
equation (3.9).
Please note that simply integrating the left and right hand side of a differ-
ential equation only works if the right hand side is a constant. If we for
example consider the simple differential equation
dx
= x, (3.29)
dt
then integrating the left and right hand side over t gives:
dx
∫ dt dt = ∫ x(t) dt. (3.30)
Since we do not know the unknown function x(t) at this point, the integral
at the right hand side cannot be evaluated. Instead, this differential equation
can be solved using the method of separation of variables, as discussed below
in §3.3.5, giving as a solution:
x(t) = et , (3.31)
Please check for yourself by filling in equation (3.31) in equation (3.29) that
this is indeed a solution.
45
In this course we predominantly refer to differential equations for functions
of one variable. We then speak of an ordinary differential equation. Ordinary
differential equations exist in many ‘shapes and sizes’. Let us give a number
of examples of differential equations for a function x(t):
d2 x
+ x = 0, (3.32)
dt2
dx
+ 5x = 0, (3.33)
dt
d2 x
− 9x = 0, (3.34)
dt2
d4 x dx
+ + 2tx = 0, (3.35)
dt4 dt
d2 x
+ sin(x) = 0, (3.36)
dt2
dx
x − (x2 + 1) = 0, (3.37)
dt
d2 x
+ 2x = sin(t). (3.38)
dt2
Using these examples we are now going to discuss several properties of or-
dinary differential equations. As mentioned above, we do this to determine
the method we will employ to solve the differential equation or to study the
behavior of the solutions.
46
3.3.1 Order of a differential equation
The order of a differential equation is a natural number that gives the highest
derivative in the equation. So, equations (3.33) and (3.37) are 1st order since
the highest derivative in these two equations is a 1st order derivative. Equa-
tion (3.35) is a 4nd order differential equation and all the other differential
equations are of the 2nd order.
Sometimes (for reasons that will become clear in chapter 6) differential equa-
tions of the 2nd or higher order are written as a system of first order differ-
ential equations. Consider for example equation (3.32), and let x1 = x. We
introduce a new function x2 (t), which is defined by
dx1
x2 (t) = . (3.39)
dt
With this new function we can also formulate (3.32) as follows:
⎧
⎪ dx1
⎪
⎪
⎪ = x2 ,
⎪ dt
⎨ (3.40)
⎪
⎪
⎪ dx2
⎪
⎪ = −x1 .
⎩ dt
We call this a system of two coupled 1st order differential equations. If we
eliminate the function x2 (t) from these two equations (by differentiating the
first equation with respect to t and then using the second equation) we find
equation (3.32) again. In general, a differential equation of the order N can
be written as a system of N coupled 1st order differential equations.
47
3.3.3 Linear versus non-linear
A differential equation is linear if the dependent variable (e.g., x in the ex-
ample) appears only to the 1st power, and no products of the dependent
variables (or its derivatives) or special functions are included in the equa-
tion. Examples of non-linear terms are higher powers (x2 , x3 ), products such
as xy in coupled differential equations (e.g., in the Lotka-Volterra model dis-
cussed in chapter 5), or sin θ in the non-linear pendulum equation (7.16).
Non-linear equations are the rule rather than the exception in physics and
are notorious for being hard to solve. Quite often, the computer will have
to help in order to learn something about the solutions, or the solutions can
be studied graphically, as will be discussed further in chapters 6 and 7. On
the other hand, the solutions of non-linear differential equations can show
extraordinarily interesting and intriguing behavior, as we will see later in
chapter 8.
48
So if an equation has an infinite number of solutions, which is the solution
that we are looking for? That is determined by additional constraints we
impose on the function. For example, such a constraint can be that we are
looking for a solution of equation (3.33) in a certain region 0 ≤ t < ∞ and
that for t = 0 the function has to have a certain value, e.g. 1. When we
demand that x(0) = 1 the constant is set and with that the solution has
been determined uniquely: x(t) = e−5t . Such a constraint (or constraints)
that is imposed on the function that we are looking for is called a boundary
condition. When the independent variable is the time, we tend to speak of
initial conditions instead of boundary conditions.
49
3.3.5 Autonomous versus non-autonomous
We call a differential equation autonomous when the independent variable
does not occur explicitly in the differential equation.
Consider the following system of N coupled 1st order differential equations
for the N dependent variables x1 , x2 , . . . , xN :
dx1
= f1 (x1 , x2 , . . . , xN ),
dt
dx2
= f2 (x1 , x2 , . . . , xN ),
dt (3.44)
⋮
dxN
= fN (x1 , x2 , . . . , xN ).
dt
Since the right hand sides, the functions f1 , f2 , . . . , fN , do not explicitly de-
pend on the independent variable t we call the system of differential equa-
tions (3.44) autonomous. Out of the equations (3.32)-(3.38) two are non-
autonomous: the differential equations (3.35) and (3.38), since in these equa-
tions the independent variable (in this case t) occurs explicitly.
50
Next, we integrate both on the left and right hand side of the = sign:
1
∫ F (x) dx = ∫ dt = t − t0 , (3.47)
Example
By using the above, we know that the solution to this equation is determined
by
1
∫ x(2 − x) dx = ∫ dt = t − t0 . (3.49)
The integral over x can easily be calculated (also check this yourself!):
1 1 1 1 1
∫ x(2 − x) dx = ∫ 2 ( x − x − 2 ) dx = 2 {ln ∣x∣ − ln ∣x − 2∣} (3.50)
e2t
x(t) = 2 . (3.52)
e2t + e2t0
51
The integration constant t0 is determined by the initial condition for x(t). If
we demand, for example, that x(t = 0) = 1 then the solution becomes
e2t et et
x(t) = 2 = 2 = , t ≥ 0, (3.53)
e2t + 1 et + e−t cosh(t)
df (t)
= g(t)h(f (t)) (3.54)
dt
in which g and h are functions. Rearranging the terms gives:
df (t)
= g(t)dt, (3.55)
h(f (t))
dx
= g(t)dt. (3.56)
h(x)
This differential equation can be solved by integrating the left and right hand
side separately.
F = ma, (3.57)
52
which means that the force F that needs to be supplied to give a mass m an
acceleration a is equal to m ⋅ a. In physics we often use Newton’s second law
as a starting point for formulating evolution equations.
where momentum = mv, with v the velocity (in the direction of the force):
d
F= (mv). (3.58)
dt
In many cases we can assume m is a constant, such that equation (3.58)
becomes:
dvx d2 x
Fx = ma = m =m 2, (3.59)
dt dt
where Fx is the force in the direction (x) of the motion of the mass.
In case multiple forces act on a mass, the sum of the forces should be taken.
d2 x
∑ Fx = m . (3.60)
dt2
In this summation, the direction of the forces should be considered. Forces
directed in the positive x-direction are taken positive and forces directed in
the negative x-direction are taken negative.
F = (Fx , Fy ). (3.61)
53
Ff M v(t)
Figure 3.6: Rolling car being slowed down by the frictional force Ff .
us:
d2 x ⎫⎪
x-direction ∑ Fx = m ⎪
dt2 ⎪ ⎪
⎪
⎬ (3.62)
d2 y ⎪⎪
⎪
y-direction ∑ Fy = m 2 . ⎪ ⎪
dt ⎭
As said, we will use Newton’s second law for formulating evolution equa-
tions. During secondary school you already used Newton’s second law to
solve dynamic problems. By using the symbol a for acceleration, instead of
2
the second derivative of the position x with respect to the time ddt2x , it had
been camouflaged that you were in fact dealing with a differential equation
(to keep it simple).
Because of the 2nd order derivative, you generally obtain a 2nd order differen-
tial equation, as discussed further in chapter 5. Here we will give an example
of using Newton’s second law to formulate a 1st order differential equation.
A car (with mass M ) moves across a horizontal road with velocity v, see
figure 3.6. At time t = 0 the engine is turned off and the car rolls further
without being powered. The car is now subject to a (rolling) resistance force
Ff that is proportional to the velocity:
Ff = −αv, (3.63)
where α is the coefficient of friction [kg s−1 ]. The question now is: can we
derive an expression for the (decreasing) velocity v(t) of the car?
Newton’s law given by equation (3.58) now looks like the following:
dv
M = −αv. (3.64)
dt
54
This differential equation has the following solution (found using separation
of variables):
α
v(t) = C ⋅ exp (− t) , (3.65)
M
where C is a random constant. With the initial condition v(t = 0) = v0 ,
equation (3.65) becomes:
I - Identify
Known variables are the radius of curvature R, the force in the direction of
motion Fe , the (rolling) resistance force of Ff = −αvθ , and the coefficient of
friction α. The velocity of the car vθ is a function of time vθ = vθ (t), but
its time-dependence is not given. However, as discussed above, vθ is not the
target valuable, since the question only asks for the evolution equation.
The given radius of curvature hints that the motion is along a circular path.
Therefore the motion along the curve can be described conveniently in polar
55
Figure 3.7: Rolling car in a curve with radius R.
What do we expect for the behavior of the physical system? Since there is a
force in the direction of movement (Fe ) and a force in the opposite direction
(Ff ), their relative values should determine whether the car decelerates, has
a constant velocity, or accelerates in the curve.
S - Set up
An important step is to make a drawing, see figure 3.7. Newton’s law should
be evaluated in the azimuthal direction. In the drawing, we chose the direc-
tion of the car counterclockwise (indicated with the velocity vθ ), such that
the movement is in the positive θ-direction. Following that choice, the sum
of the forces in the azimuthal direction is given by
E - Execute
56
The evolution equation is:
Fe − αvθ
θ̈ = (3.69)
mR
E - Evaluate
It is always valuable to check whether the dimensions at the left and right
side of the equal are the same:
which is correct.
Furthermore, the answer reveals that if Fe > αvθ , the car accelerates in the
curve (θ̈ > 0). The car has a constant angular velocity (θ̈ = 0) for Fe = αvθ ,
and decelerates (θ̈ < 0) for Fe < αvθ , in agreement with our expectation.
dq
I =∣ ∣, (3.71)
dt
in which the vertical bars indicate that the absolute value is taken.
57
in which positive charges flow. This means that when considering a flow
of electrons through a metal wire, the current I is defined in the direction
opposite to the actual transport of electrons.
The main other components of electrical circuits that we consider here are
the resistor R [Ω] and the capacitor C [F]. When a circuit contains multiple
resistors, it is often useful to define an equivalent resistance. When resistors
are in series, the equivalent resistance is given by:
These equivalent resistances can be used for very simple circuits, but in many
cases we will have to use Kirchhoff ’s rules to describe the currents and po-
tential differences in more complex circuits. To this end, we need to define
two new terms: a junction and a loop. A junction is a point in an electrical
circuit where three or more wires are connected. Any closed conducting path
containing wires and electrical components is a loop. Figure 3.8 shows an
example of an electrical circuit consisting of several junctions and loops.
Kirchhoff ’s junction rule defines that the sum of the currents at a junction
is zero:
N
∑ In = 0 . (3.74)
n=0
58
Junction a
Loop 3
R1 R2 R3
Loop 1 Loop 2
+ +
ε1 ε2
d
Junction b
Figure 3.8: Electric circuit containing three loops and two junctions.
The junction rule follows if you consider that there should be conservation of
electric charge. Kirchhoff’s junction rule is analogous to a water-pipe junc-
tion, for which the flow rate of water leaving the junction should be equal to
the flow rate of water entering the function. When using Kirchhoff’s junction
rule, the direction of the current should be taken into account. See the recipe
below for more details on how do apply Kirchhoff’s rule correctly.
Besides the junction rule, there is Kirchhoff ’s loop rule which states that the
sum of the potential differences V [V] in any loop is equal to zero:
N
∑ Vn = 0 . (3.75)
n=0
59
2. Also label all currents. If a current is unknown, you can assume a direc-
tion. You will find a negative sign for the current if the actual current
is in the opposite direction to what you have assumed. Already take
Kirchhoff’s junction rule into account as much as possible to minimize
the number of currents (e.g., label a current as I1 + I2 ).
6. By going around each loop in the assigned direction, evaluate the po-
tential differences, and work out equations according to Kirchhoff’s
loop rule. Any source of electromotive force, as well as all potential
differences over resistors and capacitors have to be taken into account,
considering the sign conventions as illustrated in figure 3.9.
- -
I + I
+ - + - +
+ε -ε +IR -IR
Figure 3.9: (a-d) Sign conventions for potential differences when evaluating
a loop. You can label each terminal of emf, resistor or capacitor with a + or
− sign, depending on the direction of the current (from + to −). When going
around in a loop, the potential difference ∆V is positive if you go from − to
+, and negative if you go from + to −.
60
t=0s
+-
R C
We are now going to discuss how to use Kirchhoff’s rules as a starting point
for formulating an evolution equation for the current in an electrical circuit.
As an example, we will look at the discharging of a capacitor. Figure 3.10
shows an electrical circuit containing a capacitor and a resistor. The capaci-
tor initially contains a charge Q0 [C], and is discharged through the resistor
by closing the switch at t = 0 s.
q
VCap = . (3.77)
C
The potentials at the terminals of the capacitor are indicated, from which
the direction of the current can be deduced, as indicated in figure 3.11. If we
evaluate a loop in counterclockwise direction, we get:
N
q
∑ Vn = IR − =0 (3.78)
n=0 C
We can use that the current is the rate of change of the charge (equation
(3.71)). However, do we need to use I = +dq/dt or I = −dq/dt? We know
61
Loop
I +-
R C
Figure 3.11: The electric circuit of figure 3.10 with the direction of the current
and the loop indicated.
that the charge q should decrease when the current flows; the capacitor is
losing charge. So, the current is equal to the negative rate of change of the
charge at the capacitor. This gives the evolution equation for the charge on
the capacitor plate:
dq q
=− (3.79)
dt RC
Again, this evolution equation can be solved using separation of variables,
resulting in an expression for the time-evolution of the charge in the circuit:
t
q = Q0 e− RC (3.80)
τ = RC. (3.81)
Check for yourself that the product of the resistance and the capacitance
indeed has the unit [s].
The evolution equation for the current can be found by simply taking the
derivatives of equation (3.80):
dI d2 q Q0 − t
=− 2 =− e RC . (3.82)
dt dt (RC)2
62
3.6 Exponential decay and characteristic timescales
In the previous sections, we have seen 3 examples of the differential equations
of similar form:
dT α
=− T (3.83)
dt Cw
dV α
=− V (3.84)
dt M
dq q
=− (3.85)
dt RC
All these physical systems can be formulated in the general form:
dN
= −CN, (3.86)
dt
with C a constant. This equation describes that the rate of change of the
function N (t) is equal to a negative constant times the function itself. Such
equations describe systems in which there is exponential decay. The solution
to the general equation is:
63
has the dimension second. Alternatively, similar to how the constant C in
equation (3.87) should have the dimension [1/s] because the argument of the
exponent should be dimensionless, sometimes you can easily find a (combi-
nation of) variables that has the dimension [s] by evaluating a mathematical
expression.
Concluding remarks
In this chapter, most of the examples involved first order differential equa-
tions, except for the ISEE example about the car in a curve. In chapter 5
there will more attention for second order differential equations.
64
4 Physical models
One of the main skills of a physicists is to capture the complex reality of natu-
ral and technological phenomena in a physical model. A model is a simplified
representation of a physical system, which can have many different forms. A
scale model can for example be used to study the behavior of a large object,
while a conceptual model describes a complex situation with abstractions of
elements of the real world. Examples of physical models discussed so far are
the pendulum for a swing or a clock, and the mass-spring system, which can
serve as model for vibrations of bonds in molecules.
In the last part of the previous chapter it was shown that very different physi-
cal systems can sometimes be described with similar mathematical equations.
In this chapter, we will discuss the simplification of evolution equations using
the method of nondimensionalization in order to recognize such similarities.
In addition, it will be demonstrated how nondimensionalization can help to
judge the importance of different terms in an evolution equation.
A very simplistic climate model would be to consider the surface of the earth
and just one layer of the atmosphere. The state of both of these “objects” can
be described with the temperature as the dependent variable. You can write
65
down evolution equations for temperature of the surface and the one-layer-
atmosphere, similar to equation (3.21). Instead of just one heating/cooling
term at the right hand side of the equation, you will have to consider: (i )
heating by the radiation of the sun, (ii ), the reflection of light at the surface,
which in turn heats the atmosphere, (iii ) the loss of heat to the surrounding,
et cetera. You understand we end up with a complicated differential equa-
tion with many terms. Since there is interaction between the surface and the
one-layer atmosphere, you will have two coupled differential equations. Now
think about that the atmosphere consists of a troposphere, stratosphere,
mesosphere, and thermoshere, which all have different characteristics, while
there is also lateral transport of heat as a result of e.g. wind or the Gulf
stream.
66
Recipe: Nondimensionalization of evolution equations
1. Make an inventory of all the variables and their dimensions.
2. Scale the dependent variable and the main independent variable (e.g.,
the time) using constants or ‘typical’ values defined in the problem,
for example the initial temperature or the size of an object: Ã = AA0 ,
where à is a dimensionless variable. Independent variables that serve
as physical constants in the problem do not need to be rescaled.
3. Substitute A = ÃA0 into the evolution equation and simplify the equa-
tion. The evolution equations become dimensionless: instead of many
dimensional variables, the equation now only contains a few dimension-
less variables.
• independent variables:
time t [s]
mass M [kg]
coefficient of friction α [kg s−1 ]
initial velocity v0 [m s−1 ]
• dependent variables:
velocity v [m s−1 ]
67
We need to nondimensionalize the dependent variable velocity v and the in-
dependent variable time t. For the rest, M , α and v0 are constants defined
in the problem.
The initial condition v(t = 0) = v0 can be used to rescale the dependent vari-
able v via ṽ = vv0 . To rescale the time, we need a combination of variables
with the dimension of [s]. A look at the inventory reveals that M /α has the
unit [s], so we can use t̃ = M
α
t.
Substituting v = v0 ṽ and t = α
M t̃ in the evolution equation 4.1 gives:
dṽv0 α
= − ṽv0 . (4.2)
d(α/M )t̃ M
dṽ
= −ṽ. (4.3)
dt̃
Finally, we also have to nondimensionalize the initial condition: v(t = 0) = v0 .
We can again use v = v0 ṽ, giving:
v0 ṽ(t = 0) = v0 . (4.4)
Note that when t = 0, t̃ should also be zero. This gives as the nondimension-
alized initial condition:
ṽ(t̃ = 0) = 1. (4.5)
In this case, all the constants cancel out when we simplify the equation, so
we can skip step 5 of the recipe.
68
variable. This means that when we nondimensionalize a differential equation,
d
we have to change the variable in the differential operator, e.g, from to
dt
d
. How can we do that? You are familiar with the chain rule:
dt̃
df df dt̃
= (4.6)
dt dt̃ dt
For the re-scaling of the independent variable we use other variables that
do not depend on that specific independent variable (i.e., not on the time t
dt̃
in this case). Consequently, the derivative should be a constant factor.
dt
α dt̃ α
In the previous example, we used t̃ = t, which gives = and thus
M dt M
dv α dv
= . Note that this is exactly the same result as what we obtained
dt M dt̃
by just substituting t̃ = M
α
t into the differential operator.
dT̄
Cw = −αT̄ , (4.7)
dt
with initial condition
T̄ (t = 0) = T0 − T∞ . (4.8)
I - Identify
69
• independent variables:
time t [s]
heat capacity Cw [J K−1 ]
heat transfer coefficient α [J s−1 K−1 ]
ambient temperature T∞ [K]
initial temperature T0 [K]
• dependent variable:
over temperature T̄ = T − T∞ [K]
S - Set up
For the temperature, the most logical choice would be to rescale T̄ by the
initial over temperature T0 − T∞ . For t, there is only one other variable that
has a dimension that contains seconds, namely α (which has units [J s−1
K−1 ]). To construct a typical timescale we therefore choose Cw /α (verify
for yourself that this ratio has indeed the dimension [s]). The dimensionless
variables now read
T̄ αt
T̃ = , t̃ = . (4.9)
T0 − T∞ Cw
E - Execute
d(T0 − T∞ )T̃
Cw = −α(T0 − T∞ )T̃ , (4.10)
d(Cw t̃/α)
(T0 − T∞ )T̃ (t = 0) = T0 − T∞ . (4.11)
70
Bringing the constants in front of the derivative we obtain
α(T0 − T∞ ) dT̃
Cw = −α(T0 − T∞ )T̃ , (4.12)
Cw dt̃
(T0 − T∞ )T̃ (t = 0) = T0 − T∞ . (4.13)
Next, we divide both the left-hand and right-hand side of equation (4.12)
by α(T0 − T∞ ) and the left-hand and right-hand side of equation (4.13) by
(T0 − T∞ ) to arrive at
dT̃
= −T̃ , (4.14)
dt̃
T̃ (t = 0) = 1. (4.15)
E - Evaluate
Hence, instead of six, the problem now contains only two variables: T̃ and
t̃. To check our results, we can confirm that the left- and right-hand sides of
equations (4.14) and (4.15) are all dimensionless. In addition, we can check
that T̃ and t̃ are dimensionless.
From equation (4.9) we can immediately see that the effect of increasing the
heat transfer coefficient on the temperature of the object is the same as the
effect of decreasing the heat capacity. Likewise, if both the heat capacity
and the heat transfer coefficient are doubled, the temperature of the object
remains unchanged.
71
4.3 Simplifying evolution equations
In the previous examples we dealt with relatively simple models, for which
you may have concluded that nondimensionalization is strictly speaking not
a crucial step when analyzing the system. However, real-world problems of-
ten consist of a combination of many coupled physical processes, as discussed
in § 4.1. We write down the evolution equation(s) to model the balances be-
tween the different mechanisms. If we are lucky, not all of these are equally
important, and some terms may be neglected all together. Nondimension-
alization allows you to assess the importance of each term beforehand and
bring the equations into a standard mathematical form that one can then
(potentially) solve.
I - Identify
72
Figure 4.1: Free body diagram showing the two forces acting on the object
along the y axis. Note that the positive y-direction is taken downwards, such
that the movement is in the positive y-direction.
• dependent variable:
velocity v [m s−1 ]
S - Set up
From√ this inventory we find that the vtime t can be made dimensionless via
t̃ = Hg t, and the velocity v via ṽ = √gH . Please note that these choices are
not unique.
√ For example, the time can alternatively be made dimensionless
using t̃ = Dg
m t (see footnote below).
E - Execute
√ √
Inserting t = Hg t̃ and v = gH ṽ in the equation gives:
√ √
d( gH ṽ)
m √ = mg − D( gH ṽ)2 . (4.20)
d( H/g t̃)
If we bring the constants in front of the derivative and work out the squared
73
term then we get:
√ √ g dṽ dṽ
m gH = mg = mg − DgH ṽ 2 . (4.21)
H dt̃ dt̃
Dividing left and right with mg results in:
dṽ DH 2
=1− ṽ = 1 − αṽ 2 , (4.22)
dt̃ m
DH
where α = is a dimensionless parameter that describes the behavior of
m
the system.7
E - Evaluate
The left- and right-hand sides of equation (4.22) are dimensionless. Further-
−1
more we can check that α [ kg mkg m ]=[-] indeed does not have a dimension.
dṽ
= −αṽ 2 . (4.23)
dt̃
This differential equation can be solved using separation of variables (see
§3.3). As a (dimensionless) initial condition we consider ṽ(t̃ = 0) = 1. This
gives for the solution:
1
ṽ(t̃) = . (4.24)
1 + αt̃
A graph of the evolution of the velocity is given in figure 4.2. The velocity
asymptotically approaches zero when time progresses. We can convince our-
selves that this solution is correct by thinking about specific examples. A
√
7
In case we would have used t̃ = Dg m
t instead, the simplified evolution equation would
√ dṽ 2
be: α dt̃ = 1 − αṽ . Please check for yourself that the analysis of the different cases gives
the same conclusions.
74
feather is an example of an object characterized by a large value for the drag
coefficient D, such that α >> 1 holds. A feather can fall initially with some
speed, but it then decreases to almost zero because of the dominating drag
force. It also makes sense to have asymptotic behavior of the velocity such
that it never becomes equal to zero.
This case represents the famous experiment of Italian scientist Galileo Galilei.
He is supposed to have dropped two spheres with the same volume (i.e., the
same D) and different masses from the Leaning Tower of Pisa to experimen-
tally demonstrate that objects fall with the same gravitational acceleration,
75
independent of the mass. He thereby established that Aristotle’s theory on
gravitation is incorrect. From the analysis above we learn that it is crucial
for this experiment to use two heavy spheres described with a relatively low
drag coefficient, representing m >> DH, otherwise the mass m is part of the
evolution equation. In other words, he could not have performed the exper-
iments with two feathers with similar sizes.
76
different dimensionless parameters has been defined in the literature. Some
relevant examples to highlight are:
The Reynolds number is a measure for the ratio between inertial and viscous
forces, and it is often used to distinguish laminar from turbulent flow. Low
Re number flows correspond to laminar flow, i.e., smooth flow without mix-
ing, while turbulence can develop in high Re number flows.
77
5 Elementary oscillations and mechanical waves
Many dynamic systems will, when they are brought out of their equilibrium
state, show behavior that repeats itself: periodic or oscillatory behavior.
Simple examples of systems that display this behavior are the pendulum and
the mass-spring system. When the amplitude of the oscillation is sufficiently
small, the governing equations are linear and the system shows harmonic
oscillations. In that case we can usually find analytical, mathematical solu-
tions for the behavior of the system. Another type of dynamic behavior is the
behavior of populations, which can be captured in models. Furthermore, the
formation of mechanical waves, propagating disturbance within a medium,
is an additional type of dynamical behavior. In this chapter we will first
describe different harmonic oscillations and their evolution equations. Later
in the chapter we will discuss population models, mechanical waves and their
properties.
At the ‘top’, the horizontal displacement of the ball x (see figure 5.1(a))
78
(a) (b) E
E=K+U
x K
U
-A A x
The evolution equation, also called the equation of motion, for the swaying
pendulum can be derived from an analysis of the forces exerted on the mass.
Since the mass at the end of the rod moves on a circular path, we use polar
coordinates here for the force analysis. The advantage of this approach is
that one of the coordinates, r, stays constant during the motion. As figure
5.3 shows, we can decompose the gravitational force (the weight Fg ) in a
component mg cos θ in the radial direction (pointing in the direction away
from the suspension point O) and a component mg sin θ in the azimuthal
direction (parallel to the circular trajectory of the moving mass).
79
O
g
θ
l
Fz = mg
Terms A and B in equation (5.1) are the centrifugal acceleration and the
Coriolis acceleration respectively. Since the acceleration of the pendulum is
in the azimuthal direction, we will use Fθ here.
The rod is assumed to be rigid and of constant length. Thus, the radius of
the circular motion is constant and equal to the length of the rod, i.e. r = l
80
O
g
θ
l
Direction of motion
mg sin
mg cos
Fz = mg
81
Some mathematics: Taylor series around x = 0
A Taylor series or Taylor expansion is an approximation of a function in
and around a certain point in terms of a power series of the independent
variable(s). Here we will show the Taylor expansion around x = 0, while in
§7.2.3 Taylor expansions around an arbitrary point will be explained.
Consider a function y = f (x) and let us investigate if we can approximate
this function in the vicinity of x = 0 by using a polynomial of the N th order
(with N a natural number). So, we write
N
f (x) ≈ TN (x) = c0 + c1 x + c2 x2 + . . . + cN xN = ∑ cn xn . (5.4)
n=0
c0 = TN (x = 0) = f (x = 0),
dx x=0 = 1 dx x=0 = f (x = 0),
c1 = 11 dT N
∣ 1 df
∣ ′
1 d2 TN 1 d2 f
c2 = 1⋅2 dx2 ∣x=0 = 1⋅2 dx2 ∣x=0 = 2 f (x = 0),
1 ′′
1 d3 TN 1 d3 f (5.5)
c3 = 1⋅2⋅3 dx3 ∣x=0 = 1⋅2⋅3 dx3 ∣x=0 = 6 f (x = 0),
1 ′′′
⋮ ⋮
1 dN TN 1 dN f
cN = N ! dxN ∣x=0 = N ! dxN ∣x=0 = 1 (N )
N! f (x = 0),
We now have the following expression for our approximation of the function
f (x) around x = 0:
f (x) ≈ ∑N n=0 cn ⋅ x
n
= ∑N 1 (n)
n=0 n! f (0) ⋅ xn ,
82
with
dn f
f (n) (x) = . (5.7)
dxn
It seems plausible that as we include more terms in this Taylor expansion
(so if we increase N ), we get a more accurate approximation of the function
in question and this is often the case, but not always (more about this in
Calculus).
Example
We see that this expansion only contains odd powers of x. This observation
is no surprise since the sine function is an odd function of x. Figure 5.4 shows
the sine function together with three Taylor expansions (N = 1, 3, and 5 or
M = 0, 1, and 2). It can clearly be seen that the approximation improves as
we include more terms in the Taylor expansion. The most basic, non-trivial
approximation for the sine function around x = 0, i.e. ∣x∣ ≪ 1, is (N = 1 or
M = 0), is
83
1st order
f(x)= sin(x) Taylor series
of f(x)
5th order
3rd order
Taylor series
Taylor series
of f(x)
of f(x)
Figure 5.4: (a) Function sin x (solid), (b-d) sin x with its Taylor series of
equation (5.9) where (b) M = 0 (N = 1) (dash), (c) M = 1 (N = 3) (small
dash) and (d) M = 2 (N = 5) (dot).
84
sin θ ∼ θ when ∣θ∣ << 1 . (5.11)
d2 θ g
+ θ=0 . (5.12)
dt2 l
Equation (5.12) is the evolution equation of the pendulum for small angles
of θ and it is a 2nd order differential equation.
By solving equation (5.12) an expression of the angle θ as function of time is
found.
d2 y
+ c2 y = 0 . (5.13)
dx2
Both a sine function and a cosine function are a solution to equation (5.13).
You can check this by filling in y = sin(cx) or y = cos(cx) in equation (5.13).
Thus, the general solution to equation (5.13) is given by:
with A and B integration constants. The sine and cosine function are linearly
independent and that is why we can add them for the general solution.
85
The other type is given by:
d2 y
− c2 y = 0 . (5.15)
dx2
Both an exponential function with a positive argument and an exponential
function with a negative argument are a solution to equation (5.15). Again,
check for yourself whether this is true. Thus, the general solution to equation
(5.15) is given by:
y = Ae+cx + Be−cx , (5.16)
with A and B (different) integration constants.
Equation (5.12) is of the same type as equation (5.13), and therefore the
general solution is a linear combination of sines and cosines, just like equation
(5.14).
For the case where the pendulum is released at t = 0 from a starting position
θ = θ0 with zero initial velocity the following initial conditions apply:
t=0 ∶ θ = θ0 , θ̇ = 0 . (5.17)
The solution that satisfies these initial conditions is
θ(t) = θ0 cos ωt (5.18)
with the angular frequency
√
g
ω= . (5.19)
l
Apparently, for small excursion angles θ, the pendulum shows a purely har-
monic oscillation, with a period
√
2π l
T≡ = 2π . (5.20)
ω g
√
This relationship T ∼ l was already determined experimentally by √ Galileo
Galilei in 1602. Furthermore, we already found the relationship T ∼ l/g in
chapter 1 using dimensional analysis. We will show in chapter 8 that the rel-
atively simple behavior of equation (5.20) is quickly lost when the excursion
angle θ is no longer small.
86
5.3 The mass-spring system
Another well-known oscillatory system is the mass-spring system. This sys-
tem consists of a point mass m connected to a spring, where the mass can
move back and forth along the x-axis (see figure 5.5(a)).
The mass-spring system is another example of a dynamic system where we
can use linearization to make the problem suitable for an analytical descrip-
tion. The linearization is applied frequently in the analysis of dynamic sys-
tems as long as it concerns small excursions from a (stable) equilibrium state
(more on equilibrium states will follow in chapter 7).
F
F(x) F(x)
m
x
O
x
(a) (b)
The equilibrium state of the point mass - where the spring is neither pressed
nor stretched, and therefore exerts no force - we call x = 0. Upon a displace-
ment x the spring exerts a force F (x) in the negative x-direction. In general
the spring force F (x) can be quite a complicated function of x, depending on
the detailed elastic properties of the spring, such as the example sketched in
figure 5.5(b). However, in most cases F (0) = 0, since x = 0 is the equilibrium
state by definition. If we neglect frictional effects the equation of motion for
the mass is the following:
d2 x
m = −F (x) . (5.21)
dt2
The function F (x) can now be expanded in a Taylor series around x = 0:
x2 ′′ x3
F (x) = F (0) + xF ′ (0) + F (0) + F ′′′ (0) + ... (5.22)
2! 3!
87
An example of the function F (x) and different orders of its corresponding
Taylor series are shown graphically in figure 5.6. Often, it is true that the
higher the order of the Taylor series, the more accurate the approximation
is (not always!).
5th order
Taylor series
of F(x)
3rd order Taylor
series of F(x)
Figure 5.6: (a) Graphical interpretation of the spring force F (x) (solid) as a
function of the displacement x, (b-d) F (x) with its Taylor series where (b)
N = 1 (dash), (c) N = 3 (small dash) and (d) N = 5 (dot).
F (x) ≃ αx , (5.24)
88
Because of this linearization the equation of motion (5.21) simplifies into
d2 x
m = −αx , (5.25)
dt2
valid for small ∣x∣. With
√
α
ω= (5.26)
m
this equation can be written as
d2 x
+ ω2x = 0 , (5.27)
dt2
and this is of the same type as equation (5.13). Thus, the general solution is
where A and B are constants that can be determined from the initial condi-
tions for x(t = 0) and ẋ(t = 0).
Apparently, when the displacements from the equilibrium state x = 0 are
small, this system also shows harmonic oscillations with an angular frequency
ω. The period of an oscillation is T = 2π/ω, and the frequency f (i.e. the
number of oscillations per unit of time) is then f = ω/2π.
For the initial conditions x(t = 0) = x0 and ẋ(t = 0) = 0 the constants in
equation (5.28) are equal to A = x0 and B = 0, and therefore
From this the instantaneous velocity ẋ(t) and the acceleration ẍ(t) of the
point mass follow directly:
The evolution of x(t), ẋ(t), and ẍ(t) is represented graphically in figure 5.7.
We can see that the displacement x(t) and the velocity ẋ(t) are exactly 90○
out of phase, whereas the acceleration ẍ(t) has an opposite phase to x(t).
89
x
x0
(a) t
x
x0ω
(b)
t
x
x0ω2
(c)
t
Figure 5.7: Graphical representation of the course of the (a) normalized dis-
placement x/x0 ,(b) velocity ẋ/x0 ω, and (c) acceleration ẍ/x0 ω 2 .
90
tion (5.21) in its general form, we can rewrite the spring force F (x). The
total force f (x) is equal to minus the spring force −F (x) and the total force
is in the direction of decreasing potential energy, therefore
dV
f (x) = − , (5.31)
dx
where the function V (x) is the potential energy that is stored in the spring
at a certain displacement x.
This also becomes clear when we integrate equation (5.31) over x:
x
∫0 f (x̃) dx̃ = −V (x), (5.32)
dV
mẍ + = 0. (5.33)
dx
We would like to see if we can rewrite this expression into the form dE/dt,
since the goal is to learn about the energy of the system. Therefore, we want
to rewrite the potential energy term into a time derivative in order to make
it of the same form as the first term. To this end, we multiply both terms of
equation (5.33) with ẋ, which gives:
dV
mẋẍ + ẋ = 0. (5.34)
dx
We are going to rewrite this into two time derivatives with a trick worth
remembering. Using the chain rule, we can write (please check for yourself
that these are correct):
d 1 2 dV dx d
ẍẋ = ( ẋ ) and = [V (x(t))] , (5.35)
dt 2 dx dt dt
and rewrite equation (5.34) to
d 1 d dE
[ mẋ2 + V (x)] = [Ekin + Epot ] = 0 → = 0. (5.36)
dt 2 dt dt
91
In other words: the total energy consisting of the sum of kinetic energy Ekin
and potential energy Epot
1
E = Ekin + Epot = mẋ2 + V (x) (5.37)
2
of the mass-spring system is conserved. When this energy is conserved the
system is called conservative. In figure 5.1 the conservation of the total en-
ergy is depicted graphically as well by the line at a constant horizontal height
depicting total energy E.
92
The constants C and D can be determined from the initial conditions for
x(t = 0) and ẋ(t = 0).
This solution shows that the amplitude of the oscillation decreases exponen-
tially with time, more specifically with a factor exp(− 12 kt). An example of
this damped oscillation can be seen in figure 5.8.
Figure 5.8: Example of a damped harmonic oscillation and the decaying ex-
ponential function.
d2 x
+ ω 2 x = a cos Ωt , (5.44)
dt2
with a = F0 /m.
This equation was already studied in 1739 (!) by Euler, and he found that
interesting things happen when the forcing frequency Ω is roughly equal to
the natural frequency ω of the mass-spring system: in that case resonance
occurs, where the oscillations have a monotonously increasing amplitude (see
figure 5.9 (b)). Figure 5.9 shows the solution of equation (5.44) for the cases
Ω = 0.8ω and Ω = ω; in this last case the resonance can clearly be seen.
Figure 5.9: Solutions x(t) of equation (5.44) for (a) Ω = 0.8ω and (b) Ω = ω.
94
It can be shown (see exercise 9.5.7) that for Ω = ω
a
x(t) = t sin ωt (5.45)
2ω
is a solution of equation (5.44) that satisfies the initial conditions x(t = 0) = 0
and ẋ(t = 0) = 0. From equation (5.45) we see that the amplitude of the
resonant oscillation increases linearly with the time t (figure 5.9(b)).
Figure 5.10: Course of the solution x(t) with damped resonant forcing.
95
5.6 Population model
So far we introduced the pendulum and a mass-spring system as simple
mechanical systems that show periodic behavior. However, there are many
natural systems that can show periodic behavior. One example we will treat
here is the population model of Lotka and Volterra. This model describes
the competition between two animal species.
The model was initially developed for explaining significant fluctuations in
the amount of fish caught in the Adriatic Sea in the period 1905 - 1923. It
was inspired on the observation that the amount of big and small fish caught
showed variations with the same frequency, but slightly out of phase. The
model can also be used more generally for the analysis of any system where
a competition between two parties (e.g. prey and predator) is present.
For simplicity we will first assume that there are no natural enemies. In
this case the animals can reproduce to their heart’s content. We can then
expect that the increase of the population size N1 (= number of animals) is
proportional to N1 :
dN1
= αN1 , (5.46)
dt
where α is the growth factor [s−1 ]. This differential equation has an expo-
nential solution:
For the case where α > 0 (sufficient food, healthy, etc.) the population
grows exponentially, whereas for α < 0 (insufficient food, diseases, etc.) the
equation resembles the equation for exponential decay (see equation (3.86))
and a decrease in the population size N1 occurs.
96
The typical timescale of this biological system is τ = 1/α. We could have
obtained this result with an analysis of the dimensions of the relevant in-
dependent variables in the system as well. Since N1 is dimensionless (an
‘amount’ is a number, so [-]) only the growth factor α remains, which has
the dimension [s−1 ]. So, the timescale of this system will have the following
proportionality relation: τ ∼ 1/α.
We can go one step further and assume that the species is threatened by
predators. In a first approximation we could say that the decrease in the
population N1 is proportional to N1 , so that equation (5.46) becomes:
dN1
= αN1 − βN1 (5.49)
dt
where α(> 0) is the growth factor and β(> 0) the mortality as a result of the
predators. The solution to this equation then is:
When α = β the population is stable (growth = 0), when α > β the popula-
tion increases, whereas when α < β the number of animals (N1 ) decreases.
We can make the population model even more realistic by assuming that
the mortality of the animals also is determined by the amount of predators
(N2 ), so: β = β(N2 ). In biological population dynamics the following is often
assumed:
dN1
= α1 N1 − γN1 N2 , (5.51)
dt
and for the predators (N2 ):
dN2
= −α2 N2 + γN1 N2 . (5.52)
dt
Here, α1 is the growth factor of the population N1 , α2 the mortality of the
population N2 , and γ a constant ‘interaction’-factor. The behavior of N1
97
and N2 is illustrated as function of time in figure 5.118 . We can see that
the population of both the prey and predators changes periodically. The
oscillations are out of phase with respect to each other, this is due to the
response they have as a result of the interaction.
Figure 5.11: Plots (a) of the solutions x(t) = N1 (t) and y(t) = N2 (t) and (b)
of the (N1 , N2 ) phase diagram of the Lotka-Volterra model (5.51,5.52) for
α1 = 2, α2 = 1, γ = 0.1 with (x0 , y0 ) = (10, 2) and (x2 , y2 ) = (10, 20).
When the predators do not eat their prey, so when γ = 0 or when N1 = 0 (all
preys are dead), equation (5.52) has a simple solution: N2 = N20 e−α2 t , which
implies that the population of the predators will decrease.
98
but they do not show a net displacement. By contrast, the pattern itself dis-
places. Examples of mechanical waves are sound waves (a disturbance of
air), water waves, waves on a rope and waves in a spring.
v
A
up
&
down λ
Figure 5.12: Block of mass on top of the spring moves up and down in a
simple harmonic motion, creating a sinusoidal wave in the rope traveling to
the right. The rope is connected to a point far to the right. The transverse
wave has an amplitude A, a wavelength λ and a wave speed v.
Periodic waves like the one just described have a repeating pattern. A pe-
riodic wave has the following properties: wavelength λ, spatial distance be-
tween two disturbances; wave speed v, speed with which the disturbance
pattern travels; and frequency f , frequency with which the pattern repeats
itself. These properties are related to each other in the following way:
v = λf. (5.53)
In this course we will assume that the wave speed is only dependent on the
mechanical properties of the system, and that upon changing λ, f changes
99
and vice versa. When considering light waves, as you will do in the Optics
course (31OPT), the wave speed will also depend on the frequency.
The height y of a point on the rope is a function of both time t and coordinate
x. At the x = 0 the point is moving up and down with period T (or frequency
f ). At t = 0 point x = 0 is at the maximal height, y = A. A quarter of the
period later, at t = T /4, the point is at the equilibrium height y = 0. Another
quarter period later, at t = T /2, the point is at the lowest height, y = −A,
and so on. The displacement of the point at x = 0 is given by
2π
y(x = 0, t) = A cos(ωt) = A cos ( t) , (5.54)
T
with angular frequency ω = 2πf = 2π/T .
100
Since the wave is traveling in the +x-direction with wave speed v, the motion
of a point at position x at time t is the same as the motion of the point at
x = 0 at time t − x/v. The full mathematical description of the wave, the
wave function, then becomes
x t
y(x, t) = A cos [2π ( − )]
λ T
x (5.55)
= A cos [ω ( − t)]
v
= A cos (kx − ωt) ,
101
Example
√
Consider the function f (x, y) = x2 y + y. For the partial derivatives of this
function we find
∂f ∂f 1
= 2xy, = x2 + √ . (5.57)
∂x ∂y 2 y
The partial derivatives of the wave function with respect to t are related to
changes of the y(x, t) in time. So, the first and second partial derivatives of
the wave function with respect to t represent the transverse velocity vy and
the transverse acceleration ay , respectively, i.e. how the local rope height
changes in time. On the other hand, the partial derivatives with respect
to x are related to the shape of the rope, i.e. how the rope height changes
in space. The first and second partial derivative of the wave function with
respect to x represent the slope and curvature of the rope, respectively.
In fact, the second partial derivatives with respect to x and to t are related
by the following relationship:
∂ 2 y(x, t) 1 ∂ 2 y(x, t)
= 2 , (5.58)
∂x2 v ∂t2
which is called the wave equation.
The wave equation is one of the most important equation in physics. You
can show (we will not do that here) that not only equation (5.55) satisfies
the wave equation, but all functions describing a periodic wave, regardless of
the shape, satisfy the wave equation, since you can express each shape as a
sum of sines and cosines and equation (5.58) is linear.
One outstanding example of the wave equation is in the theory of electro-
magnetism. Maxwell showed that both the magnetic and electric field satisfy
the wave equation. The resulting wave speed is actually the speed of light,
proving that light is an electromagnetic wave.
102
traveling on a rope, like in figure 5.12, also have a wave speed: a speed with
which the disturbance propagates.
We have mentioned before that the wave speed depends on the mechanical
properties of the system. In general, the wave speed does not depend on the
wavelength and frequency. If one would change the frequency, the wavelength
would change, and the wave speed would remain the same. Wave speed can
be calculated based on the mechanical properties of a system, as we will show
now.
If we consider the exemplary example of a transverse wave on a rope, the
mechanical properties of the system are the tension T in the rope and the
mass per unit length µ. To determine the relation between v and T, µ, you
can consider the forces on a rope segment ∆x starting at x and ending at
x + ∆x, see figure 5.13, and apply Newton’s second law to this small segment
of rope.
Since the motion is transverse (particles are only moving up and down), there
is no net force in the x-direction, only a net force in the y-direction. If the
rope is at rest there is only the tension T acting on both sides of the segment
in opposite directions. If the rope is displaced, this horizontal component of
the total force stays constant, since there is no net force in this direction. In
the y-direction there will be a net force, resulting in ay .
F
Fy
T
rope
T
Fy
F Δx
x x + Δx
It can be derived that the net force in the y-direction on a small portion of
the rope ∆x is given by
∂y ∂y
Fy = T [( ) − ( ) ], (5.59)
∂x x+∆x ∂x x
103
where the subscript of the derivative denotes the value for which the deriva-
tive is evaluated.
This net force can also be derived using Newton’s second law.
∂ 2y
Fy = ∆may = µ∆xay = µ∆x , (5.60)
∂t2
where we used that the mass of the segment is ∆m = µ∆x.
Equation (5.59) and equation (5.60) can be equated, and by dividing both
sides by ∆x while considering an ultra-small portion of the rope, the equation
becomes:
∂ 2 y(x, t) ∂ 2 y(x, t)
T = µ . (5.61)
∂x2 ∂t2
As you can see, equation (5.58) and equation (5.61) are identical. Both
equations describe the same wave motion, so we can derive that the wave
speed is
√
T
v= . (5.62)
µ
104
6 Graphical and numerical analysis of evolu-
tion equations
Often, the (set of) evolution equation(s) that describes a certain physical
system is too complicated to solve analytically. By that, we mean it is not
possible to write down the solution on paper in terms of known functions,
such as x(t) = x0 cos ωt. However, we still can get information from these
equations about the behavior of the system. In this chapter we will discuss
methods to investigate the behavior of evolution equations and their solu-
tions, without actually solving these equations explicitly. To this end, we will
make use of so-called phase diagrams and/or graphical means to interpret
evolution equations, together with numerical methods to construct approx-
imate solutions. Frequently, the information we gain from these methods is
even more valuable than the exact analytical solution to the set of evolution
equations!
(c) evolve into a regular oscillation, such that it keeps repeating in cycles,
(d) do none of these things, but instead fluctuate erratically while remain-
ing bounded.
105
(a)
x
(b)
x0 (c)
(d)
Figure 6.1: Four different potential outcomes for the long-time evolution of
x(t) for a certain system.
Indeed, we are often more interested in the qualitative behavior of the system
as time evolves than in the exact analytical solution at each point in time. To
identify this qualitative behavior, we can start to think about the differential
equations given by equations (6.1), (6.2) in a different, geometrical way. We
will now discuss how this graphical analysis works for first- and second-order
systems.
106
Direction fields Consider the first-order system that describes the cooling
of a hot object, or heating of a cold object, as discussed in §3.2, which in
dimensionless form is given by
dT̃
= −T̃ , (6.3)
dt̃
which is an autonomous system as the right-hand side does not explicitly
depend on time.
For the sake of generality, we replace the symbol T̃ by x and drop the tildes
in the discussion that follows, giving
dx
= −x. (6.4)
dt
Let us pretend we do not know the analytical solution to this system (even
though in this case we know it is given by x(t) = x0 exp (−t) of course), but
would like to learn how the hot object cools down by graphical inspection.
We start by drawing the grid (t, x), as is shown in figure 6.2(a). Each grid
point (t, x) then corresponds to a position x that our system occupies at a
time t. We now proceed by drawing in each grid point a little arrow with a
slope dxdt . Following the rule given by equation (6.4), we know exactly what
this slope should be, as for each point (t, x) equation (6.4) gives us the value
of dx
dt . All the arrows together form the vector field or direction field that
corresponds to equation (6.4). Note that for each point in time the direction
field looks exactly the same; i.e. if you draw a horizontal line (constant x,
varying t) in figure 6.2(a), you see that the vectors along the line are identical.
The reason for this similarity is the fact that time does not explicitly appear
in equation (6.4), and therefore the slope of the arrows only depends on the
positions x on the grid.
We can use the direction field to graphically construct the solutions x(t) to
equation (6.4). Each initial condition x(0) = x0 corresponds to a point (0, x0 )
in the direction field. The arrow in a grid point indicates the direction in
which the solution will evolve as time proceeds. If we follow the arrow, we
end up in the next grid point, where again the local arrow indicates how to
get to the next point, and so on. Hence, we can graphically construct the
solution by following the arrows, which point in the direction towards where
x evolves over time.
107
x x
t t
(a) (b)
Figure 6.2: Direction fields for (a) the first-order autonomous systems given
by equation (6.3) and (b) the first-order non-autonomous system given by
equation (6.5). The lengths of the arrows signifies the magnitude of the ve-
locity ẋ. The solid lines represent the exact analytical solutions to equations
(6.4) and (6.5), respectively, for various initial conditions.
108
drawing a vector in each grid point (t, x) and tracing out the solution curves,
it would be sufficient to sketch how x will evolve as time progresses. Such a
sketch of behavior of a solution is the purpose of a phase diagram.
To construct such a diagram, let us start again with the autonomous first-
order system (6.4). In figure 6.3(a) we first plot the rate of change ẋ = f (x)
for each x. The y-axis of this plot now tells you for each value of x what
is the magnitude, and, importantly, the direction of ẋ. In other words, it
tells you in what direction x will evolve over time; if ẋ > 0 the solution will
move towards larger x, hence in the positive x-direction, whereas if ẋ < 0 it
will move towards smaller x, i.e. in the negative x-direction. If ẋ = 0 the
solution will remain stuck at its present location and stay there forever. For
that reason, such a point is called a stationary point.
We mark this qualitative information about the fate of x by arrows on the
x-axis, where arrows pointing to the right imply evolution towards larger
x (i.e. ẋ > 0), and arrows pointing to the left evolution towards smaller x)
(ẋ < 0). The points where ẋ = 0 and the system will remain indefinitely (in
this example that happens in x = 0) are marked with a solid dot. As you
can see, x will always evolve towards this point as time progresses; when the
system is at a position with larger x it will move to the left until it reaches
the stationary point, whereas when it is at smaller x, it will move to the right
until it arrives at the stationary point. We therefore say that the solution
x(t) is attracted to the stationary point. Such a point is called a stable
stationary point or attractor and is marked by a solid dot in figure 6.3.
In figure 6.3(b) we show a similar plot, but now for the basic population
model discussed in §5.6 (where we replaced the symbol N by x)
dx
= x. (6.6)
dt
In this case, x will always move away from the stationary point x = 0, which
is now an unstable stationary point or repeller, marked by an open circle in
figure 6.3(b). Indeed, for x > 0 the population will start to grow and move
away from the stationary point (note that the case x < 0 does not represent
a physical situation when equation (6.6) is used to describe a population
model).
The plots shown in figure 6.3(a) and (b) in fact still contain some redun-
dant information. To illustrate the qualitative behavior of the systems they
describe, we could just show a single line denoting all positions x, where
we mark the stationary points and the behavior of the system around these
109
(a) (b)
x x
O x O x
(c) x (d) x
Figure 6.3: Plots illustrating the qualitative behavior of (a) the heating or
cooling of an object as given by evolution equation (6.3), and (b) a growing
population as given by equation (6.6). (c) and (d): Phase lines that contain
all qualitative information about the evolution of these first-order autonomous
systems.
points (i.e. if the solution will move towards or away from the stationary
points) with lines and dots, as shown in figures 6.3(c) and (d). For any point
on the line, the arrows indicate in what direction the system will move as
time evolves. Hence, the line contains all qualitative information that is re-
quired to predict how a system evolves over time. Such a line is called a
phase line, and is a one-dimensional example of a phase diagram. Note that
to construct the phase line and decide on the directionality of the arrows and
the position(s) of the stationary point(s), we used the information contained
in on the y-axis of plots in panels (a) and (b).
110
describes how the state of the system x evolves in time. Qualitatively, this
information is contained in the phase lines shown in figure 6.3(c) and (d).
These lines, containing all x, span what we call the phase space of the system.
For the first order systems given by equations (6.3) and (6.6) this space is
one-dimensional, and the phase diagram illustrating this space is indeed a
single line.
111
x
(a) (b)
Figure 6.4: Phase diagrams of (a) the autonomous first-order system (6.4)
and (b) the non-autonomous first-order system (6.5). Note that for this sys-
tem the phase diagram is two-dimensional phase diagram and identical to the
direction field of figure 6.2(b).
ẍ = −ω 2 x. (6.8)
To predict where the mass will move in the next instant, we not only need to
know the position of the mass, but also whether it was, from that position,
extending or compressing the spring, and with what speed it was doing so
(i.e. we need to know its velocity and direction of motion). Indeed, to know
the state of this system at any given time and hence be able to predict its
future, we do not only know where the mass is but also where it is going. In
mathematical terms that means we need to know x and ẋ, which implies that
the phase space of an autonomous second-order system is two-dimensional.
To better reflect this two-dimensional nature of the system, we can rewrite
equation (6.8) into a set of two first-order differential equations, one per state
112
variable. To this end, we let x1 = x, as before, but now we introduce a second
state variable x2 = ẋ, such that the system reads
ẋ1 = x2 ,
{ (6.9)
ẋ2 = −ω 2 x1 .
113
x2 x2
(a) (b)
O x1 x1
Figure 6.5: Construction of the phase diagram for the mass-spring system
via (a) the vector field given by equation (6.9) or (b) via the calculation of
trajectories as given by equations (6.14) or (6.21) (method A and B in the
main text).
Next to this graphical reconstruction, one can also calculate the phase-space
trajectories exactly, either from the evolution equations (method A) or from
energy conservation (method B) as we will show now.
dx2 ẋ2 ω 2 x1
= =− (6.12)
dx1 ẋ1 x2
114
and therefore
dx2
x2 + ω 2 x1 = 0. (6.13)
dx1
Note that the time t no longer explicitly appears in equation (6.13). Integra-
tion of equation (6.13) over x1 gives (see §3.3):
1 2 1 2 2
x + ω x1 = C, (6.14)
2 2 2
with C an integration constant. This equation describes a set of ellipses in
the phase plane with coordinates x1 and x2 ; see figure 6.5(b). To see why
equation (6.14) represents an ellipse, note that we can recast this expression
into the standard equation for an ellipse centered at the origin
x21 x22
+ = 1, (6.15)
a b
if we set a = 2C and b = 2C/ω 2 . To indicate the time evolution of the system,
we draw arrows in the elliptic trajectories. These arrows are drawn with the
help of equation (6.9): x1 increases in time for x2 > 0 (positive velocities),
and decreases for x2 < 0 (negative velocities).
Similarly, for a system of the form
ẍ = ω 2 x. (6.16)
one could show (see exercise 9.6.7) that the trajectories in the phase plane
are given by
x21 x22
− = 1, (6.17)
a b
which corresponds to a set of hyperbolas.
Figure 6.6 shows that important information about the physical behavior
of the mass-spring system can directly be obtained from the phase diagram
and we do not have to plot (and derive!) x1 (t) and x2 (t) individually. For
example, we can learn from the phase diagram that:
• A periodic motion corresponds to a closed trajectory in the phase dia-
gram. From the plot in figure 6.6(a), we see that we start from point a
at t = 0, where x1 = x0 and x2 = 0 and from there move to point b, in a
115
(a) (b)
x2 x ω
0
d
c a&e c
-x0 x0 x1 x1=0
b d
b
-x0ω a&e
Figure 6.6: (a) Phase plane for the two-dimensional, second-order au-
tonomous mass-spring system given by equation (6.8).(b) Corresponding po-
sitions of the mass, where the arrow indicates the direction of motion (com-
pression or extension of the spring). The labels a−d refer to the position in the
phase plane in panel (a). The positive x1 -direction is defined as downwards,
where extraction of the spring corresponds to positive x1 and compression of
the spring corresponds to negative x1 .
• For any value of x1 , two values of x2 are possible (except for the ex-
trema), which correspond to the compressive and extensile motion of
the spring from any position in space (see figure 6.6(b)). Vice versa,
for every value of x2 only two values of x1 are possible. We can also see
very clearly: a big displacement/stretch ∣x1 ∣ implies a smaller velocity
∣x2 ∣ and vice versa. Indeed, kinetic and potential energy are continu-
ously being converted into one another, and their sum is constant, as
we will see below.
116
where the spring is at its rest length and where there is no net force
acting on the mass.
• The origin represents a special point: all other trajectories circle around
it like the eye of a tornado. A mass positioned in this point would not
move, since ẋ1 = ẋ2 = 0, but stay in there forever. Indeed, if we position
the mass such that the spring is at its rest length and do not give it
any initial velocity, it will not move anywhere. Hence, the origin is a
stationary point.
117
This method of constructing a phase diagram is very powerful, since it can
also be used when only a rough description of the system’s potential energy
V (x1 ) is known, as will be further discussed in the course Theoretical Clas-
sical Mechanics.
x x x
(a) (b) (c)
x x x
Figure 6.7: Phase diagrams for (a) a damped mass-spring system, (b) a
forced mass-spring system, and (c) a mass-spring system with damped reso-
nant forcing such that it reaches a stable oscillation amplitude.
118
dimensional, with one evolution equation per state variable, such as equa-
tion (6.7). The phase space of an autonomous second-order system is also
two-dimensional; to know how the system evolves one needs to know both
position and velocity, see equation (6.9). We can generalize this discussion
to evolution equations of N -th order. An autonomous N -th order evolution
equation can be converted into N first-order evolution equations, and has
an N -dimensional phase space. For a non-autonomous system we add one
dimension to the phase space to take care of the time-dependence; and N -th
order non-autonomous evolution equation therefore results in an (N + 1)-
dimensional phase space where the state variables are described by N + 1
first-order evolution equations.
Consider for example the forced mass-spring system described in §5.5 given
by
To know the evolution of this system starting from a certain point we need
three numbers: x, ẋ, and t. Indeed, to predict the future, we need to know
where the mass is, how fast it is moving and in what direction, and at what
point in time we are to determine the amount of forcing it gets. The evolution
equations for the three state variables describing this 3D system are given
by
ẋ1 = x2 ,
ẋ2 = −ω 2 x1 + a cos Ωx3 , (6.23)
ẋ3 = 1.
Consider again the vector plot of figure 6.2 for the system given by equation
(6.4). If we locate ourselves in a certain initial value x0 and follow the arrow
119
starting in that point, we could trace out the solution curve. Numerical
integration on the computer works in a similar way. Suppose we start at
t = t0 in a point x0 . If we follow the arrow, some time ∆t later we will have
moved by an amount f (x0 , t0 )∆t, because distance = rate × time. Hence the
new position x(t0 + ∆t) ≈ x0 + f (x0 , t0 )∆t. Of course that is not the exact
position but only an approximate, since our velocity will change a little bit
during the time step. However, if we choose ∆t small enough, that error will
be small. Let us call this approximate position x1 = x0 +f (x0 , t0 )∆t. Likewise,
after the second time step, we will be in a position x2 = x1 + f (x1 , t1 )∆t. We
can generalize this method by writing that after n + 1 time steps, we are in
position
This rule is the simplest numerical integration rule we know and termed
Euler’s explicit method. Let us see how this works out for a first-order au-
tonomous system such as given by equation (6.3). In the exercises you will see
how this method is applied to first-order non-autonomous, and second-order
systems.
Let us take c = 2, use x0 = x(t = 0) = 1 as starting point and apply this rule
to find the future positions using a time step of ∆t = 0.2, as shown in table
6.1. A continuation of this manually constructed table can be found in the
Excel sheet example62.xls9 . The first row of this sheet contains the initial
conditions, similar to the first row of table 6.1, each following row contains
the result of the application of integration rule (6.27) to the previous row.
On Canvas you will find more Excel sheets where other, more complicated
systems are integrated numerically.
120
Table 6.1: Numerical integration of equation (6.26) compared to its exact
solution for c = 2.
x t numerical solution exact solution
x0 0 1 1
The exact and numerical solution are also plotted in figure 6.8. The top
line shows the exact solution and the black squares the approximate values
obtained from Euler’s method. As you can see, the numerical approxima-
tion quickly becomes inaccurate. We could improve the approximation by
decreasing ∆t to a very small number. However, decreasing ∆t comes at
a cost. Taking smaller (and hence more) time steps requires an increasing
amount of computational power. However, with the current powerful com-
puters this is not the most important issue. The main problem is that each
time step carries a round-off error, as computers do not have an infinite ac-
curacy. For example, to manually calculate the approximate values of the
exact solution depicted in table 6.1 we rounded them off to two significant
digits. Computers do something similar. As these round-off errors occur in
each time step, they rapidly accumulate as the number of time steps taken
increases.
121
x 1.0
0.8
0.2
0.0
0.0 0.2 0.4 0.6 0.8 1.0
Figure 6.8: Exact solution (solid line) and numerical approximation (black
squares) to equation (6.26) with c = 2, x0 = 1 and ∆t = 0.2.
left end of the time interval tn to tn+1 . Other integration schemes, such as
the improved Euler method or the fourth-order Runge-Kutta method have a
better and more accurate way to approximate the derivatives. A discussion of
these methods is beyond the scope of our course, but we mention the names
of these methods here such that you are aware of their existence. Euler’s
explicit method as discussed above, however, does contain the essence of
numerical integration and is the most basic scheme, which is why we focus
on that method here.
122
7 Analysis of stationary points and their sta-
bility
So far we have used graphical and numerical methods to inspect the behavior
of a system qualitatively. Often, we are also interested in some quantitative
information about the system. In particular, we would like to know whether
there are any special points in the phase space where the system could remain
stuck forever, and how quickly the system will evolve towards these points
as time progresses. These special points are called stationary points. We will
now discuss how to find these points and how to examine the behavior of
the solution around them. Again, this information will be obtained without
explicitly solving the evolution equations on their entire domain!
ẋ = f (x) (7.1)
f (xe ) = 0, (7.2)
such that in these points the velocity ẋ is zero. As a consequence, once the
system is in such a point, it cannot leave. Verify for yourself that for the
system (6.3) the stationary point is found in T̄e = 0. At this point, the object
has the same temperature as its surroundings and hence it will not heat up
or cool down.
As discussed in chapter 6, an autonomous second-order system, such as equa-
tion (6.8) can always be written into two first-order systems. Hence, the most
general form of an autonomous second-order system is
ẋ1 = f (x1 , x2 ),
{ (7.3)
ẋ2 = g(x1 , x2 ).
123
The stationary points x1,e , x2,e of such a system are given by
Note that, for a second-order system to be in its stationary point, the right-
hand side of both equations (7.3) needs to be equal to zero simultaneously,
such that the system has a zero velocity and a zero acceleration. Likewise,
for N -th order systems the stationary points can be found by equating the
right-hand sides of the set of first-order evolution equations for the state
variables to zero simultaneously.
ẋ1 = x2 ,
{ (7.5)
ẋ2 = −ω 2 x1 .
We are asked to find its stationary points. To this end, we will follow the
ISEE method.
I - Identify
The stationary points of equation (7.5) are the points where both the posi-
tion x1 and the velocity x2 of the mass do not change over time (i.e. the mass
has no velocity and no acceleration).
S - Set up
If x1 and x2 are not changing, then it must hold that ẋ1 = x˙2 = 0.
E - Execute
Using ẋ1 = 0 we find, upon equating the right-hand side of the first equation
of the set (7.5) to zero, x2,e = 0. Using ẋ2 = 0 we find, upon equating the
right-hand side of the second equation of the set (7.5) to zero, x1,e = 0. Hence,
the stationary point of equation (6.8) is given by (x1,e , x2,e ) = (0, 0)
124
E - Evaluate
Physically, the point (0,0) in phase space corresponds to the spring being at
its rest length and the mass having no velocity. Indeed, in this point there is
no force acting on the mass to accelerate it, while at the same time the mass
has no velocity. Hence, the point (0,0) indeed corresponds to a stationary
point.
By contrast, if only one of the two conditions were fulfilled, the mass would
not remain stationary. For example, if only the velocity ẋ1 = 0, but the mass
would still be in a position where the spring is extended or compressed (such
as in the extrema at locations a and c in figure 6.6(b)), the mass would still
have an acceleration. As a consequence, the mass would not remain station-
ary but simply pass through the point where ẋ1 = 0 and move to the next
position. On the other hand, if only the acceleration ẋ2 = 0 but the mass
would still have a finite velocity, it would simply pass through the point and
move to a new position. This situation would correspond to location b and
d in figure 6.6(b), where the mass passes through these points on its way
up or down. Only if we would position the mass in these locations without
giving it any velocity, it would remain stationary, showing that we indeed
need x1 = x2 = 0 in the stationary point.
125
7.2.1 Stable and unstable behavior
A classic example to illustrate the (in)stability of stationary states is that of
a ball in a hilly landscape. Consider the landscape shown in figure 7.1. The
evolution of the position of the ball in this landscape is of course described
by Newton’s second law. From figure 7.1, we observe that there are two
stationary points or equilibrium positions for the ball: in the bottom of the
valley (position A) or exactly on top of the hill (position B). If the ball is
placed in one of these positions at zero initial velocity, it will stay there
indefinitely as no force is acting on the ball.
B g
Figure 7.1: Ball on an hilly landscape in its (A) stable and (B) unstable
equilibrium states.
126
all possible stationary states, and then analyze which of these are stable and
which are not. Below we will discuss two approaches to perform such a stabil-
ity analysis: qualitatively, via a graphical analysis in the phase diagram, and
quantitatively, via a so-called linear stability analysis. The former method
is often quick and intuitive to apply, whereas the latter is more robust and
has the additional feature that it provides us with an estimate of how much
time the system will take to reach a certain stationary point, or how quickly
it will run away.
Both approaches to stability analysis can be described by a basic ‘recipe’.
For clarity we first summarize the steps of each recipe, and then show you
how to apply these recipes by discussing two physical examples in detail; a
first- and a second-order system.
3. Draw arrows indicating how the system will move in between the sta-
tionary points.
4. From the directionality of the arrows, identify for each stationary point
whether it is
• stable: arrows are directed towards the stationary point, and the
solutions are hence attracted to it. We denote such a point by a
in the phase diagram.
• unstable (arrows are directed away from the point, and solutions
are repelled). We denote such a point by a # in the phase diagram.
• neutrally stable as solutions are neither attracted to nor repelled
from the point. We denote such a point by a in the phase
diagram.
• half-stable: arrows are directed towards the stationary point and
the solutions are attracted from one side, but repelled away from
the stationary point on the other side. We denote such a point by
a#G (if the point is stable when coming from the left) or #
H (if the
127
point is stable when coming from the right)in the phase diagram.
In this course, we will not focus on this hybrid situation, but we
mention it here for the sake of completeness.
4. Analyze your result: if δx grows over time it means that the solution
is unstable to small perturbations around xe , as it will move away.
If δx decays over time it means that the solution is stable to small
perturbations. If δx neither grows nor decays, the solution is neutrally
stable to small perturbations.10
128
where N (t) is the population of fish at time t, and r and k are positive
constants describing the growth rate and the so-called carrying capacity, re-
spectively. For small N ≪ k, the model predicts that the growth rate of
the fish population is proportional to r. However, for populations larger
than the carrying capacity k, the growth rate actually becomes negative and
the population will decrease, modelling the effect of overcrowding (lack of
food and/or space) in the lake. We are asked to (a) determine the station-
ary point(s) of this model system and analyze their stability using (b1) the
graphical method and (b2) a linear stability analysis. To this end, we will
follow the ISEE method.
I - Identify
The stationary points of equation (7.6) are the points where the number of
fish N does not change over time.
S - Set up
If N is not changing, then it must hold that Ṅ = 0.
E - Execute
Using Ṅ = 0 gives
Ne
rNe (1 − ) = 0, (7.7)
k
from which we find two stationary points, namely Ne,1 = 0 and Ne,2 = k.
E - Evaluate
Physically, the two stationary points make sense: Ne,1 corresponds to the
situation where there are no fish in the lake, and hence no growth can occur.
Point Ne,2 corresponds to the carrying capacity, meaning that if there are
129
less fish the population will grow, but if there are more the population will
decay due to overcrowding.
I - Identify
We need the stationary points from (a) to analyze their stability. There are
two approaches to analyze the stability: (b1) the graphical method and (b2)
a linear stability analysis.
(b1) Graphical stability analysis
S - Set up
The system is given by equation (7.6). The phase diagram of this first-order
system will be a one-dimensional phase line.
3. The direction of the arrows can be found from the sign of Ṅ : for Ṅ > 0
the arrow points towards the right, to larger N , whereas for Ṅ < 0 it
points towards the left, to smaller N .
130
N
O k/2 k N
Figure 7.2: Plot of equation (7.6), where the x-axis corresponds to the phase
diagram (phase line) of the population model, and the y-axis is used to derive
the direction of the arrows and find the stationary points depicted on the
phase line.
S - Set up
131
which we can work out a step further by realizing that Ne is just a num-
ber, and hence does not depend on time, and expanding the brackets
on the right-hand side, to find
2 2
˙ = r (Ne − Ne − Ne δN + δN − Ne δN + δN ) ,
δN (7.9)
k k k k
which is an evolution equation for the perturbation δN (t). We can
reorganize this equation slightly and linearize it into
˙ = rNe (1 − Ne ) + rδN (1 − 2 Ne ) ,
δN (7.10)
k k
where we have dropped the term proportional to δN 2 , since for small
δN ≪ 1 this quadratic term will be even smaller and can therefore safely
be neglected. Note that by dropping the quadratic term, equation
(7.10) is now linear in δN . Upon close inspection of equation (7.10) we
see that we can further simplify the right-hand side: the first term on
the right-hand side will be zero by definition, since Ne is a stationary
point. The resulting linear evolution equation for small perturbations
δN around the stationary points Ne hence becomes
˙ = rδN (1 − 2 Ne ) .
δN (7.11)
k
Note that this result is still general and holds for all stationary points
Ne .11
3. We now solve equation (7.11) for each stationary point, by substituting
the specific values for Ne into the equation. In Ne,1 = 0 we find
˙ = rδN,
δN (7.12)
which has solution
δN = c0 exp (rt), (7.13)
with c0 an initial condition. In the stationary point Ne,2 = k equation
(7.11) reduces to
˙ = −rδN,
δN (7.14)
11
We deliberately keep the result general here, to avoid having to derive two evolution
equations, one per stationary point.
132
with solution
δN = c0 exp (−rt), (7.15)
again with c0 an initial condition.
4. According to solution (7.13), any perturbation in the number of fish
above Ne = 0 will grow exponentially over time. Hence, we classify
this equilibrium point as unstable. By contrast, perturbations around
Ne = k decay exponentially, according to solution (7.15), rendering that
equilibrium point stable.
E - Evaluate
Physically, the stability of the two stationary points makes sense: (point
Ne,1 ) as soon as there are a few fish, they will start reproducing, causing the
population to grow, rendering this stationary point unstable; (point Ne,2 ) if
there are less fish than the carrying capacity of the lake the population will
grow, but if there are more the population will decay due to overcrowding,
so this stationary point is stable to small perturbations.
The conclusions from the linear stability analyses are the same as the con-
clusions from the graphical analysis, as they should. However, from solutions
(7.13, 7.15) we additionally get quantitative information about how quickly
the population will grow or decay away from or towards its stationary points.
I - Identify
We have to find the stationary points of equation (7.16) and identify their
stability using a linear stability analysis.
133
S - Set up
Equation (7.16) is a non-linear, second-order autonomous equation. The sta-
tionary points are given by θ̈ = θ̇ = 0. Indeed, for the mass not to move and
hence be in the stationary point, both the velocity and the acceleration of
the mass need to be zero.
E - Execute
The Taylor series of equation (5.6) (see §5.2) for a function y = f (x)
around the specific point x = 0 can be generalized to a Taylor series of
this function around an arbitrary point x = a as follows
N
1 (n)
f (x) ≈ ∑ f (a) ⋅ (x − a)n . (7.18)
n=0 n!
134
With this expression we can approximate the given function y = f (x)
locally, i.e. around the point x = a, for ∣x − a∣ ≪ 1. The linearization
of y = f (x) around x = a is then given by a straight line through the
point (a, f (a)) with a slope f ′ (a); i.e.
The expression (7.18) gives the general expression for a Taylor expan-
sion around any point a in space. However, people often get confused
and mix up this expression with a Taylor series around x = 0. To avoid
mistakes, some people find it easier to perform a coordinate transfor-
mation that moves the point x = a to the origin before performing the
Taylor expansion. The coordinate transformation involving a trans-
lation of the old coordinates x to the new coordinates x′ is given by
x′ = x − a (7.20)
such that the new coordinate x′ is equal to zero when the old coordi-
nate x is equal to a. The Taylor series of the function f (x′) around
x′ = 0 is now equal to the Taylor series of function f (x) around x = a,
where x′ = x − a; see exercise 9.7.1.
We now use the Taylor series (7.18) to expand sin θ around the point
θ = θe (which is non-zero for θe,2 !). We deliberately do not yet fill in
the values we found for θe but keep the expansion general, to find
We stress once more that this result is valid around arbitrary points
θe . The reason for keeping the result general and not filling in the
stationary points directly is that we can now use our Taylor expansion
(7.22) in both stationary points, which saves some time (compared to
writing to expansions, one for each stationary point).
135
3. We now solve equation (7.22) for each stationary point. In θe,1 = 0 we
find
¨ = −ω 2 δθ,
δθ (7.23)
with solution
δθ = c1 cos ωt + c2 sin ωt, (7.24)
with c1 and c2 constants that are determined by some initial conditions.
In θe,2 = π we find
¨ = +ω 2 δθ,
δθ (7.25)
with solution
δθ = c1 exp ωt + c2 exp −ωt, (7.26)
with c1 and c2 again constants that are determined by initial conditions.
4. From equation (7.24) we observe that around θe,1 = 0 perturbations
neither grow nor decay but will keep oscillating. We therefore call the
point θe,1 = 0 neutrally stable, or elliptic, as we will see in exercise
9.7.5. By contrast, the perturbations around θe,2 (see equation (7.26))
contain an exponential growth term that will cause the perturbations
to grow without bound, rendering this stationary point unstable. Such
a stationary point is also called a hyperbolic point, somewhat related to
the shape of the trajectories in phase space around such a point (see
exercise 9.7.5).
E - Evaluate
The two stationary points correspond to the positions where the pendulum
hangs straight down (θe,1 = 0) or points straight up (θe,1 = π), and does not
have any velocity (such that θ̇ = 0 and the pendulum cannot simply pass
through the points θe ). The first stationary point was found to be neutrally
stable. The physical interpretation of this behavior is that, once perturbed
by giving it a small displacement or velocity, the pendulum will keep swinging
back and forth around its vertically downward pointing position at a small,
but constant, amplitude. In practice, there will always be some damping (for
example in the pivot point) causing the oscillation amplitude to gradually
decay, in line with our experience. The second stationary point (pendulum
pointing straight up), is unstable, as we know from experience.
136
8 Non-linear dynamics: from order to chaos
So far, we have mainly been concerned with linear systems. We only had
a glimpse of the behavior of non-linear systems such as the Lotka-Volterra
model in chapter 5. In this chapter we will see how the non-linearity can
give rise to complicated dynamic behavior: bifurcations, catastrophe, hys-
teresis, limit cycles, and chaos. We will show how these phenomena arise
in physical systems by giving a number of examples, such as the Van der
Pol equations describing the response of an electric circuit, and the Lorenz
equations that provide a basic model for atmospheric circulation. Note that
this final chapter is more conceptual than the previous chapters. You do not
need to memorize all details of the examples that are given. Instead, the fo-
cus should lie on understanding the concepts as well as on how to practically
construct a bifurcation diagram. To help you, the important concepts are
highlighted in italics, and summarized at the end of the chapter.
137
8.2 Bifurcations
As we saw in chapter 7, to observe a certain state of a system in nature, this
state should not only obey the evolution equations describing the system,
but it should also be stable against small perturbations. However, for many
non-linear systems, stationary points and their stability are not fixed. As
we will see, stationary points can be created or destroyed, become stable or
lose their stability depending on the value(s) of certain system parameter(s).
These major qualitative changes in the system’s dynamics (i.e. its temporal
evolution) upon variation of a system parameter are called bifurcations.
smaller than a certain critical value Fc the strut remains straight, and small
disturbances will not change this state. Hence, the straight state is stable.
However, when F is increased gradually, the ‘straight’ state will, at F > Fc ,
suddenly become unstable, causing the strut to buckle into one of the bent
states shown in figure 8.1(b,c). This qualitative change in the equilibrium
state of the system upon the change of control parameter F is called a bifur-
cation. Euler showed that the bifurcation point Fc is given by
π2
Fc = B , (8.1)
L2
138
where L is the strut length and B the rigidity. The parameter B is fully
determined by the material properties and the shape and size of the strut’s
cross section.
To quantitatively show the response of the strut to an increase in the com-
pressing force, we plot the excursion amplitude xa of the strut as a function
of F ; see figure 8.2. This amplitude remains zero as long as F < Fc , but starts
to increase gradually with increasing force F > Fc ; xa will become positive
when the strut bends to the right, and negative when it bends to the left,
see figure 8.2(b). This type of graphical representation of the behavior of the
system is called a bifurcation diagram.
Strut bending to the right
(a) (b) x (c)
F a
d
Fc F
xa 0
F
xa
x
Strut bending to the left
Figure 8.2: (a) When a force F > Fc is exerted on the strut its length shortens
by an amount d. The excursion amplitude of the strut is xa . (b) Bifurcation
diagram of the excursion amplitude xa of the strut versus the applied force
F . (c) Illustration of the bifurcation of panel (b) in the ball-on-hill analogy.
ẋ = r + x2 , (8.2)
139
where r is the system parameter, which can be positive, negative or equal to
zero. To plot the bifurcation diagram, we use the following steps:
unstable x
stable
140
From the bifurcation diagram of the strut show in figure 8.2(b) it is clear that
the system’s ‘equilibrium state’12 xa bifurcates at F = Fc into two possible
solutions: the upper branch corresponds to excursions xa > 0, whereas the
lower branch describes excursions xa < 0. Each of these branches is stable
to small perturbations. The dotted line (xa = 0, for F > Fc ) describes an
unstable solution branch: a small disturbance would push the system out
of the equilibrium xa = 0, the system would jump to one of the two stable
branches (xa > 0 or xa < 0) pretty much instantaneously. Note that the
symmetry of the physical system (equal chance of the strut buckling to the
left or to the right), is reflected in the symmetry of the bifurcation diagram
around the F -axis.
The bifurcation behavior shown in figure 8.2(b) has a nice analog in the
ball-on-a-hill configuration that we discussed in the context of stability of
equilibrium states in chapter 7. As shown in figure 8.2(c), one can think of a
ball placed in a valley located at xa = 0 for F < Fc ; in that position the ball is
stable to small perturbations around this position, and will oscillate around
xa = 0 when perturbed. At F = Fc the valley splits into two valleys with a
hill in between. For F > Fc the equilibrium state xa = 0 is now on top of
the hill, and therefore unstable, while there are two new stable equilibrium
states at xa > 0 and xa < 0.
Bifurcations occur in many physical systems. Prominent examples are the
transition from laminar to turbulent flow upon increase of the flow rate in
the field of fluid physics, or the onset of stimulated laser emission in optics.
141
An example of catastrophic behavior we see in a vertically set up, thin elastic
metal wire (e.g. brake cable of a bike) that is being clamped from below (see
figure 8.5).
LS g
LC
Clamping points
At a distance L below the free end the wire is clamped at a second point. At
short lengths L the wire will remain straight: its mechanical stiffness makes
sure the wire is stable in this state and will move back to this state when it
gets perturbed; hence, the wire is stable in its upright position. Now we are
going to increase the length L gradually. Until a certain critical length Ls the
wire will jump back to the vertical state, even when we apply big disturbances
to this equilibrium state (see figure 8.5(a)). When L is increased gradually
even further (> Ls ) we can keep the wire stable in the vertical position until
a second critical length L = Lc , but only when the disturbances are very
small (see figure 8.5(b)). When the free wire length L > Lc even the slightest
disturbance will result in a sudden collapse of the wire (see figure 8.5(c)). So
for L > Lc a small change in the system parameter L results in an abrupt
change in the state of the system: a catastrophe. The term catastrophe is
motivated by the fact that a minor change in the system parameter has major
consequences. You can imagine that if such a jump occurs in the equilibrium
142
state of e.g. a bridge, it can have catastrophic consequences!
Now, from the state L > Lc (see figure 8.5(c)), we are going to decrease the
wire length L gradually by slowly shifting the top clamp upwards. It turns
out the wire does not immediately return to the vertical state at L < Lc
(see figure 8.5(d)): upon small disturbances the wire remains hanging. Only
when the wire is shortened to L < Ls it jumps from the collapsed state back
to the vertical state at the slightest disturbance (see figure 8.5(e)). This irre-
versibility in behavior (the way down is different from the way up) is called
hysteresis.
a
L
0
LS LC L
a
(a) (b)
Figure 8.6: (a) The state of the clamped wire is measured by the deviation
a of the tip from its vertically upward position. The distance between the
tip in upright position and the top clamping point is L. (b) Bifurcation dia-
gram showing a as function of system parameter L. For L > Lc the system
will undergo a catastrophic jump from the vertical state to one of the stable
collapsed states.
the deviation of the wire tip from the vertical state (a = 0) as function of
distance L between the tip position in vertical state and the top clamping
point.
This bifurcation behavior stands in a striking contrast to the bifurcation of
the buckling strut (figure 8.1) as it allows for sudden jumps in the system
state and irreversibility in the system’s behavior upon a change of parameters.
To see how these catastrophic jumps and hysteretic behavior appear, we are
143
going to analyze the behavior of the system using figure 8.7. The initial state
a R
0
P Q L
R’
Figure 8.7: Illustration of the catastrophic jumps and hysteresis loop that can
occur for a system with a bifurcation diagram similar to the one in figure 8.6.
of the wire a = 0 with L < Ls (see figure 8.5(a)) is described by a point on the
horizontal axis between O and P . Upon increase of L beyond the first critical
value Ls this equilibrium state is still stable for small disturbances, and the
system state is described by a point on the horizontal axis between P and
Q (see figure 8.5(b)). Only at L = Lc (the point Q) the state a = 0 looses its
stability and the system suddenly jumps to the state R or R′ (dependent on
the nature of the inevitably present, small disturbances); a catastrophe (see
figure 8.5(c)). When the system has ended up at R the state of the system
will, upon a gradual decrease of L, remain on the top stable solution branch,
somewhere in between R and S (see figure 8.5(d)). Upon further decrease of
L, the state of the system will suddenly jump at L = Ls from the top stable
solution branch (point S) to point P on the equilibrium branch a = 0 (see
figure 8.5(e)). The arrows in the figure denote how the state of the system
changes upon gradual increase and decrease of the system parameter L. On
the interval Ls ≤ L ≤ Lc a so-called hysteresis loop (P QRSP ) occurs. In a
hysteretic system, the reversibility is lost: the way forward (increasing L) is
different from the way back (decreasing L).
The possibility for catastrophic jumps and hysteresis are a characteristic for
a system that shows multiple stable solution branches, such that the system
has more than one stable state for the same value of the system parameter.
In the example of the clamped wire, for Ls < L < Lc the system is stable
in the vertically upright position (a = 0), or in the position bend to the left
144
(a < 0), or to the right (a > 0).
A key example where catastrophic jumps and hysteresis occur is in our cli-
mate. So-called ‘tipping points’ in our climate are points where, when a
system parameter such as the amount of CO2 in the atmosphere is gradually
changed, the system undergoes a catastrophic jump to a new equilibrium
state, that cannot simply be undone by lowering the CO2 levels again; the
system has reached a new stable equilibrium branch. Here indeed, a small
change in the system parameters may lead to a catastrophic change in the
fate of the system. Tipping points are therefore a major topic of study for
climate researchers.
145
Strut bending to the right
xa
F
0
Figure 8.8: Bifurcation diagram for a strut with some imperfections: the strut
is more likely to bend towards the right than towards the left. To push the
system to the lower stable branch you need a big disturbance. When the force
on the strut is then decreased, the system will move along this branch until
it undergoes a catastrophic jump back to the stable upper branch.
146
θ
o θ
-
Figure 8.9: Phase diagram of the non-linear pendulum showing its behavior
close to the stationary points.
147
θ
- θ
around θ = 0.
Figure 8.11: The periodic phase plane of figure 8.10 is wrapped around a
cylinder such that the points θ = −π and θ = π overlap.
148
8.5 Limit cycles
The non-linear oscillations of the pendulum described above show up in the
cylindrical phase space as a set of closed orbits. However, non-linear systems
may also posses closed orbits that appear in isolation (i.e. without any other
closed orbits nearby). Such an isolated closed orbit is called a limit cycle.
This name comes from the fact that all trajectories that are sufficiently close
to a limit cycle either spiral away from it or towards it as time evolves; see
figure 8.12.
x2 x2 x2
x1 x1 x1
(a) (b) (c)
Figure 8.12: Three examples of isolated closed orbits in phase space: tra-
jectories either spiral (a) towards or (b) away from a limit cycle, or (c) a
combination of both.
Limit cycles are very important scientifically. The reason for that is that if
all nearby trajectories are attracted to a limit cycle, such as in figure 8.12(a),
they represent a periodic motion that is self-sustained: even in absence of
any forcing, these systems will evolve into oscillations. Some important ex-
amples of such behavior are the beating of the heart, daily rhythms in body
temperature or the detrimental self-excited oscillations in bridges or airplane
wings. In §8.5.2 we will discuss a famous example of limit-cycle oscillations
in electronic circuits.
Given the importance of limit cycles, scientists are often concerned with
identifying the presence of isolated closed orbits in the systems they study.
Unfortunately, to proof that a limit cycle must exist based on the evolution
equations of a system alone is often very hard, if not impossible, and only
suspicions, for example based on numerical simulations, remain. One theo-
rem that can sometimes be used to prove the existence of closed orbits (or, as
149
we will see later, rule out the existence of chaos) is the Poincaré-Bendixson
theorem.
x2 x2 x2
x1 x1 x1
this theorem is that if we can find a closed, bounded region within the phase
150
plane that does not contain any stationary points and in which a trajectory
remains trapped, then there must be a limit cycle within this region.
The formal proof of the Poincaré-Bendixson theorem requires tools from ad-
vanced mathematical analysis and will not be discussed here. Roughly, the
proof involves the (highly non-trivial) construction of a so-called ‘trapping
region’ in the phase plane, where the velocity vector across all boundaries
is pointing into the region, such that the trajectories inside it will remain
trapped forever. Next, we can argue that under these conditions the trapped
trajectories must end in a limit cycle by using the following property: tra-
jectories in the phase plane cannot cross themselves. To see why that is the
case, consider the most general form of a two-dimensional system:
ẋ1 = f (x1 , x2 )
(8.3)
ẋ2 = g(x1 , x2 ),
which expresses that in every point (x1 , x2 ) of the phase plane the direction
dx2 /dx1 of the trajectory has one single value, unless the point in question is
a stationary point (for which both f = 0 and g = 0 simultaneously). As a con-
sequence, in a two-dimensional system trajectories cannot cross; if they did
cross the derivative in equation (8.4) would be multi-valued, and trajectories
would be able to move in two directions at once. The only exception to this
rule are the stationary points (where nothing moves); there trajectories can
cross themselves, or another trajectory.
The notion that trajectories cannot cross has important implications for our
trajectories in the trapping region: since this region does not contain any
stationary points and the trajectories will remain confined inside this region
at all times, they have no choice but the spiral towards a limit cycle to prevent
them from crossing each other or themselves.
The results of the Poincaré-Bendixson theorem are only applicable in a two-
dimensional phase space, i.e. the phase plane. In higher dimensional systems
a radically different behavior can occur: trajectories can wander around in
a bounded region forever, without settling into a stationary point or closed
orbit. The fate of these trajectories can be extremely sensitive to the initial
151
conditions from which they start. This type of aperiodic behavior that is
extremely sensitive to initial conditions is called chaos, as we will discuss in
§8.6. A highly important corollary of the Poincaré-Bendixson theorem is that
chaos cannot occur in two-dimensional systems, where the fate of trajectories
confined to bounded regions is simple; recall figure 8.13.
Figure 8.14: The electrical circuit studied by van der Pol. Reproduced from
figure 11.3 of (1).
152
settles into self-sustained oscillations where the energy that is pumped in
exactly balances the energy that is dissipated during one cycle14 ; see figure
8.15. In the (x, ẋ) phase diagram, this periodic motion is visible as a limit
cycle, as shown in figure 8.16: the phase trajectories in the vicinity of the ori-
gin spiral outwards to a closed curve (drawn with a thick line). By contrast,
trajectories starting from ‘large initial conditions’ spiral inwards towards the
same cycle. Since the limit cycle is a closed curve, it corresponds to a periodic
oscillation in time.
Figure 8.17 shows the numerically determined (x, t)-plots and their corre-
sponding (x, ẋ) phase diagrams of equation (8.5) for the cases ε = (a) 0.1 ,
(b) 1.5, and (c) 10, all with the initial conditions x(0) = 0 and ẋ(0) = 0.01.
For small ε (figure 8.17(a)), the phase diagram looks elliptical and the oscil-
lation in x(t) is approximately harmonic. Upon an increase in the value of ε
we see that the system tends to a periodic oscillation much faster, but this
oscillation does not look harmonic any longer (see figures 8.17(b,c)) and the
shape of the limit cycle deviates more and more from an ellipse. In figure
8.17(c) we see that in every cycle x slowly decreases from the value 2 to
the value 1, and then quickly jumps to the value −2. In the second half of
the cycle x gradually increases from −2 to the value −1, and then quickly
jumps back to the value +2, after which the cycle repeats itself. The bigger
the value of ε, the more abrupt the jumps are and the larger the oscillation
period is.
14
This intuitive reasoning can be made more rigorous; mathematicians have proven that
the Van der Pol equation has a unique, stable limit cycle for each ε > 0.
153
Figure 8.16: The phase diagram of the Van der Pol oscillator (8.5) for ε = 1.
Image taken from (Van der Pol, 1926)(3).
Oscillations of the form shown in figure 8.17(b,c) are called relaxation os-
cillations. The physical interpretation of the asymmetry in the oscillation
is that the dynamic system gradually absorbs energy during the oscillation,
and then subsequently quickly releases it: in this phase the system relaxes.
This behavior can be observed best by doing the computer simulation (us-
ing a modified version of the Excel-file Lotka Volterra, or Matlab program
POLPHASE) yourself.15
15
These Matlab programs and a description of the programs can be found on Canvas.
154
Figure 8.17: The behavior of the Van der Pol oscillator (8.5) for ε = 0.1
(a), 1.5 (b), and 10 (c) with initial conditions x(0) = 0 and ẋ(0) = 0.01.
Calculations are done using the Matlab program POLPHASE (a modified
version of XTPHASE).
8.6 Chaos
The phase-space of the Van der Pol equation is two-dimensional. As discussed
in §8.5.1 the long-term evolution of a non-linear two-dimensional system will
always be predictable. We now turn to systems with a phase-space of three-
dimensions or higher. While the Poincaré-Bendixson theorem states that
the fate of trajectories in a two-dimensional system is limited (they end
in a stationary point, a closed orbit or a limit cycle), in three-dimensional
systems that is no longer the case. In three- or higher dimensional systems
the Poincaré-Bendixson theorem no longer applies, and chaotic behavior can
155
occur.
Let us first specify what we mean by chaos. Even though there is no uni-
versally accepted definition of chaos, people have agreed on the following
characteristics:
1. The motion of the system is irregular, i.e. it never repeats itself as time
evolves, and it also does not settle down to stationary points.
The third condition implies that if we know the initial conditions with infinite
precision, we can predict all future states of the system from its evolution
equations. However, the issue is that in practice we are never able to reach
such precision, and due to condition 2, any small deviation in initial condi-
tions will lead to vastly different outcomes in the long-term.
We now illustrate the beauty and complexity of chaotic motion in two exam-
ple systems.
ẍ + k ẋ + x3 = A cos Ωt . (8.6)
Here, k is the damping coefficient, A the forcing amplitude, and Ω the forcing
frequency. Note that equation (8.6) might be a second-order differential
equation, but it is non-autonomous. If we rewrite equation (8.6) into an
156
autonomous system of first-order differential equations we arrive at
ẋ = y
ẏ = −ky − x3 + A cos Ωt (8.7)
ṫ = 1 .
Since corresponding phase space is three dimensional, the Poincaré-Bendixson
theorem does not apply (see §8.5.1), and the system can potentially show
chaotic behavior, as we will see.
The behavior of the solution of equation (8.6) is illustrated in figure 8.18.
This figure shows the numerically determined solution for the parameter
values k = 0.01, Ω = 1, and A = 7.5 for two different initial conditions: the
thick line (a) for x(0) = 3 and ẋ(0) = 3, and the thin line (b) for x(0) = 3.003
and ẋ(0) = 3. The irregular course of the solution x(t) is obvious in both
cases: the non-linearity of the equation of motion (8.6) apparently gives rise
to irregular oscillations that never perfectly repeat the same pattern. With
that comes the sensitivity to the initial conditions: although the values of
x(0) only differ 1%, the solutions (a) and (b) for these initial conditions,
show radically different behavior after 5 oscillation periods of the forcing
term (A cos Ωt).
We can also map the behavior of the solution by plotting it in the (x, ẋ) phase
diagram: see figure 8.19. It can clearly be seen that the trajectory in this
two-dimensional phase-plane crosses itself time and time again, each time in
157
Figure 8.19: The chaotic oscillations of the non-linear periodically forced os-
cillator given by equation (8.6). Phase diagram constructed using the Matlab
program XTPHASE.
a different point, but the trajectories do remain confined in space (i.e. they
do not wander off to infinity). The system shows chaotic behavior. The
trajectory drawn in figure 8.19 is actually a projection of a three dimensional
trajectory on the x, y-plane: the chaotic phase trajectory actually comes out
of the plane of the drawing (in the positive t-direction), and does not cross
itself in the three-dimensional phase space.
In this example the three-dimensionality of the system arises from the fact
that the second-order evolution equation describing it is non-autonomous.
In the next example we are going to focus our attention to an autonomous
system with a three dimensional phase space.
158
Figure 8.20: Thermally-driven convection flow in between two horizontal
plates. (a) The initially ordered motion can at a sufficiently large Rayleigh
number transform into (b) convection rolls.
ẋ = −σ(x − y)
ẏ = rx − y − xz (8.8)
ż = xy − bz ,
159
Lorenz tried to analyze the set of equations (8.8) as far as possible using
standard techniques, similar to what we have discussed our course so far.
Step-by-step, he eliminated all known possibilities for the long-term evolution
of the system, until he entered terra incognita. We will follow some of his
steps to reveal the hidden secrets of the set of equations (8.8).
Phase space The Lorenz equations are an autonomous set of three first-
order differential equations. The state of this system is given by a point
(x, y, z) in the three-dimensional phase space. The so-called ‘velocity in the
phase space’ v ≡ (ẋ, ẏ, ż) is unambiguous: trajectories in this phase space
can never cross themselves or others! However, in the two-dimensional phase
plane, crossings are possible, and the Poincaré-Bendixson theorem does not
apply. Lorenz could prove that all trajectories will remain trapped within
a finite ellipsoidal volume in the three-dimensional phase space, which will
have important implications for the long-time behavior of the system, as we
will see later.
Stationary states and their stability The equations (8.8) have several
equilibrium states (x0 , y0 , z0 ). In exercise 9.8.12 we will show that
• For r < 1 the system only has one stationary state, namely (x0 , y0 , z0 ) =
(0, 0, 0).
(x0 , y0 , z0 ) = (0, ⎫
⎪
√0, 0) √ ⎪
⎪
= ( √ b(r − 1), b(r
√ − 1), r − 1) ⎬ (8.10)
⎪
⎪
⎪
= (− b(r − 1), − b(r − 1), r − 1) . ⎭
160
The physical interpretation of these stationary states is as follows: for r < 1
(small Rayleigh number, i.e. the viscous forces dominate the upward buoy-
ancy forces due to the heating of the fluid) the heat transport happens via
conduction (there is no flow in this case). When r > 1 convection occurs,
and the heat transport then happens via flow. For r < 1 the system has one
stationary state (x0 , yo , z0 ) = (0, 0, 0), whereas three stationary states exist
for r > 1. Hence, the quantity r is a bifurcation parameter that changes the
number and qualitative behavior of the stationary states.
You can prove, using what we have learned in chapter 7, that the stationary
state (x0 , y0 , z0 ) = (0, 0, 0) is stable for r < 1, and unstable for r > 1. You
will set up this proof in exercise 9.8.12. Moreover, Lorenz proved that for
r < 1 every trajectory will approach the stationary point (0, 0, 0) and hence
no limit cycles or chaos can occur. The other two stationary points listed
in expression (8.10) are (linearly) stable for 1 < r < rc , with rc = σ(σ+b+3)
(σ−b−1) . In
figure 8.21 the bifurcation diagram for the Lorenz system is shown. Beyond
the point r = rc there are no stable stationary points or limit cycles. So what
happens when the stable branches loose their stability beyond r > rc ? In that
range of the phase space, some peculiar behavior arises, as we will see below.
0
1 r = rc r
Figure 8.21: Sketch of the bifurcation diagram for the Lorenz equations (8.8).
161
numerically determined x(t) solutions of equations (8.8) are shown in figure
8.22. As is clear from the figure, the temporal evolution of these solutions
is irregular (aperiodic) in shape, and moreover, it is extremely sensitive to
initial conditions. The x(t) solutions in figure 8.22 only differ 1% in their
initial value for x(0), and show radically different behavior for larger t values.
In the figure this divergent behavior can be observed for roughly t > 14. If
we make the difference in initial conditions smaller by a factor 100 (so the
absolute values then are 5 and 5.00005) the solutions stay similar for only a
slightly longer time: yet at t > 16 they diverge again. Indeed, for r > rc the
Lorenz equations show chaotic behavior.
162
substantial deviations, even in the limited interval 0 < t < 20.
Lorenz saw that the chaotic behavior of the equations (8.8) has important
consequences for the long-term predictability of of chaotic systems. Lorenz
(1963) writes:
Figure 8.23: The projection of the solution trajectory of equations (8.8) on the
x, z-plane, for σ = 10, b = 8/3, r = 28 (hence r > rc ) and the initial condition
(x, y, z) = (5, 5, 5) on t = 0. Calculations are done using the Matlab program
NPHASEXT.
163
Figure 8.24: The projection of the solution trajectory of equations (8.8) on
the x, y-plane, for r = 28 and the initial condition (x, y, z) = (5, 5, 5) on t = 0.
Calculations done using NPHASEXT.
the system remains ‘dwelling’ on the butterfly wings, without ever settling
into an equilibrium state. For example, in figure 8.23 we see a trajectory that
starts near the origin, and first moves around the unstable point in the right
half of the phase plane, before it suddenly jumps to the left, where it spirals
around the left unstable point for a while, before jumping back to the right,
and so on. The state of the system keeps on changing in this way, without
ever repeating itself. The trajectory seems to be crossing itself several times,
but this caused by the projection. Recall that a trajectory of the autonomous
system given by equations (8.8) can never cross itself, or another trajectory,
in the three-dimensional phase space. In three dimensions, the ‘wings’ of the
butterfly may look like two surfaces that merge into one, but in fact they
are not: Lorenz showed that if you zoom in carefully, each of these surfaces
consists of another set of two surfaces, which in turn consists of yet another
set of two surfaces, and so on. Hence, the butterfly has what is called a
fractal structure.
The motion of the trajectories on the butterfly wings turns out to be highly
sensitive to the initial conditions; i.e. from what point in phase space the
trajectory starts. This sensitivity means that two trajectories that start close
to each other in phase space rapidly diverge as time evolves, and end up in
completely different positions on the butterfly. However, at all times they
will remain confined in space (i.e. they do not leave to infinity), as if attracted
to the butterfly wings. An attracting object in the phase space that displays
high sensitivity to initial conditions is called a strange attractor. The Lorenz
164
attractor is one of the most famous types of strange attractors that appear
in chaotic systems, but many more have been discovered since.
Chaos is a fascinating phenomenon in non-linear system dynamics, but it
is not only a scientific curiosity. Applications of chaos can be found in a
wide range of fields, ranging from analyzing the turbulent motion in flu-
ids, making weather predictions, understanding of cardiac arrhythmia, stock
market predictions, to the use of synchronized chaos for encrypting messages
in communication.
165
a trajectory is confined to a bounded region, it either ends in a stationary
point, moves in a closed orbit, or approaches a limit cycle. In three- or
higher dimensional systems the theorem no longer applies and chaos can
occur. Chaotic motion is irregular (in the sense that it does not repeat
itself) and extremely sensitive to the initial conditions. Chaos is a direct
result of the non-linearity of the system: if a system starts from two only
slightly different initial positions in the phase diagram, this difference may be
amplified in a non-linear way such that the system moves towards two vastly
different locations as time evolves, making the two trajectories diverge.
In some circumstances the trajectories separate but remain attracted to cer-
tain region on the phase diagram such that they stay within a finite volume.
If such an attracting region in the phase diagram has a high sensitivity to
initial conditions (i.e. two points that start close by end up at vastly different
locations on the attractor at later times) it is called a strange attractor.
166
9 Exercises
The level of the exercises is categorized with stars:
• 8: The first time may cause some sweat, but after a few practises, this
should be done with your eyes closed.
• 88: Requires some physical insights and multiple steps to find the
right answer.
d2 x dx
(d) + + C = 0, where x is a position and t is the time.
dt2 dt
x − ut
(e) x′ = √ , in which x and x′ are positions, t is the time, u is the
1 − u2 /c2
velocity and c is the speed of light.
167
9.1.2 Dimension check 2 8
Determine in the given equations the dimension of variable(s):
GmM
(a) the gravitational constant G in F = , in which F is the gravita-
r2
tional force and r the distance between masses m and M .
(b) Ω in x = a cos(Ωt), where t is the time.
(c) γ in E = γv 2 with E [J]=[kg m2 s−2 ] the energy and v a velocity. (How
did you check your answer during the evaluate step?)
d2 θ
(d) α and β in + (α + β cos(T ))θ = 0, in which θ [-] is an angle.
dT 2
0.450g
(e) ϵ in ϵ < , in which ωmax is an angular frequency and g is the
ωmax 2
gravitational acceleration.
9.1.4 Nozzle 88
A fireman holds the nozzle of a fire hose, from which a forceful stream of
water emits (cross section A, velocity V ), see figure 9.1. The water has a
density ρ, and the flow can be considered frictionless. In order to keep the
nozzle under control the fireman has to exert a force F in the direction of
the stream.
Derive using dimension analysis a relationship between the force F and the
variables ρ, V , and A.
168
9.1.5 Fountain 88
In a fountain water flows upwards, against the gravity (g), see figure 9.2.
The velocity at the base of the fountain equals V .
The water has a density ρ, and all frictional effects can be neglected.
Derive using dimension analysis the relationship between the height of the
fountain H and the other relevant variables.
- Movie - Exercise: Fountain
169
9.1.8 Water waves 88
A wave goes across a horizontal layer of water (depth H), see figure 9.3.
Since the gravitational acceleration g plays an essential role in this motion,
the wave usually is denoted by a ‘gravity wave’.
(a) Derive using dimension analysis the relationship between the wave ve-
locity V and the relevant variables g and H.
Derive using dimension analysis the relationship between the force F that the
demonstrator has to exert and the relevant physical variables in this problem.
170
Figure 9.4: Beam of water.
connected in parallel (see figure 9.5). When at a certain time the capacitor
has stored a certain amount of charge, it will discharge via the coil. Because
of the self induction of the coil this discharge process will be opposed and
this will even cause the charge in the circuit to flow back to the capacitor and
therefore the capacitor will charge again. If one would measure the electrical
current (dimension [A]) in the circuit, oscillating behavior would be observed
since the capacitor periodically charges and discharges.
Derive using dimension analysis the relationship between the oscillation time
T of the alternating current in the LC-circuit and the relevant variables of
this electrical network. N.B. The dimensions of self-induction and capaci-
tance are
171
L C
relationship between the Lorentz force and the relevant physical variables in
this problem.
172
(h) f (x) = x+1 , −∞
x2
< x < ∞, x ≠ −1
(i) f (x) = x−1 , −∞
3x+6
< x < ∞, x ≠ 1
(j) f (x) = x2 −9 , −∞
9
< x < ∞, x ≠ ±3
(k) f (x) = 1+ex , −∞
ex
<x<∞
(l) f (x) = 1 + x1 , −∞ < x < ∞, x ≠ 0
√
(m) f (x) = x + 1, −1 < x < ∞
9.1.14 Differentiation 8
Determine the following derivatives. You can use:
• Product rule: d
dx [f (x) × g(x)] = f (x)g ′ (x) + f ′ (x)g(x).
• Quotient rule: d
dx [ fg(x)
(x)
]= f ′ (x)g(x)−f (x)g ′ (x)
(g(x))2
.
• Chain rule: d
dx [f (g(x))] = f ′ (g(x)) g ′ (x).
(a) f (x) = sin(px), p is a parameter
(b) f (x) = sin(x) cos(x)
√
(c) f (x) = 9 − x2 , − 3 ≤ x ≤ 3
(d) f (t) = exp (t2 )
9.1.15 Integration 8
Determine the following integrals. For some of these integrals, the method of
substitution can be useful. This method is the integral version of the chain
rule, which can be written in the integral form as:
173
(a) ∫−2 (2 + 5x)dx
2
9√
(b) ∫0 9 − x dx
1
(c) ∫1/3 1t dt
(h) ∫ bax dx, b and a are parameters and b > 0 (Hint ∶ bax = exp [a ln(b)x] )
174
9.2 Exercises chapter 2
9.2.1 Adding and subtracting vectors 8
⃗ for which holds
(a) Give an expression for w,
⎛2⎞ ⎛5⎞
⎜7⎟ + w⃗ = ⎜ 2 ⎟ .
⎝3⎠ ⎝−1⎠
(b) Take two random, non-equal in length and/or direction, vectors u⃗ and
v⃗ and draw
• u⃗ + v⃗
u + 2⃗
• 3⃗ v
• u⃗ − v⃗
u − 3⃗
• 5⃗ v
9.2.2 Lines 8
Determine a vector representation of the line through
9.2.3 Planes 8
Determine a vector representation of the plane
⎛4⎞ ⎛1⎞
2. That contains the line x⃗ = ⎜−1⎟ + µ ⎜ 1 ⎟ and the point (5, 2, 6).
⎝3⎠ ⎝−2⎠
175
9.2.5 Vector expressions 2 8
⃗ θ) = (3, π)
Express the following vectors in Cartesian coordinates (x, y): A(r,
⃗
and B(r, θ) = (−1, 2 )
π
vr = vx cos θ + vy sin θ,
(9.3)
vθ = −vx sin θ + vy cos θ.
And show that with equations (9.3) and (9.4) you can find equations (2.34).
x(t) = x0 + γt2 ,
176
9.2.10 Moving mass 2 8
A mass m moves with a velocity v(t) along the x-axis and its position is
given by
x(t) = x0 + βt + γt2 ,
where x0 is the initial position and β and γ are constants. Determine the
corresponding expressions for the velocity v(t) and the acceleration a(t).
Display the evolution of x, v, and a as a function of the time graphically.
̂ sin ωt,
x=x
(b) Determine the path length s of the mass in between t = 0 and t = T /2,
where T is the period of the oscillating motion.
177
(a) u=̂
v, v =̂
v.
√
(b) u=̂
v, v =̂
v 3
(c) u=̂
v, v =̂
vt
u=̂
v sin ωt
(d) }
v=̂
v sin ωt
u=̂
v sin ωt
(e) }
v=̂
v cos ωt
178
9.3 Exercises chapter 3
9.3.1 Water tank 88
Consider a water tank, where the input tube is below the free surface of
the water in the tank, and where the volume flow rate into the tank varies
harmonically in time:
(a) Determine the expression for the water height h(t) with h(t = 0) = h0 .
(b) Sketch the evolution of ϕV (t) and h(t) in one graph as a function of t.
Discuss the result.
179
9.3.3 Leaking water tank 2 88
See the previous exercise, but now for the case where the exit velocity is
dependent on the water height in the tank:
√
U= 2gh.
exp (t2 )
x(t) = 2 . (9.6)
1 + exp (t2 )
180
dy
(a) + sin(t)y = 0
dt
d2 y dy
(b) + +y =0
dt2 dt
Rewrite this differential equation into a system of 1st order differential
equations.
d2 y
(c) + y3 = 0
dt2
d4 y
(d) +y =0
dt4
Rewrite this differential equation into a system of 1st order differential
equations.
ẋ = y
(e) {
ẏ = −x
Derive one single differential equation for x(t) from this system.
⎧
⎪ ẋ = y
⎪
⎪
(f) ⎨ = −z
ẏ
⎪
⎪
⎪
⎩ ż = 2(x + y)
Derive one single differential equation for x(t) from this system.
θ̇ = y
(l) {
ẏ = − sin(θ)
Derive one single differential equation for θ(t) from this system.
ẋ = y
(m) {
ẏ = −x − (x2 − 1) y
Derive one single differential equation for x(t) from this system.
182
9.3.9 Drag 88
At high velocities V the resistance of a driving car is dominated by drag (or
air resistance). In good approximation the drag force is proportional to V 2 :
Fdrag = −DV 2 ,
At t = 0 the engine is turned off and the car with mass M rolls further with
a (decreasing) velocity V (t) with V (t = 0) = V0 .
(c) Show that the characteristic timescale T in this expression for V can
also be determined from a dimension analysis of the independent vari-
ables in this problem.
183
spring force is given by Fs = kx2 , with k the spring constant (k > 0), and the
spring has a length of zero in rest.
The angular velocity for this device is constant and given by θ̇ = ω [s−1 ].
A locomotive is located at a distance from the center of the turntable r [m].
The position is described in polar coordinates.
(b) Show that, by using Newton’s second law, the radial component of the
evolution equation for the position of the locomotive is given by
k 2
r̈ − ω 2 r + r =0
m
(c) Give the evolution equation for the azimuthal component of the posi-
tion of the locomotive.
9.3.12 Kirchhoff 1 88
For the circuit shown in figure 9.8, calculate:
184
14.0 V
e + - f
4.0 Ω I2
- + I1
b c
6.0 Ω I3
10.0 V
a d
2.0 Ω
9.3.13 Kirchhoff 2 88
Under steady-state conditions, calculate in the multiloop circuit shown in
figure 9.9:
9.3.14 Kirchhoff 3 88
The electric circuit of figure 9.10 contains four resistors: R1 , R2 , R3 and Rv ,
where Rv is an adjustable, variable resistance. In addition, there is an emf
with voltage V .
The resistances can be considered as given. The currents are for convenience
already labelled, but should be considered unknown.
(a) Give the equation for the loop that runs from the emf, via R1 and then
via R2 back to the emf.
185
4.00 V
- +
d e
I3 5.00 Ω I3
3.00 Ω
c f
I2
I1 5.00 Ω I1
+ -
b g
8.00 V
I=0
- + + -
a h
3.00 V 6.00 μF
186
I1 R1 Rv Iv R2 I2 R3 I3
V
+ -
closed
ε switch
+ -
R C
187
N surface sites per unit area, i.e., positions where a molecule can adsorb.
The coverage θ is the fraction of sites on which a molecule is absorbed. A
molecule can only adsorb on empty sites, which scales with ∼(1-θ). The
number of molecules impacting on the surface (leading to adsorption) can be
described with a flux Γ [m−2 s−1 ].
(b) Write down the expression for how the coverage θ changes during a time
interval ∆t as a result of the molecules adsorbing on the surface. (Hint:
find the relationship between the variables based on their dimensions).
(c) Give the evolution equation for the coverage of molecules on the surface.
(d) Solve the evolution equation, assuming θ(t = 0) = 0 as the initial con-
dition.
When adsorbed on the surface, a molecule can also escape from the surface
again, in process referred to as desorption. Such a desorption reaction scales
with the coverage (∼ θ), and is characterized with a so-called rate constant
k [s−1 ], which is basically a probability for whether desorption occurs.
(e) Add a term accounting for the desorption to the evolution equation
derived in (c).
188
Figure 9.12: The force executed on the spacecraft is a consequence of the
photons impacting on the solar sail.
(b) Give an expression for how the momentum of the spacecraft psc changes
during a time interval ∆t as a result of the light captured on the sail.
(d) Give the evolution equation for the position of the spacecraft.
(c) the slowing down of a rolling car, based on the variables defined in §3.4.
(d) Give the differential equation for exponential growth. Give an expres-
sion for the doubling time in terms of the e-folding timescale τ .
189
9.4 Exercises chapter 4
9.4.1 Nondimensionalizing evolution equations 88
Consider the decelerating bike of exercise 9.3.10.
(a) What would be an appropriate typical velocity scale to nondimension-
alize velocity V ?
(b) What would be a typical time scale to nondimensionalize time t?
(c) Nondimensionalize the evolution equation for V that you found in ex-
ercise 9.3.10 including the initial condition.
Consider again the leaking water tank of exercise 9.3.3.
√
(d) Show that A0 /A h0 /2g has the dimension [s].
(e) Nondimensionalize the evolution equation for h(t) derived in exercise
9.3.3 choosing an appropriate characteristic time and length scale.
(f) Compare the result of question (e) to the result of question (c). What
do you observe?
190
9.4.3 Nondimensional electrical circuit 888
R L
191
9.4.4 Nondimensional mechanical system 888
In chapter 5, we will deduce a differential equation for a mass-spring system
with damping:
d2 x dx
m 2
+γ + αx = 0, (9.10)
dt dt
in which γ is the damping constant and α is the spring constant. At t = 0,
the mass is at position x0 .
(a) Deduce from equation (9.10) what the dimensions of γ and α are.
(b) What is an appropriate characteristic timescale to nondimensionalize
the independent variable t?
(c) What is an appropriate length scale to nondimensionalize the depen-
dent variable x?
(d) Nondimensionalize the evolution equation for this mass-spring system.
(e) Compare the result of question (d) to the result of question 9.4.3(e)
What do you observe?
(f) Study the analogy between electrical and mechanical systems by filling
out the table below.
Characteristic Mechanical system Electrical system
Independent variable time t
Dependent variable
Inertia mass m
Rate of change current I
Resistance Resistance R
Stiffness spring constant α
192
(a) Make a graph of ϕw,1 as a function of time. Define what ω should be.
(b) Give the evolution equation for the temperature of the object.
(c) Nondimensionalize the evolution equation. See equation (4.9) for how
to nondimensionalize the time t, instead of using ω.
(e) Solve the evolution equation for β >>1 and discuss your result.
(f) Solve the evolution equation for β <<1 and discuss your result.
193
9.5 Exercises chapter 5
9.5.1 Taylor series around x = 0 8
Expand the following functions in a Taylor series up to order N = 3 around
x = 0:
9.5.2 Linearization 88
Linearize the following non-linear differential equations for ∣x∣ ≪ 1 (i.e., write
the non-linear term as a Taylor series) and then solve:
(a) d2 x
dt2 + sin(x) = 0
(b) d2 x
dt2 + tanh(−16x) = 0
(c) dx
dt = ln(x + 1)3
(d) d2 x
dt2 dt + 2 sin(x) = 0 (Hint: try the solution x(t) ∼ e for the
+ 3 cos(x) dx pt
194
9.5.3 The simple pendulum 88
Consider the pendulum (see figure 5.2 on page 80), of which the motion can
be described conveniently in polar coordinates, see figure 5.3 on page 81.
195
(a) Give the classical (normal) expression for the kinetic energy Eclass,kin of
a mass.
(b) Use a Taylor expansion to approximate equation (9.12) for small speeds.
Hint: use ( vc )2 = x around x = 0.
(c) Show that the relativistic kinetic energy Erel,kin in equation (9.12) is
the classical kinetic energy Eclass,kin if v ≪ c. Hint: assume that the
mass is equal to m0 at small speeds.
196
(b) Investigate the behavior of equation (5.44) using the excel file pendu-
[Link], for example for the cases Ω = 0.8ω and Ω = ω (see figure 5.9).
Describe the behavior you observe.
(a) Set the forcing term to zero (A = 0) and investigate the influence of
damping by using different values of k as input (as in exercise 9.5.6(b)).
(b) Set the damping to zero (k = 0) and investigate the influence of forcing
by using different values of A and Ω as input. The value Ω = ω will
result in resonance (as in exercise 9.5.7(b)).
(c) Now combine damping and resonant forcing (Ω = ω). Try different
values for k and A and investigate when the damping is dominant, when
the forcing is dominant and when damping and forcing are balanced.
9.5.9 Nondimensionalization 88
(a) Nondimensionalize the linearized pendulum equation as given by given
by equation (5.12).
(c) Compare the answers to (a) and (b) to each other. What do you notice?
θ̈ + ω 2 sin θ = 0. (9.13)
During the oscillations θ(t) of the mass, kinetic energy Ekin is continuously
being converted into potential energy Epot and vice versa.
197
(a) Give the expression for the kinetic energy Ekin of the swaying mass.
(b) Derive the expression for the potential energy Epot (θ) that the mass
has at a certain excursion θ.
(d) Derive this equation for energy conservation again, but now by multi-
plying the terms in equation (9.13) by θ̇ and rewriting this in the shape
of d[⋯ ]/dt = 0. Hint: use θ ⋅ θ̇ = dt ( 2 θ ).
d 1 2
(e) Does the result found in (d) correspond to what has been found in (c)?
mẍ + αx = 0. (9.14)
We would like to investigate the energy of the system, for that we will use
the linear oscillation equation and apply several mathematical ‘tricks’.
For the next step we would like to add the two equations, preferentially in
such a way that the right-hand side of the equality sign is equal to 0. So, we
multiply the equation for ẋ on both sides of the equality sign with αx and we
multiply the equation for v̇ on both sides with mv. The right hand side of
each of the equations from (a) now are the same but have an opposite sign.
(b) Show that the two equations from the system in (a) can then be rewrit-
ten into
d 1
(hint: x ⋅ ẋ = ( x2 ))
dt 2
d 1 2
( αx ) = αvx, (9.15a)
dt 2
d 1 2
( mv ) = −αxv. (9.15b)
dt 2
198
As said, we would like to add the two equations (9.15a) and (9.15b) to each
other.
(e) What is the dimension of this constant E? What is the physical mean-
ing of result equation (9.17)?
ẋ = v, (9.19a)
1 dU
v̇ = − . (9.19b)
m dx
(a) Give the expressions for the kinetic energy Ekin (θ) and for the potential
energy Epot (θ) (see exercise 9.5.10).
(b) Use a Taylor expansion to approximate the potential energy for small
excursions θ.
(c) Set up the equation that describes the energy balance of a pendulum
in terms of θ using the approximation.
(d) Compare the found energy balance to the energy balance of a spring
given by equation (5.37) on page 92 with V (x) = 21 αx2 . What are the
similarities and differences?
dN1 ⎫
⎪
= α1 N1 − β1 N2 ⎪
⎪
⎪
dt ⎪
⎬ (9.21)
dN2 ⎪
⎪
⎪
= −α2 N2 + β2 N1 , ⎪
⎪
dt ⎭
(b) The same question (a), but now for the simplified Lotka-Volterra model
given by equation (9.21).
200
9.5.16 Model for disease epidemic 88
For modeling the evolution of a disease epidemic we can create a model based
on the Lotka-Volterra model given by equations (5.51)-(5.52) with α1 = 0:
dx ⎫
⎪
= −cxy ⎪
⎪
⎪
dt ⎪
⎬ (9.22)
dy ⎪
⎪
⎪
= +cxy − by, ⎪
⎪
dt ⎭
where
• x(t) = number of individuals in the population that are at risk of being
infected; y(t) = number of people that are infected at a time t;
• b = coefficient (> 0) that determines how fast y decreases as a result of
cure (or death) of infected people;
• c = coefficient (> 0) that describes how fast the infection spreads.
(a) Show that the number of infected people has to decrease when x(t =
0) < b/c.
(b) Show that when x(t = 0) > b/c the number of infected people increases
monotonically until x reaches the value of b/c. Give a physical expla-
nation for the observed behavior of the solutions x(t) and y(t).
(c) How could the model (9.22) be made more realistic?
(d) Nondimensionalize the evolution equations.
201
9.5.18 Graphing transverse waves 8
A transverse wave on a rope has wave speed v, amplitude A and wavelength λ.
At time t = 0 and at position x = 0 the displacement is maximum downwards.
The wave is traveling in the positive x-direction.
(a) Give an expression for the frequency, period and wave number.
(d) f (x, y) = xy
(e) g(v, w) = v ln w
202
9.5.21 Wave speed on a rope 888
Use figure 5.13 on page 103 to show that
(a)
∂y
F1y = T ( ) , (9.23)
∂x x
and
∂y
F2y = T ( ) . (9.24)
∂x x+∆x
Hint: the ratio Fiy /T should be equal to the magnitude of the slope of
the rope in that point.
F 2 y(x,t)
(b) Show that ∆xy is equal to T ∂ ∂x2 for very small ∆x by using the
equations above.
203
9.6 Exercises chapter 6
9.6.1 Graphical analysis of an autonomous first-order system 88
Consider the system
dx
= sin(x).
dt
(a) Sketch the direction field for this system for −π ≤ x ≤ π.
(b) Draw the solutions x(t) for initial conditions x(0) = 0, and x(0) = π/2.
(d) Sketch the phase line for this system, indicate the stationary points
and use arrows to illustrate the behavior of the system away from the
stationary points.
(b) Draw the solutions x(t) for initial conditions x(0) = 0, x(0) = 1 and
x(0) = 2.
204
9.6.3 Phase space 8
Reformulate the following second-order differential equations into a set of
first-order autonomous differential equations:
d2 θ g
(i) + sin θ = 0
dt2 l
d2 x
(ii) + ω2x = 0
dt2
d2 x k dx
(iii) + + ω2x = 0
dt2 l dt
d2 x
(iv) + ω 2 x = a cos(Ωt)
dt2
d2 x dx
(v) 2
+k = at2
dt dt
205
(c) What does the evolution of the solution look like in the θ, θ̈ phase
plane?
ẍ = ω 2 x. (9.25)
(c) Show that the trajectories in the phase plane of this system are given
by hyperbolas; i.e. show that the shape of the trajectories is given by
x21 x22
− = 1, (9.26)
a b
and determine the constants a and b.
(d) Sketch the phase diagram and use arrows to indicate the direction of
the trajectories.
206
(b) Roughly sketch the trajectories in the phase plane, in a similar way as
what is done in figure 6.5 in §6.1.3.
(c) Determine the exact shape of the trajectories for the case where R = 0.
(d) Argue whether this system will show periodic oscillations or not.
1. f (x, t) = λ,
2. f (x, t) = λt,
3. f (x, t) = λx,
4. f (x, t) = λxt,
where λ is a constant.
(b) Determine the solutions numerically, by hand, using the explicit Euler
integration method, for three time steps ∆t. To this end, take ∆t = 1,
λ = 1, and initial condition x(0) = 0.
(c) Compare the numerical solutions to the exact solutions for the same
time steps by tabelling and plotting the values (see the example in table
6.1 and figure 6.8). To this end, take λ = 1, x0 = 1 and use a time step
∆t = 1.
207
9.6.10 Numerical integration of a second-order system 88
In this exercise we will numerically integrate the mass-spring system given by
equation (6.8), which is a second-order, autonomous system. At a first glance
it may not be clear how to numerically integrate this system using Euler’s
method, following the integration rule given by equation (6.25). However,
we can use a trick:
(a) Rewrite equation (6.8) into a set of first-order differential equations for
the state variables x1 (position) and x2 (velocity).
(b) Write down the expressions for position and velocity in the next time
step tn+1 in terms of the values in the previous time step tn using Euler’s
explicit method.
(c) Tabulate the numerical values of x1 and x2 for the first three time steps
∆t. To this end, take ω = 1, ∆t = 1, x1 (0) = 1, and x2 (0) = 0.
208
9.7 Exercises chapter 7
9.7.1 Taylor series 1 8
The Taylor series of a function f around x = 0 is given by (recall §5.2)
N
1 (n)
f (x) ≈ ∑ f (0) ⋅ xn . (9.27)
n=0 n!
(b) Give the first two terms of the correct expansion of f around θe .
(c) Give the first two terms of the expansion of f around θ = 0 and θ = π.
(d) Make a sketch of f (θ) on the domain [0, 2π]. In your sketch, add the
two linearizations of f derived under (c).
209
(c) Using the phase diagram, determine whether the stationary points
found under (a) are stable or unstable.
You will now perform a linear stability analysis to determine the stability of
each stationary point, to practice this procedure and confirm your answer to
(c). To this end, we will consider a small perturbation δx ≪ 1 around each
equilibrium point xe and determine whether this perturbation will grow or
shrink over time.
(e) Solve the resulting equations for δx (you will have one equation per
stationary point) and analyze the result: does the small disturbance
grow or shrink over time?
(f) What do you hence conclude about the stability of each stationary
point?
You will analyze the stability of the stationary points of this system using a
linear stability analysis. To this end, perform the following steps:
(c) Solve the resulting equations for δθ and analyze your results: does the
disturbance grow over time or not?
(d) What do you hence conclude about the stability of each stationary
point?
210
9.7.5 Non-linear pendulum 888
(a) Rewrite the pendulum equation (7.16) into a set first-order equations.
What is the dimensionality of the phase space for the pendulum?
(d) Sketch the shape of the trajectories in the (x1 , x2 )-phase diagram.
Clearly mark the location(s) of the equilibrium point(s). Add arrows
to indicate the directionality of the curves.
(e) Using your plot, evaluate the stability of the equilibrium point(s).
(f) Why are these points also called elliptic and hyperbolic points do you
think?
(g) Using the results of the linear stability analysis of the pendulum equa-
tion in §7.2.3, namely equation (7.23) and (7.25), determine the exact
shape of the trajectories in the phase space close to the two equilibrium
points.
Ṅ1 = α1 N1 − γN1 N2
(9.31)
Ṅ2 = −α2 N2 + γN1 N2 .
(b) What is the dimensionality of the phase space for this system?
(c) Draw the (N1 , N2 )-phase plane and mark the stationary points (with-
out trajectories).
211
(d) Sketch the directionality of the paths that lie on the N1 - and N2 -axes.
(e) Indicate, by roughly drawing arrows with the right direction, the tra-
jectories around the stationary points.
(f) From the direction of the trajectories in phase space, what do you
conclude about the stability of the stationary points?
(c) Simplify equations (9.33) by filling in the stationary points and solve
them.
(d) From your results under (c), what do you conclude about the stability
of the stationary points? Compare this conclusion to your results of
the graphical stability analysis in the previous exercise.
(e) Show that the solutions starting from the vicinity of the stable sta-
tionary point show oscillations around this point with a period T =
2π/(α1 α2 )1/2 .
(f) Derive expressions for the shape of the trajectories for the perturba-
tions δN1 , δN2 in the phase diagram, and demonstrate why one of the
stationary points is also called an elliptic point, while the other is called
a hyperbolic point.
212
(g) Modify the excel file [Link] for the Lotka-Volterra model
with α1 = α2 = 1 and γ = 0.1. Verify what has been found in (a) - (c) by
performing simulations, e.g. with initial conditions (N1 (0), N2 (0)) =
(9,9), (7,7), (2,2), etc. Also give a physical explanation for the observed
behavior of the system.
F (t) = β [x(t)] ,
2
(d) Give an expression for the (dimensionless) kinetic energy of the mass.
From hereon we discard the tildes in equation (9.35) and rewrite this equation
as follows
dV
ẍ = − . (9.36)
dx
(e) Determine the function V (x) assuming that V (x = 0) = 0.
213
(f) Sketch the function V (x) and show from this plot that equation (9.35)
has two stationary points. Can you judge from the plot of V (x) which
of these stationary points are stable and which are unstable? Motivate
your answer.
(g) Multiply all terms in equation (9.36) with ẋ and then rewrite the result
dt = 0, where E is the sum of kinetic
into the energy conservation form dE
and potential energy.
214
9.8 Exercises chapter 8
9.8.1 Bifurcation diagram 1 88
Consider the system (8.2).
(a) What are the stationary points of this system for r < 0, r = 0 and r > 0?
(b) Graphically analyze the stability of these equilibrium states (see chap-
ter 6).
(c) What is the dimensionality of the phase space for this system?
(d) Construct the phase diagrams of the system for a case where r < 0,
r = 0 and r > 0.
(e) Draw the bifurcation diagram of this system. Indicate the stability of
each branch by using dashed lines for unstable and solid lines for stable
branches.
(b) Plot ẋ) versus x for r < 0, r = 0 and r > 0 and use this plot to construct
the phase lines for these three cases.
(c) Using your sketches, determine the stability of each equilibrium point
for the cases r < 0, r = 0, r > 0.
(d) Draw the bifurcation diagram for this system. Indicate the stability of
each branch by using dashed lines for unstable and solid lines for stable
branches.
215
9.8.3 Bifurcation diagram 3 888
Consider the following nonlinear, first-order system
where r is a positive constant and sinh (x) = 12 {exp (x) − exp (−x)}.
(a) For 0 ≤ r < 1 this system has only one stationary point, namely x = 0.
Investigate the stability of this equilibrium point using a linear stability
analysis.
(b) Show that for r > 1 there are three equilibrium points one of which
still is x = 0. Investigate the stability of all three equilibrium points
by graphical analysis. (Hint: Plot the two functions on the right-hand
side of equation (9.38) in one figure and evaluate the sign of ẋ as a
function of x).
(c) Show that the system described by equation (9.38) undergoes a bifur-
cation at x = 0 as r is varied and plot a bifurcation diagram.
(a) Roughly sketch the bifurcation diagram of the strut. In other words:
plot the excursion amplitude xa of the strut as a function of the com-
pression force F . Mark the bifurcation point Fc .
(b) Consider the situation where the strut has an imperfection, such that it
is more likely to bend towards the left when compressed than towards
the right. Modify the bifurcation diagram accordingly.
(c) Now the strut is compressed with a force F > Fc but we give it a push
such that it is forced to bend towards the right(i.e. its unfavorable
state). From this bent state, we slowly decrease the compression force
back to zero. Sketch the path taken by the strut in the bifurcation
diagram.
(d) Explain (using your previous answers) why the imperfection of the strut
allows for hysteresis in this system.
216
9.8.5 The non-linear pendulum 1 88
Consider the non-linear pendulum described by equation (5.3) in §5.2, and
imagine that we give it an initial angular velocity Ω from its initial position
θ = 0.
(a) Write down the initial conditions that correspond to this situation.
(b) Introduce the dimensionless time t̃ = t/(l/g)1/2 and formulate the prob-
lem (pendulum equation + initial conditions) in a dimensionless form.
(c) Show that the equation can be written as a system of two first order
differential equations:
dθ
θ̇ = = y,
dt̃
dy
ẏ = = − sin θ,
dt̃
dθ dθ/dt̃
= = ⋯.
dy dy/dt̃
1 2
Show that after integration we get: y = cos θ + constant.
2
(e) Determine the constant by applying the initial conditions.
(a) Study the motion of the pendulum for an initial excursion θ0 = 3.124139 (=
179○ ). Compare the oscillation period with those for the cases θ0 = 178○
and θ0 = 179.5○ .
217
Now suppose that the pendulum is subject to a friction force. This friction
proportional to the angular velocity and therefore given by Ff = kdθ/dt.
(b) Show that by including the friction force non-dimensional pendulum
equation becomes
θ̈ + k̃ θ̇ + sin θ = 0 (9.39)
and determine k̃.
(c) Using the initial conditions θ(0) = 0, θ̇(0) = Ω̃, with Ω̃ = Ω(l/g)1/2 ,
investigate the influence of the damping term on the motion of the
pendulum using the excel file.
218
9.8.9 The Van der Pol oscillator 8
Investigate the behavior of the Van der Pol oscillator – described by equa-
tion (8.5) in §8.5.2 – by making a modified version of the excel file Lotka-
[Link]. Investigate the behavior of equation (8.5) for different values
of ε. Use for example the input values x(0) = 0, ẋ = 0.01 and the time step
dt = 0.01. Is the final oscillation very sensitive to the initial conditions x(0)
and ẋ(0)? How does the oscillation period T depend on ε? NB: upon in-
creasing values of ε the size of the time step dt will have to be decreased
in order to still obtain accurate results. Check how for ε = 10 the period T
depends on the time step dt.
(b) Convert equation (8.6) into a system of autonomous 1st order differen-
tial equations.
(c) Give an explanation for the strong dependence on the starting condi-
tions.
(d) In figure 9.14 different numerical solutions are shown for different start-
ing conditions. Describe the different behaviors.
(e) Investigate the behavior of this system by using the excel file pendu-
[Link] (you have to modify the file yourself).
219
Figure 9.14: (x, t)-diagram obtained numerically with NXTWAIT for differ-
ent starting conditions, with k = 0.08, Ω = 1 and A = 0.2.
(b) Convert equation (9.42) into a system of autonomous 1st order differ-
ential equations.
(c) Describe the behavior of the forced Van der Pol oscillator seen in figure
9.15, 9.16 and 9.17: explain which of the figures shows a limit cycle, a
(potential) strange attractor or period doubling (i.e. a periodic motion
where the oscillation period doubles).
(b) Determine the other stationary points (if any) of the Lorenz equations
for r < 1.
(c) Determine the other stationary points (if any) of the Lorenz equations
for r > 1.
220
Figure 9.15: Behavior of the forced Van der Pol oscillator for A = 1, ϵ = 0.5
and ω = 1. Starting conditions are x(0) = 0.01 and ẋ(0) = 0.
Figure 9.16: Behavior of the forced Van der Pol oscillator for A = 1, ϵ = 0.5
and ω = 0.5. Starting conditions are x(0) = 0.01 and ẋ(0) = 0.
221
Figure 9.17: Behavior of the forced Van der Pol oscillator for A = 1, ϵ = 0
and ω = 0.5. Starting conditions are x(0) = 0.01 and ẋ(0) = 0.
(d) Using these results, determine the stability of the stationary point
(0, 0, 0) for r < 1 and for r > 1.
(e) Based on your answers above, sketch the (r, xe )-bifurcation diagram
for the Lorenz equations for 0 < r < rc .
222
A References and recommended literature
A.1 Bibliography
References
[1] D.J. Acheson – From Calculus to Chaos. Oxford University Press, https:
//[Link]/oclc/38062718
[3] B. van der Pol – On relaxation oscillations. Phil. Mag. 2, 978 - 992 (1926),
[Link]
[4] P. Martien, S.C. Pope, P.L. Scott & R.S. Shaw – The chaotic behaviour
of the leaky faucet. Phys. Lett. 110 A, 399-404 (1985), [Link]
org/10.1016/0375-9601(85)90065-9
[5] H. Aref – Stirring by chaotic advection. J. Fluid. Mech. 143, 1-21 (1984),
[Link]
223
A lot of the material has been inspired on the book
D.J. Acheson – From Calculus to Chaos
Oxford University Press (1997).
This book is recommended for those that want to read more about this sub-
ject matter!
Unfortunately, most books on this subject are quite specialized and not very
accessible for first year students, because of the (still) limited knowledge of
all mathematics involved. Books that give a nice and readable introduction
to non-linear systems and chaotic behavior are (in increasing order of degree
of specialization):
J. Gleick – Chaos
Abacus (1993) [this book has also been translated into Dutch]
G.L. Baker & J.P. Gollub – Chaotic Dynamics: an Introduction (2nd ed.)
Cambridge University Press (1996).
This is only a small selection from the vast amount of literature (both spe-
cialized and popular scientific) that has been published on this subject.
On the subject of ‘catastrophe theory’ a lot has been written as well. A nice
review paper (mentioned before in chapter 8) is:
There also are a lot of websites on the field of non-linear systems. There you
can find information on advanced research in this field, but also on the ele-
mentary principles of non-linear oscillations, bifurcations, chaotic dynamics,
etc.
224
B Information about [Link]
B.1 Introduction
The excel file [Link] is a tool for your study and enjoyment, that
uses the Euler method to numerically solve the following differential equation:
g
ẍ + k ẋ + sin x + A cos Ωt = 0 (B.1)
l
For many of you this equation will be recognizable as the differential equation
that describes a pendulum. If you do not recognize this equation, please have
another look at chapter 5.
This pendulum-model here is a rather elaborate version of the pendulum. It
is not linearized; it has some damping (the k ẋ-term) and it has a harmonic
driving force (the A cos Ωt-term), which can make it behave in very interesting
ways.
Having all these terms built in to this file may seem intimidating at first,
but it is ultimately quite helpful, because all the constants can be set freely,
enabling the study of a rich set of behaviors of this pendulum system.
Moreover, the freely setting of constants, also includes the freedom of setting
them to 0, which – of course – makes them drop out of the equation entirely,
putting us back into the world of a much simpler equation, whenever we desire
to relax ourselves by enjoying a simpler depiction of the physical reality.
So, this luxurious version of the equation does not force you to work with
a complex equation if you do not want to. It does, however, allow you to
switch on extra bits of physically relevant terms in the equation, to reveal
entire new worlds of exciting behavior.
The file provides immediate graphic output that visualizes the behavior of
the differential equation: It gives a plot of x against t, as well as ẋ and ẍ
against t. If you look closely, you will be able to see the more or less 90° phase
difference.
It also gives a phase diagram: ẋ versus x. And finally it gives a vector plot.
Play around with the settings and see what interesting stuff you can make
happen. See if it is numerical in origin or depicts ‘real’ physics.
225
B.2 A peek under the hood: setting starting values
When we take a closer look at the excel file at hand, at the very top of sheet
1 we first see 4 columns that are labeled t, x′′ , x′ and x. We will come back
to these columns in a bit.
Further to the right (column F onwards) we see relevant constants that are
given a numerical value. We will list all of them here:
• dt [s]: this sets the time step for the calculation. It needs to be small
enough to make the assumption (of linearity and stability) true16 .
226
This form of the equation allows us to calculate ẍ(0), i.e. ẍ at time t = 0
using nothing but the constants as defined in the previous subsection. And
since for t = 0 we now have x , ẋ and ẍ, we might as well put them all in a
table. This is exactly what can be seen in the first numerical row (so really
the second row) of the first 4 columns of sheet 1.
Now, how does one get from the first numerical row to the second numerical
row? That is very easy, if you are willing to assume that everything is linear,
which we are, because we have made dt small enough for that to be true. So,
what does that linearity mean? Well, it means that we can use the Euler
method:
and that
These two equations require only information that we already have and thus
allow us to fill the second numerical line of the table. And since we now have
the second numerical line of the table filled, we can use the same procedure
to fill the third numerical line. And so on, and so forth, until we have had
enough17 .
Excel has some neat tricks to fill tables with values based on values in pre-
vious rows. It seems therefore that the program Excel was made for doing
calculations like these, but it wasn’t. I highly recommend you to take a look
at how the formulas in this excel file implement this calculation as described
in this manual.
B.4 Visualizations
Now that we have filled our (by now enormous) table, we want to assess the
information that is hidden in these many many numbers. To do that, we will
represent this information graphically, because our brains are much better at
recognizing patterns in graphs than in tables. What graphs are most helpful
for your purpose, is for you, the engineer, to decide.
17
I had enough after 10 000 lines, as I am sure some of you will have seen by now. Feel
free to expand the table as far as you like.
227
For your convenience, this file provides a number of graphs: of x against t,
as well as ẋ and ẍ against t.
While these graphs are interesting, there are – perhaps – better ways to see
what is happening to this system. First, there is a phase diagram, which plots
ẋ against x, which makes a lot of sense in this particular physical context,
because the potential energy scales with x2 and the kinetic energy scales with
ẋ2 .
The sum of those two energies then corresponds to the mechanical energy of
the system, which is conserved (constant) if there is no damping or driving.
That means that in that case we expect to see an ellipse in the phase diagram.
The phase diagram is also very helpful to see if the motion of the system
repeats itself or not.
The final graph that is provided for your convenience is the vector plot (direc-
tion field).18 The vector plot shows the direction in which the system wants
to progress at various coordinate points in the x-ẋ-space. By following the
arrows, you can draw the phase diagram that would result from any given
starting point in the x-ẋ-space. Play with the starting values to see how the
curve looks in the vector plot.
If you modify this excel file to model the behavior of other exciting differential
equations, you may well arrive at a point where you need other visualizations.
Even for this system, there may be situations where you want to make some
aspect of the behavior visible that are not currently covered by the provided
graphs. Have fun exploring the possibilities.
18
Vector plots are very difficult to make in Excel, but with some trickery it worked.
228
C Greek alphabet
229