Preview-9781498774048 A37870037
Preview-9781498774048 A37870037
FOR
DYNAMICAL SYSTEMS
BIOLOGICAL MODELING
DYNAMICAL SYSTEMS
FOR BIOLOGICAL
MODELING
Dynamical Systems for Biological Modeling: An Introduction pro-
vides both biology and mathematics students with the understanding
and techniques necessary to undertake basic modeling of biological
systems. It achieves this through the development and analysis of
dynamical systems. AN INTRODUCTION
The approach emphasizes qualitative ideas rather than explicit com-
putations. Some technical details are necessary, but a qualitative ap-
proach emphasizing ideas is essential for understanding. The model-
ing approach helps students focus on essentials rather than extensive
mathematical details, which is helpful for students whose primary in-
terests are in sciences other than mathematics.
The book discusses a variety of biological modeling topics, including
population biology, epidemiology, immunology, intraspecies competi-
tion, harvesting, predator–prey systems, structured populations, and
more.
The authors also include examples of problems with solutions and
some exercises that follow the examples quite closely. In addition,
problems are included that go beyond the examples, both in math- Fred Brauer
Brauer • Kribs
ematical analysis and in the development of mathematical models for
biological problems, in order to encourage deeper understanding and
an eagerness to use mathematics in learning about biology. Christopher Kribs
C664X
w w w. c rc p r e s s . c o m
Published Titles
Green’s Functions with Applications, Second Edition Dean G. Duffy
Introduction to Financial Mathematics Kevin J. Hastings
Linear and Integer Optimization: Theory and Practice, Third Edition
Gerard Sierksma and Yori Zwols
Markov Processes James R. Kirkwood
Pocket Book of Integrals and Mathematical Formulas, 5th Edition
Ronald J. Tallarida
Stochastic Partial Differential Equations, Second Edition Pao-Liu Chow
Dynamical Systems for Biological Modeling: An Introduction
Fred Brauer and Christopher Kribs
Advances in Applied Mathematics
DYNAMICAL SYSTEMS
FOR BIOLOGICAL
MODELING
AN INTRODUCTION
Fred Brauer
University of British Columbia
Vancouver, British Columbia, Canada
Christopher Kribs
University of Texas at Arlington
Arlington, Texas, USA
Back cover image credit: (Photo of healthcare workers) Cleopatra Adedeji, CDC PHIL public domain
collection.
CRC Press
Taylor & Francis Group
6000 Broken Sound Parkway NW, Suite 300
Boca Raton, FL 33487-2742
© 2016 by Taylor & Francis Group, LLC
CRC Press is an imprint of Taylor & Francis Group, an Informa business
This book contains information obtained from authentic and highly regarded sources. Reasonable
efforts have been made to publish reliable data and information, but the author and publisher cannot
assume responsibility for the validity of all materials or the consequences of their use. The authors and
publishers have attempted to trace the copyright holders of all material reproduced in this publication
and apologize to copyright holders if permission to publish in this form has not been obtained. If any
copyright material has not been acknowledged please write and let us know so we may rectify in any
future reprint.
Except as permitted under U.S. Copyright Law, no part of this book may be reprinted, reproduced,
transmitted, or utilized in any form by any electronic, mechanical, or other means, now known or
hereafter invented, including photocopying, microfilming, and recording, or in any information stor-
age or retrieval system, without written permission from the publishers.
For permission to photocopy or use material electronically from this work, please access www.copy-
right.com (http://www.copyright.com/) or contact the Copyright Clearance Center, Inc. (CCC), 222
Rosewood Drive, Danvers, MA 01923, 978-750-8400. CCC is a not-for-profit organization that pro-
vides licenses and registration for a variety of users. For organizations that have been granted a photo-
copy license by the CCC, a separate system of payment has been arranged.
Trademark Notice: Product or corporate names may be trademarks or registered trademarks, and are
used only for identification and explanation without intent to infringe.
Visit the Taylor & Francis Web site at
http://www.taylorandfrancis.com
and the CRC Press Web site at
http://www.crcpress.com
to our children and grandchildren
This page intentionally left blank
Contents
Preface xi
Acknowledgments xiii
I Elementary Topics 1
1 Introduction to Biological Modeling 3
1.1 The nature and purposes of biological modeling . . . . . . . 3
1.2 The modeling process . . . . . . . . . . . . . . . . . . . . . . 5
1.3 Types of mathematical models . . . . . . . . . . . . . . . . . 11
1.4 Assumptions, simplifications, and compromises . . . . . . . . 14
1.5 Scale, and choosing units . . . . . . . . . . . . . . . . . . . . 17
vii
viii Contents
4.3.3 Contact rate saturation and the “Pay It Forward” model 237
4.4 Parameter changes, thresholds, and bifurcations . . . . . . . 242
4.4.1 Hysteresis . . . . . . . . . . . . . . . . . . . . . . . . . 249
4.4.2 The spruce budworm . . . . . . . . . . . . . . . . . . . 251
4.5 Numerical analysis of differential equations . . . . . . . . . . 258
4.5.1 Approximation error . . . . . . . . . . . . . . . . . . . 259
4.5.2 Euler’s method . . . . . . . . . . . . . . . . . . . . . . 260
4.5.3 Other numerical methods . . . . . . . . . . . . . . . . 264
4.5.4 Eutrophication . . . . . . . . . . . . . . . . . . . . . . 270
Miscellaneous exercises . . . . . . . . . . . . . . . . . . . . . . . . 277
Bibliography 459
Index 467
Preface
xi
xii Preface
We thank Bob Stern at CRC Press for planting the initial idea for this book,
and both him and Bob Ross for their support and understanding in the face
of long delays during the preparation of the manuscript. (Although we do not
include delay equations in this book, there certainly were delays.) We also
thank everyone at Taylor & Francis who helped with the production of this
book, especially Shashi Kumar and Marcus Fontaine for critically useful help
involving LaTeX, Karen Simon, and Kevin Craig for graphic design assistance.
The figures and photos accompanying discussion of the various biologi-
cal systems studied and discussed play a crucial role in bringing the models
(and their motivations) to life for the reader, and many appear in this work
through the kind permission of others. We therefore acknowledge here all those
who generously permitted us to print their photos, or helped us obtain permis-
sion: Donna Anstey, Francine Bérubé, Daniel Bowen, John Calambokidis, Tom
Chrzanowski, Patricia Ernst, Carla Flores, Tim Gerrodette, Stefano Guerrieri,
Ray Hamblett, Alan M. Hughes, Duncan Jackson, Russell S. Karow, Carolyn
Kribs, Joel Michaelsen, Bernard E. Picton, Dave Powell, Francis Ratnieks,
Helen Sarakinos, Howard Swatland, Michael Tildesley, and S. Bradleigh Vin-
son.
We also thank all those photographers who contributed indirectly, in-
cluding photos in the public domain: Cleopatra Adedeji, Lennert B., David
Burdick, Janice Haney Carr, Mark Conlin, Karen Couch, Jan Derk, Gary
Fellers, Ryan Hagerty, William Chapman Hewitson, Steve Hillebrand, Tom
Hodge, John & Karen Hollingsworth, Al Mare, Maureen Metcalfe, Benjamin
Mills, A.J. Nicholson, Sergey Nivens, Zev Ross, Jeff Schmaltz, Greg Webster,
Gary Zahm, and the following organizations: the Centers for Disease Con-
trol, Florida Keys National Marine Sanctuary, Ken Gray Image Collection
at Oregon State University, MODIS/NASA, National Diabetes Information
Clearinghouse, NOAA, the Pennsylvania Dept. of Conservation and Natural
Resources, River Alliance of Wisconsin, the Sickle Cell Foundation of Georgia,
the Southwest Fisheries Science Center of the NOAA Fisheries Service, U.S.
Fish and Wildlife Service, U.S. Geological Survey, U.S. National Park Service,
and the Wisconsin Dept. of Natural Resources.
xiii
This page intentionally left blank
Part I
Elementary Topics
1
This page intentionally left blank
Chapter 1
Introduction to Biological Modeling
3
4 Dynamical Systems for Biological Modeling: An Introduction
tion: mathematical modeling in the practice of biologists and mathematicians, Science and
Education 6(5): 441–472.
2 G.E.P. Box (1976). Science and statistics, Journal of the American Statistical Associ-
evaluation
mate solutions numerically, and are useful for illustration purposes, or when a
model is too complicated to complete a qualitative analysis, or when we have
good estimates of the parameters involved. In this text we shall show how to
apply all three types of analysis, although qualitative analysis will receive the
most emphasis, as a way to prove how complicated models behave, regard-
less of the exact parameter values. Although the mathematical nature of such
models can generate convincingly real data, it is often important to remember
that, as gross oversimplifications of reality, mathematical models are just as
much rough sketches as the nonmathematical theories with which biologists
are familiar, and qualitative descriptions of behavior befit this notion.
(4) Interpretation Interpreting mathematical results in biological
terms requires a return to the original context of the problem, and is easier
with a well-articulated research question. That is, rather than simply asking,
“What happens if we model the following biological system?” one ought to
ask a specific question that can be addressed with a model — for example,
“What effects do seasonal temperature variations have on the size of this pop-
ulation?” or “How does behavior change based on observed infection levels
affect the eradicability of this disease?” (A general statistical analysis of an
experimental data set, however, may show up trends that shape subsequent
research directions.) Interpretation is also facilitated by a close correspon-
dence between each element of the mathematical model and the elements of
the biological system. The conclusion “this population will go extinct if beta
x is less than 1” is only useful if one can put “beta x” in biological terms —
what do beta and x mean? can we measure them (or at least their product)?
Which might we be able to control, and which are inherent properties of the
biological system?
The basis for an interpretation may be numerical, qualitative, or graphical.
When most parameters (fixed quantities) in a model can be estimated fairly
well, numerical information can provide ranges within which some varying
or controllable quantity causes the biological system to behave in a partic-
ular way, or critical values which cause that behavior to change. Identifying
thresholds between survival and extinction, or between settling down to an
equilibrium level and oscillating forever, or comparing the behavior of two
related but slightly different models, can answer qualitative questions such
as, “Which explanation for this phenomenon better accounts for our obser-
vations?” or “Does the system behave differently if we take into account this
additional factor?” The ready availability of numerous computational tools
also makes it possible to represent results graphically, and a graph can be
an especially compelling, concise statement of a complex result. Graphs can
illustrate both general trends and striking thresholds.
However, just as with algebraic expressions, graphical depictions of math-
ematical information can be so concise that the job of unpacking them into
nonmathematical terms can be significant. The ability of mathematics in all its
forms to represent complicated ideas compactly makes it both powerful and
challenging, and if one considers all the time invested in becoming familiar
Introduction to Biological Modeling 9
Rate
births deaths
Population size
FIGURE 1.2: A graph comparing birth and death rates vs. population size,
after Roth (2001).
• Note first that the horizontal axis in the graph is not time but population
size. That is, the graph shows how birth and death rates vary depending
on the population, rather than over time. Since many continuous graphs
depict how some quantity changes over time, one must readjust one’s
reading of the graph to reflect what it is that is varying.
• Note second that the vertical axis in the graph gives birth and death rates
(measured in individuals per day, week, or year), and not total births
and deaths. That is, the graph shows how fast births and deaths occur,
as population size grows (varies). The bending downward of the birth
rate curve, for example, as population size increases does not address
what has happened to previous births in the past of any population that
reaches that size. The distinction (and relationship) between population
4 W.-M. Roth (1998), Unspecified things, signs, and “natural objects”: towards a phe-
models which keep track only of the overall sizes of otherwise homogeneous
groups may allow the variables representing them to vary continuously, espe-
cially if the unit (see Section 1.5) makes this meaningful: biomass measured
in kilograms, or individuals measured in thousands or millions (where each
individual is such a small quantity that the difference between discrete and
continuous is minimal). In general, however, the choice between discrete and
continuous state variables is linked to a more fundamental decision: whether
to make the model deterministic or stochastic.
A deterministic model describes a system in terms of averages: every possi-
ble outcome — dying or not dying, reproducing or not reproducing, recovering
from a disease at any moment from just after infection to years afterward —
occurs, in the proportions corresponding to the relative probabilities of each
event happening. If the average lifetime for a population under study is 30
years, then the corresponding average (per capita) death rate is its reciprocal,
1 1
30 /yr ≈ 0.03/yr, and in a deterministic model precisely 1/30th, or 3 3 %, of the
population will die each year. In some sense, it is more accurate to say that
in a deterministic model, 1/30th of each individual dies per year. This type
of model is appropriate for large populations, where we call on the so-called
Law of Large Numbers, which says that as the number of trials of a random
event (such as whether or not a given individual dies) increases, the actual
experimental probability (here the proportion of the population that under-
goes a certain change) approaches the theoretical probability of the event.
Deterministic models also commonly use continuous state variables.
On the other hand, a stochastic, or probabilistic, model describes all events
in terms of probabilities, and essentially flips a coin or tosses a die for each
individual member of the population, to see whether that member dies or
not, reproduces or not, etc. Consequently, these models use discrete state
variables. A stochastic approach generally requires a little more mathematical
machinery — in particular, familiarity with probability distributions — but is
appropriate in cases where populations are small enough that the Law of Large
Numbers does not apply, or where for some other reason it is important to
couch the model in terms of probabilities: for example, to determine a possible
probability distribution for the outcome of a certain event (like how many
cases an outbreak of disease will cause). Recently, studies have been made of
the structure of social contact networks,8 and in some cases detailed data has
been recorded for contact networks (e.g., SARS outbreaks, and sexual contact
networks in small closed populations); studying how these networks affect
the spread of contact-driven phenomena such as infectious diseases requires
a stochastic approach. Likewise, studies of disease eradication must focus on
the last few infected individuals, where probabilistic effects are important. For
the large-scale study of gonorrhea mentioned earlier, however, a deterministic
8 See, for instance, S.H. Strogatz (2001). Exploring complex networks, Nature 410: 268–
276, and M.E.J. Newman (2003). The structure and function of complex networks, SIAM
Review 45: 167–256.
14 Dynamical Systems for Biological Modeling: An Introduction
approach is not only simpler but has provided significant enough insights to
inform disease control strategies.
In addition, statistical analyses can be especially important for some mod-
els. Two particular calculations of relevance here are sensitivity analysis and
uncertainty analysis. In a sensitivity analysis, a probability distribution of pa-
rameter values is chosen around the parameters’ estimated averages, in order
to determine how strongly the model results depend on each parameter; the
outcome is a ranking of parameters to which some particular model output —
say, the minimum influx of new individuals per year needed in order to sustain
a population which reproduces slowly — is sensitive. For example, one might
find this hypothetical minimum influx to be more sensitive to the existing
population’s death rate than to its reproductive rate. An uncertainty analysis
studies the impact of measurement errors (how far off the estimated param-
eter values are); the outcome is a probability distribution for some model
output, say, the spread of possible values for the required minimum influx
given estimated probability distributions for the birth and death rates.
No single text can hope to make a reader conversant with all of these
types of mathematical models. In this book we shall focus on deterministic
models, with continuous state variables, stratified discretely when necessary
to incorporate heterogeneity, the alternative being continuous variation us-
ing partial differential equations. Chapter 2 will consider models of biological
systems appropriate for discrete dynamical systems (recall that by discrete
we mean discrete in time), while the remaining chapters will consider mod-
els using continuous dynamical systems. In each case, we will begin our study
with simple (linear) single equations, proceed to more complicated (nonlinear)
single equations, and finally consider systems of interacting populations.
the way radioactive decay works (as opposed to, say, a fixed period of time);
although some biological processes do work this way, the real reason we make
this assumption is to make our models be differential equations rather than
something more complicated, like delay or integral equations. Second, at the
same time our willingness to consider reasonably complex models means giving
up exact solutions to the equations in favor of qualitative information about
the solutions: do they eventually taper off toward some equilibrium, or do
they oscillate forever, or do they crash to zero in finite time, or do they do
something stranger? In the case of a quantitative model, we give up exact
solutions and broad, analytical guarantees of possible behaviors in exchange
for quantitative approximations given specific parameter values.9
Third, typically we also make some kind of assumption of homogeneity
of individuals — that, within a given group, they all behave the same way
with regard to any events described in the model. Recall also the discussion of
handling heterogeneity in the previous section; stratification typically includes
this assumption of homogeneity within each class, in exchange for a simpler
type of model. This assumption, as well as the first one above, arises from the
motivation to minimize the number of state variables used (the dimension of
the model).
Fourth, we sometimes give up immediate biological interpretability in re-
turn for tractability — that is, after initially defining a model in biological
terms, we may further simplify it by redefining variables and parameters, in a
way that makes the model mathematically simpler (usually reducing the num-
ber of different variables and/or parameters) but may complicate our ability
to interpret the new quantities in biological terms. For example, one model
for foraging ants10 studied in Section 4.1 begins with five parameters:
αN K(βN − α) βK 2
a= , b= , c= .
σ σ σ
9 Computational schemes used in numerical analysis, however, are typically shown to
provide approximations that converge to the exact solution as the time-steps involved get
smaller. That is, one can make the approximate solutions as close as one likes to the exact
solution, if one is willing to wait longer for the computer to run its calculations.
10 D.J.T. Sumpter and S.C. Pratt (2003). A modelling framework for understanding social
The resulting model is simpler to analyze, but the new parameters are more
difficult to interpret in biological terms because the biological information
has been packed mathematically, and must be unpacked following analysis in
order to be interpreted more easily. This process is called rescaling or non-
dimensionalization and is discussed further in Section 1.5 below.
In articulating the simplifying assumptions involved in forming a model,
one should consider the consequences of introducing these “errors.” For ex-
ample, what do we lose from the results of a model if we assume homogeneous
mixing of sediments in a lake, or of a human population? The answers here,
of course, may be very different: in the first case, we lose the ability to dis-
tinguish the effects of sediment build-up as a function of depth, or distance
from the shore, including the resulting distribution of creatures in the lake
that are affected by those sediments (small animals may hide from predators
in the sediment, small animals and plants may even eat it; others, like the
predators, may be hindered by it). In the second case we lose our ability to
determine to what extent some individuals, who come into contact with more
people than most, such as a supermarket checker or a delivery person, may
be instrumental in the transmission of some contact-based process, such as an
infectious disease or the spreading of news and rumors by word of mouth.
There is, finally, another type of simplification which is sometimes made
without any intention of biological justification. In order to make inroads on
a tough problem, we may deliberately oversimplify our model — for instance,
by setting one or more quantities to zero — when the simpler model is easier
to analyze, with the purpose of bringing those results back to the original
problem to inform our intuition and expectations of how the full analysis will
turn out. For example, if there are two processes taking place and one proceeds
much more slowly than the other, we may assume temporarily that the “slow”
variables remain constant. We mention this practice (discussed in Chapter 6)
simply because it can be a useful tool for analyzing models at the edge of
our ability to handle, and because it might not occur to modelers focused
on justifying biologically all mathematical simplifications (the difference here
being that they are only temporary simplifications).
In any case, since models are imperfect descriptions of reality, unless our
main focus really is close fitting of data, our ultimate goal for conclusions
drawn from modeling should be a notion called robustness. This means that the
biological insights obtained from a mathematical model should be independent
of the particular mathematical structure and functions used, to the extent that
we are uncertain what the exact structure or function should be. For example,
as a population grows to fill its habitat, it runs up against the limitations
on the habitat’s resources, which begins to limit the population’s ability to
reproduce. This is true on scales anywhere from a Petri dish to the planet
Earth. This limitation on the birth rate can be described mathematically by
any function which tapers off eventually toward zero after an initial increase
(see, e.g., Figure 1.2). The most common function used for this purpose is
the quadratic that leads to the logistic equation, analysis of which shows that
Introduction to Biological Modeling 17
the population will eventually level off at a size determined by the resources.
However, other functions of similar shape (that described above) and similar
properties can be used instead, with the same results. Likewise, we might
hope that stratifying a population into three or four age or risk categories will
provide results qualitatively similar to those of a model which stratifies the
population into ten or twenty classes. (We certainly would not like to analyze
the latter model!) Another example is that of threshold quantities, mentioned
above and discussed in Section 4.4. In this way, we justify to a limited extent
the imperfection of our model.
Sometimes models make predictions that are surprising or even alarming.
Such predictions from simple models imply a need for further careful study
of the phenomenon, in order to see if more detailed models make similar
predictions. Predictions which are robust across multiple models are more
likely to be accurate (but no more accurate than the models) and should be
taken seriously.
than with others outside the collective. Recent research in mathematical bi-
ology has identified numerous situations in which collectives are important:
for example, individual households in studying infectious diseases. Within a
household, infections tend to spread faster among household members than
between a household member and an individual outside the household. This
is true of human respiratory diseases, as many families know, but also of pests
such as mice, which carry hantaviruses, and insects, which act as vectors for
diseases such as malaria (mosquitoes) and Chagas’ disease (triatomines or
“kissing bugs”). At the population level, it then also becomes reasonable to
make households the unit of measurement, and count infected houses rather
than infected individuals, with recovery coming only when no individuals in
a given household remain infected, or when treatment has eliminated all the
pests in the house.
Another issue related to scale and units is the rescaling procedure men-
tioned in the previous section. Sometimes we find it possible to reduce the
mathematical complexity of a model by reducing the number of variables
and/or parameters. Although the rescaled model can be more difficult to inter-
pret immediately, the resulting simplifications in our calculations are typically
worth it, especially when we can always undo the transformation afterward to
facilitate interpretation. Probably the most common type of rescaling is to re-
define variables relative to benchmark parameters. For example, in the model
of foraging ants mentioned in the previous section (and explored more fully
in Section 4.1), Sumpter and Pratt also rescaled both the state variable E(t),
representing the number of ants exploiting the food site, and the independent
variable t for time, as follows:
E t
x= , τ= ,
K K/σ
so that both x and τ are dimensionless. That is, x gives the number of ex-
ploring ants as a multiple of the benchmark value K, and τ gives the time
as a multiple of the benchmark value K/σ (which is how much time it takes,
on average, for K ants to retire). This is why the process is also called non-
dimensionalization. (The transformation to x in the article also involves elimi-
nation of another state variable for the number of ants not exploiting the food
source by assuming the total ant population constant, another simplifying
technique mentioned in the previous section.)
Introduction to Biological Modeling 19
Exercises
Consider the following biological systems from a modeling perspective. For
each, determine which type of mathematical model and analysis you believe
would be most appropriate with regard to the criteria developed in this chap-
ter:
• discrete or continuous independent variable(s) (time, age, space),
• discrete or continuous dependent variable (population or quantity),
• type of stratification or continuous distribution of traits, if any,
• deterministic or stochastic,
• quantitative (numerical) or qualitative analysis,
• scale and units.
Defend or justify each of your choices with a sentence. (This exercise is most
useful if discussed in a group setting after each person has written down
his/her choices.)
1. the number of salmon that return to a particular pool to spawn each
year
2. a population of pea aphids whose genetic resistance to infection by fungal
spores varies inversely with their resistance to attack by parasitic wasps
(studied by students in the paper by Smith, Haarer and Confrey)
3. the frequency of a particular allele within each generation of a population
4. the likelihood of extinction of a rare allele (for reasons other than ge-
netic) over many generations of a population
5. the geographic dispersal (movement) of house sparrows within the
United States, starting with the original eight pairs released in the spring
of 1851 in Brooklyn, New York
6. the spread of tall grasses around the shore of a pond from an isolated
cluster
7. seasonal competition for space among different species of trees in a rain-
forest
8. weekly harvesting (removal) of fish in a fish hatchery
9. the growth of a yeast culture in a Petri dish
10. the mixing and growth of bacteria and nutrients in a chemostat
11. the growth of a deer population subject to an annual hunting season
20 Dynamical Systems for Biological Modeling: An Introduction
26. In what important ways does Figure 1.4 below differ from Figure 1.2?
Consider what will happen to the size of the population if it begins in
each of the three regions marked (a), (b) and (c). (This graph exhibits
something called an Allee effect, which is explored in Section 2.2.)
Introduction to Biological Modeling 21
Rate
deaths
births
Population size
(a) (b) (c) Graph courtesy M. Tildesley
FIGURE 1.4: Graph for Exer- FIGURE 1.5: Graph for Exer-
cise 26. cise 27.
27. Figure 1.5 shows the distribution of farms in the U.K. during the 2001
outbreak of foot-and-mouth disease (FMD), in terms of the numbers of
cows and sheep on each farm. Color intensity indicates the number of
farms with the given numbers of animals.
(a) Where, on this graph, are the farms with large numbers of cows
but no sheep? Where are the farms with many sheep but no cows?
(b) What does the graph indicate about the distinct types of farms
that exist?
(c) Since there is no treatment for FMD, the epidemic was brought
under control by culling — slaughtering all susceptible animals on
farms within a certain radius of any animal found to be infected.
This wiped out numerous small farms altogether. How might the
small farmers use this graph to argue for a change in control policy?
28. Smith, Haarer and Confrey (1997) studied a group of graduate students
working together in a course on mathematical biology (see footnote 1).
They found that the goals of students from different fields, as well as the
course instructors, who had different backgrounds, differed at times. If
we consider three perspectives from which students using mathematical
models to represent biological systems might come, we might say that:
Those who came with the perspective of an experimental biologist wanted
models to incorporate all their data, and to fit and explain them.
Those who came with the perspective of a theoretical biologist wanted
to use the data obtained beforehand to suggest trends to explore in the
model, to use the model as a means of exploring the effects of particular
phenomena (like genetic variation) across particular systems, i.e., for
many different species and habitats. They saw the model as a virtual
22 Dynamical Systems for Biological Modeling: An Introduction
23
24 Dynamical Systems for Biological Modeling: An Introduction
Photo courtesy U.S. Fish and Wildlife Service, dls.fws.gov Photo courtesy Joel Michaelsen
FIGURE 2.1: The semelparous salmon (left) and the monocarpic century
plant (right) reproduce in distinct generations. Note the different stages of the
blooming spikes on the three century plants.
These equations are called difference equations, since they give the difference in
size between one generation and the next, and first-order difference equations1
have the form yk+1 = f (yk ), which can be read as saying that the size of the
next generation (generation number k + 1 of population y) is a function f of
the present generation (generation number k of population y). In the rest of
this section, we will discuss the simplest type of difference equation and what
its solutions look like. Following that, the next sections in this chapter develop
some tools, both analytical and computational, for studying more complicated
difference equations. Later sections will look at classes of biological systems
that can be studied using discrete dynamical systems, including population
genetics, competition, harvesting, and finally systems involving more than one
quantity or population.
where the symbol ≈ signifying approximate equality means that the error in
this approximation is small for small h, in the sense that this error divided by
1 First-order difference equations will be our primary focus in this chapter.
Difference Equations (Discrete Dynamical Systems) 25
Example 1.
Solve the difference equation yk+1 = 2yk , with y0 = 1.
Solution: From y1 = 2y0 (the difference equation with k = 0) we see that
y1 = 2y0 = 2. Then y2 = 2y1 = 4, y3 = 2y2 = 8, . . . We may then guess (and
prove by induction) that yk = 2k . This is the solution of the given problem.
Graphing will show the familiar exponential curve.
Example 2.
Verify that yk = 5(1.1)k is the solution of the difference equation yk+1 =
(1.1)yk , y0 = 5.
Solution: First verify the initial condition: The expression yk = 5(1.1)k with
k = 0 gives y0 = 5(1.1)0 = 5, as desired. Now substitute
the proposed solution
into the difference equation: yk+1 = (1.1) 5(1.1)k = 5(1.1)k+1 . Thus the
given yk satisfies the given difference equation and initial condition.
Equation (2.5) fits the general form yk+1 = f (yk ) of a first-order difference
equation; it also belongs to a more specific class of equations of the form
called linear difference equations because the right-hand side f (yk ) is a linear
function of yk . The special case (2.5) where b = 0 is known as the homogeneous
case. These simplest types of difference equation have special names for two
reasons: first, as we shall see below, they are relatively easy to solve outright
(in fact, they are the only kind of difference equation we shall attempt to solve
explicitly); and, second, as we shall see in a later section, they turn out to be
key to understanding the behavior of more complicated difference equations.
y1 = r y0 , y2 = r y1 = r 2 y0 , y3 = r y2 = r 3 y0 , . . .
yk = r k y0 , (2.7)
Example 3.
Find the solution of the difference equation yk+1 = −yk , y0 = 1.
Solution: From the formula (2.7) with r = −1 we have yk = (−1)k ; notice
that yk oscillates between positive and negative values.
Difference Equations (Discrete Dynamical Systems) 27
Example 4.
Find the solution of the non-homogeneous linear difference equation
yk+1 = −yk + 1, y0 = 1.
and then conjecture that yk alternates between 0 and 1. To verify the correct-
ness of this conjecture, we need only note that if yk = 1, then yk+1 = 0 and
if yk = 0, then yk+1 = 1. Thus yk does alternate between 0 and 1, which we
may express explicitly as yk = 12 [1 + (−1)k ].
y1 =r y0 + b
y2 =r y1 + b = r(r y0 + b) + b = r2 y0 + r b + b
y3 =r y2 + b = r(r2 y0 + r b + b) = r3 y0 + r2 b + r b + b, etc.
yk = rk y0 + b 1 + r + r2 + . . . + rk−1 .
(2.8)
1 − rk
1 + r + r2 + . . . + rk−1 =
1−r
for the sum of a geometric series (with r 6= 1), we may write this solution in
the form
1 − rk
b b
yk = r k y0 + b = y0 − rk + . (2.9)
1−r 1−r 1−r
We may also consider what happens to solutions of linear difference equa-
tions over long periods of time – in mathematical terms, as k → ∞. Consider-
ing the solution (2.9), we see that if r is large in size, i.e., r > 1 or r < −1, then
rk grows unbounded as k → ∞, and thus yk grows unbounded too. The only
b b
exception occurs when y0 = 1−r , in which case yk is a constant 1−r for all
b
k (cf. (2.9)) and thus approaches 1−r as k → ∞. Small differences, however,
from this equilibrium solution will be magnified for large r (cf. again (2.9)).
If r is instead small in size (between −1 and 1), then rk approaches zero
b
as k → ∞, and in view of (2.9) the solution yk approaches the limit 1−r as
k → ∞ regardless of the initial value y0 .
If r = −1, rk alternates between −1 and 1, and yk does not have a limit
28 Dynamical Systems for Biological Modeling: An Introduction
b
(unless y0 = 1−r ). If r = 1, the formula (2.9) is meaningless, but the formula
(2.8) becomes yk = y0 + rk; thus yk becomes unbounded as k → ∞.
The way the solution of the linear homogeneous difference equation (2.5)
depends on the value of the survival-and-growth term r will be important
when we study qualitative behavior of solutions of difference equations in
Section 2.3. From the formula (2.7) we see that yk → 0 as k → ∞ if |r| < 1
and yk grows unbounded as k → ∞ if |r| > 1. More precisely, if 0 ≤ r < 1,
yk decreases monotonically to zero and if −1 < r < 0, yk oscillates between
positive and negative values in approaching zero. If r > 1, yk increases to +∞
and if r < −1, yk oscillates unboundedly. The “boundary” cases are r = −1,
in which yk oscillates between ±y0 and does not approach a limit, and r = 1,
in which yk is the constant y0 . The essential property we shall need is the
following result.
Example 5.
Find for which values of a every solution of the difference equation yk+1 =
(1 + a)yk approaches zero as k → ∞.
Solution: Every solution approaches zero if and only if |1 + a| < 1, or −1 <
1 + a < 1, or −2 < a < 0.
ryk2
yk+1 = (2.11)
yk2 + A2
have been suggested as descriptions for populations whose growth rates satu-
rate for large population sizes. Here A is the population size at 50% saturation
2 P. F. Verhulst, Récherches mathématiques sur la loi d’accroissement de la population,
(plug in A for yk in (2.10) to see why). For small yk (relative to A), the denom-
inator of the right-hand side of (2.10) and (2.11) is essentially A, so that (2.10)
has yk ≈ Ar yk , similar to the unrestricted growth of the linear equation (2.5).
However, for large yk , A is relatively insignificant, making the right-hand sides
of (2.10) and (2.11) (and thus yk+1 ) approximately equal to r.
Another much-studied example is the logistic difference equation
yk
yk+1 = ryk 1 − , (2.12)
K
also introduced by Verhulst, with a growth rate which decreases to zero as yk
approaches the carrying capacity K and which becomes negative for yk > K.
The logistic difference equation should not be taken seriously as a model for
large population sizes as yk+1 is negative if yk > K. Other difference equations
which have been used as models to fit field data are
and (
ryk1−β , for yk > ǫ,
yk+1 = (2.14)
ryk , for yk < ǫ.
None of the difference equations (2.10), (2.11), (2.12), (2.13), (2.14) are
derived from actual population growth laws. Rather, they are attempts to
give quantitative expression to rough qualitative ideas about the biological
laws governing population growth. For this reason, we should be skeptical
of the biological significance of any deduction from a specific model which
depends on the precise formula for the solution of that model. Our goal should
be to formulate principles which are robust, that is, which are valid for a large
class of models embodying some set of qualitative hypotheses. Therefore, we
shall be more concerned with qualitative properties of solutions of difference
equations than with formulae for solutions. In fact, although we have seen
some examples of linear difference equations for which a solution formula is
available, the solution of nonlinear difference equations like (2.10), (2.11),
(2.12), (2.13), and (2.14) usually cannot be found in general as functions of
the equation parameters. In Section 2.3 we will develop tools for analyzing
the behavior of these more complicated equations.
The most that we can do quantitatively with many nonlinear difference
equations is to calculate solutions numerically by iteration for particular
choices of parameter values, as illustrated by the following two examples.
Example 6
Find the first four terms of the solution of the difference equation yk+1 =
yk (1 − yk ) with y0 = 12 .
Solution: We have y1 = 12 (1 − 12 ) = 14 = 0.25, y2 = 14 (1 − 41 ) = 16
3
= 0.1875,
3 3 39 39 39
y3 = 16 (1 − 16 ) = 256 = 0.152344, y4 = 256 (1 − 256 ) = 0.129135.
30 Dynamical Systems for Biological Modeling: An Introduction
0.5 1
0.4 0.8
0.3 0.6
0.2 0.4
0.1 0.2
0 1 2 3 4 0 5 10 15 20 25
Example 7.
1
Verify that the constant sequence yk = 2 (k = 0, 1, 2, . . .) is a solution of the
difference equation yk+1 = 2yk (1 − yk ).
Solution: If yk = 12 , then 2yk (1 − yk ) = 2( 12 )(1 − 21 ) = 12 . Thus yk = 1
2 satisfies
yk+1 = 2yk (1 − yk ).
Exercises
1. The bacteria E. coli doubles in a little over 20 minutes in good lab
conditions. (For purposes of this exercise, we will assume it takes exactly
20 minutes.)
(a) Write a difference equation that models the growth of an E. coli
Difference Equations (Discrete Dynamical Systems) 31
wn+1 = F wn + µ,
possible reasons and implications, Journal of Theoretical Biology 75: 349–371, 1978.
32 Dynamical Systems for Biological Modeling: An Introduction
yk
5. Find the first three terms of the solution to yk+1 = yk +1 , y0 = 1.
2
yk
6. Find the first three terms of the solution to yk+1 = 2 +1 ,
yk
y0 = 1.
yk+1 = r yk (2.15)
which we have already solved analytically in Section 2.1. The method is also
applicable to difference equations which cannot be solved analytically. It may
be carried out on a computer with the aid of a computer algebra system such
as Maple, Mathematica, or MATLAB. Some of the figures in this section were
produced using Maple, with a program given in Appendix A.
This method begins by drawing in the y − z plane the reproduction curve,
which is the graph of the function on the right-hand side of our difference
equation, and the line z = y, which we shall use for reflection purposes. For
equation (2.15), the reproduction curve is the line z = r y (taken from r yk ).
Next, we mark y0 on the y-axis, and go vertically to the reproduction curve
(meeting it at height ry0 ). The next step is to go horizontally to the line
z = y, meeting it at the point (y1 , y1 ). (Recall y1 = ry0 from (2.15).) Then
we repeat the process, going vertically to the reproduction curve (at height
ry1 ), then horizontally to the line z = y at the point (y2 , y2 ), where y2 = ry1 .
Continuing in the same manner, we reach successively the values y3 , y4 , y5 ,
. . .. The graphic portrayal will have four different cases — r > 1 (Figure 2.4),
0 ≤ r < 1 (Figure 2.5), −1 < r < 0 (Figure 2.6), r < −1 (Figure 2.7) —
corresponding to different relative positions of the reproduction curve and the
line z = y. In each case, the graphical solution illustrates the behavior already
z=ry
y =r y
1 0
y =r y
2 1
y =r y
2 1
y =r y
1 0
y y
y y y y
0 1 1 0
z z=y z z=y
y0 y0
y y
z=ry
z=ry
Example 1.
Apply the cobwebbing method to describe the solutions of the Verhulst equa-
tion
r yk
yk+1 = .
yk + A
ry
Solution: The reproduction curve is z = y+A and its slope is
dz rA
= .
dy (y + A)2
At y = 0 the slope is r/A. If r < A, this slope is less than 1, so the reproduction
curve lies below the line z = y, while if r > A this slope is greater than 1, so the
reproduction curve begins above the line z = y but comes down to intersect
it at y = r − A. If r > A, every solution, regardless of the initial value y0 ,
approaches the limit y∞ = r − A (Figure 2.8), and if r < A, every solution
approaches zero (Figure 2.9). In either case, the limit is an intersection of the
reproduction curve and the line z = y.