Examples of Dynamical Systems
Examples of Dynamical Systems
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 1
Example Dynamical Systems ...
1D Flow: x R
x = F (x)
Fixed Points:
x R such that
x |x = 0
or
F (x ) = 0
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 2
Example Dynamical Systems ...
dF
Local Flow: x = x
dx x(t)
Solution: x(t) / e t
x(0)
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 3
Example Dynamical Systems ...
1D Flows ...
Stability Classification of Fixed Points:
Slope of F (x) at x :
x
1. Stable: <0
Attractor Attractor
2. Unstable: >0 x
Repellor
3. Neutral: =0
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 4
Example Dynamical Systems ...
2D Flow: !
x R2
x = f (x, y)
x = F (x) or
x = (x, y) y = g(x, y)
F = (f, g)
Fixed Points:
(x , y ) such that
~x |(x ,y ) = (0, 0)
or
0 = f (x , y )
0 = g(x , y )
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 5
Example Dynamical Systems ...
x = F (x)
!
"
F ! !
Local Flow: "x = "x
"x !
!
x(t)
!
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 6
Example Dynamical Systems ...
Solution:
At
~x(t) / e ~x(0)
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 7
Example Dynamical Systems ...
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 9
Example Dynamical Systems ...
2D Flows ...
Stability Classification of Fixed Points ...
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 10
Example Dynamical Systems ...
2D Flows ...
Stability Classification of Fixed Points:
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 11
Example Dynamical Systems ...
2D Flows ...
Stability Classification of Fixed Points:
Center:
!(1 ) = !(2 ) = 0
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 12
Example Dynamical Systems ...
2D Flows ...
Stability Classification of Fixed Points ...
Magnitude of (in)stability: Det(A) = 1 2
Det(A) > 0 :
Stable: Tr(A) < 0 Tr(A) = 1 + 2
Marginal: Tr(A) = 0
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 13
Example Dynamical Systems ...
2D Flows ...
Stability Classification of Fixed Points ...
Tr(A)
Tr2 (A) 4Det(A) = 0
Unstable
Saddles
Unstable Spirals
Det(A)
Stable Spirals
Saddles
Stable
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 14
Example Dynamical Systems ...
2D Flows ...
Stability Classification of Fixed Points ...
Tr(A)
Tr2 (A) 4Det(A) = 0
Unstable
Saddles
Unstable Spirals
Det(A)
Stable Spirals
Saddles
Stable
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 14
Example Dynamical Systems ...
2D Flows ...
Stability Classification of Fixed Points ...
Tr(A)
Tr2 (A) 4Det(A) = 0
Unstable
Saddles
Unstable Spirals
Det(A)
Stable Spirals
Saddles
Stable
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 14
Example Dynamical Systems ...
2D Flows ...
Stability Classification of Fixed Points ...
Tr(A)
Tr2 (A) 4Det(A) = 0
Unstable
Saddles
Unstable Spirals
Det(A)
Stable Spirals
Saddles
Stable
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 14
Example Dynamical Systems ...
2D Flows ...
Stability Classification of Fixed Points ...
Tr(A)
Tr2 (A) 4Det(A) = 0
Unstable
Saddles
Unstable Spirals
Det(A)
Stable Spirals
Saddles
Stable
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 14
Example Dynamical Systems ...
2D Flows ...
Stability Classification of Fixed Points ...
Tr(A)
Tr2 (A) 4Det(A) = 0
Unstable
Saddles
Unstable Spirals
Det(A)
Stable Spirals
Saddles
Stable
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 14
Example Dynamical Systems ...
2D Flows ...
Stability Classification of Fixed Points ...
Tr(A)
Tr2 (A) 4Det(A) = 0
Unstable
Saddles
Unstable Spirals
Det(A)
Stable Spirals
Saddles
Stable
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 14
Example Dynamical Systems ...
2D Flows ...
Stability Classification of Fixed Points ...
s u
Hyperbolic intersection of W and W :
Fixed point
persists under
u u
perturbation W W
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 15
Example Dynamical Systems ...
2D Flows ...
Stability Classification of Fixed Points ...
s u
Non-hyperbolic intersection of W and W :
Fragile
s u
W W
Fixed point
changes structure
under perturbation
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 16
Example Dynamical Systems ...
2D Flows: Limit Cycles
isolated, closed trajectory:
a periodic orbit: ~
x(t) = ~x(t + p), for all t
( p is the period)
model of stable oscillation
this is a new behavior type
not possible in 1D flows
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 17
Example Dynamical Systems ...
2D Flows: Limit Cycles ...
Unstable cycle
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 18
Example Dynamical Systems ...
2D Flows: Limit Cycles ...
Saddle cycle
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 19
Example Dynamical Systems ...
2D Flows ...
Limit Cycle Examples
r = r(1 r2 )
= 1
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 20
Example Dynamical Systems ...
2D Flows ...
Limit Cycle Examples ... y
(a, ) = (0.1, 10.0)
2
2
x + (x a)x + x = 0
x
or -2 2
x = y
y = x + y(a x2 )
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 21
Example Dynamical Systems ...
2D Flows ...
Limit cycle existence
(requires real work to show!)
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 22
Example Dynamical Systems ...
2D Flows ...
Limit cycle existence
(requires real work to show!)
How to find limit cycles?
Poincar-Bendixson Theorem:
(a) trajectory confined to trapping region
(b) no fixed points
R
then have limit cycle C C
somewhere inside R .
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 23
Example Dynamical Systems ...
3D Flows:
Fixed points
Limit cycles
and ... ?
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 24
Example Dynamical Systems ...
3D Flows: Quasiperiodicity
product of two limit cycles:
two irrational frequencies 1 = 2
1 2
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 25
Example Dynamical Systems ...
Torus attractor
1 1 = 2
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 26
Example Dynamical Systems ...
3D Flows: Chaos
recurrent instability
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 27
Example Dynamical Systems ...
3D Flows: Chaos ...
A topological construction:
saddle fixed point at origin: 0
1D unstable manifold: dim(W u (0)) = 1
2D stable manifold: dim(W (0)) = 2
s
C+ C
0
Orbits Cannot Cross: Need 3D!
x = (y x)
y = rx y xz
z = xy bz
Parameters: , r, b > 0
Exercise: Show fixed point at the origin can be a saddle, with 2 stable and 1 unstable directions
Exercise: Show there is a symmetry (x, y) (x, y)
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 29
Example Dynamical Systems ...
r F~ (~x) = Tr(A) = 1 b
V = ( + 1 + b)V
Region volume shrinks
V (t) = e (+1+b)t
exponentially fast!
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 31
Example Dynamical Systems ...
3D Flows: Chaos ...
Lorenz attractor structure
Branched manifold
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 32
Example Dynamical Systems ...
50
0
-45 x+y 45
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 33
Example Dynamical Systems ...
Zn+1
30
30 Zn 50
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 34
Example Dynamical Systems ...
Time of Return
1.5
Tn+1
T(Z)
0.5
30 Z 50
0.5
0.5 Tn 1.5
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 35
Example Dynamical Systems ...
3D Flows ...
Lorenz reduces to a cusp 1D map:
normalize to zn [0, 1]
b
zn+1 = a(1 |1 2zn | )
1
Parameters:
height: a > 0
peak sharpness: 0 < b < 1 zn+1
0
0 zn 1
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 36
Example Dynamical Systems ...
3D Flows ...
Rssler equations
x = y z
y = x + ay
z = b + z(x c)
Parameters: a, b, c > 0
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 37
Example Dynamical Systems ...
3D Flows ...
Rssler chaotic attractor
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 38
Example Dynamical Systems ...
3D Flows ...
Rssler branched manifold
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 39
Example Dynamical Systems ...
3D Flows ...
Rssler maximum-x return map: xn+1 = f (xn )
14
xn+1
0
0 xn 14
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 40
Example Dynamical Systems ...
3D Flows ...
When normalized to xn [0, 1]
get the Logistic Map:
1
xn+1 = rxn (1 xn )
xn+1
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 41
Example Dynamical Systems ...
Dimension Attractor
1 Fixed point
4 Above + Hyperchaos
5 Above + ?
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 42
Example Dynamical Systems ...
Lorenz: x = (y x) , r, b > 0
y = rx y xz
z = xy bz
Rssler: x = y z
y = x + ay
z = b + z(x c)
Cusp Map: zn [0, 1] a > 0, 0 < b < 1
b
zn+1 = a(1 |1 2zn | )
Logistic map:
xn+1 = rxn (1 xn ) xn [0, 1] r [0, 4]
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 44
The Learning Channel
B 1 0 1 0
...001011101000... 1 1
1 0
0
0 1
1
1 A C 0
0
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 45
Example Dynamical Systems ...
NDAC, Chapter 3.
Lecture 3: Natural Computation & Self-Organization, Physics 256A (Winter 2014); Jim Crutchfield
Tuesday, January 13, 15 46