Part 5 Momentum Hops
Part 5 Momentum Hops
Brownian Motion
Dene Situation Calculate momentum Calculate Variance Calculate Probability Distribution Probability Distribution in Classical Mechanics Statistical and Hamiltonian Dynamics Probability Distributions in Dynamical Systems time dependence of dynamical systems calculation set up calculation continued calculation concluded Poisson bracket generalizing stat mech time dependence in Hamiltonian systems one-particle distribution Classical Mechanics Brownian motion again: toward a unique solution friction collisions calculation set up calculation continued calculation concluded a unique probability distribution Summary Boltzmann Equation Scattering forward backward all together Symmetries detailed balance-local equilibrium conservation of particle number H-theorem sign of dissipation term dS/dt Homework
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
Robert Brown (1773-1858) saw particles of pollen dance around in uid under microscope. This motion was caused by many tiny particles hitting the grains of pollen.
Brownian motion:
http://www.worsleyschool.net/science/les/brownian/motion.html
Albert Einstein (1905) explained this dancing by many, many collisions with molecules in uid dp/dt=......+ (t)-p/
v.1 p=(px, py, pz) = (x, y, z) (t) is a Gaussian random variable resulting from random kicks produced by collisions. Since the kicks have random directions <(t)>=0. Different collisions are assumed to be statistically independent <j(t) k(s)> =(t-s)j,k v.2 The relaxation time, , describes friction slowing down as the particles moves through the medium. In contrast describes the extra momentum picked up via the collisions. Both represent the same physical effect, little particles hitting our big one. However, they operate in a somewhat different fashion. The individual kicks point in every which direction and only in the long run produce any concerted change in momentum. On the other hand the term in is a friction tending to continually push our particle toward smaller speeds relative to the medium.
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
P (t) =
tt dt (t ) exp( )
Because P(t) is a sum of many random variables according to the central limit theorem, it must be a Gaussian random variable. Therefore it has a Gaussian probability distribution. In equilibrium, P(t) should have the variance, M kT, with M being the mass of the Brownian particle. In equilibrium it will have the Maxwell-Boltzmann probability distribution
(p) = 2M
3/2
exp[p2 /(2M )]
Notice that if this works out for us, it will be our rst proof that the ideas of Gibbs, Boltzmann, and Maxwell about the canonical distribution was correct. So we would have a proof that this law works, at least in this situation. In physics, we often use laws long before there is any substantial proof that they are correct. We use little bits of evidence, intuition, and guesswork and gradually convince ourselves that X must be right. If X is attractive, we hold on to that view until there is overwhelming evidence to the contrary.
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
du
dv < j (t )k (s ) >
v.4
< p j (t )p k (s ) >=
du
dv j ,k (u v )exp[(t u ) / (s v ) / ]
....... if t > s the integral over u always gets a contribution from the delta-function so that this expression then becomes < p j (t )p k (s ) >=
dv j ,k exp[(t + s 2v ) / ]
exp[ | t s | / ]
v.5
j ,k
2
so we see that pj2/(2M), where M is the mass of the Brownian particle is on one hand given by <
pj
2M
>= / (4M )
On the other hand, we know that in classical physics this quantity is kT/2. Thus we obtain the relation between the two parameters in the Einstein model. v.6 = 2MkT
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
Probability distribution
= 2MkT Whenever this relation is satised, p has the right variance, MkT, and the right MaxwellBoltzmann probability distribution. 3/2 (p) = exp[p2 /(2M )] 2M More generally, if we have a Hamiltonian, H(p,r), for the one-particle system, the Maxwell-Boltzmann distribution takes the form (p,r)=exp[-H(p,r)]/Z, v.7 where, the the simplest case the Hamiltonian is H(p,r) = p2/(2M) +U(r) Maxwell and Boltzmann expected that, in appropriate circumstances, if they waited long enough, a Hamiltonian system would get to equilibrium and they would end up with a Maxwell-Boltzmann probability distribution Question: Should we not be able to derive this distribution from classical mechanics alone? Maybe we should have to assume that we must long enough to reach equilibrium? Anything more? Something of the form v.7 is called by mathematicians a Gibbs measure and by physicists a Boltzmann distribution or often a Maxwell-Boltzmann distribution. Why? Should we care?
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
and calculate its average using the probability distribution which is appropriate at the earlier time, i.e. the average is dx g(x+dt V(x,t)) (x,t). Equate those two expressions for the average
v.8
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
throw away the things that cancel against each other to get
dx g(x){t(x,t)
+ x [V(x,t) (x,t)]}=0
Notice that g(x) is arbitrary. If this left hand side is going to always to vanish, the { } must vanish. We then conclude that t(x,t) + x [V(x,t) (x,t)] =0. Thats for one coordinate, x. If there are lots of coordinates this equation reads
t (x, t) + (x, t)
j
(xj Vj ) +
j
Vj xj (x, t) = 0
v.9
We call the second term on the left the divergence term. It describes the dilation of the volume element by the changes in the xs caused by the time development. The last term is the direct result of the time-change in each coordinate X(t) Now we have the general result for the time development of the probability density. We go look at the Hamiltonian case which is rather special
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
(xj Vj ) +
j
Vj xj (x, t) = 0
The Hamiltonian case is special. There are two kinds of coordinates xj=q with Vj = p H and xj=p with Vj = -q H. In that case, the divergence term is (q p H -p q H) =0. This result, called Liouvilles theorem, says that the size of the volume element is independent of time. As a result the the probability density obeys a special equation, with no divergence term v.10 t (p, q, t) + [(p H)q (q H)p ](p, q, t) = 0
The time derivative of any function of p and q is given in Hamiltonian mechanics by v.11 . dX(p, q)/dt = [( H) ( H) ]X(p, q)
p q q p
In particular if H is the Hamiltonian, assumed to be a function of the ps and qs but not containing any other t-dependence, then dH/dt=0, i.e. H is independent of time. Further, if is any function of a time-independent H and of any other conserved function of p and q (but not t) then will be a solution of our equation. Thus, not only is the Boltzmann function a solution describing the equilibrium timedependence of a Hamiltonian system , there are many other solutions as well.
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
Poisson Bracket
The Poisson Bracket is Dened by
{f, g} =
g f f g q p q p
t ={H,}
These Poisson brackets are rather like the commutators of quantum mechanics. For example {{f,g),h}+ {{h,f),g}+ {{g,h),f}=0. The same kind of relation is true for operators in quantum theory with { and } replaced by [ and ]. The bracket relations for classical time-dependence are very much like the time-dependence of operators and density matrices in quantum theory. This relation between quantum mechanics and the canonical version of classical mechanics is quite surprising and turns out to be quite deep. Note the difference in sign between the relation for dX/dt and the one for t . I have gotten one of those signs wrong many times in my life. Think for a bit about why we write t but dX/dt. Why?
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
10
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
11
Say it again
For the simplest case in which H=p2/(2M) + U(r), the result of Hamiltonian mechanics is that the probability distribution (p, r, t) has the time dependence t(p,r,t)+( p/M).r (p,r,t) - (r U).p (p,r,t) = 0 A time independent solution of this equation would be that could be any function of H. This result stands in apparent contradiction to our knowledge of statistical mechanics which tells us that the probability distribution should be the MaxwellBoltzmann distribution, i.e. one which is exponential in H. What additional information should we bring to bear on this situation? We already have a hint from the Brownian motion calculation that this calculation might give the Maxwell-Boltzmann result. Lets go back to that and see what equation we get for . The Einstein model for Brownian motion is dp/dt=......+ (t)-p/ where ... might stand for additional terms coming from Hamiltonian mechanics. I plan to study successively the effect of the two terms in this model upon the equation for and then put it all together.
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
12
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
13
comes from computing dp g(p) (p,t+t). That same average is obtained by taking the solution at time t+t, which is of the form p(t+t)=p(t) +p. Here, p is given by the effect of the stochastic term, so that
t+t
p =
t
ds (s)
Then the average at time t+t can also be written as < dp g(p+p) (p,t)> . Here, the average <...> is an average over the possible values of the stochastic variables (s) for s between t and t+t. If we equate these two expressions, we nd
dp g(p) (p,t+t)
The right hand side can be rearranged by shifting the origin of integration and replacing the variable p by p-p. Then this right side becomes < = < dp g(p) (p-p,t)> Since g(p) is arbitrary, we it follows that (p,t+t) = < (p-p,t)>
14
dp g(p) (p,t+t)
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
continued
ds (s)
p =
t
(the result is particularly simple because p does not depend upon p).
(p,t) + t t (p,t) = <(p,t)>+<p> p (p,t)+ <p2> (p)2 (p,t)/2 The rst terms on each side cancel, the average of p is zero, and the rest gives t (p,t) = [ <p2>/(2t) ] (p)2 (p,t) The average has the value:
t+t t+t t+t t+t
[p]2 =
t
du
t
du
t
ds (u s) = t
so that we end up with the result (Notice that because it is diffusive, this
t (p,t) =.....+ (/2) (p)2 (p,t) This describes a diffusion in momentum space. result cannot be followed backward in time!)
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
15
16
v.12
This only makes sense and has the right equilibrium behavior if the simple-particle-motion assumptions which went into the right hand side of the equation are also used on the left, specically (p,r,t) = p2/(2M) +U(r) Equation v.12 works equally well if we use as our basic variable the density of particles in phase space, f(p,r,t) =N(p,r,t). We then have t f(p,r,t) + p (p,r,t) . r f(p,r,t) - r (p,r,t) . p f(p,r,t) = (/2) (p)2 f(p,r,t) + p . [p/ f(p,r,t)] v.13
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
17
18
The scattering:
q q
Given that there are particles available with the appropriate initial momentum, the scattering rate into a volume element of nal momentum dp dq can be written as dp dq Q( p,q p,q ) The probability that we could get the particles we need for the scattering produce a factor f(p,r,t) dq f(q,r,t ), so that the total scattering rate for this process is f(p,r,t) dq f(q,r,t ) dp dq Q( p,q p,q ) The process itself reduces the number described by p,r at the rate shown. Conversely, there is an inverse process, and a corresponding rate of increase of f(p,r,t) q p q p
19
Since we have far too many symbols here, in the next steps we shall drop the r,t everywhere. The next step notices that each collision must include conservation of energy and of momentum. That means the Qs must be proportional to delta functions which enforce conservation of energy and momentum. Specically, Q( p,q p,q ) = R( p,q p,q ) (p+q - p-q) ((p)+ (q) - (p)-(q)) We then nd the equation [t + (p/m) . r - (r U) . p] f(p) = -
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
This means that if we care to, we can write the Boltzmann equation as [t + (p/m) . r - (r U) . p] f(p) = -
We shall need one more symmetry statement to obtain proper conservation laws, namely the statement that p and q play symmetrical roles in the scattering event. Q( p,q p,q ) = Q( q, p q, p ) symmetrical scattering This symmetry is appropriate because we are thinking that particles of the same kind are involved in the scattering event. If the particles were identical in the quantum sense, we would also have Q( p,q p,q ) = Q( p,q q, p )
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
21
local equilibrium is the statement that the right hand side of the Boltzmann equation vanishes, specically that f(p) f(q) = f(p) f(q) v.15 so that relaxation to equilibrium is driven by the relatively slow processes controlled by the gradients on the left hand side of the equation. This provides a mechanism for the system to provide relaxation times much slower than the collision rate of a typical particle. In local equilibrium f(p,r,t) = exp{-(r,t)[(p,r,t)-(r,t)-p.v(r,t)- v(r,t)2/(2m)]} so that the conservation laws for probability, momentum, and energy ensure that statement v.15 is satised. Here (r,t), (r,t), and v(r,t) are the parameters dening the local equilibrium state. The left hand side of the Boltzmann equation will then play a role in driving their slow relaxation to overall equilibrium. This slide describes how the rst description of the Maxwell-Boltzmann distribution was obtained.
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
22
The second term is on the left is the divergence of the particle current: r . j(r,t) with j(r,t) = dp f(p,r,t)p/m
The third term on the left vanishes because it contains a total derivative with respect to momentum and we assume that the momentum integrands drop off fast enough at innity so that the integral of the total derivative is zero. When integrated over momentum, the two collision terms are exactly the same except for a sign and thus cancel with one another. We are left with the differential form of the number conservation law t n(r,t) + r . j(r,t) = 0.
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
23
H-Theorem
Boltzmann proved a result called the H-theorem, which is our rst representation of a low describing the non-equilibrium behavior of entropy. In fact, we have few other examples! To obtain this take the Boltzmann equation, equation v.14, and multiply by ln f. Note that (ln f) d f = d [f ln f]- d f = d[f ln f/e]. Now, integrate over all momentum. The rst term on the left hand side of the Boltzmann equation becomes t h(r,t) with h(r,t) = dp f(p,r,t) ln [f (p,r,t)/e]
The second term is on the left is the divergence of the particle current: r . jh(r,t) with jh(r,t) = dp p/m f(p,r,t) ln [f (p,r,t)/e]
A brief calculation, involving an integral by parts, shows that the third term on the left vanishes because it contains a total derivative with respect to momentum and we assume that the momentum integrands drop off fast enough at innity so that the integral of the total derivative is zero. When integrated over momentum, the two collision terms on the right become R=-
dp dq dp dq (p+q - p-q) ((p)+ (q) - (p)-(q)) Q( p,q p,q ) [f(p) f(q) - f(p) f(q) ] ln f(p) )
Because this result, except for the factor in blue, is symmetrical in p and q, we can replace ln f(p) by ln f(q) or by the averages of these two, [ln f(p)+ ln f(q)]/2 giving
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
23 24
R=-
dp dq dp dq (p+q - p-q) ((p)+ (q) - (p)-(q)) Q( p,q p,q ) [f(p) f(q) - f(p) f(q) ] [ln f(p)+ln f(q)]/2
Now the whole integral, except for the factor in blue. is anti-symmetrical in the replacement of unprimed variables by primed ones. For this reason we can make the replacements [ln f(p)+ln f(q)]/2 - ln f(p)+ln f(q)]/2 [ln f(p)+ln f(q) - ln f(p) - ln f(q)]/4 Since ln a +ln b = ln(ab) we can rewrite our entire result as R=-
Q( p,q p,q ) [f(p) f(q) - f(p) f(q) ] {ln [f(p) f(q)]-ln [f(p) f(q)]} /4 The entire integral is negative, except perhaps for the factor in red. However, this factor is of the form [X - Y] [ln X - ln Y ]. This factor is positive if X > Y, equally positive if Y>X, and only zero when X=Y. In that case, we are in local equilibrium! Put it all together, our result is that t h(r,t) + r . jh(r,t) =R
25
Put it all together, our result is that t h(r,t) + r . jh(r,t) = R and that R <0, except in local equilibrium when R =0
S(t)/k = - h(r,t) + conserved things
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
26
Homework:
Assume our Brownian particle, as described by equation v.12, is charged? How can I include electric and magnetic elds in this equation? Does the system go to equilibrium in the presence of space and time-independent elds? What happens when the eld depends upon time? How can we be sure that equation conserves the total probability of nding the Brownian particle? Should it conserve the momentum or energy of that particle? What are the equations for the time dependence of the particles energy and momentum? What about its angular momentum? Find the laws of conservation of energy and momentum from the Boltzmann equation, equation v.14.
Perimeter Institute statistical physics Lecture Notes part V: Hopping in Momentum Version 1.52 9/11/09 Leo Kadanoff
27