Entropy and Probability
Entropy and Probability
(A statistical view)
Entropy ~ a measure of the disorder of a
system.
A state of high order = low probability
A state of low order = high probability
In an irreversible process, the
universe moves from a state of low
probability to a state of higher
probability.
We will illustrate the concepts by
considering the free expansion of a gas
from volume Vi to volume Vf.
The gas always expands to fill the
available space. It never spontaneously
compresses itself back into the original
volume.
R
1
(2 R, 1 L)
(all R)
4
6
4
number of microstates
In general:
N
1
2
W
2
4
M
2
3
4 1
16
1 5 10 10 5 1
32
1 6 15 20 15 6 1
64
1 7 21 35 35 21 7 1
128
1 8 28 56 70 56 28 8 1
256
1 1
1 2 1
1
1
3
4
3
6
2N N+1
This table was generated using the formula
for # of permutations for picking n items
from N total:
WN,n =
N!
N! (N-n)!
multiplicity
i.e. W6,2 =
6!
2! 4!
= 15