Chapter1 Expectedutility
Chapter1 Expectedutility
Zaruhi Sahakyan
Economics of Risk
ECON 469
University of Illinois
Fall 2015
1 / 89
Risk vs uncertainty
Frank Knight (1885 - 1972, University of Chicago) in his 1921 book Risk,
Uncertainty, and Profit discusses risk vs uncertainty.
Risk applies to situations where we do not know the outcome of a
given situation, but can accurately measure the odds (a decision leads
to consequences that are not precisely predictable, but follow a known
probability distribution).
Uncertainty, on the other hand, applies to situations where we cannot
know all the information we need in order to set accurate odds
(uncertainty or ambiguity means that the probability distribution of
outcomes is at least partially unknown to the decision maker).
2 / 89
Introduction
3 / 89
Introduction
The focus of this course is:
To recognize, quantify, analyze, treat and incorporate risks into our
decision-making process.
To attempt to model human behavior towards risk using
1
4 / 89
5 / 89
Lotteries
To describe uncertainty we assume that there is a set of outcomes
(consequences) C = {c1 , c2 , ..., cs }. For example, C = { nothing, trip to
Italy, $5000}. Agent knows C and knows the probability of each outcome,
but he does not know which outcome will occur.
Definition
Lottery (or a gamble) is a probability distribution over outcomes C . That
is L = (c1 , p1 ; c2 , p2 ; ...; cs , ps ), where ci is the outcome in state i, pi is the
corresponding state probability, i pi > 0 and pi = 1.
For example,
or
1
1
1
L = (nothing , ; Italy , ; $5000, )
2
4
4
1
1
1
2
4
4
L=
nothing Italy $5000
6 / 89
Lotteries
Definition
Let L denote the set of all lotteries. We will refer to these lotteries as
simple lotteries because they directly assign probability to each outcome.
Definition
Compound lottery is a lottery over lotteries, i.e. with some probability you
win one lottery and with another probability you win another lottery.
A compound lottery L could be expressed as:
p 1p
L1
L2
7 / 89
Lotteries
Example
1
1
Let L1 = (nothing , ; Italy , ; $5000, 0) and
2
2
1
1
L2 = (nothing , ; Italy , 0; $5000, ) are two simple lotteries. Then lottery
2
2
1
1
L = L1 + L2 is a compound lottery. Given L, the prob. of nothing
2
2
1 1 1 1
1
1
1
= + = ; prob. of Italy= ; prob. of $5000= .
2 2 2 2
2
4
4
Thus compound lottery L is equivalent to a simple lottery
1
1
1
2
nothing
Italy
$5000
Consumer only cares about the final outcome, so we can look at simple
lotteries. Any compound lottery is equivalent to a simple lottery.
Zaruhi Sahakyan (University of Illinois)
8 / 89
Probability
9 / 89
Probability
Different notions of randomness and associated probabilities:
Classical probability:
Deterministic but very complex phenomena may look random and be
modeled as such (e.g. radioactive decay; precipitation probability in
weather forecast)
Independent repeated trials, frequentist:
Example: Throw a coin 100 times
Beliefs, subjective probability:
Example: According to intrade.com in January of 2013 the probability
for Lincoln to win Academy Award for Best Picture was .796
The same mathematical apparatus can handle all types of probability.
10 / 89
Probability concepts
Sample space or probability space S
Examples: all possible outcomes of coin tosses, card deals etc.
Singletons are called elementary events cannot be decomposed any
further (Example: die roll results in a 6)
Others are composite events (Example: die roll results in a 5 or a 6)
Elementary events may depend on context (e.g. when two
indistinguishable coins are tossed, one head, one tail is an
elementary event; if the two coins are distinguishable, 1 head, 1 tail is
a composite of two elementary events)
Elementary events called states of the world: once you know which of
these has occurred, all uncertainty is resolved
Partial resolution: knowledge of composite event that contains the actual
state.
11 / 89
Pr (A E )
Pr (E )
12 / 89
Pr (A|E )Pr (E )
Pr (A)
Pr (A E )
Pr (A)
Pr (A|E ) =
Pr (A E )
Pr (E )
Pr (AE )
Pr (A)
expression
13 / 89
14 / 89
15 / 89
Notation
16 / 89
Solution
17 / 89
18 / 89
19 / 89
20 / 89
Review: Combinatorics
For any set containing n elements, the number of distinct k-element
subsets of it that can be formed (the
k-combinations
of its elements) is
n
n
given by the binomial coefficient k . Therefore k is often read as n
choose k.
n
n!
=
k!(n k)!
k
For example
4
4!
4321
=
=
=4
1
1!(4 1)!
1 (3 2 1)
4
4321
4!
=
=6
=
2
2!(4 2)!
2 1 (2 1)
n
0
n
n
= 1,
= 0,
=
0
k
k
nk
Zaruhi Sahakyan (University of Illinois)
21 / 89
22 / 89
PN
i=1 Xi
N
Population mean: Expected Value of X for all x: the weighted average of
all of its values. The wieghts are the probabilities P(x)
E (X ) = =
xP(x) =
N
X
xi pi
i=1
Variance:
2
PN
i=1 (Xi
)2
N
Population Variance for all x: the weighted average of the squared
deviations from the mean.
V (X ) = 2 =
N
X
X
(x )2 P(x) =
(xi )2 pi
i=1
23 / 89
E (c) = c
E (X + c) = E (X ) + c
E (cX ) = cE (X )
V (c) = 0
V (X + c) = V (X )
V (cX ) = c 2 V (X )
24 / 89
Previous example is based on the assumption that what matters for players
is expected payoff. Is this always true?
People choose to gamble, play lotteries etc. even though the expected
payoff is less than their cost ( expected loss)
Explanation: Excitement when buying a ticket; enjoyment of thinking
what one would do if lucky
Sempronius example from book
25 / 89
1
2
(if his
26 / 89
27 / 89
Variance of x and y
One ship:
1
1
Var x = (4000 8000)2 + (12000 8000)2 = 16000000
2
2
Two ships:
Do it:
28 / 89
29 / 89
30 / 89
31 / 89
2n
The expected value of payoffs is
X
i=1
pi x i =
X
(1/2)i 2i =
i=1
However, most people would not even be willing to pay 100$ for the right
to play this game, even if you explain that the expected value is infinite.
32 / 89
pi u(xi ) =
i=1
X
X
1
1
( )i i = ln(4)
( )i ln(2i ) = ln 2
2
2
i=1
i=1
Hence the expected utility of the game is ln(4), so the payoffs would be as
good as an amount of $ 4 which the individuals gets with certainty, and so
people should be willing to pay only $ 4.
Zaruhi Sahakyan (University of Illinois)
33 / 89
Proof:
Denote
1 i
i=1 i( 2 )
1 i
i=1 i( 2 )
=2
Solve for S:
1
1
1 + (S + 1)
2
2
1
S =1S =2
2
34 / 89
Bernoullis theory can explain why people are not willing to pay large
amounts of money for this lottery. However, there are several problems
with Bernoullis suggestion:
The choice of the utility function is arbitrary (mostly influenced by
the desire to make computation easy).
More generally, under which basic assumptions (axioms) can a
behavior which maximizes expected utility be derived?
Are there other reasons why individuals may be reluctant to pay large
amounts of money in this game?
35 / 89
Risk aversion
Definition
An agent is risk averse if, at any wealth level w , he or she dislikes every
lottery with an expected payoff of zero:
For all w , z with E z = 0, u(w ) Eu(w + z).
(Strictly risk averse if the inequality is strict.) In other words u(w ) is
concave.
Intuition:
Your wealth is $10. I toss a coin and offer you $1 if it is heads and take $1
from you if it is tails
E z = 0.5 1 + 0.5 (1) = 0
Expected payoff is 0.5 11 + 0.5 9 = 10, but you reject it.
Reason: your gain in utility from another $1 is less than your loss in
utility from losing $1
Your Marginal Utility diminishes, you are risk averse (u 00 (w ) < 0).
Conversely, if you are risk averse, your Marginal Utility diminishes.
Zaruhi Sahakyan (University of Illinois)
36 / 89
Risk aversion
Equivalent Concepts
A person is risk averse
A persons marginal utility of wealth (money) diminishes
A persons utility function, u(x), is concave
A persons indifference curves are convex.
37 / 89
u(x) = x.
Should he go ahead with the shipment, i.e. should he accept the lottery?
The optimal decision is to accept the lottery z with mean 6= 0 and
variance 2 , if
Eu(w + z) u(w )
38 / 89
39 / 89
u = 8000 = 89.4
Sempronius is best off with full insurance (if available), then with
diversification, and worst off without diversification.
40 / 89
41 / 89
42 / 89
Risk premium
Definition
Risk premium associated with a zero-mean lottery is the maximum
amount of money that an individual is willing to pay in order to get rid of
a zero-mean lottery z.
Eu(w + z)
| {z }
u(w )
| {z }
An individual ends up with the same welfare either by accepting the risk or
by paying the risk premium .
Risk premium is a money measure rather than a utility measure.
Risk premium can be compared between different individuals
(Sempronius is more/less risk averse than Alexander).
Risk premium is willingness to pay for insurance on top of the fair
premium.
Zaruhi Sahakyan (University of Illinois)
43 / 89
u(w )
| {z }
44 / 89
Definition
Certainty equivalent is the certain amount of money that makes an
individual as well off as with the lottery.
Risk premium = Expected wealth - Certainty equivalent
45 / 89
46 / 89
47 / 89
48 / 89
49 / 89
50 / 89
Taylor
The line we fitted has the same function value and slope at x0 , but not the
same second derivative as the original function
Better fit:
g (x) = f (x0 ) + f 0 (x0 )(x x0 ) + c(x x0 )2
Can fit:
value
first derivative
second derivative
g 0 (x)
51 / 89
Taylor series
In general:
f (x) f (x0 ) +
N
X
f (n) (x0 )
n=1
n!
(x x0 )n
52 / 89
Risk premium
Definition of risk premium :
Eu(w + z)
| {z }
u(w )
| {z }
X
X
1
pi +u 0 (w )
pi zi + u 00 (w )
pi zi2
2
| {z }
| {z }
| {z }
X
=1
=0
=Var (
z)
53 / 89
Var (
z)
2
00
u (w )
0
u (w )
54 / 89
Risk premium
Var (
z)
00
u (w )
0
u (w )
Observation 1:
Risk premium is (for small risks) linear in the variance of the risk.
Risk premium is quadratic in the size of the risk
Suppose z = k (k is a factor that scales the risk, e.g., k = 2
twice as much risk, E (
z ) = 0)
2
Var (
z ) = Var (k ) = k Var (
)
for small risks (k goes to zero), the risk premium is not just small,
but very small (i.e., small even relative to the size of the risk)
Therefor at the margin, accepting a small zero-mean risk has no effect
on the welfare of risk-averse agents (risk-neutral towards small risks).
Application: Should you buy travel insurance or extended warranties for
small appliances because of risk aversion?
Zaruhi Sahakyan (University of Illinois)
55 / 89
Risk premium
Var (
z)
00
u (w )
0
u (w )
|
{z
}
Observation 2:
The Arrow-Pratt measure of risk aversion shows how risk averse a person
is: Higher Arrow-Pratt measure higher risk premium.
Observation 3:
Arrow-Pratt measure of risk aversion is invariant to (i.e., does not change
when we have) a linear transformation of the utility function:
Let v (x) = a + bu(x), where b > 0. Then
bu 00 (x)
u 00 (x)
v 00 (x)
=
.
v 0 (x)
bu 0 (x)
u 0 (x)
56 / 89
Cardinal utility
In consumer theory under certainty, only the ordering of utility numbers
matters: an indifference curve higher up in the preferences should be
assigned a larger number, but how much larger is immaterial and has no
significance. Therefore that utility is said to be ordinal. Under uncertainty,
and specifically under the expected utility theory, the size of differences in
utility numbers matters, at least up to a choice of scale. For example, if
the consequences are magnitudes of wealth with w1 < w2 < w3 , then
whether [u(w2 ) u(w1 )] is bigger or less than [u(w3 ) u(w2 )] matters for
whether u(w2 ) > or < 12 u(w1 ) + 12 u(w3 ), and therefore for whether the
decision-maker would prefer to have w2 for sure, or a 50 : 50 gamble
between w1 and w3 . Therefore a non-linear transformation of the u(w )
numbers, which could change [u(w2 ) u(w1 )] and [u(w3 ) u(w2 )] in
quite different ways, can affect this comparison and therefore would not
represent the same underlying attitude toward risk.
Since the magnitudes of utility numbers matter (up to the choice of origin
and scale), the utility function that goes into expected utility calculations
is said to be cardinal.
Zaruhi Sahakyan (University of Illinois)
57 / 89
58 / 89
59 / 89
Concave transformations
Suppose v is a concave transformation of u. For example, v (u) =
u = x. Then,
q
p
x = 4 x = x 0.25
v (u(x)) = u(x) =
u and
u 00 (x)
(0.5)0.5x 1.5
1
=
=
0
0.5
u (x)
0.5x
2x
v 00 (x)
(0.75)0.25x 1.75
3
=
=
0
0.75
v (x)
0.25x
4x
v has a higher risk premium than u for all risks. One can show (EGS Prop.
1.5) that this is true whenever v is a concave transformation of u.
Zaruhi Sahakyan (University of Illinois)
60 / 89
Example
61 / 89
Example: Solution
62 / 89
Do it Yourself
63 / 89
It is plausible that a person has a higher risk premium for the same risk
when he is poor than when he is rich
Example:
(
+100 with probability 1/2
z =
100 with probability 1/2
Case 1: w = $101
Case 2: w = $1, 000, 000
Show that rich person is almost risk-neutral against this particular risk.
64 / 89
(
+100
z =
100
Case 1: w = $101
1
1
1+
201 = 101 101 = 57.59 = $43.41
2
2
Case 2: w = $1, 000, 000
1p
1
999, 900+
1000100 = 1000000 1000000 = 999999.9975
2
2
= $0.0025
Rich person is almost risk-neutral (against this risk)
65 / 89
(x)
Let A(x) = uu0 (x)
(degree of absolute risk aversion of the agent)
00 2
u (x)
u 000 (x)u 0 (x) [u 00 (x)]2
u 000 (x) u 00 (x)
A (x) =
=
+ 0
= 00
0
2
0
[u (x)]
u (x) u (x)
u (x)
0
= A(x)[A(x) P(x)]
000
(x)
: the degree of absolute prudence of agent with utility u
P(x) = uu00 (x)
0
For A (x) < 0, it must be that P(x) > A(x). A necessary condition for
this is u 000 (x) > 0.
1
is decreasing in x.
Example: For u = x, A(x) = 2x
000
DARA requires that u is positive (marginal utility is convex):
000
3 5
= x2
8
66 / 89
df (x) 1
dx f (x) ,
where
du 0 (w )/u 0 (w )
wu 00 (w )
= 0
= wA(w )
dw /w
u (w )
67 / 89
z ) u (w )w
= Var (
2
u 0 (w )
Zaruhi Sahakyan (University of Illinois)
68 / 89
z ) u 00 (w )w
Var (
z)
= Var (
=
R(w )
0
2
u (w )
2
Suppose you face a relative risk of 20 percent of your expected wealth
level, with equal probability, i.e. z = (0.2, 21 ; 0.2, 12 )
shows the share of your initial wealth that you are ready to pay to
1
u(w ) = w , R(w ) = wA(w ) = w 2w
= 12
69 / 89
70 / 89
71 / 89
Quadratic utility
Early researchers in finance, such as Markowitz and Sharpe, used just the
mean and the variance of the return rate of an asset to describe it.
Mean-variance characterization is often easier than using an von NM
utility function.
Q: But is it compatible with vNM theory?
A: Yes, but under some conditions.
72 / 89
1
1
Eu(w
) = aE (w
) [E (w
)]2 Var (w
).
2
2
Zaruhi Sahakyan (University of Illinois)
73 / 89
e
Constant absolute risk aversion (CARA): A(w ) = rre rw
=r
74 / 89
1
w
75 / 89
1
w
76 / 89
77 / 89
Axioms
Notation: A lottery is described by
p1 p2
x1 x2
pn
xn
78 / 89
Axiom (Ordering)
The agent has a complete and transitive ordering on L.
Axiom (Non-satiation)
1 u2 u2
1 u1 u1
u1 > u2
xmin xmax
xmin xmax
79 / 89
Axioms: Continuity
Axiom (Continuity)
For all x [xmin , xmax ], there exists a probability u(x) such that
1 u(x) u(x)
x
xmin
xmax
u(x) is called the equivalent winning probability.
Example: Getting $ 1000 for sure is as good as getting $ 5000 with
probability 1/4. (Note: This is just one individuals preference, and it is
certainly not true for everybody!)
80 / 89
Axioms: Independence
Axiom (Independence)
Let Li , Lj , Lk L
and Li Lj (Lk is arbitrary). Then, for all p, we have
1p p
1p p
Li
Lk
Lj
Lk
Reason: With prob. 1 p, the two big lotteries deliver different payoffs
(either Li or Lj ), and we know that Li Lj . So in this case, the first big
lottery is better than the second big lottery.
With prob. p, both lotteries deliver the same payoff Lk and hence in this
case, both lotteries are equally good.
=First big lottery is more attractive
Intuitive, but apparently the critical axiom of the theory.
81 / 89
100%
Choice 1: Choose either A1 =
or
$ 1 million
1%
89%
10%
B1 =
0 $ 1 million $ 5 million
82 / 89
Allais experiment
Consider
choice 1; rewrite A1 and
B1 (without any substantive change) as
89%
11%
A1 =
and
$ 1 million $ 1 million
89%
11%
1/11
10/11
B1 =
$ 1 million
0
$ 5 million
Independence axiom: Any preference for A1 or B1 cannot depend on the
respective first parts of the lotteries (i.e., 89% chance of getting 1 mio.;
this is the Lk in the independence axiom).
1/11
10/11
Thus, A1 B1 if and only if $ 1 million
0
$ 5 million
Similarly, the choice between A2 and B2 can be broken down to the same
question. (Do it!)
A1 B1 and A2 B2 is inconsistent with the independence axiom.
A1 B1 and A2 B2 is inconsistent with the independence axiom.
Zaruhi Sahakyan (University of Illinois)
83 / 89
Expected-utility theorem
Proposition (Expected-utility theorem)
If an individual satisfies axioms 1-4, he behaves as if he were maximizing
expected utility for some function u
X
pi u(xi )
i
84 / 89
Expected-utility theorem
Proof: Let LA LB . (Axiom 1 guarantees that we can always order two
lotteries). Consider x1 (first possible prize);
by the continuity
axiom, there
1 u1 u1
exists a probability u1 such that x1
.
xmin xmax
Independence axiom: we can substitute this lottery for x1 in
A
A
A
p1A
p2 pn
p1 p2A pnA
LA =
1 u1 u1
x1 x2 xn
x2 xn
xmin xmax
Substitute sequentially all xi in LA and LB equivalent standard lotteries
A
A
p
p
1
2
1 u2 u2
L0A = 1 u1 u1
xmin xmax
xmin xmax
85 / 89
Expected-utility theorem
Similar substitution for L0B .
B
B
p
p
1
2
1 u2 u2
L0B = 1 u1 u1
xmin xmax
xmin xmax
Now L0A and L0B can be compared using the non-satiation axiom. The logic
goes as follows:
LA LB (by completeness)
L0A LA and L0B LB (by construction)
L0A LA LB L0B L0A P
L0B (by transitivity)
P
0
0
Hence LA LB if and only if i piA ui i piB ui (by non-satiation)
This is the Expected utility form that we wanted to arrive at.
86 / 89
Important properties of u
87 / 89
Important properties of u
u(x) = x u(4) = 2;
(3/4)u(0) + (1/4)u(16) = 1 this individual prefers $ 4 certain over
the lottery.
v (x) = [u(x)]4 = x 2 . v (4) = 16, and
(3/4)v (0) + (1/4)v (16) = 64 this individual prefers the lottery
over $4 certain.
88 / 89
Important properties of u
89 / 89