LM03 Probability Concepts IFT Notes
LM03 Probability Concepts IFT Notes
This document should be read in conjunction with the corresponding reading in the 2023 Level I
CFA® Program curriculum. Some of the graphs, charts, tables, examples, and figures are copyright
2022, CFA Institute. Reproduced and republished with permission from CFA Institute. All rights
reserved.
Required disclaimer: CFA Institute does not endorse, promote, or warrant the accuracy or quality of
the products or services offered by IFT. CFA Institute, CFA®, and Chartered Financial Analyst® are
trademarks owned by CFA Institute.
Version 1.0
Odds against an event are defined as the probability of the event not occurring to the
probability of the event occurring. Odds against E = [1 – P(E)] / P(E).
Give odds against E of “a to b”, the implied probability of E is b / (a + b).
Example
If P(E) = 0.2, what are the odds against the event occurring? If the odds against an event are
4 to 1, what is the probability of the event?
Solution:
0.8 4
P(E) = 0.2 = 1. Hence the odds against E are 4 to 1.
1
Given the odds against an event, the probability of the event is 4 + 1 = 0.2
Example
P(interest rates will decrease) = P(D) = 40%
P(stock price increases) = P(S)
P(stock price will increase given interest rates decrease) = P(S|D) = 70%
Compute probability of a stock price increase and an interest rate decrease.
Solution:
P(SD) = P(S|D) x P(D) = 0.7 x 0.4 = 0.28 = 28%
Addition Rule for Probabilities
Addition rule is used to determine the probability that at least one of the events will occur. It
is expressed as:
P(A or B) = P(A) + P(B) – P(AB)
P(AB) represents the joint probability that both A and B will occur. It is subtracted from the
sum of the unconditional probabilities: P(A) + P(B), to avoid double counting.
If the two events are mutually exclusive, the joint probability: P(AB) is zero and the
probability that either A or B will occur is simply the sum of the unconditional probabilities
for each event:
P(A or B) = P(A) + P(B)
Example
P(price of A increases) = P(A) = 0.5
P(price of B increases) = P(B) = 0.7
P(price of A and B increases) = P(AB) = 0.3
Compute the probability that the price of stock A or the price of stock B increases.
Solution
P(A or B) = 0.5 + 0.7 – 0.3 = 0.9
Independent and Dependent Events
If the occurrence of one event does not influence the occurrence of the other event, then the
two events are called independent events.
i.e. P(A|B) = P(A) or P(B|A) = P(B)
Multiplication rule for independent events: P(AB) = P(A) P(B)
Addition rule for independent events: P(A or B) = P(A) + P(B) – P(AB). (The addition rule
does not change.)
If the probability of an event is affected by the occurrence of another event, then it is called a
dependent event.
Total Probability Rule
The total probability rule is used to calculate the unconditional probability of an event, given
conditional probabilities.
In investment analysis, we often formulate a set of mutually exclusive and exhaustive
scenarios and then estimate the probability of a particular event. For example, let’s say that
we have two scenarios S and non-S that are mutually exclusive and exhaustive.
According to the total probability rule, the probability of any event P(A) can be expressed as:
P(A) = P(AS) + P(ASC)
Using the multiplication rule we get,
P(A) = P(A|S) P(S) + P(A|SC) P(SC)
If we have more than two scenarios, we can generalize this equation to:
P(A) = P(AS1) + P(AS2) +… + P(ASn) = P(A|S1) P(S1) + P(A|S2) P(S2) + … + P(A|Sn) P(Sn)
3. Expected Value and Variance
Expected Value of a Random Variable
The expected value of a random variable can be defined as the probability-weighted average
of the possible outcomes of the random variable. For a random variable X, the expected value
of X is denoted as E(X) and is calculated as:
n
E(X) = ∑ P(Xi ) Xi
i=1
where:
Xi = One of n possible outcomes of the random variable X
P(Xi) = Probability of Xi
Variance of a Random Variable
The expected value is our forecast, but we cannot count on the individual forecast being
realized. This is why we need to measure the risk we face. Variance and standard deviation
are examples of how we can measure this risk. The variance of a random variable is the
probability-weighted sum of the squared differences between each possible outcome and the
expected value of the random variable. It is expressed as:
n
2 (X)
σ = ∑ P(X) [X − E(X)]2
i=1
Variance is a number greater than or equal to 0 because it is the sum of squared terms. If
variance is 0, there is no dispersion or risk. The outcome is certain and the quantity X is not
Example
What is the expected price of a stock at the end of the current period given the following
information: probability that interest rates will decline = 0.4. If interest rates decline there is
a 75% chance that stock price will be $100 versus a 25% chance that the stock price will be
$90. If interest rates do not decline there is a 50% chance that the stock price will be $80
versus a 50% chance that stock price will be $70.
Solution:
We can plot the probabilities using a tree diagram.
Consider the first node (top right). It refers to the probability that the stock price will be
$100 given a decline in interest rates. We can calculate the probability of that happening by
multiplying the probability of a decline in interest rates (0.4) by the probability of the stock
price being $100 if that happens (0.75). This gives us a conditional probability of 0.30. In
short, it is the joint probability of the stock price being $100 given a decline in interest rates.
Similarly, probabilities are calculated for each of the other three nodes. We can then
calculate:
E(Price│decline in interest rates) = 0.75 ($100) + 0.25 ($90) = $97.50
E(Price│no decline in interest rates) = 0.50 ($80) + 0.50 ($70) = $75.00
Now we use the total probability rule for expected value of stock price at the end of the
current period:
actual return will vary around 9%. The amount of variability is measured by the variance. In
order to determine the variance of return, we must first calculate the covariance.
Covariance
Covariance tells us how movements in a random variable vary with movements in another
random variable, whereas variance tells us how a random variable varies with itself. Assume
there are two random variables Ri and Rj. The forward-looking, population covariance
between Ri and Rj (used to measure how they move together) is given by:
Cov (R i , R j ) = E ([R i – ER i ][ R j – ER j ])
where:
ERi = expected return for variable Ri
ERj = expected return for variable Rj
If the random variables are returns, the units of both forward-looking covariance and
historical variance would be returns squared.
The sample covariance between two random variables Ri and Rj is the average value of the
product of the deviations of observations on two random variables from their sample means.
It is calculated as follows:
n
Ri,t Ri R j,t R j n 1
Cov Ri , R j
i 1
Unlike the population covariance, the sample covariance is based on historical data set. This
reading focuses on covariance in a forward-looking sense.
Example
Continuing with our previous example, calculate the covariance of returns between A and B.
Solution:
Say Ri represents the return on A and Rj represents the return on B, we have already
calculated the expected returns of A and B as 7.5% and 10% respectively. The covariance of
returns is:
E [(Ri – 7.5) (Rj – 10)]
= 0.25(2% - 7.5%)(4% - 10%) + 0.5(8% - 7.5%)(10% - 10%) + 0.25(12% - 7.5%)(16% -
10%)
= 0.000825 + 0 + 0.000675 = 0.0015
Correlation
The problem with covariance is that it can vary from negative infinity to positive infinity
which makes it difficult to interpret. To address this problem, we use another measure called
correlation. Correlation is a standardized measure of the linear relationship between two
7. Principles of Counting
In counting, enumeration (counting the outcomes one by one) is the most basic resource.
This process is difficult and is prone to error. We will discuss shortcuts and principles of
counting, which make the process easier.
Multiplication Rule of Counting
The first of these principles is the multiplication rule. It states that ‘if one task can be done in
n1 ways, and a second task, given the first, can be done in n2 ways, and a third task, given the
first two tasks, can be done in n3 ways and so on for k tasks, then the number of ways the k
tasks can be done is (n1) (n2) (n3)… (nk). So the multiplication rule for counting can be
expressed as:
Number of ways of doing k tasks = n1 x n2 x n3 … nk
where:
n1 = number of ways of doing the first task,
n2 = number of ways of doing the second task and so on
Example
Consider a simple example. Suppose we have three steps in an investment decision process.
The first step can be done in 2 ways, the second step can be done in 4 ways and the third in 3
ways. In how many ways can the investment decision be made?
Solution:
Following the multiplication rule, there are (2) (4) (3) = 24 ways of making the investment
decision.
Notice that there are three groupings in this problem. From each group, only one step can be
selected.
Factorial
Another counting principle relates to the assignment of members of a group to an equal
number of positions. The number of ways we can assign every member of a group of size n to
n slots is n! (read as n factorial) = n (n - 1) (n - 2) (n - 3) … 1. By convention, 0! = 1. The
difference between the multiplication rule and factorial is that there is only one group in a
factorial. It involves arranging the set of items within the group and the order in which the
items are arranged matters. The formula is:
Number of ways of assigning group of size n to n tasks = n!
Example
There are five equity analysts covering five emerging countries. In how many ways can the
countries be assigned to the analysts?
Solution:
The total number of ways the assignments can be made = 5! = 120
Labeling
Labeling refers to the number of ways that n items can be labelled with k different labels
with n, of the first type, n of the second type, and so on. This can be expressed as:
Number of ways in which n items can be labelled using k labels =
n!
[(n1 !)(n2 !) … (nk !)]
Example
A portfolio consists of eight stocks. The goal is to designate four of the stocks as "long-term
holds," three of the stocks as "short-term holds," and one stock a "sell." How many ways can
these labels be assigned to the eight stocks?
Solution:
Notice that there are eight items (stocks) that are to be labelled in three different ways.
8!
= 280
4! × 3! × 1!
Combination
A special case of the labelling is the combination formula. It is the number of ways to choose
r objects from a total of n objects, when the order in which the r objects are listed does not
matter. This can be expressed as:
Instructor’s Note: given a problem, use the following pointers to identify the correct
counting method to apply.
Factorial: if there is one group of size n and n items/tasks to be assigned, number of
ways = n!
Labeling: used when there are three or more labels. Each item/member of a group must
be applied a label.
Combination: used when there are two groups of a certain size, say n and r. Use
combination when the order of choosing r objects from n objects does NOT matter.
Permutation: used when there are two groups of a certain size, say n and r. Use
permutation when the order of choosing r objects from n objects does matter.
Combination and permutation functions are available on the financial calculator and
should be used rather than the formula.
Summary
LO: Define a random variable, an outcome, and an event.
A random variable is an uncertain quantity/number.
An outcome is the observed value of a random variable.
An event can be a single outcome or a set of outcomes.
LO: Identify the two defining properties of probability, including mutually exclusive
and exhaustive events, and compare and contrast empirical, subjective, and a priori
probabilities;.
The two defining properties of a probability are:
The probability of any event E is a number between 0 and 1: 0 ≤ P(E) ≤ 1.
The sum of the probabilities of any set of mutually exclusive and exhaustive events
equals 1.
Mutually exclusive events are events that cannot happen at the same time. Exhaustive events
are those that include all possible outcomes.
The methods of estimating probabilities are:
Empirical probability: Based on analyzing the frequency of an event’s occurrence in
the past.
A priori probability: Based on formal reasoning and inspection rather than personal
judgment.
Subjective probability: Informed guess based on personal judgment.
LO: Describe the probability of an event in terms of odds for and against the event.
Odds for E = P(E) / [1 – P(E)].
Odds against E = [1 – P(E)] / P(E).
LO: Calculate and interpret conditional probabilities.
Unconditional probability (marginal probability) is the probability of an event occurring
irrespective of the occurrence of other events. It is denoted as P(A).
Conditional probability is the probability of an event occurring given that another event has
occurred. It is denoted as P(A|B), which is the probability of event A given that event B has
occurred.
LO: Demonstrate the application of the multiplication and addition rules for
probability.
Multiplication rule is used to determine the joint probability of two events. It is expressed as:
P(AB) = P(A|B) P(B)
Addition rule is used to determine the probability that at least one of the events will occur. It
is expressed as:
P(A or B) = P(A) + P(B) – P(AB)
The total probability rule is used to calculate the unconditional probability of an event, given
conditional probabilities. It is expressed as:
P(A) = P(A|S1) P(S1) + P(A|S2) P(S2) + … + P(A|Sn) P(Sn)
LO: Compare and contrast dependent and independent events.
If the occurrence of one event does not influence the occurrence of the other event, then the
events are called independent events.
i.e. P(A|B) = P(A) or P(B|A) = P(B)
If the probability of an event is affected by the occurrence of another event then it is called a
dependent event.
LO: Calculate and interpret an unconditional probability using the total probability
rule.
Using the total probability rule the unconditional probability of A can be computed as:
P(A) = P(A|S1) P(S1) + P(A|S2) P(S2) + … + P(A|Sn) P(Sn)
Where S1, S2 .. Sn are mutually exclusive and exhaustive events.
LO: Calculate and interpret the expected value, variance, and standard deviation of
random variables.
The expected value of a random variable can be defined as the probability-weighted average
of the possible outcomes of the random variable.
n
E(X) = ∑ P(Xi ) Xi
i=1
LO: Calculate and interpret the expected value, variance, standard deviation,
covariances, and correlations of portfolio returns.
The formula for calculating the expected portfolio return is:
E(RP) = w1 E(R1) + w2 E(R2) + … + wn E(Rn)
Variance can be computed as:
σ2 (R P ) = w12 σ12 (R1 ) + w22 σ22 (R 2 ) + 2w1 w2 Cov(R1 R 2 )
LO: Calculate and interpret the covariances of portfolio returns using the joint
probability function.
Given two random variables Ri and Rj, the covariance between Ri and Rj is given by:
Cov(Ri, Rj) = E[(Ri – ERi) (Rj – ERj)]
where:
ERi = expected return for variable Ri
ERj = expected return for variable Rj
LO: Calculate and interpret an updated probability using Bayes’ formula.
Bayes’ formula is a rational method for updating or adjusting the probability of an event
based on new information. According to Bayes’ formula, the updated probability of an event
given new information is:
P(Information│Event)
P(Event│Information) = × P(Event)
P(Information)
LO: Identify the most appropriate method to solve a particular counting problem and
analyze counting problems using factorial, combination, and permutation concepts.
The number of ways we can assign every member of a group of size n to n slots is n!
n!
Number of ways in which n items can be labelled using k labels = [(n
1 !)(n2 !)…(nk !)]
The combination formula gives the number of ways to choose r objects from a total of n
objects, when the order in which the r objects are listed does not matter.
𝑛 n n!
𝐶𝑟 = ( ) =
r (n − r)! r!
The permutation formula gives the number of ways to choose r objects from a total of n
objects, when the order in which the r objects are listed does matter.
𝑛 n!
Pr =
(n − r)!