Lecture 10 & 11 - Probability-1
Lecture 10 & 11 - Probability-1
Suborna Sultana
Adjunct Lecturer
Department of Mathematics and Natural Sciences
BRAC University
2
Probability
Probability measures the likelihood of occurring an event.
Examples:
Weather Forecasting
Predicting batting average in cricket matches
Politics
Choosing appropriate insurance strategies
Selecting sport strategies etc.
Experiment:
Experiment is an act that can be repeated under given conditions. An experiment is a procedure which
can repeated infinitely but it has a well-defined set of possible outcomes. Unit experiment is called
trial.
Example:
Tossing a coin is an example of experiment since it can be infinitely repeated and it has defined
set of possible outcomes which are “heads” & “tails”.
Rolling a dice is another example of experiment which can be repeated several times and an
infinite set of possible outcomes, S = { 1, 2, 3, 4, 5, 6 }
Measuring the lifetime of an automobile is also an example of experiment and it’s sample space
consists of all nonnegative real numbers. That is, S = [ 0, ∞ )
Experiment may be Deterministic or predictable and Random or unpredictable.
3
Deterministic or predictable experiment:
An experiment whose outcome is predictable in advanced is called deterministic experiment.
Everyone conducting the experiment will get the same result or outcome.
Examples:
Predicting the amount of money in a bank account if you know the initial deposit and the
interest rate.
The relationship between a circumference and radius of a circle, or the area and radius of a
circle.
Outcome:
An outcome is the result of an experiment. In other words, an outcome is a particular result of an
experiment. In a tossing coin experiment “Head” is an outcome of the experiment.
Sample Space:
A set or collection of all possible outcomes of a random experiment is called sample space of that
random experiment and it is denoted by S. Each outcome of an experiment is a sample point or element
in the sample space.
For example,
Tossing a coin: S = { H, T }
White Die
1 2 3 4 5 6
Red Die
Event: One or more outcomes of a random experiment constitute an event. An event, E can be
defined as a set of outcomes of an experiment or a subset of a sample space (S).
For example, in throwing a die experiment, the sample space is S = {1, 2, 3, 4, 5, 6}.
E = {2, 4, 6} is an event, which can be described in words as “the number is even”.
Impossible event: An event is called impossible event when it never happens. This means that
probability of an impossible event is always zero and it will never happen. Probability of living without
breathing is an impossible event.
On a day, event E1 = {Rain} & event E2 = {Sunny} may occur simultaneously. These are not
mutually exclusive events.
In a coin tossing experiment, E1 = {Head} and event E2 ={Tail} are collectively exhaustive,
because together they comprise the all the outcomes that are possible in a coin tossing
experiment. There are no other possible outcomes of this experiment than these two.
In a coin to tossing experiment, the events E1 = {Head} and event E2 = {tail} are
equally likely, because the chance of occurring E1 is as same as occurring E2.
The sample space of throwing a die is, S = { 1, 2, 3, 4, 5, 6 } and the probability of getting a chosen
number = 1/6. Here, the chance of occurring each numeral is the same and so they are equally
likely events.
Disjoint events:
Two events are called disjoint, if they have no common elements between them.
Mutually exclusive events are disjoint events.
STA201_SUM2020_MDG
6
Dependent Events:
If two events have some common elements then both of these events are referred as dependent events.
For example, in a deck of 52 cards, if E 1 be an event of selecting ‘Red’ card and E 2 be another event of
selecting ‘Queen’ card then these events are joint events since there are two ‘Queen’ cards in a set of
‘Red’ cards.
Union: The union of two sets contains all the elements contained in either set (or both sets).The
union is notated A ⋃ B, where A and B are two sets.
Intersection: The intersection of two sets contains only the elements that are in both sets.The
intersection is notated A ⋂ B.
Compliment: The complement of a set A contains everything that is not in the set A. The
complement is notated A’, or Ac.
A union B (A ⋃ B)
A intersect B (A ⋂ B)
A compliment (A’)
STA201_SUM2020_MDG
7
Independent Events:
Two events are known as independent events if the occurrence of one event does not affect the
probability of occurring another event.
For two independent events A and B, the probability that A and B will both occur is found by
multiplying the two probabilities.
P (A and B) = P (A) P( B )
We then define our favorable event and assign probability to the event using one of the
following 3 basic approaches:
Classical approach
Frequency approach
Subjective approach
Classical approach:
If a random experiment has a total of n(S) possible outcomes, all of which are mutually exclusive,
equally likely and collectively exhaustive, such that n(A) of the outcomes are favorable to an event A,
then the probability of the event A is defined by,
𝑛(𝐴)
P(A) =
𝑛(𝑆)
S= {1, 2, 3, 4, 5, 6}
n(E1) 1
Therefore, probability of occurring event E 1 is, P(𝐸1) = =
𝑛(𝑆) 6
n(E2) 3 1
Probability of occurring event E2 is, P(𝐸2) = = =
𝑛(𝑆) 6 2
8
Frequency/ Statistical approach:
If an experiment is repeated n times under the same conditions and event E occurs f times out of n
𝑓
times, then P(E) = lim
𝑛→∞ 𝑛
That is, when n is very large, P(E) is very close to the relative frequency of event E.
Example:
Subjective approach:
Based on the judgement (personal experience, prior information and belief etc.), one can assign
probability to an event E of a random experiment.
For example; on a day of summer someone made a statement on probability that rain will occur on that
day is 0.7, based on his previous experience.
Axioms of Probability
Valid probabilities will follow 3 axioms-
P
9
Example 1: A person holds ticket in a lottery that offers 10 prizes and sells 120 tickets. What is the
probability that the person will not win a prize?
Solution: Let A be the event of winning a prize.
𝑛(𝐴) 10 1
Here, P(A) = = =
𝑛(𝑆) 120 12
1 11
Thus, P(𝐴’) = 1 − = 12
12
11
So, the probability that the person will not win a prize is 12
Example 2: In a community of 400 people, 20 people has a particular disease. If a person is selected
randomly from that community, what is the probability that he/ she does not has the disease?
Solution:
Let, D = the randomly selected person has the disease
H𝑒𝑟𝑒, P(𝐷) = 20/400 = .05
∴ P(𝐷’) = 1−.05 = 0.95
So, the probability that he/ she does not have the disease is 0.95
Example 3: A dice is thrown in an experiment. What is the probability that an even number will
occur?
Solution: The sample space for the experiment is, S = { 1, 2, 3, 4, 5, 6 }
Let the event is E = {2, 4, 6 }
Here, n(E) = 3 and n(S) = 6
Therefore, the probability of occurring the event, E
𝑛(𝐸) 3 1
P(E) = = = = 0.5
𝑛(𝑆) 6 2
Addition Laws
• For disjoint events A and B-
The probability that, either event A or event B will occur is,
𝑃(𝐴 𝖴 𝐵) = 𝑃(𝐴) + 𝑃 (𝐵 )
• For disjoint events A, B, C, … , and Z
The probability that, either event A or event B or event C or … or event Z will occur is,
𝑃(𝐴 𝖴 𝐵 𝖴 𝐶 𝖴 ⋯𝖴 𝑍) = 𝑃(𝐴) + 𝑃(𝐵) + 𝑃(𝐶) + …+ 𝑃(𝑍)
• For joint events A and B-
The probability that, either event A or event B or both will occur is,
𝑃(𝐴 𝖴 𝐵) = 𝑃(𝐴) + 𝑃(𝐵) − 𝑃(𝐴 ∩ 𝐵)
• For joint events A, B, and C
The probability that, either event A or event B or event C or any two of them or all will occur is,
𝑃(𝐴 ∪ 𝐵 ∪ 𝐶) = 𝑃(𝐴) + 𝑃(𝐵) + 𝑃(𝐶) − 𝑃(𝐴 ∩ 𝐵) − 𝑃(𝐵 ∩ 𝐶) − 𝑃(𝐴 ∩ 𝐶) + 𝑃(𝐴 ∩ 𝐵 ∩ 𝐶)
10
Example 4:
In a company, 60% of the employees have motorcycle, 40% has private car and 20% has both. If an
employee is selected randomly from that company, then
a) What is the probability that the employee has either motorcycle or private car?
b) What is the probability that the employee has neither motorcycle nor private car?
Solution:
Let, M= the randomly selected employ has motorcycle
C= the randomly selected employee has car
P (𝐶) = = 0.4
P
a) Probability that the person has either motorcycle or private car is,
𝑃(𝑀 𝖴 𝐶) = 𝑃(𝑀) + 𝑃(𝐶) − 𝑃(𝑀 ∩ 𝐶)
= 0.6 + 0.4 − 0.2
= 0.8
b) Probability that the person has neither motorcycle nor private car is
P(𝑀 𝖴 𝐶)𝑐 = 1 − (𝑀 𝖴 𝐶)
= 1 − 0.8
= 0.2
Conditional probability:
Conditional probability is defined as the likelihood of an event or outcome occurring, based on the
occurrence of a previous event or outcome. The probability that event A occurs, given that event B has
occurred, is called a conditional probability.
The conditional probability of A, given B, is denoted by the symbol P(A|B).
𝑝(A ∩ B)
𝑃(A|B) = ; 𝑓𝑜𝑟 𝑃(B) > 0
P(B)
𝑝(A ∩ B)
𝑃(B|A) = ; 𝑓𝑜𝑟 𝑃(A) > 0
P(A)
Multiplication Laws
• For two dependent events A and B
The probability that, both event A and event B will occur simultaneously is,
P(A ∩ B) = P(A|B) P(B)
Here, occurrence of event A depends on occurrence of event B.
• For two independent events A and B
The probability that, both event A and event B will occur simultaneously is,
P(A ∩ B) = P(A) P(B)
Example 6: In rainy season, it rains 70% of the days in Bangladesh. When it rains, 80% times it
makes thunderstorms. What is the probability that, in a particular day of rainy season, it will rain and
it will thunderstorm?
P(𝑇|𝑅) = = 0.8
Therefore, the probability that, on that particular day of rainy season, it will rain and it will
thunderstorm is -
𝑃(𝑅 ∩ 𝑇) = 𝑃(𝑇|𝑅) 𝑃(𝑅)
= 0.8 ∗ 0.7
= 0.56
12
Example 7: A jar contains 3 red, 5 green, 2 blue and 6 yellow marbles. A marble is chosen at
random from the jar. After replacing it, a second marble is chosen. What is the probability of
choosing a green and then a yellow marble?
Solution: Let, G = Green marble will be chosen
Y = Yellow marble will be chosen
= =
Law of Total Probability: Let, events 𝐴1 and 𝐴2 form partition of S. Let B be an event with P(B)>0.
Then, P(𝐵) = P(𝐴1 ∩ 𝐵) + P(𝐴2 ∩ 𝐵) = P(𝐵|𝐴1) 𝑃 (𝐴1) + 𝑃(𝐵|𝐴2) P(𝐴2)
Let, events 𝐴1, 𝐴2, …, 𝐴𝑘 form partition of S. Let B be an event with P(B)>0. Then,
P(𝐵) = P(𝐴1 ∩ 𝐵) + P(𝐴2 ∩ 𝐵) + …… + P(𝐴𝑘 ∩ 𝐵)
= P(𝐴1) P(𝐵|𝐴1) + P(𝐴2) P(𝐵|𝐴2) + ….. + 𝑃(𝐴𝑘) 𝑃(𝐵|𝐴𝑘)
13
Example 8: A person has undertaken a mining job. The probabilities of completion of job on time
with and without rain are 0.42 and 0.90 respectively. If the probability that it will rain is 0.45, then
determine the probability that the mining job will be completed on time.
P(C|R) = 0.42
P(C|R′) = 0.90
Since, events R and R′ form partitions of the sample space S, by total probability theorem, we have,
= 0.189 + 0.495
= 0.684
So, the probability that the job will be completed on time is 0.684.
14
Example 9:. Suppose a study of speeding violations and drivers who use cell phones
produced the following fictional data:
c) Find P(person is a cell phone user | he had a violation in the last year).
25
=
70
Example 10: Below given a contingency table for Smoking status and Cancer status.
Smoking status/ Cancer status Cancer Healthy Total
13250
b) The probability that a randomly selected person is a smoker, P(C) = 26360 = 0.503
c) The probability that a randomly selected person is both smoker and has cancer,
7860
𝑃 (𝑆 ∩ 𝐶 ) = = 0.298
26360
7860
𝑃(𝐶∩𝑆) 26360⁄ 7860
d) 𝑝(𝐶 |𝑆 ) = = 9390 = = 0.837
𝑃(𝑆) 9390
26360
16
Bayes’ Theorem
𝑃(𝐴∩𝐵)
𝑃 (𝐴 |𝐵 ) = 𝑜𝑟, 𝑃(𝐴 ∩ 𝐵) = 𝑃(𝐴|𝐵). 𝑃(𝐵) ……………………(1.1)
𝑃(𝐵)
𝑃(𝐴∩𝐵)
𝑃 (𝐵 |𝐴 ) = 𝑜𝑟, 𝑃(𝐴 ∩ 𝐵) = 𝑃 (𝐵 |𝐴). 𝑃(𝐴) ……………………..(1.2)
𝑃(𝐴)
The LHS of both equations 1.1 and 1.2 are equal. Equating them gives:
There is 43% chance that a randomly selected student is in the photography club that the student is
male.
Example 12: A particular study showed that 12% of men will likely develop prostate cancer
at some point in their lives. A man with prostate cancer has 95% chance of a positive test result
from a medical screening exam. A man without prostate cancer has a 6% chance of getting a
false positive test result. What is the probability that a man has cancer given he has a positive
test result?
There is 68.3% chance that a man has cancer given he has a positive test result.
18
Example 13: A consulting firm submitted a bid for a large consulting contract. The firm's
management felt it had a 50-50 chance of landing the project. However, the agency to which the bid
was submitted subsequently asked for additional information. Past experiences indicate that for 75%
of successful bids and 40% of unsuccessful bids the agency asked for additional information.
a) What is the probability of the bid being successful?
b) What is the conditional probability of a request for additional information given that the bid
will be ultimately successful?
c) Compute the probability that the bid will be successful given a request for additional
information
Solution:
Let A1 = the bid is successful
A2 = the bid is unsuccessful
B = additional information requested
Example 14: Suppose that an insurance company classifies people into one of the three classes –
good risks, average risks and bad risks. Their records indicate that the probabilities that good,
average, and bad risk persons will be involved in an accident over a 1-year span are 0.05, 0.15 and
0.3 respectively. 20% of the population are "good risks", 50% are "average risks", and 30% are "bad
risks”.
a) What proportion of people have accidents in a fixed year?
b) If policy holder A had no accidents in 1987, what is the probability that he or she is a good risk
person?
Solution:
Let A1 = good risk
A2 = average risk
A3 = bad risk
B = accident occurs
P(A1) = 0.2
P(A2) = 0.5
P(A3) = 0.3
P(B|A1) = 0.05
P(B|A2) = 0.15
19
P(B|A3) = 0.3
a) P(B) = P(B|A1) * P(A1) + P(B|A2) * P(A2) + P(B|A3) * P(A3)
= ( 0.05*0.2) + ( 0.15*0.5) + ( 0.3*0.3)
= 0.175
b) Let 𝐵’ = accident does not occur
∴ P(𝐵’) = 1 - 0.175 = 0.825
and P(𝐵’|𝐴1 ) = 1 - 0.05 = 0.95
′
𝑃(𝐵 |𝐴1 )∗𝑃(𝐴1 ) 0.95∗0.2
𝑃(𝐴1|𝐵’) = = = 0.23
𝑃(𝐵′ ) 0.825
If policy holder A had no accidents in 1987, there is a 23% chance that he or she is a good risk.
Example 15: In a bolt factory, machine A, B, C manufacture 25%, 35% and 40% respectively of
the total bolts. Of their outputs, 5%, 4% and 2% are respectively, defective bolts. A bolt is drawn at
random from the product. If the bolt drawn is found defective, what is the probability that it is
manufactured by the machine A or C?