Basic concepts of events and probability.

Addition rule and Product rule.

Total probability formula and Bayes formula.
Independence

P ROBABILITY AND S TATISTICS

C HAPTER 1: I NTRODUCTION TO PROBABILITY

Dr. Phan Thi Huong

HoChiMinh City University of Technology

Faculty of Applied Science, Department of Applied Mathematics
Email: [email protected]

HCM city — 2021.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

O UTLINE

1 B ASIC CONCEPTS OF EVENTS AND PROBABILITY.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

O UTLINE

1 B ASIC CONCEPTS OF EVENTS AND PROBABILITY.

2 A DDITION RULE AND P RODUCT RULE .

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

O UTLINE

1 B ASIC CONCEPTS OF EVENTS AND PROBABILITY.

2 A DDITION RULE AND P RODUCT RULE .

3 T OTAL PROBABILITY FORMULA AND B AYES FORMULA .

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

O UTLINE

1 B ASIC CONCEPTS OF EVENTS AND PROBABILITY.

2 A DDITION RULE AND P RODUCT RULE .

3 T OTAL PROBABILITY FORMULA AND B AYES FORMULA .

4 I NDEPENDENCE

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

L EARNING OUTCOMES

After careful study of this chapter, you should be able to do the

following:
1 Understand and describe sample spaces and events for
random experiments
2 Interpret and calculate probabilities of events.
3 Interpret and calculate conditional probabilities of events
4 Determine the independence of events and use independence
to calculate probabilities
5 Use Bayes’ theorem to calculate conditional probabilities
6 Use Total probability formula to calculate a probability of an
event.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

An experiment is a procedure that is

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

An experiment is a procedure that is

carried out under controlled conditions, and

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

An experiment is a procedure that is

carried out under controlled conditions, and
executed to discover an unknown result.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

An experiment is a procedure that is

carried out under controlled conditions, and
executed to discover an unknown result.
A trial is a single performance of an experiment.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

An experiment is a procedure that is

carried out under controlled conditions, and
executed to discover an unknown result.
A trial is a single performance of an experiment.
An outcome is the result of a trial.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

An experiment is a procedure that is

carried out under controlled conditions, and
executed to discover an unknown result.
A trial is a single performance of an experiment.
An outcome is the result of a trial.
Deterministic or predictable experiments: only one possible
result or outcome.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

An experiment is a procedure that is

carried out under controlled conditions, and
executed to discover an unknown result.
A trial is a single performance of an experiment.
An outcome is the result of a trial.
Deterministic or predictable experiments: only one possible
result or outcome.
Random experiment: different outcomes even when repeated
in the same manner every time, ex: Tossing a coin or a dice,
measuring a person wight, measuring the current of a thin
copper wire, ...

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

The set of all possible outcomes of a random experiment is

called the sample space of the experiment. The sample space
is denoted as Ω.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

The set of all possible outcomes of a random experiment is

called the sample space of the experiment. The sample space
is denoted as Ω.
Points ω in Ω are called sample outcomes, realizations, or
elements

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

The set of all possible outcomes of a random experiment is

called the sample space of the experiment. The sample space
is denoted as Ω.
Points ω in Ω are called sample outcomes, realizations, or
elements
A sample space is discrete if it consists of a finite or countable
infinite set of outcomes

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

The set of all possible outcomes of a random experiment is

called the sample space of the experiment. The sample space
is denoted as Ω.
Points ω in Ω are called sample outcomes, realizations, or
elements
A sample space is discrete if it consists of a finite or countable
infinite set of outcomes
A sample space is continuous if it contains an interval (either
finite or infinite) of real numbers.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

E XAMPLE 1
Consider an experiment that selects a cell phone camera and
records the recycle time of a flash.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

E XAMPLE 1
Consider an experiment that selects a cell phone camera and
records the recycle time of a flash.
Ω = R+ = {x| x > 0}

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

E XAMPLE 1
Consider an experiment that selects a cell phone camera and
records the recycle time of a flash.
Ω = R+ = {x| x > 0}
If it is known that all recycle times are between 1.5 and 5
seconds, ⇒ Ω = {x | 1.5 < x < 5}

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

E XAMPLE 1
Consider an experiment that selects a cell phone camera and
records the recycle time of a flash.
Ω = R+ = {x| x > 0}
If it is known that all recycle times are between 1.5 and 5
seconds, ⇒ Ω = {x | 1.5 < x < 5}
If the objective of the analysis is to consider only whether the
recycle time is low, medium, or high, ⇒
Ω = {l ow, mi ni um, hi g h}

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

E XAMPLE 1
Consider an experiment that selects a cell phone camera and
records the recycle time of a flash.
Ω = R+ = {x| x > 0}
If it is known that all recycle times are between 1.5 and 5
seconds, ⇒ Ω = {x | 1.5 < x < 5}
If the objective of the analysis is to consider only whether the
recycle time is low, medium, or high, ⇒
Ω = {l ow, mi ni um, hi g h}
If the objective is only to evaluate whether or not a particular
camera conforms to a minimum recycle time specification, ⇒
Ω = {yes, no}.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

An event A is a subset of the sample space of a random

experiment. (= statement, sentence, clause)

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

An event A is a subset of the sample space of a random

experiment. (= statement, sentence, clause)
A null event is the one never happened, denoted by ;.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

An event A is a subset of the sample space of a random

experiment. (= statement, sentence, clause)
A null event is the one never happened, denoted by ;.
A true event is the one always happened, denoted by Ω.

E XAMPLE 2
Recycle time of a flash

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

An event A is a subset of the sample space of a random

experiment. (= statement, sentence, clause)
A null event is the one never happened, denoted by ;.
A true event is the one always happened, denoted by Ω.

E XAMPLE 2
Recycle time of a flash
1 Ω = R+ = {x| x > 0} ⇒ A 1 = (1, ∞), A 2 = [1, 2], ...

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

An event A is a subset of the sample space of a random

experiment. (= statement, sentence, clause)
A null event is the one never happened, denoted by ;.
A true event is the one always happened, denoted by Ω.

E XAMPLE 2
Recycle time of a flash
1 Ω = R+ = {x| x > 0} ⇒ A 1 = (1, ∞), A 2 = [1, 2], ...
2 Ω = {x| 1.5 < x < 5} ⇒ A 1 = (1, 3), A 2 = [2, 3.5], ...

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

An event A is a subset of the sample space of a random

experiment. (= statement, sentence, clause)
A null event is the one never happened, denoted by ;.
A true event is the one always happened, denoted by Ω.

E XAMPLE 2
Recycle time of a flash
1 Ω = R+ = {x| x > 0} ⇒ A 1 = (1, ∞), A 2 = [1, 2], ...
2 Ω = {x| 1.5 < x < 5} ⇒ A 1 = (1, 3), A 2 = [2, 3.5], ...
3 Ω = {l ow, mi ni um, hi g h} ⇒ A 1 = {l ow, mi ni um},
A 2 = {l ow}, ...

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

An event A is a subset of the sample space of a random

experiment. (= statement, sentence, clause)
A null event is the one never happened, denoted by ;.
A true event is the one always happened, denoted by Ω.

E XAMPLE 2
Recycle time of a flash
1 Ω = R+ = {x| x > 0} ⇒ A 1 = (1, ∞), A 2 = [1, 2], ...
2 Ω = {x| 1.5 < x < 5} ⇒ A 1 = (1, 3), A 2 = [2, 3.5], ...
3 Ω = {l ow, mi ni um, hi g h} ⇒ A 1 = {l ow, mi ni um},
A 2 = {l ow}, ...
4 Ω = {yes, no}, ⇒ A 1 = {yes}, A 2 = {no}.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

O PERATIONS

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

O PERATIONS
1 The complement of event A is an event which consists of all
outcomes in the sample space that are not in A: A = Ω\A. Also
denoted by A c or A 0 .

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

O PERATIONS
1 The complement of event A is an event which consists of all
outcomes in the sample space that are not in A: A = Ω\A. Also
denoted by A c or A 0 .
2 The product of two events A and B is the intersection of A and
B which consist of all outcomes that are both in A and in B :
AB = A ∩ B = {x : x ∈ A and x ∈ B }.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

O PERATIONS
1 The complement of event A is an event which consists of all
outcomes in the sample space that are not in A: A = Ω\A. Also
denoted by A c or A 0 .
2 The product of two events A and B is the intersection of A and
B which consist of all outcomes that are both in A and in B :
AB = A ∩ B = {x : x ∈ A and x ∈ B }.
3 The sum of two events A and B is the union of A and B which
consist of all outcomes that are in A or in B :
A + B = A ∪ B = {x : x ∈ A or x ∈ B }.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

O PERATIONS
1 The complement of event A is an event which consists of all
outcomes in the sample space that are not in A: A = Ω\A. Also
denoted by A c or A 0 .
2 The product of two events A and B is the intersection of A and
B which consist of all outcomes that are both in A and in B :
AB = A ∩ B = {x : x ∈ A and x ∈ B }.
3 The sum of two events A and B is the union of A and B which
consist of all outcomes that are in A or in B :
A + B = A ∪ B = {x : x ∈ A or x ∈ B }.
4 The different between A and B is the event which consist of all
outcomes that are in A but not in B :
A − B = A\B = {x : x ∈ A and x ∉ B }.
Dr. Phan Thi Huong Probability and Statistics
 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

M UTUALLY EXCLUSIVE EVENTS
If AB = ;, we say that A and B are disjoint, or mutually exclusive,
e.i, A and B cannot simultaneously occur.

EXHAUSTIVE EVENTS
A set of n events A 1 , A 2 , . . . , A n is called an exhaustive set if and only
if (
A i .A j = ;, i , j ∈ 1, n
A1 + A2 + · · · + An = Ω

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

A LGEBRA OF EVENTS ’ OPERATIONS

1 De Morgan’s Rules
A + B = A B.
AB = A + B .
2 Distributive law
A(B +C ) = AB + AC .
A + (BC ) = (A + B )(A +C ).
3 Difference laws
A − (B +C ) = (A − B )(A −C )
A − (BC ) = (A − B ) + (A −C )

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

E XAMPLE 3
Suppose that the recycle times of two cameras are recorded. If the
objective of the analysis is to consider only whether or not the
cameras conform to the manufacturing specifications, either
camera may or may not conform. We abbreviate yes and no as y
and n. If the ordered pair (yn) indicates that the first camera
conforms and the second does not, write below events by notations.

(A) The sample space Ω.

(B) At least one camera conforms E 1 .
(C) Both cameras do not conform E 2 .

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

S AMPLE S PACES AND E VENTS

E XAMPLE 4
Disks of polycarbonate plastic from a supplier are analyzed for
scratch and shock resistance. The results from 100 disks are
summarized here:
Shock Resistance

High Low

Scratch High 70 9
Resistance Low 16 5

Let A denote the event that a disk has high shock resistance, and let
B denote the event that a disk has high scratch resistance.
Determine the number of disks in A.B , A, and A + B .
Dr. Phan Thi Huong Probability and Statistics
 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

D EFINITIONS AND I NTERPRETATIONS P ROBABILITY

I NTERPRETATIONS OF P ROBABILITY
Probability is used to quantify the likelihood or chance that a
particular outcome or event from a random experiment will occur.
The likelihood of an outcome is quantified by assigning a number
from the interval [0, 1] to the outcome.

E QUALLY L IKELY O UTCOMES

If all outcomes in a finite set Ω are equally likely, the probability of
A is the number of outcomes in A divided by the total number of
outcomes:

#A
P (A) =
#Ω

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

E XAMPLE 5
If the last digit of a weight measurement is equally likely to be any
of the digits 0 through 9,
(A) What is the probability that the last digit is 0?
(B) What is the probability that the last digit is greater than or
equal to 5?

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

I NTERPRETATIONS AND A XIOMS OF P ROBABILITY

F REQUENCIES
A relative frequency is a proportion measuring how often, or how
frequently, something or other occurs in a sequence of
observations. Think of some experiment which can be repeated n
trial. Let A be a possible result of such a trial. If A happens m times
m
in n trials, then f n (A) = is the relative frequency of A in the n
n
trials. Then,
m
P (A) = lim f n (A) = (1)
n→∞ n
or
f n (A) ≈ P (A)
for large n.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

I NTERPRETATIONS AND A XIOMS OF P ROBABILITY

F REQUENCIES
A relative frequency is a proportion measuring how often, or how
frequently, something or other occurs in a sequence of
observations. Think of some experiment which can be repeated n
trial. Let A be a possible result of such a trial. If A happens m times
m
in n trials, then f n (A) = is the relative frequency of A in the n
n
trials. Then,
m
P (A) = lim f n (A) = (2)
n→∞ n
or
f n (A) ≈ P (A)
for large n.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

I NTERPRETATIONS AND A XIOMS OF P ROBABILITY

E XAMPLE 6
Suppose a coin is tossed and recorded the number of head.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

I NTERPRETATIONS AND A XIOMS OF P ROBABILITY

G EOMETRIC PROBABILITY
Consider an experiment with equally likely outcomes, infinite
sample space Ω. Let A be an event of this experiment. If both of Ω
and A can be illustrated by geometric regions,

the measure of the region of A |A|

P (A) = = . (3)
the measure of the region of Ω |Ω|

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

I NTERPRETATIONS AND A XIOMS OF P ROBABILITY

E XAMPLE 7
If a point M is randomly chose inside the triangle OAB. Find the
probability that M is in the quadrangle OACD.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

I NTERPRETATIONS AND A XIOMS OF P ROBABILITY

A XIOMS OF P ROBABILITY
Denote by A the collection of all events. Probability is a function

P : A → [0, 1]

such that

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

I NTERPRETATIONS AND A XIOMS OF P ROBABILITY

A XIOMS OF P ROBABILITY
Denote by A the collection of all events. Probability is a function

P : A → [0, 1]

such that
1 P(A) ≥ 0, ∀A ∈ A

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

I NTERPRETATIONS AND A XIOMS OF P ROBABILITY

A XIOMS OF P ROBABILITY
Denote by A the collection of all events. Probability is a function

P : A → [0, 1]

such that
1 P(A) ≥ 0, ∀A ∈ A
2 P(Ω) = 1

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

I NTERPRETATIONS AND A XIOMS OF P ROBABILITY

A XIOMS OF P ROBABILITY
Denote by A the collection of all events. Probability is a function

P : A → [0, 1]

such that
1 P(A) ≥ 0, ∀A ∈ A
2 P(Ω) = 1
3 P(;) = 0

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

I NTERPRETATIONS AND A XIOMS OF P ROBABILITY

A XIOMS OF P ROBABILITY
Denote by A the collection of all events. Probability is a function

P : A → [0, 1]

such that
1 P(A) ≥ 0, ∀A ∈ A
2 P(Ω) = 1
3 P(;) = 0
4 For two disjoint events A and B

P (A + B ) = P (A) + P (B )

For any event A ∈ A , P(A) is called the probability of A.

Dr. Phan Thi Huong Probability and Statistics
 Basic concepts of events and probability.
Addition rule and Product rule. Sample Spaces and Events
Total probability formula and Bayes formula. Definitions and Interpretations Probability
Independence

I NTERPRETATIONS AND A XIOMS OF P ROBABILITY

P ROPERTIES OF P ROBABILITY
1 0 ≤ P(A) ≤ 1.
2 P(A) = 1 − P(A).
3 For a sequence of disjoint events A 1 , . . . , A n

P(A 1 + . . . A n ) = P(A 1 ) + · · · + P(A n )

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

A DDITION RULE

1 For two events

P(A + B ) = P(A) + P(B ) − P(AB )

2 For three events

P(A+B +C ) = P(A)+P(B )+P(C )−P(AB )−P(AC )−P(BC )+P(ABC )

Note the alternating signs.

3 In general,
à !
P A i = P(A i ) − P(A i A j A k ) − . . .
X X X X
P (A i A j ) +
i i i<j i , j ,k

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

A DDITION RULE

E XAMPLE 8
Consider the semiconductor wafer data in the table below.

A wafer is randomly selected from the batch. Let H denote the

event that the chosen wafer contains high levels of contamination.
Let C denote the event that the wafer is in the center of a sputtering
tool. Compute P(H ), P(C ), P(HC ) and P(H +C ).

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

A DDITION RULE

E XAMPLE 9
In a big company, they announced a new requirement that staffs
have to able to speak at least one of three foreign languages
including English, Chinese, or Japanese. Then they have reported as
below:
There are respectively 46.45, 40, and 42.58 percentage of staffs can
speak English, Chinese and Japanese. Furthermore, 12.9% of them
can speak both English and Chinese, 15.48% of them can speak
both English and Japanese, 12.9% of them can speak both Japanese
and Chinese. Also, 5.16% of staffs able to speak all three languages.
Compute the percentage of staffs confirm this new requirement.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

C ONDITIONAL PROBABILITY

A communications channel has an error rate of 1 per 1000 bits

transmitted. Errors are rare, but do tend to occur in bursts. If a bit is
in error, the probability that the next bit is also in error is greater
that. ⇒ Sometimes probabilities need to be reevaluated as
additional information becomes available.
D EFINITION 2.1
The probability of an event B under the knowledge that the
outcome will be in event A is denoted as P (B |A) and this is called
the conditional probability of B given A.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

C ONDITIONAL PROBABILITY

F ORMULA OF CONDITIONAL PROBABILITY

Let two events A and B where P (B ) > 0. The conditional probability
of event A given event B is

P (AB )
P (A|B ) = , P (B ) > 0 (4)
P (B )

Similarly, where P (A) > 0, the conditional probability of event B

given event A is

P (AB )
P (B |A) = , P (A) > 0 (5)
P (A)

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

C ONDITIONAL PROBABILITY

E XAMPLE 10
An example of 400 parts classified by surface flaws and as
(functionally) defective.

Suppose that a part is chosen randomly, compute the following

probability.
(A) The chosen part is defective.
(B) The chosen part is defective given that it has surface flaws.
(C) The chosen part is defective given that it has no surface flaws.
Dr. Phan Thi Huong Probability and Statistics
 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

C ONDITIONAL PROBABILITY

P ROPERTIES OF CONDITIONAL PROBABILITY

1 0 ≤ P (A|B ) ≤ 1
2 P (B |B ) = 1
3 If AC = ;, P [(A +C )|B ] = P (A|B ) + P (C |B )
4 P ( Ā|B ) = 1 − P (A|B )

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

M ULTIPLICATION RULE

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

M ULTIPLICATION RULE

For two events A and B

P(AB ) = P(A|B )P(B ) = P(B |A)P (A)

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

M ULTIPLICATION RULE

For two events A and B

P(AB ) = P(A|B )P(B ) = P(B |A)P (A)

For three events A, B and C

P(ABC ) = P(A|BC )P(B |C )P(C )

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

M ULTIPLICATION RULE

For two events A and B

P(AB ) = P(A|B )P(B ) = P(B |A)P (A)

For three events A, B and C

P(ABC ) = P(A|BC )P(B |C )P(C )

In general,

P(A 1 A 2 . . . A n ) = P(A n |A 1 . . . A n−1 )P(A n−1 |A 1 . . . A n−2 ) . . . P(A 2 |A 1 )P(A 1 )

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

M ULTIPLICATION RULE

E XAMPLE 11
The bin contains 3 defective parts and 47 nondefective parts.
(A) Two parts are randomly chosen from the bin. What is the
probability that the second part is defective given that the first
part is defective?
(B) Three parts are randomly chosen from the bin. What is the
probability that the first two parts selected are defective and
the third is not defective?

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

T OTAL PROBABILITY FORMULA

For two events A and B ,

P (A) = P (A|B )P (B ) + P (A|B )P (B )

In general, assume A 1 , A 2 , . . . , A n are n mutually exclusive and

exhaustive sets, e.i A i ∩ A j = ; and ∪i A i = Ω. Then,

P (B ) = P (A 1 )P (B |A 1 ) + P (A 2 )P (B |A 2 ) + ... + P (B |A n )P (A n )
Xn
= P (A i )P (B |A i )
i =1

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

T OTAL PROBABILITY FORMULA

E XAMPLE 12
Information about product failure based on chip manufacturing
process contamination is given below. Find the probability of
failure.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

B AYSE FORMULA

For two events A and B .Then,

P(A|B )P(B )
P(B |A) =
P(A)

In general, assume A 1 , A 2 , . . . , A n are n mutually exclusive and

exhaustive sets, e.i A i ∩ A j = ; and ∪i A i = Ω. Then,

P(A i )P(B |A i ) P(A i )P(B |A i )

P(A i |B ) = = Pn
P(B ) i =1 P(A i )P(B |A i )

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

B AYSE FORMULA

E XAMPLE 13
Because a new medical procedure has been shown to be effective in
the early detection of an illness, a medical screening of the
population is proposed. The probability that the test correctly
identifies someone with the illness as positive is 0.99, and the
probability that the test correctly identifies someone without the
illness as negative is 0.95. The incidence of the illness in the general
population is 0.0001. If a person takes the test, compute the
following probabilities.
(A) His result is positive.
(B) He has the illness in case the test shows a positive result.
(C) The test is performing correctly.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

B AYSE FORMULA

E XAMPLE 14
The conditional probability that a high level of contamination was
present when a failure occurred is to be determined. The
information is summarized in the table below.

Suppose that a failed product has been taken, compute the chance
that it has high levels of contamination.

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

I NDEPENDENCE

Two events are independent if any one of the following

equivalent statements is true:
1 P(AB ) = P(A).P(B )
2 P(A|B ) = P(A)
3 P(B |A) = P(B )
The event A 1 , A 2 , ..., A n are independent if and only if for any
subset of these events

P(A i 1 A i 2 . . . A i k ) = P(A i 1 )P(A i 2 ) . . . P(A i k )

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

I NDEPENDENCE

E XAMPLE 15
Disks of polycarbonate plastic from a supplier are analyzed for
scratch and shock resistance. The results from 100 disks are
summarized as follows:

Let A denote the event that a disk has high shock resistance, and let
B denote the event that a disk has high scratch resistance. Are
events A and B independent?

Dr. Phan Thi Huong Probability and Statistics

 Basic concepts of events and probability.
Addition rule and Product rule.
Total probability formula and Bayes formula.
Independence

I NDEPENDENCE

E XAMPLE 16
The following circuit operates if and only if there is a path of
functional devices from left to right. The probabilities that each
device functions are as shown where p = 0.9. Assume that the
probability that a device is functional does not depend on whether
or not other devices are functional. What is the probability that the
circuit operates?

Dr. Phan Thi Huong Probability and Statistics