Module I Probability (1)
Module I Probability (1)
MODULE
IV
PROBABIL
ITY
Dr. Divya P. Velayudhan
Assistant Professor
SIMS, Kodakara
Introduction to Probability
• What is probability?
Population Sample
Statistics
5
What is Probability?
Experiment Experimental
Outcomes
Toss a coin Head, tail
Select a part for inspection Defective,
nondefective
Conduct a sales call Purchase, no purchase
Roll a die 1, 2, 3, 4, 5, 6
Play a football game Win, lose, tie
9
Basic Concepts
Equally likely Events: Two events are said to be equally likely if anyone of them cannot be
expected to occur in preference to other. For example, getting herd and getting tail when a
coin is tossed are equally likely events.
Mutually exclusive events: A set of events are said to be mutually exclusive of the
occurrence of one of them excludes the possibility of the occurrence of the others.
Exhaustive Events: A group of events is said to be exhaustive when it includes all possible
outcomes of the random experiment under consideration.
Dependent Events: Two or more events are said to be dependent if the happening of one of
them affects the happening of the other.
17
Basic Concepts
–D: observe a 3
18
Example
Toss a die:
11 E1
22
S ={E1, E2, E3, E4,
E2
E5, E6} S
33
E3 •E1 •E3
44
E4 •E5
55
E5 •E2 •E4 •E6
66
E6
Simple events Sample space
19
20
Basic Concepts
S
•E1 •E3
•The die toss: A •E5
– A: an odd number B
– B: a number > 2 •E2 •E4 •E6
A ={E1, E3,
E5}
B ={E3, E4, E5,
An eventE
is6}
a collection of one or more
21
The Probability of an Event
•• The
The probability
probability ofof an
an event
event A A is
is
found
found by
by adding
adding the
the probabilities
probabilities of
of all
all
the
the simple
simple events
events contained
contained in
in A.
A.
23
Using Simple Events
=
=1/4
1/4+
+1/4
1/4+
+1/4
1/4=
=3/4
3/4
H
H TH
TH 1/4
TT
TT
1/4
TT TT
26
Limitations
Problem when applied in case of less orderly decision
problems
Assumes away situations that are unlikely but that
could conceivably happen (coin landing on its edge)
Assumes a kind of symmetry about the world
ASREAL LIFE SITUATIONS ARE DISORDERLY AND
UNLIKELY
33
Relative Frequency of Occurrence
Addition Theorem
Here, there are 2 situations.
(a) Events are mutually exclusive
(b) Events are not mutually exclusive
39
Theorems of Probability
1. A bag contains 5 white balls and 8 black balls. One ball is drawn
at random from the bag and is then replaced. Again another one is
drawn. Find the probability that both the balls are white.
2. Single coin is tossed for three times. What is the probability of
getting head in all the 3 times?
45
1. A bag contains 5 white balls and 8 black balls. One ball is drawn
at random from the bag. Again, another one is drawn without
replacing the first ball. Find the probability that both the balls
drawn are white.
47
Exercise
2. The probability that ‘A’ solves a problem in Maths is 2/5 and the
probability that ‘B’ solves it is 3/8. If they try independently find the
probability that :-
(i) Both solve the problem.
(ii) at least one solve the problem.
(iii) none solve the problem.
48
• P(AB)=P(A)⋅P(B)
4. ‘A’ speaks truth in 70%cases and ‘B’ in 85% cases. In what percentage of
cases they likely to contradict each other in stating the same fact?
53
5. 20% of students in a university are graduates and 80% are undergraduates. The
probability that graduate student is married is 0.50 and the probability that an
undergraduate student is married is 0.10. If one student is selected at random, what
is the probability that the student selected is married?
55
6. Two sets of candidates are competing for the position on the board of directors
of a company. The probability that the first and second sets will win are 0.6 and 0.4
respectively. If the first set wins, the probability of introducing a new product is 0.8
and the corresponding probability if the second set wins is 0.3. What is the
probability that the new product will be introduced?
63
Probabilities under Conditions of
Statistical Independence
Two
Two events,
events, A A and
and B, B, are
are said
said to
to be
be Statistically
Statistically
independent
independent ifif the
the occurrence
occurrence or
or non-occurrence
non-occurrence ofof
one
one of
of the
the events
events does
does not
not change
change thethe probability
probability of
of
the
the occurrence
occurrence of
of the
the other
other event.
event.
Three types of Probabilities under Statistical
Independence:
Marginal
Joint
Conditional
64
Marginal Probabilities Statistical
Independence
“given
Two
Two events
events AA and ” independent
and BB are
are independent ifif and
and only
only ifif
P(A|B)
P(A|B) =
= P(A)
P(A) or
or P(B|A)
P(B|A) =
= P(B)
P(B)
Otherwise,
Otherwise, they
they are
are dependent.
dependent.
67
Example 1
P ( A B ) P ( A) P ( B ) P ( A B )
A B
Example: Additive 76
Rule
P(AB)
P(AB) =P(A)
=P(A) +
+ P(B)
P(B) ––
P(AB)
P(AB)
=
= 6/36
6/36 +
+ 6/36
6/36 –– 1/36
1/36
78
A Special Case
A and B are
P(AB)
P(AB) == P(A)
P(A) +
+
mutually exclusive, P(B)
P(B)
so that =
= 20/120
20/120 +
+ 30/120
30/120
Example: Two Dice
A: dice add to 3
B: dice add to 6
A and B are
mutually exclusive,
so that
P(AB)
P(AB) =
= P(A)
P(A) +
+
P(B)
P(B)
=
= 2/36
2/36 +
+ 5/36
5/36
Calculating 80
Probabilities
for Complements
We know that for any event A:
P(A AC) = 0 AC
for Intersections
For any two events, A and B, the probability that both A
and B occur is
P(A B) =
P(A B) = P(A)
P(A) P(B
P(B given
given that
that A
A
occurred)
occurred) =
= P(A)P(B|A)
P(A)P(B|A)
P(A B) =
P(A B) = P(A)
P(A)
Bayes’ Rule
Steps in computation
1. Find the prior probability
2. Find the conditional probability.
3. Find the joint probability by multiplying step 1 and step 2.
4. Find posterior probability as percentage of total joint probability.
85
POSTERIOR PROBABILITIES
1.0 P(Ace) =
0.55
87
MALE FEMALE
Btech 20 10 3
0
Non Btech 30 20 5
0
5 3
0 0 8
0
89
Marginal Probability
P(Male) = 50/80
P(Btech) = 30/80
Joint Probability
P(Btech Male) = 20/80
P(Male Non Btech) = 30/80
Conditional Probability
P(Male|Btech) = 20/30
P(Btech|Male) = 20/50
90
3. The probability that a doctor will diagnose a particular disease correctly is 0.6. The
probability that a patient will die by his treatment after correct diagnosis is 0.4 and the
probability of death by wrong diagnosis is 0.7. A patient of the doctor who had the
disease died. What is the probability that his disease was not correctly diagnosed?
94
Exercise
4. There are two Urns, one containing 5 white balls and 4 black balls; and the other
containing 6 white balls and 5 black balls. One Urn is chosen and one ball is drawn. If
it is white, what is the probability that the Urn selected is the first?
Probability Distributions 95
P( A B)
3. Conditional probability: P( A | B)
P( B)
4. Independent and dependent events
5. Additive Rule of Probability:
P( A B) P( A) P( B) P( A B)