1 EC108 Estimation and Confidence Interval
1 EC108 Estimation and Confidence Interval
One
Population
Estimating the Value of a Parameter
Using Confidence Intervals
Chapter Outline
1
4
Introduction
Introduction
• In this chapter we address these and other
types of situations that require an estimate of
some population parameter.
• Inferential statements concerning estimates of a
single population parameter , based on
information contained in a random sample are
discussed
• Specifically, we focus on the procedures to
estimate the mean of a population, a proportion
of a population members and the variance of
the population
Overview
• We apply the results about the sample
mean to the problem of estimation
• Estimation is the process of using sample
data to estimate the value of a population
parameter
• We will quantify the accuracy of our
estimation process
Statistical Inference
• Its most important in decision making process
in economics, business and science
• Statistical Estimation involves the use of
sample statistics to predict the corresponding
population parameters.
• Statistical Inference refers to the estimation
and hypothesis testing
• Estimation is the process of inferring or
estimating a population parameter (such as its
mean or standard deviation) from the
corresponding statistic of a sample drawn from
a population
Statistical Estimation
Point estimator and point estimate
and CI estimator
• Lets take note of the following
• A point estimate is a single number,
– How much uncertainty is associated with a point estimate of a
population parameter? A point estimate is highly unreliable measure
of a population parameter as the probability that it will exactly
equal the true value is extremely small
• An interval estimate provides more information about a population
characteristic than does a point estimate. It provides a confidence level for
the estimate. Such interval estimates are called confidence intervals. CI
offers a range of values within which the population parameter is
expected to fall
Upper
Lower
Confidence Confidence
Point Estimate
Limit Limit
Width of
confidence interval
Point estimate
• A point estimator should be:
• 1. Unbiased
• 2. Most efficient
• (read more about this)
• An interval gives a range of values:
– Takes into consideration variation in sample
statistics from sample to sample
– Based on observations from 1 sample
– Gives information about closeness to unknown
population parameters (it provides information
about how close the point estimate, provided by the
sample, is to the value of the population parameter)
– Stated in terms of level of confidence. (Can never
be 100% confident)
• The general formula for all confidence intervals is
equal to:
Point Estimate ± (Critical Value)(Standard Error)
1
Learning Objectives
Confidence Interval Estimation of
Population Mean, μ, when σ is known
• Our objective is to find a range of values, rather
than a single number, to estimate a population
mean (This may look unrealistic since population
variance is usually unavailable )
• Assumptions
– Population standard deviation σ is known
– Population is normally distributed
– If population is not normal, use large sample
σ
• Confidence interval estimate: x = X Z
n
(where Z is the normal distribution’s critical value for a probability of α/2
in each tail)
• Consider a 95% confidence interval:
1 − = .95 = .05 / 2 = .025
α .475 .475 α
= .025 = .025
2 2
Z
Z= -1.96 0 Z= 1.96
Lower Upper
Confidence Point Estimate Confidence
Limit Limit
μ
μl μu
The confidence interval for a
single population mean, μ, is
given as
Confidence Interval and
Confidence Level
• Simple example
Confidence Interval Estimation for the Mean of a
Population That is Normally Distributed: Population
Variance Known
Example CI
Estimation
• The environment of our problem is that,
we want to estimate the value of an
unknown population mean
• The process that we use is called
estimation
• This is one of the most common goals of
statistics
Point Estimate
• Estimation involves two steps
– Step 1 – to obtain a specific numeric estimate,
this is called the point estimate
– Step 2 – to quantify the accuracy and
precision of the point estimate
• The first step is relatively easy
• The second step is why we need statistics
Examples of Point Estimate
• Some examples of point estimates are
– The sample mean to estimate the population
mean
– The sample standard deviation to estimate
the population standard deviation
– The sample proportion to estimate the
population proportion
– The sample median to estimate the
population median
Precision of Point Estimate
• The most obvious point estimate for the
population mean is the sample mean
• Now we will use the material on the
sampling distribution of sample mean to
quantify the accuracy and precision of this
point estimate
Example
• An example of what we want to quantify
– We want to estimate the miles per gallon for a
certain car
– We test some number of cars
– We calculate the sample mean …eg. it is 27
and CI is 25-29
– 27 miles per gallon would be our best guess
Example (continued)
• How sure are we that the gas economy is
27 and not 28.1, or 25.2?
• We would like to make a statement such
as
“We think that the mileage is 27 mpg
and we’re pretty sure that we’re
not too far off”
Interval Estimation
• A confidence interval for an unknown parameter is an
interval of numbers
– Compare this to a point estimate which is just one
number, not an interval of numbers ( a range of
numbers)
• The level of confidence represents the expected
proportion of intervals that will contain the parameter if
a large number of different samples is obtained
• The confidence interval quantifies the accuracy and
precision of the point estimate
• the larger the sample size, the narrower the interval
estimates that reflect our uncertainty about a
parameter’s true value
Interpret Confidence level
What does the level of confidence represent?
• If we obtain a series of 50 random samples from
a population of interest
• Follow a process for calculating confidence
intervals for population mean with a 90% level of
confidence from each of the sample means
• Then, we would expect that 90% of those 50
confidence intervals (or about 45) would contain
our population mean
Confidence Level
• The level of confidence is always
expressed as a percent
• The level of confidence is described by a
parameter α (i.e.,alpha)
• The level of confidence is (1 – α) • 100%
– When α = .05, then (1 – α) = .95, and we have
a 95% level of confidence
– When α = .01, then (1 – α) = .99, and we have
a 99% level of confidence
Confidence Interval
• If we expect that a method would create
intervals that contain the population mean
90% of the time, we call those intervals
90% confidence intervals
• If we have a method for intervals that
contain the population mean 95% of the
time, those are 95% confidence intervals
• And so forth
Summary
• To tie the definitions together
– We are using the sample mean to estimate the
population mean ..(Point estimate)
– With each specific sample, we can construct a ,for
instance, 95% confidence interval to estimate the
population mean… (Interval estimate)
– 95% confidence interval tells you that If we take
samples repeatedly, we expect that 95% of these
intervals would contain the population mean
Example
• Back to our 27 miles per gallon car
“We think that the mileage is 27 mpg
and we’re pretty sure that
we’re not too far off”
• Putting in numbers (quantify the accuracy)
“We estimate the gas mileage is 27 mpg
and we are 90% confident that
the real mileage of this model of car
is between 25 and 29 miles per gallon”
Example (continued)
“We estimate the gas mileage is 27 mpg”
• This is our point estimate
“and we are 90% confident that”
• Our confidence level is 90% (which is 1- α ,
i.e. α = 0.10)
“the real mileage of this model of car”
• The population mean
“is between 25 and 29 miles per gallon”
• Our confidence interval is (25, 29)
Known Population Standard
Deviation
• First, we assume that we know the
standard deviation of the population (σ)
• This is not very realistic … but we need it
for right now to introduce how to construct
a confidence interval
• We’ll solve this problem in a better way
(where we don’t know what σ is) later…
but first we’ll do this one
Assumption
To estimate the mean with a known s, we
need a normal distribution assumption for
the sampling distribution of mean.
Assumption satisfied by:
1. Knowing that the sampled population is normally
distributed, or
2. Using a large enough random sample
Central Limit Theory
Go and read this part!!
Sampling Distribution of Means
• The values of a general normal random variable are within 1.96
times (or about 2 times according to empirical rule) its standard
deviation away from its mean 95% of the time
• Thus the sample mean is within
s
± 1.96
n
of the population mean 95% of the time
s
Here, s =
x
n
Interval for Sample Mean
• Because the sample mean has an approximately
normal distribution, it is in the interval
s
1.96
n
around the (unknown) population mean 95% of the
time. In other words, the interval will cover 95% of
possible sample means, when you take samples from
the population repeatedly.
s
• Since X = 1.96 , we can flip the equation around
n
between μ and X to solve for the population mean μ
Interval for Population Mean
• After we solve for the population mean μ, we
find that μ is within the interval
s
x 1.96
n
around the (known) sample mean “95% of the
time”
• This isn’t exactly true in the mathematical sense
as the population mean is not a random variable
… that’s why we call this a “confidence” instead
of a “probability”
Confidence Interval
• Thus a 95% confidence interval for the
Population mean is
s
x 1.96
n
s
mean s
X =
n
• and use Student’s t-distribution, which
depends on sample size for inference.
The t-distribution
• For samples under 120 or so,
the difference between the
sample distribution s and the
normal distribution σ can be
large, the smaller the sample
the larger the difference
• Degrees of freedom
capture the sample
size, In our case= n - 1
Confidence Intervals w/out σ
• Example: Randomly sampling 16 students for their GPA,
you get a sample mean of 3.0 and sample std. deviation (s)
of 0.4
t = (X − ) /
s s
rewriting = X t
n n
s 1
x t = 6.4 2.145 = 6.4 0.55
n 15
What happens to CI as
sample gets larger?
s
x Z
For large samples:
n Z and t values
become almost
identical, so CIs are
s almost identical.
x t
n
Properties of t-distribution
• Several properties are familiar about the Student’s t
distribution
– Just like the normal distribution, it is centered at 0
and symmetric about 0
– Just like the normal curve, the total area under
the Student’s t curve is 1, the area to left of 0 is
½, and the area to the right of 0 is also ½
– Just like the normal curve, as t increases, the
Student’s t curve gets close to, but never
reaches, 0
Difference between Z and t
• So what’s different?
• Unlike the normal, there are many different “standard”
t-distributions
– There is a “standard” one with 1 degree of freedom
– There is a “standard” one with 2 degrees of
freedom
– There is a “standard” one with 3 degrees of
freedom
– Etc.
• The number of degrees of freedom is crucial for the t-
distributions
t-statistic
• When σ is known, the z-score
x−
z=
s/ n
follows a standard normal distribution
• When σ is not known, the t-statistic
x−
t=
s/ n
follows a t-distribution with n – 1(sample size
minus 1) degrees of freedom
t-distribution
• Comparing three curves
– The standard normal curve
– The t curve with 14 degrees of freedom
– The t curve with 4 degrees of freedom
t-distribution
• Take note
Determine t-values
Calculation of t-distribution
• The calculation of t-distribution values t
can be done in similar ways as the
calculation of normal values z
– Using tables
– Using technology – TI graphing Calculator
Probability of exceeding the critical value
0.10 0.05 0.025 0.01 0.005 0.001
1. 3.078 6.314 12.706 31.821 63.657 318.313
Use a t-table shown to find a critical value 2. 1.886 2.920 4.303 6.965 9.925 22.327
(one tail) 3. 1.638 2.353 3.182 4.541 5.841 10.215
Upper critical values of Student's t 5. 1.476 2.015 2.571 3.365 4.032 5.893
distribution with n degrees of freedom 6. 1.440 1.943 2.447 3.143 3.707 5.208
Or use TI graphing calculator to find 17. 1.333 1.740 2.110 2.567 2.898 3.646
s to x + t s
x − t 0.025 0.025
n n
where t0.025 is the critical value for the
t-distribution with (n – 1) degrees of freedom
to
0.29
1.38 + 2.447 = 1.65
7
or (1.11, 1.65)
Example 2
Suppose you do a study of acupuncture to determine how effective it is in
relieving pain. You measure sensory rates for 15 subjects with the results
given below. Use the sample data to construct a 95% confidence interval for
the mean sensory rate for the population (assumed normal) from which you
took the data.
8.6; 9.4; 7.9; 6.8; 8.3; 7.3; 9.2; 9.6; 8.7; 11.4; 10.3; 5.4; 8.1; 5.5; 6.9
Solution (Do in groups)
To find the confidence interval, first we need to find the sample mean. Since
population standard deviation is not given and we have the sample data to
calculate the sample standard deviation, we can construct a t-confidence interval
for estimating the mean.
Use TI calculator entering the data and obtain one-variable statistics. We obtain
X = 8.2267 and s =1.6722, where n = 15
Critical value is t 0.025;df =14 = 2.145
1.6722
8.2267 2.145
95% confidence interval is 15 ; Between 7.30 and 9.15
Example 3
Check the underlying distribution
• When apply a t-interval, we need to make sure the
underlying population is approximately normally
distributed.
• When the sample size is small, outlier of the data will
have a major affect on the data set, because outliers will
affect the calculation of sample mean and sample
standard deviation.
• So what can we do?
– For a small sample, we always must check to see that
the outlier is a legitimate data value (and not just a
typo)
– We can collect more data, for example to increase n
to be over 30. Apply the central limit theorem, we can
use a z-interval to approximate a t-interval.
Summary
• We used values from the normal
distribution when we knew the value of the
population standard deviation σ
• When we do not know σ, we estimate σ
using the sample standard deviation s
• We use values from the t-distribution when
we use s instead of σ, i.e. when we don’t
know the population standard deviation
3. Confidence Intervals
about a
Population Proportion
Some scenarios
• What proportion of the students at BUSE
would like classes to be offered on
Saturdays?
• What percent of students in SADC expect
to pursue doctoral degrees?
• What proportion of registered voters will
vote for a particular candidate in an
upcoming election?
• In all these examples, the proportion of
population members possessing some
specific characteristic is of interest
Learning Objectives
• Obtain a point estimate for the population
proportion
• Construct and interpret a confidence interval
for the population proportion
• Determine the sample size necessary for
estimating a population proportion within a
specified margin of error
Obtain a point estimate for the
population proportion
Mean & Proportion
• So far, we learned to calculate confidence
intervals for the population mean, when we
knew σ and
• We also learned to calculate confidence
intervals for the mean, when we did not know
σ
• Here, we’ll learn how to construct confidence
intervals for situations when we are analyzing
a population proportion
• The issues and methods are quite similar
Sample Proportion
• When we analyze the population mean, we use
the sample mean as the point estimate
– The sample mean is our best guess for the
population mean
p(1 − p)
s pˆ =
n
pˆ (1 − pˆ ) pˆ (1 − pˆ )
pˆ − z / 2
n
to pˆ + z / 2 n
to
0.47 0.53
0.47 + 2.575 = 0.53
500
0.5 0.5
2.575 = .01
n
so
2
2.575
n = 0.25
.01
and n = 16,577
Example 1 (continued)
• We understand now why political polls
often have a 3 or 4 percentage points
margin of error
• Since it takes a large sample (n = 16,577)
to get to be 99% confident to within 1
percentage point, the 3 or 4 percentage
points margin of error targets are good
compromises between accuracy and cost
effectiveness
Sample Size Determination
• We can write this as a formula
• The sample size n needed to result in a margin
of error E% for (1 – α) • 100% confidence for a
population proportion is
(Z ) 2
p̂ (1 − p̂ )
n= /2
(E% )2
• Usually we don’t get an integer for n, so we
would need to take the next higher number (the
one lower wouldn’t be large enough)
Example 2
Determine the sample size necessary to estimate the true
proportion of laboratory mice with a certain genetic defect. We
would like the estimate to be within 0.015 with 95% confidence.
Solution:
1. Level of confidence: 1 − = 0.95, z/2 = 1.96
2. Desired maximum error is E = 0.015.
3. No estimate of p given, use p̂ = 0.5
n= /2
= = 4268.44 4269
( E% ) 2
(0.015
2
)
Example 2 (continued)
Suppose we know the genetic defect occurs in approximately 1 of
80 animals
Use: p̂ = 1 / 80 = 0.0125
(Z ) 2
p̂ (1 − p̂ )
n= /2
(E% )2
=
(1.96) (0.0125)(0.9875) = 210.75 211
2
(0.015) 2
pˆ (1 − pˆ ) to pˆ (1 − pˆ )
pˆ − z / 2 pˆ + z / 2
n n
Summary
• The main questions that determine the
confidence interval to use:
• Is it a
– Population mean?
– Population proportion?
• In the case of a population mean, we need to
determine
– Is the population variance known?
– Does the data look reasonably normal?
Estimating the Value of a
Parameter
Using Confidence Intervals
Summary
• We can use a sample {mean, proportion} to
estimate the population {mean, proportion}
• In each case, we can use the appropriate
sampling distribution of the sample statistic to
construct a confidence interval around our
estimate
• The confidence interval expresses the
confidence we have that our calculated interval
contains the true parameter
REFERENCE