Mean and Variance of Sampling Distribution
Mean and Variance of Sampling Distribution
What is it . . .
Statisticians are interested to know how the means of the samples of the same
size taken from the same population vary about the population mean, not just on
simply describing the variation of the individual data values about the mean of the
population.
Example:
Consider a population consisting of 1, 2, 3, 4 and 5. Suppose samples of size 2 are
drawn from this population, what is the mean and variance of the sampling
distribution of the sample means?
Solution :
Step 1. Compute the mean of the population (µ). µ = ΣX = 1 + 2 + 3 + 4 + 5 = 3
N 5
Step 2. Compute the variance of the population (σ2).
X X ̶ µ (X ̶ µ)2
1 ̶ 2 4 σ2 = Σ(X - µ)2
2 ̶ 1 1 N
3 0 0 = 10
4 1 1 5
5 2 4 σ = 2
2
Σ(X ̶ µ)2 = 10
So the variance of the population σ2 = 2.
Step 3. Determine the number of possible samples of size n = 2. (Use a calculator)
NCn = 5C2 = 10
So there are 10 possible samples of size 2 that can be drawn.
Step 4. List all possible samples & their corresponding means.
(Refer to the 1st table below)
Step 5. Construct the sampling distribution of the sample means & compute the mean
of the sampling distribution of the sample means (µx).
(Refer to the 2nd table below)
Step 4. Step 5.
Samples Means Sample Means Frequency Probability
𝑋̅ (F) P(𝑋̅) 𝑋̅ • P(𝑋̅)
1, 2 1.5 1.5 1 1/10 0.15
1, 3 2 2 1 1/10 0.20
1, 4 2.5 2.5 2 2/10 or 1/5 0.50
1, 5 3 3 2 2/10 or 1/5 0.60
2, 3 2.5 3.5 2 2/10 or 1/5 0.70
2, 4 3 4 1 1/10 0.40
2, 5 3.5 4.5 1 1/10 0.45
3, 4 3.5 𝜇𝑥̅ = Σ[𝑋̅ • P(𝑋̅)] = 3
3, 5 4
4, 5 4.5
What have you observed of the mean, variance & standard deviation of the population
& the sampling distribution of the sample means?
What is it . . .
Properties of the Sampling Distribution of the Sample Means
1. The mean of the sampling distribution of the sample means is equal to the
population mean µ. That is, 𝜇𝑥̅ = µ.
2. The variance of the sampling distribution of the sample means σ is given by:
𝜎𝑥̅2 = σ2 • N ̶ n for finite population; & 𝜎𝑥̅2 = σ2 for infinite population.
n N ̶ 1 n
3. The standard deviation σ of the sampling distribution of the sample means is given
by:
𝜎𝑥̅ = σ2 • N̶ n for finite population where N ̶ n is the finite population
√𝑛 √N ̶ 1 √N ̶ 1 correction factor
𝜎𝑥̅ = σ2 for infinite population
√𝑛
The standard deviation 𝜎𝑥̅ of the sampling distribution of the sample means is
also known as the standard error of the mean. It measures the degree of accuracy of
the sample mean as an estimate of the population mean.
A good estimate of the mean is obtained if the standard error of the mean is
small or close to zero, while it is a poor estimate if the value is large.
Example:
A population consists of the five numbers 2, 3, 6, 8, 11. Consider all possible samples
of size 2 which can be drawn with replacements from this population. Find the mean
& standard deviation of the population & the mean & standard deviation of the
sampling distribution of the means.
Solution :
Step 1. µ = ΣX = 2 + 3 + 6 + 8 + 11 = 30 = 6
N 5 5
Step 2. Compute the variance of the population (σ2) & then the standard deviation (σ).
σ2 = (2-6)2 + (3-6)2 + (6-6)2 + (8-6)2 + (11-6)2 = (-4)2 + (-3)2 + (0)2 + (2)2 + (5)2
5 5
σ = 16 + 9 + 0 + 4 + 25 = 54 = 10.8 so σ = √10.8 = 3.29
2
5 5
Step 3. NCn = 5C5 = 25 samples of size 2 which can be drawn with replacement since
any one of the five numbers on the first draw can be associated with any of the five
numbers of the second draw.
Step 4. List all possible samples & their corresponding means.
Samples Means Samples Means Samples Means Samples Means Samples Means
2, 2 4 3, 2 2.5 6, 2 4 8, 2 5 11, 2 6.5
2, 3 2.5 3, 3 3 6, 3 4.5 8, 3 5.5 11, 3 7
2, 6 4 3, 6 4.5 6, 6 6 8, 6 7 11, 6 8.5
2, 8 5 3, 8 5.5 6, 8 7 8, 8 8 11, 8 9.5
2, 11 6.5 3, 11 7 6, 11 8.5 8, 11 9.5 11, 11 11
Step 5. Construct the sampling distribution of the sample means & compute the mean
of the sampling distribution of the sample means (𝜇𝑥̅ ).
What is it . . .
Step 5. Construct the sampling distribution of the sample means & compute the mean
of the sampling distribution of the sample means (𝜇𝑥̅ ).
Sample Means Frequency Probability 𝑋̅ • P(𝑋̅)
̅
(𝑋) ̅
P(𝑋)
2.5 1 1/10 0.08
4 1 1/10 0.20
4.5 1 1/10 0.12
5 1 1/10 0.32
5.5 1 1/10 0.36
6.5 1 1/10 0.40
7 2 2/10 0.44
8.5 1 1/10 0.24
9.5 1 1/10 0.52
𝜇𝑥̅ = Σ[ 𝑋̅• P(𝑋̅) ] = 6
Step 6. Compute the variance ( 𝜎𝑥̅2 ) & standard deviation ( 𝜎𝑥̅ ) of the sampling
distribution of the sample means.