ANALYSIS OF
VARIANCE
(ANOVA)
ADVANCED STATISTICS
DEFINITION
• A statistical technique for testing for differences between the means of several groups
• One of the most widely used statistical tests
• T-Test
• Compare the means of two groups
• Independent samples
• Paired samples
• ANOVA
• No restriction on the number of groups
T-TEST
Group 1 Group 2
Mean
Mean
Is the mean of one group significantly different to the
mean of the other group?
•t-test: Ho : 1= 2 Ha: 1 2
F-test
Group 1 Group 2 Group 3
Mean Mean Mean
Is the mean of one group significantly different to the
means of the other groups?
Analysis of Variance
One way ANOVA Factorial ANOVA
One Independent More than One
Variable Independent Variable
Between Repeated
Two Three Four
subjects measures / way way way
Within
subjects
Different Same
participants participants
A FEW EXAMPLES…
• Between subjects one way ANOVA
• The effect of one independent variable with three or more
levels on a dependent variable
• What are the independent & dependent variables in each
of the following studies?
• The effect of three drugs on reaction time
• The effect of five styles of teaching on exam results
• The effect of age (old, middle, young) on recall
• The effect of gender (male, female) on hostility
RATIONALE
• Let’s say you have three groups and you want to see if
they are significantly different…
• Recall inferential statistics
• Sample Population
• Your question:
• Are these 3 groups representative of the same population
or of different populations?
Population Draw 3 samples
1
2
Did the
manipulation
alter the
3 samples to
such an
extent that
Drug 1 Drug 2 Drug 3 they now
represent
Manipulate different
DV the samples populations?
µ1 µ2 µ3
measure effect of
manipulation on a DV
STEPS OF F-TEST
1. Specify the alternative / research hypothesis
At least one mean is significantly different from the others
At least one group is representative of a separate population
2. Set up the null hypothesis
The hypothesis that all population means are equal
All groups are representative of the same population
Omnibus Ho: µ1= µ2 = µ3
STEPS OF F-TEST
3. Collect your data
4. Run the appropriate statistical test
Between subjects one way ANOVA
5. Obtain the test statistic & associated p-value
F statistic
Compare the F statistic you obtained with the distribution of F when
Ho is true
Determine the probability of obtaining such an F value when Ho is
true
STEPS OF F-TEST
6. Decide whether to reject or fail to reject Ho on the basis
of the p value
If the p value is very small (<.5), reject Ho…
Conclude that at least one sample mean is significantly different to
the other means…
Not all groups are representative of the same population
HOW IS ANOVA DONE?
Assume Ho is true
Assume that all three groups are representative of the same
population
Make two estimates of the variance of this population
If Ho is true, then these two estimates should be about
the same
If Ho is false, these two estimates should be different
TWO ESTIMATES OF POPULATION
VARIANCE
• Within group variance
• Pooled variability among participants in each treatment group
• Between group variance
• Variability among group means
If Ho is true… If Ho is false…
Between Groups Variance Between Groups Variance
Within Groups Variance Within Groups Variance
=1 >1
CALCULATIONS
Step…
1: Sum of squares
2: Degrees of freedom
3: Mean square
4: Fc
5: Ft
Total Variance In data
SStotal
Between groups Within groups
variance Variance
SSbetween SSwithin
SOURCE OF SUM OF SQUARES DEGREE OF FREEDOM MEAN OF THE SUM
VARIATION OF SQAURES
TOTAL SSt dft = rc – 1
BETWEEN COLUMNS SSc dfc = c – 1 MSSc =
WITHIN COLUMNS SSw dfw = c (r – 1) MSSw =
2
𝑆𝑆𝑡 = ∑ (∑ 𝑋
2
)−
[ ∑ (∑ 𝑋) ] 𝑑𝑓𝑡 =𝑟𝑐 − 1
𝑟𝑐
𝑑𝑓𝑐 =𝑐 − 1
2
1 [ ∑2(∑ 𝑋 ) ]
𝑆𝑆𝑐 =
𝑟
[ ∑ (∑ 𝑋 ) ] − 𝑟𝑐 𝑑𝑓𝑤
=𝑐 (𝑟 −1)
𝑆𝑆𝑤 = 𝑆𝑆𝑡 − 𝑆𝑆𝑐
𝑆𝑆𝑐
𝐹𝑐=
𝑀𝑆𝑆𝑐
𝑀𝑆𝑆𝑐= 𝑀𝑆𝑆𝑤
𝑑𝑓𝑐
𝑆𝑆𝑤
𝑀𝑆𝑆𝑤=
𝑑𝑓𝑤
SAMPLE PROBLEM
• THREE TRAINING METHODS ARE EMPLOYED AND THEN COMPARED TO DETERMINE IF THERE ARE DIFFERENCES IN THE
PRODUCTIVITY LEVELS OF THREE GROUPS THAT ARE TRAINED. A SAMPLE OF FIVE TRAINEES EACH IS TAKEN FROM THE
THREE GROUPS. THE PRODUCTIVITY LEVELS ARE AS FOLLOWS:
•
• METHOD 1: 85 60 75 80 65
• METHOD 2: 70 82 62 65 68
• METHOD 3: 85 82 78 80 79
•
• AT 1% LEVEL OF SIGNIFICANCE, DO THE TRAINING METHODS YIELD SIGNIFICANTLY DIFFERENT PRODUCTIVITY LEVELS?
