Errors in Epidemiological Studies
Errors in Epidemiological Studies
• ‘random error’
= imprecision
• ‘systematic error’
= bias unbiased + unprecise unbiased + precise
• Occurs when there is a systematic difference
between the characteristics of the people
selected for a study and the characteristics of
those who are not
• Distortion of effect resulting from the way
participants are accepted into studies
• Healthy Worker Effect – risk for certain illnesses
in industrial working populations is lower than in
the general population
Selection Bias
• Selective differences between comparison
groups that impacts on relationship
between exposure and outcome
• Usually results from comparative groups
not coming from the same study base and
not being representative of the
populations they come from
Selection Bias Examples
• Case‐control study:
• Controls have less potential for exposure than
cases
• Outcome = brain tumor;
• exposure = overhead high voltage power lines
• Cases chosen from province wide cancer registry
• Controls chosen from rural areas
• Systematic differences between cases and
controls
Selection Bias Examples
Self‐selection bias:
• You want to determine the prevalence of
HIV infection
• You ask for volunteers for testing
• You find no HIV
• Is it correct to conclude that there is no
HIV in this location?
Selection Bias Examples
• Healthy worker effect:
• Another form of self‐selection bias
• “self‐screening” process – people who are unhealthy
“screen” themselves out of active worker population
• Example:
• ‐ Course of recovery from low back injuries in 25‐45 year
olds
• ‐ Data captured on worker’s compensation records
• ‐ But prior to identifying subjects for study, self‐selection
has already taken place
Selection Bias Examples
• Also occurs before subjects are identified for study
• Diagnostic or workup bias:
• Diagnoses (case selection) may be influenced by physician’s
knowledge of exposure
• Example:
• ‐ Case control study – outcome is pulmonary disease,
exposure is smoking
• ‐ Radiologist aware of patient’s smoking status when reading
x‐ray – may look more carefully for abnormalities on x‐ray
and differentially select cases
• Legitimate for clinical decisions, inconvenient for research
Sources of Selection Bias
• Volunteers for studies are almost always
selective
• Paid participants may be selectively different
from the general population
• Hospital and clinical data are based on a
selective population
• Disease or factor under investigation makes
people unavailable for study
Measurement Bias
• Occurs when individual measurements or
classifications of disease or exposure are
inaccurate
• Sources:
– Quality of laboratory analysis
– Recall bias
• Information / Measurement /
Misclassification Bias
• Method of gathering information is inappropriate
and yields systematic errors in measurement of
exposures or outcomes
• If misclassification of exposure
(or disease) is unrelated to disease
(or exposure) then the misclassification
is non‐differential
• If misclassification of exposure (or disease) is related
to disease (or exposure) then the misclassification is
differential
• Distorts the true strength of association
Sources of information bias
• Subject variation
• Observer variation
• Deficiency of tools
• Technical errors in measurement
•
Information / Measurement /
Misclassification Bias
• Recall bias:
• Those exposed have a greater sensitivity for
recalling exposure (reduced specificity)
• - specifically important in case-control studies
when exposure history is obtained retrospectively
• cases may more closely scrutinize their past
history looking for ways to explain their illness
• - controls, not feeling a burden of disease, may
less closely examine their past history
Information / Measurement /
Misclassification Bias
• Reporting bias:
• Individuals with severe disease tends to have
complete records therefore more complete
information about exposures and greater
association found
• Individuals who are aware of being
participants of a study behave differently
(Hawthorne effect)
Confounding
• Occurs when another exposure exists in the
study population and is associated with both
the disease and the exposure being studied
• When the effects of two exposures (risk
factors) have not been separated, and
incorrect conclusions are drawn that the
effect is due to one rather than the other
variable
Confounding
Exposure Disease
Definition of Confounding
A confounder:
1) Is associated with exposure
2) Is associated with disease
3) Is NOT a consequence of exposure (i.e. not
occurring between exposure and disease)
Conf.
Exposure Disease
Confounding
• Confounder is not a result of the exposure
– e.g., association between child’s birth rank
(exposure) and Down syndrome (outcome);
mother’s age a confounder?
– e.g., association between mother’s age
(exposure) and Down syndrome (outcome); birth
rank a confounder?
Confounding