Scribd
Upload
432 views

Reliability of Measurement Tools

Reliability and validity are important aspects of measuring instruments. Reliability refers to consistency and includes stability over time (test-retest), internal consistency of subparts, and equivalence between parallel forms. Validity determines if an instrument actually measures the intended construct and includes face validity, content validity through expert review, and construct validity such as convergent measures correlating and discriminant measures not correlating. Reliability and validity help ensure instruments accurately and consistently measure their intended attributes.

Uploaded by

malyn1218
Copyright
© Attribution Non-Commercial (BY-NC)
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
432 views

Reliability of Measurement Tools

Reliability and validity are important aspects of measuring instruments. Reliability refers to consistency and includes stability over time (test-retest), internal consistency of subparts, and equivalence between parallel forms. Validity determines if an instrument actually measures the intended construct and includes face validity, content validity through expert review, and construct validity such as convergent measures correlating and discriminant measures not correlating. Reliability and validity help ensure instruments accurately and consistently measure their intended attributes.

Uploaded by

malyn1218
Copyright
© Attribution Non-Commercial (BY-NC)
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 6

Reliability of Measurement

Tools

Reliability of an instrument is the


degree of consistency with which it
measures the attribute it is supposed to
measure.
Aspects of Reliability Assessed in Data Collection Tools

• Stability – refers to the extent to which the same results are obtained
on repeated administrations of the instrument.
- test-retest reliability (this is usually through the use of
Pearson Product Moment coefficient (r)]
• Internal Consistency – the degree to which the subparts of an
instrument are all measuring the same attribute or dimension, as a
measure of the instrument’s reliability.
- also mean homogeneity
- Split half reliability - items are divided into two comparable
halves for scoring, creating two separate scores for
each subject.
- Cronbach’s alpha coefficient- a reliability index that
estimates the internal consistency or homogeneity of a
measure composed of several items or parts (Likert Scale).
Aspects of Reliability to assess…
n Equivalence
contd. – Measuring instruments exist in two or
more forms called equivalent, parallel, or
alternative forms.
- two approaches:
a. When different observers/researchers are using
an instrument to measure the same
phenomena at the same time.
b. When two presumably parallel instruments are
administered to individuals at about the same
time.
4. Test Item Reliability - item analysis to see how each
item relates to every other item and to the instrument
as a whole.
VALIDITY OF Measuring
Instruments
Validity refers to the degree to which
an instrument measures what it is
supposed to be measuring.
Validity Measure of Data Collection
Instruments
 Face Validity – Most subjective
refers to whether the instrument looks as though it is measuring
the appropriate construct.
 Content Validity – the degree to which the items in an instrument
adequately represent the universe of content.
- Useful with questionnaires, and inventories.
Done through the use of a panel of experts.
 Construct Validity – ability to measure an abstract construct and the
degree to which the instrument reflects the theoretical components of
the construct.
 Known groups method- a test can discriminate between
individuals that are known to have the trait and those who do not.
 Convergent Validity – two measures believed to reflect the
same underlying phenomenon will yield similar results or will correlate
highly: two IQ tests
 Discriminant Validity: a construct can be differentiated from
others – the results of an intelligence test should not correlate with
gross motor skills
Validity Measure of Data Collection
Instruments contd.
 MTMM (Multi-Trait Multi-Method Matrix) Method
– a method of establishing the construct
validity of an instrument that involves the use of
multiple measures for a set of subjects.
- the target instrument is valid to the extent
that there is a strong relationship between it
and other measures purporting to measure the
same attribute (convergence) and a weak
relationship between it and other measures
purporting to measure a different attribute
(Discriminability)

You might also like