Chapter 12 Methods of Data Collection 3
Chapter 12 Methods of Data Collection 3
METHODS OF DATA
COLLECTION
LEARNING OBJECTIVES
Projective Dimensions of
techniques data collection
Observation
Questionnaire and
method (structured
schedule
and unstructured)
CHAPTER OUTLINE
Vignette
Thurstone
Scales Or Focus Group
Differential Discussion
Scale
Existing
Likert Scale
records
Development Of
Rating Scale
Research Tools
Data is a fact which is an observable and measurable
phenomenon at different level of measurement
(qualitative or quantitative). Data collection is the process
of gathering and measuring information on variables of
interest, in an established systematic fashion that enables
one to answer stated research questions, test hypotheses
and evaluate outcomes. Important questions to be asked
while data collection are what, how, who, where and
when data will be collected.
AIMS OF DATA COLLECTION
IDENTIFY VARIABLES/FACTS
MEASURE VARIABLE/
PHENOMENA
DESCRIBE BEHAVIOUR
OBTAIN EMPIRICAL
EVIDENCE (OBJECTIVE,
RELIABLE, VALID)
DIMENSIONS OF DATA COLLECTION
STRUCTURED V/S
UN-STRUCTURED
DIMENSIONS
OBJECTIVITY V/S OF DATA QUANTITATIVE
SUBJECTIVITY COLLECTION V/S QUALITATIVE
RESEARCHER
OBTRUSIVENESS V/S
UNOBTRUSIVENESS
1. Structure versus un-structured:- structured plan indicates what
information is to be gathered and how to gather it? Structured data is
most often categorized as quantitative data. In structured data collection
process, all the following questions need to be answered before
commencing the data collection.
What data to collect?
From whom data will be collected?
Who will collect the data?
From where the data will be collected?
When the data is to be collected?
2. Quantitative versus qualitative:-data collected about a numeric
variable will always be quantitative and data collected about a
categorical variable will always be qualitative. Therefore, you can
identify the type of data prior to collection, based on whether the
variable is numeric or categorical. Quantitative data can be analyzed
statistically, for example annual income of the subjects; whereas
qualitative data is narrated and described in categories such as
occupation, religion, gender etc.
3. Researcher obtrusiveness versus unobtrusiveness:-in obtrusive
data collection, the subjects are aware of the fact that they are being
studied, which can influence their response or behavior; for example
questionnaires or interview methods. Whereas, in unobtrusive data
collection, subjects are not aware of the fact that they are being studied
and therefore research does not affect their response or behavior; for
example content analysis and secondary analysis of data.
4. Objectivity versus Subjectivity: - It refers to the degree to which
two independent researchers can arrive at similar scores or make similar
observations regarding the concepts. Subjective data are the information
from the researcher’s point of view including feelings, perceptions and
concerns whereas objective data are observable and measurable data
obtained through the observation, laboratory and diagnostic testing etc.
SOURCES OF DATA
Primary data
Collected fresh and for the first
time, and thus considered as
original data.
Secondary data
Already been collected by
someone else.
METHODS OF DATA COLLECTION
SOURCES OF PRIMARY DATA SOURCES OF SECONDARY DATA
I. Observation method 1) Existing Records
Structured 2) Publications such as textbooks, magazine
Unstructured
Participant articles, book reviews, commentaries,
Non-participant
encyclopedias, almanacs.
I. Self-report
Interview method 3) Reference of text books and other reference
Questionnaires books
Interview Schedules
4) Analysis of newspaper articles.
I. Other methods
Warranty cards
Biophysical Measures
Projective technique
Focus group discussion
Oral histories
Critical incidence report
Diaries, Vignettes and Q-Short
COLLECTION OF PRIMARY DATA
Collecting Observation
Other methods
Primary Data method
Self-report
OBSERVATION METHOD
MEANING OF OBSERVATION
Literally, observation is a process of ‘seeing’ the things or events with
naked eye with or without the use of any device to unravel the
complexity of any phenomena to satisfy the demands of an empirical
question.
Observation studies as those that “involve the systematic recording of
observable phenomena or behavior
r in a natural setting”
Gorman and Clayton ( 2005)
Broad questions in observation
What relationship should exist between the observer and the observed, and how can such
relationship be established?
TYPES OF OBSERVATION
(i) Structured or controlled observation
(ii) Unstructured observation (Participant observation)
STRUCTURED OBSERVATION
Structured observation (also known as systemic observation) is a
method in which researchers gather data without direct involvement
with the participants and the data collection technique is structured in a
well-defined and procedural manner. The observer observes the
behavior according to pre-arranged schedule. i.e.
Whom to observe?
What to observe?
How and where to observe
How long to observe for recording the details of verbatim.
Data thus collected will be statistically analyzed and interpreted.
Methods of Recording Observation
1. Checklists: Checklist enables the observer to systematically record the presence
of a pre-specified behavior or condition. In checklist, the behavior to be performed
by the subject is defined explicitly and operationally to facilitate a quick and
accurate categorization of behavior.
2. Rating Scales: The scales are used in observational studies to assess the quality
of some experience or activity. These scales are found in one or a combination of
three basic forms:
Graphic Numerical
Rating Rating
Scale Scale
Forced-Choice
Rating Scale
Shortcomings of Rating Scales
Halo Effect
TIME SAMPLING
EVENT SAMPLING
Open,
nonjudgmental
Holistic.
attitude of
researcher.
CHARACTERISTI
CS OF
PARTICIPANT
OBSERVATION
Focus on learning
and understanding Naturalistic setting.
of behavior.
Extensive
involvement of
observer.
Goals of Participant Observation
• To develop a holistic understanding of
the phenomena under study.
• To understand how things are
organized and prioritized, how people
interrelate to each other and what are
the cultural parameters.
Position of the Observer
Complete
observer
Observer as
participant
Participant as
observer
Complete
participant
1. Complete participant
Researcher becomes a member of the group being studied and conceals
his/her identity as researcher from the group to avoid disrupting normal
activity. The disadvantages of this are that, the researcher may lack
objectivity, the group members may feel distrustful of the researcher
when the research role is revealed and is ethically incorrect. For
example, researchers adopt the role of a student to study the academic
behavior of the students.
2. Participant as observer
The researcher becomes a participant of the group being studied and the
group is aware of the researcher’s presence. Here, the researcher is a
participant in the group who is observing others and who is interested
more in observing, than in participating.
3. Observer as participant
In this position the researcher is an observer who is not a member of
the group and who is interested in participating as a means for
conducting better observation and hence, generating more complete
understanding of the group's activities. For example, researcher
participates in students’ activities to experience and understand their
behavior.
4. Complete observer
In which the researcher is completely hidden from view while observing
and participants being studied remain unaware of being observed.
Observation is completely unobtrusive and unknown to participants.
Three types of processes of observation
Descriptive observation
• Observes anything and everything, assuming that he/she knows nothing; the disadvantage of this type is that
it can lead to the collection of minutiae that may or may not be relevant to the study.
Focused observation
• The researcher will analyze material that is relevant to what the researchers are studying. For example, the
facial expressions a participant makes when trying to perform a specific task.
Selective observation
• Researcher focuses on different types of activities to help delineate the differences in those activities. In other
words, here researcher pays attention to events that match a prior conclusion and ignore other events or activities.
Recording Participants’ Observation
Recording participants observation
Field notes
Descriptive field notes
Photographic Observation
a. Field notes:- Field notes are the primary way of capturing the data that is
collected from participant observations. The feelings, thoughts, suppositions of
the researcher may be noted separately. According to Bogdan and Biklen
(1982), field notes usually consist of two broad kinds of
writing: descriptive and reflective.
Descriptive field notes:- These notes provide detailed and accurate
descriptions of what the observer sees, hears and experiences. Detailed,
concrete and vividly specific words should be used instead of abstract,
superficial, summary or evaluative language.
Reflective field notes:- These notes build on the descriptive field notes to
reflect personal account of what researcher interprets or perceives. These
notes go beyond the descriptions presented above, to include observer
speculations, feelings, problems, ideas, hunches, impressions, prejudices and
analyses.
b. Photographic Observation:- Use photographs to remember
activities, take photographs of activities and provide a written
description of the activity that tells the story of what is happening in the
activity, photo by photo.
QUESTIONNAIRE AND SCHEDULE
To measure
behavior, attitudes,
To explore a new
preferences, opinions
topic
and, intentions of the
subjects.
Steps Involved In the Development of a Questionnaire
Decide the
Define the target
information
required
respondents
Open ended
Closed ended Partially closed
Questionnaire
Questionnaire ended questions
TYPES OF
QUESTION
NAIRE
Closed ended Questionnaire
It is defined as question that ask respondents to choose from a distinct
set of pre-defined responses, such as “yes/no” or among a set of
multiple choice questions. Closed ended questions structure the answer
by only allowing responses which fit into pre-decided categories.
Closed questions can provide nominal, ordinal, interval and ratio scale
data. Various types of closed-ended questions are:
1. Dichotomous questions
2. Multi choice questions
TYPES OF MULTIPLE CHOICE QUESTIONS
Rank
Order
Checklist
Open Ended Questionnaire
These types of questions allow the subjects to respond to the question in their own
words. Open-ended questions helps to collect qualitative data where respondent must
“Create” their response. For example, why did you choose nursing as a profession?
Adequate space must be provided to allow the re-expression of options. Open-ended
questions prompt a conversation because they can't be answered with one-word answers.
Partially Closed Ended Questions
• Though answer choices are provided, but subjects have the option of creating their own
response.
• For example;- for what reasons did you retire before the age of 58?
• (i) Health reasons
• (ii) Desire for more free time
• (iii) Was assured of more than adequate income
• (iv) Please list as many other reasons as you can think of.
_________________________
Question wording in questionnaire
Clarity
Avoid double-barreled
Question
Length
variety
Physical Closing
appearance questions
Question
flow
Administration of Questionnaire
1. Self-administered (Group
administered):- This type of
questionnaire can be distributed
in a number of ways. The most
convenient procedure is to
administer questionnaire to a
group of respondents who
complete the instrument at the
2. Mailingsame
distribution:-
time. Here
questionnaires are mailed to
respondent’s home or work
address. Mailing questionnaires
are commonly used when the
researcher wants to reach a large
sample in a relatively short time.
The respondent then completes
the questionnaire and mails back
to the researcher.
3. Computer administration:-
Administration of questionnaire using
the computer is becoming more
common nowadays. It has many
advantages. It can be easily
programmed, designed and be
individualized.
4. Personal presentation of
questionnaire:- Personal presentation
of questionnaire to individual
respondents is another alternative.
Personal contact with respondents has
been found to have a positive effect on
the rate of the questionnaire returned
INTERVIEW SCHEDULE
It is appropriate especially
when dealing with abnormal It facilitates cross-questioning.
persons.
Structured Interviews
Semi-Structured Interviews
Unstructured Interviews or
in-depth interview
1. Structured Interviews
It is a type of interview in which the interviewer asks a particular set of
predetermined questions and these questions are planned and created in
advance, which means that all respondents are asked the same questions
in the same order. It is also known as a standardized interview and is
significantly quantitative in its approach.
2. Semi-Structured Interviews
Here, the interviewer does not strictly follow a formalized list of
questions. They will ask more open-ended questions, allowing for a
discussion with the interviewee rather than a straightforward question
and answer format. Semi-structured interviews offer a considerable
amount of flexibility to the researcher to explore the respondents along
with maintaining basic interview structure.
3. Unstructured Interviews or in-depth interview
It is an interview in which there is no specific set of predetermined
questions, although the interviewers usually have certain topics in mind
that they wish to cover during the interview. Unstructured
interviews flow like an everyday conversation and tend to be more
informal and open-ended. These interviews have the least number of
questions as they lean more towards a normal conversation but with an
underlying subject. The main objective of most researchers using
unstructured interviews is to build a bond with the respondents due to
which there are high chances that the respondents will be 100% truthful
with their answers.
METHODS OF RESEARCH INTERVIEWS
• How do we “get in” This varies with the group, one is attempting to study.
• The decision of how to present oneself is very important because it leaves a profound impression on the respondents and has a great
influence on the success or failure of the study
Locating an informant
• The researcher must find the insider, a member of a group studied, willing to be an informant and to act as a guide to and translator
of a cultural moves and values and this information will be helpful for the study and saves time
Establishing rapport
• Close rapport with respondent opens doors to more informed research but it may also create problems as the researcher may
become a spokes person for the group studied loosing his or her distance and objectivity
• Regardless of the circumstances one ought to take notes regularly and promptly write everything and analyze ones notes frequently
The instrument of an Interview
INTERVIEW SCHEDULE
An interview schedule is a questionnaire that is read to the
respondent
INTERVIEW GUIDE
It allows the interviewer freedom to pursue relevant topics in
depth, usually by deciding on the spot how to word a question
in the specific context of an interview, rather than reading
from a script as in the case of interview schedule.
PROJECTIVE TECHNIQUES
Projective techniques are based on the phenomena of projection. Projective
techniques are the indirect and unstructured methods of data collection which uses
projection of respondents for inferring about underline motives, urges or intentions
which cannot be secure through direct questioning, as the respondent resists
revealing that. This technique is sensitive to convert an unconscious aspect of
behavior and encourages a wide variety of subject responses.
DEFINITION
“A projective technique is interpretations of situations and events, by reading into
them our own experience and feelings.”
Drever (1964)
Characteristics of Projective Techniques
Purpose of the test is not
disclosed
TAT or Thematic
Mud play, Drawing tests
Apperception Test.
ADVANTAGES DISADVANTAGE
These tests are less susceptible to faking than It is difficult to score projective techniques
self-report measures. objectively.
It is often easier to make rapport and gain High degree of inference is required and the
people’s interest with a projective technique quality of data depends on sensitivity and
than a questionnaire or scale. interpretive skills of the investigator.
A focus group discussion (FGD) is a way to gather data from the people of similar backgrounds or experiences
on a specific topic of interest. The group of participants is guided by a moderator (or group facilitator) who
introduces topics for discussion and helps the group to participate in a lively and natural discussion among
themselves. FGD allows participants to agree or disagree with each other so that it provides an insight into how a
group thinks about an issue, about the range of opinion and ideas.
Phenomenon Amenable to Focus Group Discussion
Inform decision-making,
Validate the results from
strategic planning and
surveys.
resource allocation
Steps in Focus Group Discussion
Adequacy Reliability
of data of data
Suitability of data
1. Reliability of data: The reliability of data can be tested by finding out such things
about the said data.
Who collected the data?
What were the sources of data?
Where the data was collected?
Were proper methods used to collect the data?
At what time data was collected?
Was there any bias?
What level of accuracy was desired? Was it achieved?
2. Suitability of data: The data found suitable for one enquiry may not necessarily be
found suitable for another enquiry. Hence if the available data are found to be
unsuitable they should not be used by the researcher. In this context the researcher must
very carefully scrutinize the definition of various terms and units of collection used at
the time of collecting data from the primary sources originally.
3. Adequacy of data: If the level of accuracy achieved in data is found inadequate for
the purpose of the present enquiry, they will be considered inadequate; if they are
related to an area which may be either narrower or wider than the area of the present
EXISTING RECORDS
Rating scale
Semantic differential
scale & Multi Arbitrary scale
dimensional scale
Differential scale
Factor scale
(Thurstone type scale)
Cumulative scale
Summated scale (Likert)
(Guttman’s scale)
1. RATING SCALE
Rating scale refers to a scale with a set of points, which describes
varying degrees of the dimension of an attitude being observed.
Types of Rating Scale
TYPES OF RATING SCALE
NUMERICAL RATING SCALE
• It’s called “Equal appearing intervals” because items for test (see Step 6 below), are equally spaced apart.
ADVANTAGES DISADVANTAGES
It is relatively easy for One drawback encountered
researchers to develop and for with VAS is that patients have
the respondents to use. difficulty finding the point on
VAS permit statistically the line that best applies to
significant differences in them.
distributions to be readily VAS can only be used in
determined. written (or digital) format and
VAS is particularly well suited not for oral interviews.
to measuring continuous A minimum patient ability in
features. Data obtained with terms of visual ability and
VAS can be converted hand-eye coordination is
parametrically to an interval- required in VAS.
scale level.
CHAPTER FOCUS
Data is a fact which is an observable and measurable phenomenon at different
level of measurement (qualitative or quantitative). Data collection is the process
of gathering and measuring information on variables of interest, in an established
systematic fashion that enables one to answer stated research questions, test
hypotheses and evaluate outcomes. Dimensions of data collection include
structure, quantifiability, researcher obtrusiveness and objectivity. Participant
observation is the process enabling researchers to learn about the activities of the
people under study in the natural setting through observing and participating in
those activities. Structured Interviews is a type of interview in which the
interviewer asks a particular set of predetermined question where questions are
planned and created in advance, which means that all respondents are asked the
same questions in the same order. A visual analog scale is a particularly useful
scale for assessing perception of physical stimuli such as pain, sleep, quality and
shortness of breath.