SPSS in 60 Pages
SPSS in 60 Pages
Survey Tips
A handy guide to help you
save time and money as
you plan, develop, and
execute your surveys
www.spss.com
Table of Contents
Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1
Planning . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3
Define your mission . . . . . . . . . . . . . . . . . . .3
Outline your research . . . . . . . . . . . . . . . . .3
Establish a budget . . . . . . . . . . . . . . . . . . . .4
Develop a schedule . . . . . . . . . . . . . . . . . . .4
Define the population . . . . . . . . . . . . . . . . .4
Determine your sample size . . . . . . . . . . . .5
Select a sampling technique . . . . . . . . . . . .7
Choose a survey method . . . . . . . . . . . . . . .9
Questionnaire design . . . . . . . . . . . . . . . . . .12
Determine your survey’s length . . . . . . . . .12
Choose appropriate question formats . . .14
Design your response choices . . . . . . . . . .18
Use professional formatting . . . . . . . . . . .21
Conduct a pilot study . . . . . . . . . . . . . . . .24
Finding problems in your survey . . . . . . . .25
Data collection . . . . . . . . . . . . . . . . . . . . . . .26
Use incentives as appropriate . . . . . . . . . .26
Give clear instructions . . . . . . . . . . . . . . . .28
Interviewer-administered surveys . . . . . . .28
Telephone surveys . . . . . . . . . . . . . . . . . . .29
Mailed surveys . . . . . . . . . . . . . . . . . . . . .32
Online surveys . . . . . . . . . . . . . . . . . . . . . .34
Survey field times . . . . . . . . . . . . . . . . . . .34
“Ideal” response rate . . . . . . . . . . . . . . . .34
Analysis and reporting . . . . . . . . . . . . . . . . .35
Use a unique identification variable . . . . .35
Clean and verify your data . . . . . . . . . . . . .36
Analyze open-ended questions . . . . . . . . .37
Keep track of your analyses . . . . . . . . . . . .37
Design readable reports . . . . . . . . . . . . . .42
Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . .43
Glossary . . . . . . . . . . . . . . . . . . . . . . . . . . . .44
About SPSS Inc. . . . . . . . . . . . . . . . . . . . . . . .51
SPSS products for survey
and market research . . . . . . . . . . . . . . . . .52
1
This symbol highlights SPSS products
that help you perform a particular action
or specific survey application more
effectively and productively. A list of
SPSS survey research products can be
found on pages 52—56 of this booklet.
2
Stage one: Planning
Define your mission
Do you know why you and your organization
want to conduct this survey? If so, use these
reasons to develop your survey’s mission. Once
developed, refer to your mission throughout
the survey process to make sure that every
action taken supports it.
3
Establish a budget
Mapping an action plan helps you justify your
study and budget. It also helps determine the
scope and size of your survey. Typically, the
major costs of a survey are data collection
and data entry. Some methods, such as e-mail
or online surveys, typically have a lower cost-
per-returned-questionnaire and may help you
stay within your budget.
Develop a schedule
If you’re new to survey research, assume that
the process will take longer than you expect.
When creating an entirely new survey, allow
time for review and performing a pilot study.
With any survey, be sure to allow enough time
for data collection, analysis, and reporting.
4
A young child may be able to pay attention
to your questions for as little as five
minutes, or may not understand all of
the content. Older respondents may
not understand new phrases or jargon.
One age group may prefer phone or
mail surveys, another online surveys.
5
There is usually no reason to survey
more than 1,000 to 1,500§ respondents.
While the precision of results tends to
improve as the sample size increases,
the increase in precision is negligible
when sample size is greater than
1,500§ respondents.
SamplePower
One approach
A conservative formula you can use to determine
the appropriate sample size N is based on the
amount of error you are willing to tolerate,
stated as a proportion or percent.
N =_____
1
error2
N =_____
1 = _____
1 = 400
.052 .0025
A second approach
If you have reason to expect a high degree of
correlation between variables, then you can use
a smaller sample size for your survey. Base the
sample size on the minimum adequate sample
size of important subgroups in the population.
6
Many analysts suggest that there should be at
least 100§ cases in each subgroup. If possible,
know what proportion of the population (in the
real world) is in each subgroup and calculate
the total sample size required. Take into account
the expected non-response rate of this population
and increase the sample size by that factor.
Purposive sampling
Use non-probabilistic or purposive sampling,
if you want to learn about people with special
characteristics. Purposive sampling is often
used for focus groups.
7
You want to survey females between the
ages of 18 and 25 who watch television
at least 10 hours a week. You’ll want to
conduct a purposive sample, to be
sure that you include all of the relevant
characteristics and exclude individuals
who don’t fit these requirements.
SamplePower
8
You can take equal numbers of various
subgroups—former, current, and new
customers, for example—to maximize
statistical power in tests.
9
Consider the length of your survey
If you must ask a lot of questions, or expect the
respondent to spend an hour or more with your
survey, an interviewer-administered in-person
survey is recommended. If you can’t afford to
perform in-person surveys, the second-best
option is a self-administered survey.
10
Online surveys are another cost-effective
method. You save on postage, printing, and
wages for interviewers—and you minimize the
costs of data entry and data cleansing, since
information is already captured in an electronic
format. Depending upon the number of surveys
your organization conducts, you may find that
a survey developed and/or hosted by an
application service provider (ASP) is an
economical alternative.
Consider speed
Web and telephone surveys are the fastest
methods of conducting surveys. The typical
time required for collecting data through a Web
or telephone survey ranges from a few days to
a few weeks, while mailing a survey can add at
least a month to the process.
11
If you’re thinking of conducting a
Web-based survey, make sure you’re
able to obtain a valid sample population
with that method. For example, some
populations—such as members of certain
professional organizations or students
at many universities—have access to the
Internet. However, you can’t assume that
everyone does, or that they are willing
to complete a survey online.
12
Here are some general guidelines:
■ A survey targeting children should
13
Which of the following questions do you
find clearer?
“I agree that snack foods such as
candy bars should be available in
school vending machines.”
14
Avoid “leading” and “loaded” questions
Leading questions indicate—subtly or not so
subtly—the desired or acceptable answer. For
this reason, they discredit the objectivity of
your results.
Be specific
If questions include vague qualifiers like “few,”
“many,” or “usually,” or undefined qualifiers like
“good” and “bad,” the meaning of respondents’
answers may be difficult to quantify.
15
Don’t lead with responses
In interviewer-administered surveys, avoid
beginning questions with a phrase like “Do
you very often, frequently, seldom, or never...”
Since people pay attention to what they hear
first, respondents listening to a question with
this structure will focus on the choices, and
not the question.
16
Offer respondents a choice of languages
In certain situations, your survey can be conducted
in a single language. It’s increasingly common,
however, to create and field surveys in multiple
languages. You’ll want to provide questions,
response lists, and instructions in the languages
preferred by respondents while simplifying
data analysis as much as possible.
mrTranslate
17
The question, “Are there additional
features you’d like to see in our product?”
will generate comments that are not so
quickly classified as a simple list might
be. The benefit to this approach is that
it may uncover preferences or views
your organization might not have
considered suggesting. In this example,
it might lead to your organization
developing features that you may not
have imagined customers wanting.
18
Many researchers include a middle response
option in a scale. The middle answer offers a
comfortable response for subjects who have
legitimately divided or neutral opinions.
1 2 3 4 5
Strongly Agree Neither Disagree Strongly
Agree Agree nor Disagree
Disagree
1 2 3 4
Very Satisfied Dissatisfied Very
Satisfied Dissatisfied
mrInterview,
SPSS Categories
19
Offering “Don’t know” as a response option
Should you offer “Don’t know” as a response
option? By including it, you provide a response
choice for respondents who genuinely don’t
know. However, including this alternative enables
some respondents to avoid stating an opinion.
20
Statistical software can help you find and
understand patterns in the groups of people
that answer “I couldn’t say” or “Not applicable,”
so that you can determine if they share similar
characteristics.
21
For example, you can format questions
in upper- and lower-case text and
responses in all-capital letters and
boldface type.
■ Parentheses ( )
■ Brackets [ ]
■ Circles ❍
22
Make your survey look attractive
The presentation of a survey can either
encourage or deter a person from responding.
23
If you are creating an online survey, use images,
sound, and animation, where appropriate, to
make your survey engaging. If it is more than
just a few items long, you can improve the
response rate if respondents can take the survey
in stages, without having to re-enter answers.
mrPaper, mrScan,
mrInterview,
Dimensions ASP,
Dimensions Service Bureau
24
If you plan a mail survey, it’s a good
idea to mail the surveys to a test sample
to gauge response time and other factors.
25
Common survey problems
Look for the following common problems
in surveys:
■ Interviewers have problems reading
confusing
■ Instructions are confusing
anticipated
■ There are unintentionally repeated or
redundant questions
■ There is too little space for responses to
open-ended questions
26
SPSS Classification Trees,
mrInterview
■ Gift certificates
27
Give clear instructions
Begin your survey by briefly explaining its purpose.
Let respondents know how the data will be
used, and that their privacy will be protected.
In online surveys, you can also let respondents
see how far they’ve progressed, which encourages
them to complete the survey.
25 words
■ Limit the number of response options—
28
Use good interviewers
A good interviewer is essential to a successful
telephone or in-person survey. A good interviewer:
■ Understands respondents and is empathetic
■ Listens well
■ Is articulate
■ Can be objective
mrInterview CATI
29
Prompt the interviewer
There are tactics the interviewer can use to
help the respondent answer the questions. In
the interviewer’s script, tell him or her to:
■ Mention response alternatives within the
30
■ Conduct a practice session so you can listen
to the interviewer and provide feedback
■ Coach the interviewer on how to answer
common questions that may arise
mrInterview,
mrPaper, mrScan
31
concise. Also, at the beginning, mention any
incentives being offered to survey respondents.
If the person does not want to participate,
don’t press them; say “Thank you,” and move
on to another individual.
32
Notify respondents in advance
Send respondents an e-mail or postcard to alert
them that the survey will arrive in approximately
one week. Pre-notification will increase the
likelihood of response because the respondents
are more likely to recognize the survey when it
arrives. The note may also spark curiosity in the
respondents, and they will look for the survey.
mrInterview,
Dimensions ASP,
Dimensions Service Bureau
■ Method of administration
34
■ Level of difficulty of the survey
■ Aesthetic appeal of the survey
■ Perceived cost of completion
missing responses
35
Clean and verify your data
If you’ve collected data using electronic
methods, your data may already be clean
and ready for analysis. When collecting data
entered manually, however, allow time to
perform data verification and cleaning. As
the analyst, you should have an idea of how
your file should look. Software is available
that can streamline the data cleaning process.
36
Analyze open-ended questions
Developing a coding scheme for open-ended
questions can be time-consuming and may
require data entry personnel who have a good
understanding of the subject matter. However,
there are techniques available that make reliable
analysis of open-ended survey responses fast
and efficient. With these tools, it’s easier to turn
unstructured text responses into information you
can analyze along with other quantitative data.
SPSS Base
37
Using categorical variables
Categorical or nominal variables provide a list
of choices with no meaningful order to the list.
38
Using interval or continuous variables
Interval or continuous variables have an implied
order and an implied distance between the
response options.
Regression
Regression is one of the more popular statistical
procedures using interval-level variables.
Scatterplots and histograms are appropriate
graphical displays for these kinds of variables.
Crosstabulation
Performing a crosstabulation is appropriate
when you have two or more categorical variables.
(Continuous variables don’t lend themselves to
crosstabulation, since you would get as many
rows or columns as there are different responses.)
39
When looking at crosstabulations, if the
probability of a chi-square is .05 or less, it is
usually small enough for the analyst to feel that
the distribution did not result from chance.
Factor analysis
In survey research, factor analysis can be
helpful. It can be used to show the underlying
structure of a large number of variables, to
simplify the discussion of the data, or even
to suggest new, combined variables for use
in other analytic procedures.
SPSS Base
40
Differences in the mean
Use a t test to learn about differences in
means between two groups.
41
Design readable reports
Keep your audience in mind when reporting
survey results. Organize your report logically,
write clearly, and avoid jargon that may be
confusing of unfamiliar to your readers. You
may want to create report templates, not only
to save time but also so that the look of your
reports supports your organization’s brand, or
that of your clients.
mrInterview
42
Deliver timely reports
You conducted your survey because people
wanted information. Deliver results to them
faster and they’ll be able to put that information
to use sooner. To save time, you might want
to use templates to standardize reports or
presentations. You can use software that
enables you to provide analysts or clients with
online access to real-time results, or even
develop customized applications to deliver
information wherever it’s needed.
Conclusion
This booklet has briefly touched on a number
of the things you’ll want to bear in mind as
you plan and conduct survey research projects.
Some related topics, such as predictive
modeling, are beyond the scope of this booklet.
If you want to explore this, or study any of
the topics covered here in greater detail, we
recommend you seek out a college-level
textbook on marketing and survey research
tools and practices. Or attend an SPSS training
course in the application of our products to
survey research. Information on these courses
can be found at www.spss.com/training.
43
Glossary
Analysis of variance (ANOVA) — A method of
analysis used when dealing with a continuous
or integral dependent variable and one or more
categorical or nominal variables
44
Coding scheme — A method for assigning a
code (usually in the form of a number) to
responses to a question. For example, if you
are researching customers’ opinions of a
certain product feature, you might devise a
coding scheme to identify a positive opinion
with a 1, a negative one with a 2, and a neutral
one with a 3. Coding schemes are also used to
turn open-ended text responses into data that
can be analyzed.
45
Error bar chart — A chart that plots the
confidence intervals, standard errors, or
standard deviations of individual variables
46
Interval variable — See continuous variable
47
Ordinal variable — A variable whose response
options have an implied order but no implied
distance. For example, a scale that ranges
from “strongly agree” to “strongly disagree.”
48
Ratio variables — Variables that have order
among points, equal distances between
adjacent points, and an absolute zero
49
Strata — (Plural of stratum) In sampling,
groups defined by certain characteristics
(See stratified sampling.)
50
About SPSS Inc.
For more than 35 years, SPSS Inc. (NASDAQ:
SPSS) has helped commercial, academic, and
government organizations maximize productivity
and accuracy through every phase in the survey
research process, from ad hoc research projects
to high-volume, complex programs. SPSS Inc.
offers a broad range of end-to-end survey and
market research tools to support survey
design, authoring, and sampling, as well as
data collection, analysis, and publishing.
■ Product enhancements
■ Demographic surveys
■ Referral identification
■ Population/member demographics
■ Benefit analysis
■ Policy analysis
■ Constituent preferences
■ Crime analysis
■ Academic surveys
■ Professor/course evaluations
51
SPSS is also a leading provider of predictive
analytics software and solutions. SPSS predictive
analytic technologies connect data to effective
action by drawing reliable conclusions about
current conditions and future events. More
than 250,000 commercial, academic, and
public sector customers rely on SPSS technology
to help increase revenue, reduce cost, improve
processes, and detect and prevent fraud.
Founded in 1968, SPSS is headquartered in
Chicago, Illinois. For additional information,
please visit www.spss.com.
52
■ You can use SPSS Text Analysis for Surveys
to create code frames and categorize open-
ended text responses more quickly and
reliably, regardless of the program used to
create your questionnaire
Planning
SamplePower® — Easily determine the sample
size you need, saving your organization both
time and money
Questionnaire Design
SPSS Data Entry™ — Design surveys and forms
on the desktop
53
Data collection
SPSS Data Entry™ — Enter survey responses
through your desktop or networked data
entry stations
Data analysis
SPSS Base — Includes all the tools you need
to analyze your data, including frequencies,
descriptives, crosstabs, t tests, regression,
and more.
54
SPSS Exact Tests™ — Make correct conclusions
when working with small samples
Modeling
SPSS Advanced Models™ — Analyze complex
relationships using this high-end modeler’s
toolkit
55
SPSS Classification Trees™ — Create highly
visual classification and decision trees to find
specific subgroups and relationships in your
data that you might not uncover using more
traditional statistics
56
What the experts are saying about SPSS
products for survey research:
– King Douglas
Senior Analyst and Database Manager
American Airlines
– Michael Reuscher
Vice President, IT Project Management
Synovate
– Jacqueline Martin
Principal Support Officer
East Ayrshire Council
57
“SPSS gave me answers to my ‘how’ and
‘why’ questions on customer preferences.
We learned exactly where customers
think we are struggling and can allocate
resources to address the problem.”
– Sharon James
Process Specialist
Haworth Furniture
– Julie Frandsen
Assistant Editor
Aspen Publishers
– Bob Muenchen
Manager, Statistical Consulting Center
The University of Tennessee Office of
Information Technology