Spatial Thinking Ability Test
Spatial Thinking Ability Test
1]
On: 02 January 2015, At: 19:41
Publisher: Routledge
Informa Ltd Registered in England and Wales Registered Number: 1072954 Registered office: Mortimer House,
37-41 Mortimer Street, London W1T 3JH, UK
Journal of Geography
Publication details, including instructions for authors and subscription information:
http://www.tandfonline.com/loi/rjog20
To cite this article: Jongwon Lee & Robert Bednarz (2012) Components of Spatial Thinking: Evidence from a Spatial Thinking
Ability Test, Journal of Geography, 111:1, 15-26, DOI: 10.1080/00221341.2011.583262
Taylor & Francis makes every effort to ensure the accuracy of all the information (the “Content”) contained
in the publications on our platform. However, Taylor & Francis, our agents, and our licensors make no
representations or warranties whatsoever as to the accuracy, completeness, or suitability for any purpose of the
Content. Any opinions and views expressed in this publication are the opinions and views of the authors, and
are not the views of or endorsed by Taylor & Francis. The accuracy of the Content should not be relied upon and
should be independently verified with primary sources of information. Taylor and Francis shall not be liable for
any losses, actions, claims, proceedings, demands, costs, expenses, damages, and other liabilities whatsoever
or howsoever caused arising directly or indirectly in connection with, in relation to or arising out of the use of
the Content.
This article may be used for research, teaching, and private study purposes. Any substantial or systematic
reproduction, redistribution, reselling, loan, sub-licensing, systematic supply, or distribution in any
form to anyone is expressly forbidden. Terms & Conditions of access and use can be found at http://
www.tandfonline.com/page/terms-and-conditions
Components of Spatial Thinking: Evidence from a Spatial
Thinking Ability Test
Jongwon Lee and Robert Bednarz
ABSTRACT
This article introduces the development and
validation of the spatial thinking ability INTRODUCTION
test (STAT). The STAT consists of sixteen Spatial thinking has been actively investigated during the last decade, especially
multiple-choice questions of eight types.
The STAT was validated by administering it with respect to its relationship to geospatial technologies and its relevance
to a sample of 532 junior high, high school, to problem solving in everyday life, the workplace, and science (Albert and
and university students. Factor analysis Golledge 1999; Battersby, Golledge, and Marsh 2006; Bednarz 2004; Golledge 2002;
using principal components extraction was Marsh, Golledge, and Battersby 2007). However, long before researchers began
applied to identify underlying spatial
thinking components and to evaluate to focus on spatial thinking, psychologists and others sought to identify and
the construct validity of the STAT. measure spatial ability. Spatial ability—typically defined as spatial perception,
Spatial components identified through visualization, and orientation—is seen as a narrower concept than spatial thinking
factor analysis only partly coincided with (Committee on Support for Thinking Spatially 2006). It is beyond the scope of
spatial concepts used to develop the
questions that compose the STAT and this article to provide a comprehensive review of the literature concerning the
with the components of spatial thinking differences and distinctions between spatial ability, spatial reasoning, spatial
Downloaded by [66.31.30.1] at 19:41 02 January 2015
hypothesized by other researchers. cognition, spatial concepts, spatial intelligence, and environmental cognition.
Learning to Think Spatially, published by the National Research Council, while
Key Words: spatial thinking, spatial recognizing that no clear consensus as yet exists concerning spatial thinking,
thinking ability test (STAT), factor analysis provided a significant step toward understanding its nature and its importance
in the school curriculum. The Committee (26) saw spatial ability as “a trait that a
person has and as a way of characterizing a person’s ability to perform mentally
such operations as rotation, perspective change, and so forth. The concept
derives in part from the psychometric tradition of intelligence measurement
and testing . . . ” The Committee viewed spatial thinking, on the other hand, as a
constructive amalgam of three mutually reinforcing components: the concept of
space, tools of representation, and processes of reasoning. In order for individuals
to conceptualize space, understand representations, and reason spatially, they
must possess the appropriate spatial skills (Committee on Support for Thinking
Spatially 2006).
The Committee (2006) also recognized the educational value of spatial thinking,
arguing that it can be taught and learned; thus spatial thinking should be an
important part of the educational curriculum at all levels. The Committee further
suggested that GIS and other geospatial technologies can play a powerful role in
promoting spatial thinking. In fact, many studies have pointed to the advantage
of integrating GIS into the classroom (e.g., Allen 2007; DeMers and Vincent 2007;
Doering and Veletsianos 2007; Milson and Earle 2007; Patterson, Reeve, and Page
Dr. Jongwon Lee is an assistant professor of 2003) and have shown explicit links between GIS learning and students’ spatial
social studies education (geography education
major) at Ewha Womans University, Seoul, thinking skills (Kerski 2008; Lee and Bednarz 2009; Schultz, Kerski, and Patterson
South Korea. His research interests are in the 2008).
areas of geography education: spatial cognition However, researchers have also argued that “to be most effective, GIS teaching
and skills, especially the role of geospatial and curriculum development strategies should begin with an assessment of
technology in spatial thinking.
student understanding of spatial relationships. . . ” (Wigglesworth 2003, 282),
emphasizing the importance of establishing viable spatial thinking assessment
Robert Bednarz is professor of geography, Texas
A & M University, College Station, Texas, USA, based on a scientifically rigorous definition (Eliot and Czarnolewski 2007).
and North American Commissioning Editor of Unfortunately, such a standardized measure of essential knowledge and skills
the Journal of Geography in Higher Education. does not exist. In fact, the Committee stated explicitly that “[t]here are neither
His recent research has focused on spatial think-
ing, the impact of using geospatial technologies
content standards nor valid and reliable assessments for spatial thinking”
on spatial thinking skills, assessment of spa- (Committee on the Support for Thinking Spatially 2006, 232).
tial thinking skills, and the implementation of This article begins with a brief discussion of concepts of spatial thinking
geospatial technologies in science and geoscience skills and the instruments available to measure them. Next, the article presents
curricula.
the development and validation procedures of the spatial thinking ability test
(STAT) that is modeled after the spatial skills test (Lee organization of the world economy” (Bednarz n.d.). The
and Bednarz 2009). Data are presented that support the concept or object investigated through the third context is
validity and reliability of STAT based upon a field test not necessarily spatial but can be spatialized by time-space
of 532 junior high, high school, and university students. coordination. For example, written linguistic symbols are
The differences in the performance of these three levels spatially defined and spatially arranged, and readers must
of students are explored and tested for significance using establish word order so that sentence and passage meaning
ANOVA. In addition, factor analysis is applied to identify can be determined. Patterns in complex numerical data can
underlying spatial thinking components, to determine if often be revealed and best understood by portraying the
the identified components support the structure of spatial information graphically.
thinking proposed by other researchers, and to evaluate the Although Learning to Think Spatially (Committee on the
construct validity of the STAT. Support for Thinking Spatially 2006) provides multicontex-
tual and interdisciplinary definitions of spatial thinking, it
has been criticized for its lack of a conceptual framework,
CONCEPTS OF SPATIAL THINKING an essential prerequisite for development of assessment
Because the term “spatial thinking” has been used in both tools (e.g., Gersmehl and Gersmehl 2006). Previous research
nonacademic and academic areas extensively, a variety of is not devoid of conceptual frameworks, however, as
definitions exist (Committee on the Support for Thinking Gersmehl and Gersmehl (2006, 2007) and Golledge and
Spatially 2006; Eliot and Czarnolewski 2007; Gersmehl 2005; others (Battersby, Golledge, and Marsh 2006; Golledge
Gersmehl and Gersmehl 2006; 2007; Golledge and Stimson 1995, 2002; Golledge and Stimson 1997; Golledge, Marsh,
1997; Harris 1981; Marsh, Golledge, and Battersby 2007; and Battersby 2008; Marsh, Golledge, and Battersby 2007)
Downloaded by [66.31.30.1] at 19:41 02 January 2015
Montello et al. 1999). In addition, substantial disagreement have proposed hierarchies of spatial thinking skills and
continues to occur about the scale (from tabletop scale concepts. In a study to specify a taxonomy of spatial
to geographic scale) and dimensions (thinking in, about, thinking, Gersmehl and Gersmehl (2006, 2007) defined
and with space) of spatial thinking, about the nature of spatial thinking as skills that geographers use to analyze the
cognitive processes involved, about the number of major spatial relationships in the world. They identified thirteen
components, and, as noted in the introduction, about the modes of spatial thinking: defining a location, describing
relationship, if any, between spatial ability and spatial conditions (the geographic concept of site), tracing spatial
thinking. connections (situation), making a spatial comparison, infer-
A few studies provide valuable input for the develop- ring a spatial aura (influence), delimiting a region, fitting a
ment of spatial thinking assessments. These studies suggest place into a spatial hierarchy, graphing a spatial transition,
a series of spatial thinking concepts and describe differences identifying a spatial analog, discerning spatial patterns,
between expert and novice performance in spatial thinking. assessing a spatial association, designing and using a spatial
Some of the most useful studies include Learning to Think model, and mapping spatial exceptions. They argued that
Spatially (Committee on the Support for Thinking Spatially brain research suggests that these modes of spatial thinking
2006), Gersmehl’s (2005) spatial thinking taxonomy, and have distinct or independent neurological foundations.
Golledge and others’ categorization of geospatial concepts They offered no empirical evidence or other rigorous
(Battersby, Golledge, and Marsh 2006; Golledge 2002; assessment to support their hypothesis that the modes they
Golledge and Stimson 1997; Golledge, Marsh, and Battersby identified are independent, however.
2008; Marsh, Golledge, and Battersby 2007). A hierarchical set of spatial thinking concepts was pro-
Learning to Think Spatially (Committee on the Support for posed by Golledge and his colleagues (2008). This sequence
Thinking Spatially 2006) introduces three spatial contexts: progresses from four basic spatial concepts (or primitives)
life space (cognition in space), physical space (cognition to more complex and abstract concepts through five differ-
about space), and intellectual space (cognition with space). ent levels as follows (Golledge, Marsh, and Battersby 2008,
The first of these involves thinking about the world in which 91–92): (1) primitive level (identity, location, magnitude,
we live. It often includes way-finding and navigation in space-time); (2) simple level (arrangements, distribution,
the real, geographic world. It also includes other everyday line, shape, boundary, distance, reference frame, sequence);
activities including assembling it furniture by following (3) difficult level (adjacency, angle, classification, coordi-
instructions, packing the trunk of a car to maximize carrying nate, grid pattern, polygon); (4) complicated level (buffer,
capacity, etc. The second context, cognition about space, connectivity, gradient, profile, representation, scale); and
focuses on “a scientific understanding of nature, structure, (5) complex level (area association, interpolations, map
and function of phenomena that range from the microscopic projection, subjective space, virtual reality). The spatial
to the astronomical scales” (30). It is useful in explaining thinking skills suggested by the Gersmehls (2006, 2007)
the structure of the atom or DNA, the movement and and geospatial concepts proposed by Golledge, Marsh,
arrangement of the elements of the solar system, etc. and Battersby (2008) share the common context of the
Other examples include “shapes and structures of urban geographic scale. However, whereas Gersmehls’ concepts
areas, the diffusion of cultures and agriculture, or the are related to geographic analysis, the geospatial concepts
16
Components of Spatial Thinking: Evidence from a Spatial Thinking Ability Test
17
Jongwon Lee and Robert Bednarz
the spatial relationships. In order to answer the questions isolines based on point data, and differentiating among
properly, participants had to combine two thematic layers spatial data types.
of information and perform logical functions (i.e., Boolean The initial motivation to revise and augment the original
logic). In a similar study, Albert and Golledge (1999) used spatial skills test was to measure students’ mastery of the
a simplified set of thematic layers to evaluate how well GIS content and skills contained in the Association of American
users could select appropriate map layers and operations Geographers’ Teachers’ Guide to Modern Geography (TGMG)
and visually verify map overlay processes to achieve a project materials. The primary aim of the TGMG, funded
specific result. by the U.S. Department of Education, is to improve the
Another type of spatial task used to assess individuals’ preparation and ability of geography teachers to incorpo-
spatial ability includes map-reading skills such as following rate spatial thinking skills into their classes. The TGMG
directions, judging distances, comprehending geographic project produced a variety of print and digital materials
characteristics, and recognizing patterns (Carswell 1971; for preservice and in-service teacher preparation programs,
Gilmartin and Patton 1984). Map-reading skills devised by for example, a multimedia CD with animated instructional
Gilmartin and Patton (1984) provided students with repre- units that deal with the analytical skills specified in the
sentations of a country’s population distribution, topogra- National Geography Standards, such as measuring direction,
phy, and climate that they then used to answer multiple- distance, slope, and density; analyzing map patterns and
choice questions such as “Which of the country’s three making rigorous map comparisons; formulating and testing
major cities has the largest population?” Also included hypotheses; identifying exceptions to patterns predicted
in the same study was a road map-reading task to assess by hypotheses; and buffering, overlaying, windowing, and
abilities such as distance estimation, route comparison (e.g., other methods of spatial analysis. The spatial thinking
Downloaded by [66.31.30.1] at 19:41 02 January 2015
visually compare two straight-line distances and judge ability test (STAT) was designed to assess individuals’
which is shorter), and pattern recognition (e.g., choose growth in spatial thinking skills and to help determine
which of four generalized diagrams best represents the the effectiveness of the TGMG materials in promoting
overall road pattern in the study area). Finally, Kerski the spatial thinking skills of teachers. The revised and
(2000) created a task that assessed both the spatial concept, expanded spatial skills test also provided a data set that
“best location,” and map reading simultaneously. He asked can be used to provide a preliminary assessment of the
students to analyze geographic information and select the reliability and validity of the previously noted spatial
best location for a fast food restaurant in a hypothetical area thinking conceptualizations proposed by other researchers.
based on a given set of variables including traffic volume, The initial step in the construction of the STAT was the
existing fast food locations, locations of high schools, and delineation of the assessment objective and the description
annual median income. of the test contents to be measured. Two sets of spatial
thinking concepts were analyzed and combined and served
to inform the development of STAT. The first set of concepts
DEVELOPMENT OF THE SPATIAL THINKING ABILITY was identified by Gersmehl (2005) whose ideas served as
TEST (STAT) the theoretical foundation of the TGMG project. The second
One goal of the present study was to develop a standard- set was comprised of Golledge’s (2002) list of spatial think-
ized test of spatial thinking abilities (the spatial thinking ing skills, which played a key role in the development of
ability test (STAT)) that integrates geography content the original spatial thinking ability test. Golledge’s concepts
knowledge and spatial skills. Currently no standardized were especially useful because they were detailed enough
instrument for assessing the set of spatial thinking skills to develop test items, potentially leading to improvement
discussed previously exists. In addition, the reviewed of test content validity. Additionally, both lists share some
studies using questionnaires or other measures to assess common concepts and features as noted previously.
spatial skills often ignored issues of reliability and validity. Each test item was designed to measure one or two
The current study extends the authors’ research (Lee and components of spatial thinking identified by one or both of
Bednarz 2009) that developed and deployed spatial skills these two studies. The aspects of spatial thinking abilities
tests (SST) to measure changes in students’ spatial skills covered by STAT include: (1) comprehending orientation
after they completed GIS coursework. That research found and direction; (2) comparing map information to graphic
a significant relationship between the completion of one or information; (3) choosing the best location based on several
more geospatial technology courses and students’ scores on spatial factors; (4) imagining a slope profile based on
the spatial skills test. The components of spatial relations a topographic map; (5) correlating spatially distributed
as defined by Golledge and Stimson (1997) provided guide- phenomena; (6) mentally visualizing 3-D images based
lines for developing test items. The spatial skills tests consist on 2-D information; (7) overlaying and dissolving maps;
of a set of multiple-choice questions and performance tasks and (8) comprehending geographic features represented as
that were designed to evaluate students’ skills including point, line, or polygon (see Table 2).
overlaying and dissolving a map, reading a topographic During the development of STAT, we focused on a
map, evaluating several factors to find the best location, central problem related to test construction: how to
recognizing spatially correlated phenomena, constructing ensure practicability while at the same time providing
18
Components of Spatial Thinking: Evidence from a Spatial Thinking Ability Test
maximum comprehensibility of
Table 2. Description of question types and spatial thinking components to measure. spatial thinking concepts. A num-
ber of other factors were also
considered in the design of the
Type Item Spatial Thinking STAT. These factors included (1)
(Item Number) Description Components to Measure
cognitive process (i.e., maximizing
I (#1, #2) In order to solve item #1 and #2, Item #1 and #2 evaluate the trait spatial processes and minimizing
participants should visually of “comprehending orientation verbal processes); (2) psychometric
navigate road maps using and direction (e.g., rationale; (3) mode of represen-
verbal information including forward-backward; left-right; tation (text, picture, graph, map,
participant’s current location, up-down; back-front; color versus black and white, etc.);
directions to destination, street horizontal-vertical; and (4) practical constraints (e.g.,
information, etc. (See Fig. 1) north/south/east/west)” amount of time required to com-
(Golledge 2002).
plete the test).
II (#3) In order to solve item #3, Item #3 assesses the trait of
The current version of the test
participants should recognize “discerning spatial patterns”
map patterns and represent (Gersmehl 2005) and “graphing is fourteen pages long and has
them in graphic form. a spatial transition” (Gersmehl two equivalent forms (one that
2005). can be used for a pretest and
III (#4) In order to solve item #4, The basic rationale behind item #4 one for a post-test) allowing for
participants should select an is to assess the trait the evaluation of changes in spa-
Downloaded by [66.31.30.1] at 19:41 02 January 2015
ideal location for a fictitious “comprehending overlay and tial thinking skills over a period
facility based on multiple pieces dissolve” (Golledge 2002) and of time. The pre- and post-tests
of spatial information such as “inferring a spatial aura were composed of slightly different
land use, elevation, population (influence)” (Gersmehl 2005). questions covering the same spatial
density, etc.
thinking skills. Each form, contain-
IV (#5) In order to solve item #5, In solving item #5, participants
ing sixteen multiple-choice ques-
participants should create a deal with several cognitive traits
profile of topography along a including “recognizing spatial tions, consists of eight different
proposed line on a contour map. form (such as cross-sections to types of questions (Table 2). Figure
In addition, the participants three-dimensional block 1a and 1b contain a sample of items
need to properly orient diagrams or image)” (Golledge from the STAT. We also constructed
themselves in situ. 2002), “being able to transform a three-item questionnaire to col-
perceptions, representations lect information about the subject’s
and images from one dimension gender, academic major (geogra-
to another and the reverse” phy major or not), and amount of
(Golledge 2002) and “graphing geospatial coursework completed
a spatial transition” (Gersmehl
(e.g., GIS and cartography).
2005).
Formal and informal review
V (#6, #7) In order to solve item #6, Item #6 and #7 evaluate the trait
participants should identify “comprehending spatial of STAT took place in a vari-
spatial correlations between association (positive and ety of venues, mostly conducted
sets of maps. Additionally, item negative)” (Golledge 2002), as part of the evaluation plan
#7 asks participants to display “making a spatial comparison” of the TGMG project. After a
the identified spatial relationship (Gersmehl 2005), and draft of STAT was completed, all
in a graphic form. (See Fig. 1) “assessing a spatial items were carefully reviewed by
association” (Gersmehl 2005). a team of experts consisting pri-
Item #7 additionally assesses marily of the TGMG project team
the trait of “graphing a spatial and steering committee members.
transition” (Gersmehl 2005).
The team included two individ-
VI (#8) In order to solve item #8, Item #8 assesses the trait of
uals who teach geographic edu-
participants need to mentally “being able to transform
visualize a 3-D image based on perceptions, representations cation courses for undergraduate
2-D information. (See Fig. 1) and images from one dimension and graduate students; these mem-
to another and the reverse” bers conducted an informal review
(Golledge 2002). and then pilot-tested the instru-
VII (#9, #10, In order to solve item #9, #10, #11, Item #9, #10, #11, and #12 ment with their students. Twenty-
#11, #12) and #12, participants should correspond to the trait seven undergraduate students par-
visually verify a map overlay “overlaying and dissolving ticipated in a pilot test that helped
process and then select the maps” (Golledge 2002). estimate the difficulty level of
appropriate map layers involved STAT and reduce the incidence
in the overlay. (See Fig. 1)
of errors in test administration.
(Continued on next page)
19
Jongwon Lee and Robert Bednarz
TEST RESULTS
20
Components of Spatial Thinking: Evidence from a Spatial Thinking Ability Test
21
Jongwon Lee and Robert Bednarz
22
Components of Spatial Thinking: Evidence from a Spatial Thinking Ability Test
23
Jongwon Lee and Robert Bednarz
24
Components of Spatial Thinking: Evidence from a Spatial Thinking Ability Test
component skill sets. The results also help explain why indi- Clements, D. H., M. T. Battista, J. Sarama, and S.
viduals perform well on some spatial thinking tasks while Swaminathan. 1997. Development of students’ spatial
performing poorly at others. For geography educators these thinking in a unit on geometric motions and area. The
results suggest that because students perform well on some Elementary School Journal 98 (2): 171–186.
tasks does not mean that they will perform well on others. If
Committee on Support for Thinking Spatially. 2006. Learn-
different tasks require different skill sets, performance may
ing to Think Spatially. Washington, D.C.: The National
be uneven. The results also suggest that giving students
Academies Press.
a variety of ways to demonstrate what they have learned
might reveal a student’s knowledge or ability that would go Dean, G. M., and P. E. Morris. 2003. The relationship
undetected if only one method of assessment is employed. between self-reports of imagery and spatial ability.
The two forms of STAT were equivalent in difficulty at British Journal of Psychology 94 (2): 245–273.
baseline, and therefore, the two forms of STAT can be used
DeMers, M. N., and J. S. Vincent. 2007. ArcAtlas in
for pre- and post-test designs to evaluate changes in spatial
the classroom: Pattern identification, description, and
thinking abilities over a brief period. In addition, the field
explanation. Journal of Geography 106 (6): 277–284.
tests in several different environments showed STAT was
useful for testing both university and high school students. de Vaus, D. 2002. Surveys in Social Research, 5th ed. London:
Our standardized measure needs to substantiate content Routledge.
validity more rigorously. This measure, however, provides
Doering, A., and G. Veletsianos. 2007. An integration of the
rigorous bedrock for testing that can be expanded with
use of real-time, authentic geospatial data in the K–1
new tests in the near future. The current version of STAT
classroom. Journal of Geography 106 (6): 217–225.
Downloaded by [66.31.30.1] at 19:41 02 January 2015
25
Jongwon Lee and Robert Bednarz
———. 1992. Do people understand spatial concepts: The Kyllonen, P. C., D. F. Lohman, and D. J. Woltz. 1984.
case of first-order primitives. In Theories and Methods of Componential modeling of alternative strategies for
Spatio-temporal Reasoning in Geographic Space, ed. A. U. performing spatial tasks. Journal of Educational Psychol-
Frank, I. Campari, and U. Formentini, pp. 1–21. New ogy 76 (6): 1325–1345.
York: Springer-Verlag.
Lee, J., and R. S. Bednarz. 2009. The effect of GIS learning on
Golledge, R. G., M. Marsh., and S. Battersby. 2008. Match- spatial thinking. Journal of Geography in Higher Education
ing geospatial concepts with geographic educational 33 (2): 183–198.
needs. Geographical Research 46 (1): 85–98.
Lloyd, R., and R. L. Bunch. 2003. Technology and map-
Golledge, R. G., and R. J. Stimson. 1997. Spatial Behavior: A learning: Users, methods, and symbols. Annals of
Geographic Perspective. New York: The Guilford Press. the Association of American Geographers 93 (4): 828–
850.
Hall-Wallace, M. K., and C. M. McAuliffe. 2002. Design,
implementation, and evaluation of GIS-based learning Lohman, D. F., and P. C. Kyllonen. 1983. Individual
materials in an introductory geoscience. Journal of differences in solution strategy on spatial tasks. In
Geoscience Education 50 (1): 5–14. Individual differences in cognition, ed. D. F. Dillon and
R. R. Schmeck, pp. 105–135. New York: Academic
Harris, L. J. 1981. Sex variations in spatial skills. In Spatial
Press.
Representation and Behavior Across the Lifespan, ed. L. S.
Liben, A. H. Patterson, and N. Newcombe, pp. 31–54. Marsh, M., R. Golledge, and S. E. Battersby. 2007. Geospatial
New York: Academic Press. concept understanding and recognition in G6–college
Downloaded by [66.31.30.1] at 19:41 02 January 2015
26