Challenge Based Learning
Challenge Based Learning
Overall Outcomes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
ISBN 978-0-9765087-4-8
Citation
Johnson, Laurence F.; Smith, Rachel S.; Smythe, J. Troy; Varon, Rachel K. (2009).
Challenge-Based Learning: An Approach for Our Time. Austin, Texas: The New Media Consortium.
Cover photograph: “Desert Moon Rising” by Josh Sommers on Flickr (http://www.flickr.com/photos/joshsommers/935470210/). Creative Commons.
We’ve known about it for more than 25 years now, since the publication of A Nation at Risk in 1983, and
despite billions of dollars of investment and massive reform projects like No Child Left Behind (NCLB), we
still find that three of ten kids drop out of school without a diploma.1 Each year the US sees its children do
worse in math and science than countries such as Kazakhstan, Latvia, and Lithuania.
The most recent study of global math and science performance2 shows US students making some gains
in the last four years, with fourth graders moving from 12th to 11th place, and eighth graders in from 15th
to 9th place in math results, but what the rankings do not show is that that is largely due to erosions in
performance around the world, not in the US making great strides. In fact, there is no significant difference
in science performance among US students in the last four years at all.
At the same time, the world has never had a greater urgency in ensuring that our children are equipped to
tackle the serious challenges that lay before them. The world, to a teenager, is a place rife with serious issues
— a global financial meltdown, planetary warming, dependence on fossil fuels, wars on two continents.
When polled, dropouts report that they leave school because it has no relevance in their lives. Employers
sponsor study after study documenting the skills the American workforce needs to stay competitive in a
global marketplace, yet increasingly employers are left looking overseas for those skills, as US schools are
by and large not cultivating them.
1 See Barton (2005) One Third of a Nation: Rising Dropout Rates and Declining Opportunities. Educational Testing Service Policy Information
Report
2 Trends in International Mathematics and Science Study, 2007 Results. See the full study at http://nces.ed.gov/timss/
What if we focused our energy not on test scores and rankings but on engaging students in their work?
What if their work was more than facts and formulas as presented in books, but relevant to the world they
see? What if rather than trying to teach them problem solving, we actually encouraged them to take on
problems that needed solving? Rather than teaching them a science curriculum, what if we opened the
door for them to do science?
Imagine a class where that sort of thing was the central focus. A class organized on solving real-world issues,
in the spirit of the exhortation made famous by John Lennon to “think globally, act locally.” A class where
the goal was to reach out to any discipline that could provide a piece of the solution, where kids helped
steer other kids to useful resources and knowledge. A class where the outcomes would be absolutely
authentic. A class that would touch on all the essential 21st century skills listed recently by over 40 leading
companies.3 Imagine further that in this class, more than 95% of the kids would self-report that they were
deeply engaged, and that they routinely worked in groups, accessed the Internet for just-in-time tools and
resources, and used the web and digital media to richly communicate their solutions.
That is just what a group of 29 teachers did in December 2008, working with a visionary team of educators
from Apple, Inc. The concept they all embraced was called challenge-based learning,4 and by any measure
it was a fresh approach. It called for a new way of thinking about the role of the teacher, one in which
he or she had to be comfortable as the students struggled and wrestled with a meaningful challenge,
letting them choose their own path to understanding within a clearly global issue like sustainability, global
warming, or war, and ultimately allowing them to come up with both questions and answers as they
directed the course of their own learning.
In a pilot of the approach that ran in a variety of formats in six schools across the US, fully 97% of the
321 students involved found the experience worthwhile. Students self-reported that they were learning
and refining skills that closely matched those identified by the Partnership for 21st Century Skills, even
though they were never shown that listing. Initially unsure their efforts would matter, by the end of their
respective projects 80% of participating students reported that they had made a difference in their schools
or communities by addressing their challenge. Students strongly endorsed challenge-based learning, with
four out of five saying they would definitely recommend the approach to other students.
This white paper tells the story of their efforts, and how the results of this pilot show that there is indeed
room in public education for fresh thinking. Kids are clearly engaged when they are allowed to craft
creative solutions — and the evidence from this pilot shows that when given the room and flexibility to
tackle things they see as not only relevant, but critical to their lives, they are not only engaged, but they
bring the learning to themselves.
The story begins as it did in real life, with an assessment of the reality faced by our public schools, and an
acknowledgement both of the work that has been done to this point and the work that remains to be
done. Challenge-based learning builds on a longstanding stream of solid educational thinking, and it is
clear not only from this pilot, but also from the literature that it works, so the case for change is something
we will touch on, but not dwell upon. Most of this story begs to be told via the voices of the students and
teachers who participated, and it is in their excitement and their
passion that the true success of this pilot can be felt.
If an unfriendly foreign power had attempted to impose No such immediate, conscious, and focused effort has taken place.
on America the mediocre educational performance that The reform efforts that have been implemented have not served
to rectify the situation; some have arguably made it worse. The
exists today, we might well have viewed it as an act of war.
most recent and, possibly, infamous of these, No Child Left Behind
— A Nation at Risk
(NCLB),6 has resulted in a severely restricted curriculum, greater use
of test preparation drills in place of instruction, and channeling of services away from students at the top
and bottom of the achievement scale in favor of those who are closer to the “pass/fail” cutoff for high-
stakes tests.7 To make matters worse, some feel that the harsh penalties for failing to meet the standards
set forth in NCLB have drawn schools’ focus away from deeper, more endemic problems.8
5 National Commission on Excellence in Education. (1983). A Nation at Risk: The Imperative for Educational Reform. Retrieved from http://www.
ed.gov/pubs/NatAtRisk/index.html
6 2002 reauthorization of the Elementary and Secondary Education Act (ESEA), known as No Child Left Behind (NCLB).
7 See Laitsch (2006).
8 Chapman (2007) makes this point, as well as pointing out that educational testing experts state that the 2014 standards goals set for schools
are utterly unattainable as set forth in NCLB.
Barton’s are not isolated observations.12 Although the situation has drawn considerable attention and
political focus to public education in the United States, teachers are still frustrated and we are still losing
30% of our students; it was only recently that we could even agree how to count dropouts. Students
are also leaving school earlier: in the past, students who left high school before graduation typically left
between their junior and senior year. More recently, the majority of dropouts leave high school between
grades 9 and 10.13
Legislative efforts, then, have not only failed to improve performance, but are also failing to keep kids
in school. The evidence shows that one of the main reasons students are leaving is because they are
Clearly, something has to change. If the reason students are leaving school is disengagement and a feeling
that the work is irrelevant, clearly the solution is not to mandate higher test scores. Rather, let us consider
for a moment the implications of addressing the dilemma students are actually having.
Young people are not blind to the world’s problems. They are aware that the world
The time to begin is now. There
economy is in a dangerous and delicate condition, and they have a clear sense of what
is not one moment to waste.
a collapse would mean — to themselves, their families and friends, and to people across
— A Stagnant Nation
the country and around the globe. They realize that the planet’s temperature is climbing,
slowly but perceptibly, and that they may see the effects of that change in their lifetime.
They understand that their lifestyle is built upon nonrenewable energy sources and they know some of
what that implies.
There are real problems that need solving, and young people understand that no less than adults do. They
see these important issues taking the international stage and they know that school is not preparing them
to address challenges of this level. And one in three makes the choice to leave.
It is time to try a new approach. As the scope and potential causes of the nation’s dropout problem are
more fully realized, school reformers are attuned to innovative ways to help keep student engagement
high. Connecting class work to the real world is one obvious way to attain this goal.17
The educator by the very nature of his work is obliged to see his
present work in terms of what it accomplishes, or fails to accomplish,
for a future whose objects are linked to those of the present.
— Experience and Education
None of these approaches have taken hold in K-12 education, partly because they are bolted on to the
curriculum in addition to everything else that must be done. Other drawbacks are that it can be
difficult to identify appropriate candidates for projects, since not all topics lend themselves to being
framed as problems; and teachers must become project managers as well as guiders of learning.
Within a teaching environment that is heavily influenced by the demands of standardized testing,
it can be very difficult for problem-based learning approaches to take root and flourish.
Instead, what is needed is a new teaching model that incorporates the best aspects of problem-
based learning, project-based learning, and contextual teaching and learning while focusing on real
problems faced in the real world. This model must engage students’ curiosity and desire to learn. It
must make the solving of real problems the center of the curriculum, give students access to 21st
century tools, and require them to work collaboratively and manage their own time. It must
allow students to direct the course of their learning and engage teachers in a supportive, very
necessary role as guides.
Challenge-based learning is such a model. As the teachers and students found who participated
in this pilot project, challenge-based learning brings relevance to class work. By giving
students the opportunity to focus on a challenge of global significance, yet apply themselves
to developing local solutions, challenge-based learning creates a space where students can
direct their own research into real-world matters and think critically about how to apply what
they learn. The result, as this study shows, is increased engagement, extra time spent working on the
challenge, creative application of technology, and increased student satisfaction with schoolwork. Not
incidentally, students also mastered the subject-area content and developed many of the skills identified
as vital for 21st century learners.
Challenge-based learning builds on the successes of problem-based learning models where students
engage in self-directed work scenarios (or “problems”) based in real life. In challenge-based learning, as
18 Dewey (1938) held that it is the responsibility of the educator to present students with problems that have some bearing on their current
experience, and to make the problem sufficiently interesting to engage learners and arouse their curiosity and natural desire to learn.
19 See, for instance, Pearlman (2006); Saye and Brush (2004); Ward and Lee (2004); Maxwell et al. (2001); and Berns and Ericson (2001).
Big Idea
Essential Question
The Challenge
Solution – Action
Assessment
Publishing – Student Samples Publishing – Student Reflection/Documentation
A unique feature of challenge-based learning is that problems are tied to an idea of global importance
(war, say, or the sustainability of water). Students are able to research the area of the challenge in terms of
events taking place in the world around them, strengthening the connection between what they learn in
school and what they perceive outside it. They then work in teams of co-learners, further increasing their
interest in the process and giving them valuable experience in team dynamics and collaborative work.
Teachers act as coaches to the student-centered communities of practice, addressing individual questions
and concerns and stepping in to help the students retain their focus if the problem seems too large.
A key feature of challenge-based learning is that it appropriates the networking tools and media
production techniques already being used in daily life by many 21st century learners. In preparing the final
products of their research — presentations of their chosen solutions — students draw upon photography,
videography, audio recording, and writing skills that they may already be using as web content producers.
If they are not already doing those things, challenge-based learning provides an engaging opportunity for
them to hone these kinds of high-level communication skills.
As will be seen from the research findings, challenge-based learning motivates students to come to class
and do well. It leverages technology tools to put the daily experiences of students in the service of their
education. It focuses learning on real-world issues, gives students a chance to work on important problems,
gets their voices heard, and empowers them to influence their community for the better. Challenge-based
learning has real potential to reverse the slipping trend of poor retention, low scores, and disengagement,
turning learning into an exciting, meaningful experience — as it is meant to be.
While the potential benefits of challenge-based learning present a persuasive case for its use, the details of
implementation and the actual effects on student learning, teacher planning, and curriculum integration
had not been tested and thus were largely unknown. In the fall of 2008, Apple, Inc. decided to put challenge-
base learning to the test, in a pilot study that could not only inform practice, but also be replicable across
a wide variety of school settings. Six schools from across the country, all schools with one-to-one laptop
initiatives in place, were chosen to participate.
20 http://images.apple.com/education/docs/teachers/Apple-ChallengedBasedLearning.pdf
To prepare for the pilot, the teachers and staff attended a two-
day workshop at Apple’s headquarters in Cupertino, where
9th Grade
working in school-based teams, they selected one or more “big 250 Students
ideas” as the focus of the projects that would take place on their
campuses,21 identified a local challenge related to those “big ideas,”
and planned how the projects would play out at their schools.
Comparative Race/Ethnicity Each teacher was interviewed individually at the meeting to record his or her
Category All US Project Schools initial feelings about the project. Teachers expressed apprehension, excitement,
White 63.5% 54.8%
Black 15.7% 5.2%
and enthusiasm at the thought of working with their students on a project as
Hispanic 14.9% 8% open-ended as a challenge-based learning project is. They recognized that the
Asian/Pacific Islander 4.7% 17.9%
American Indian/Alaska Native 1.2% 1% projects would be challenging to lead, but felt that they would be effective and
Multi-Ethnic 11.4%
Unreported 1.7%
that the students would find both the challenges and the process engaging.
100% 100%
US categories and local and national data from National Center for Edu- Once the working groups returned to campus, the project moved very quickly.
cation Statistics (NCES) http://nces.ed.gov/programs/digest/d07/tables/
dt07_097.asp Two schools, Manor New Technology High and Punahou High School, elected to
implement their challenges in just five days. Moreau Catholic spread their work over two weeks, allocating
every other day to the effort. The remaining three schools chose a three-week window.
21 The big idea was meant to be a concept with far-reaching significance that impacts humanity. The essential questions created a more specific
focus for the big idea and guided the students toward one aspect of the larger concept. The challenge brought the big idea and essential
question home with a local call to action. The big ideas, essential questions, and challenges tackled in the pilot projects were all identified by
the teachers during the December planning meeting
The first task was for the teachers to explain the process to their students and present the big idea, the
essential question, and the challenge. The students’ task was to define guiding questions — smaller pieces
of the essential question that could be researched to increase their understanding of the big idea — and
brainstorm solutions to the challenge, finally choosing one to plan and implement locally. Each group was
to create a video or a website describing the results of their research and promoting their solution to the
challenge. While not every group produced the same level of quality, it was clear that across the board, the
students gave much of themselves to the work, and some of the materials are extraordinary.22
The journals — in both written and video form — describe the experience from the
Subject Disciplines Represented
point of view of the teachers, students, administrators, and staff at points throughout Asian History History
Biology Mathematics
the process as they were immersed in the project. All in all, students submitted more Chemistry Multimedia
than 1200 written journal entries. Dozens of hours of teacher interviews were captured, Computer Animation Physical Science
Graphic Design Social Studies
along with pre- and post-data on the impressions of all participants in the project, and Earth Science Study Skills
Engineering Theatre
of course all the effort produced a rich treasure trove of student-produced content
English World Studies
related to their projects. Health & Physical Ed
Collectively, these materials richly describe the six unique approaches taken at each of the pilot schools,
with frank clarity about using challenge-based learning, which participants found at times daunting, at
times puzzling, but always challenging and engaging.
These interviews, journal entries and other materials produced as part of the six implementations, comprised
the primary research materials used in this study.23 Data was captured on virtually every aspect of the
process, with perspectives representing
I think it’s going to be scary, and I think it’s going to take people out of their
faculty, support staff, administration, and of
course, students. comfort zone. I think that’s going to be important, because too often we get stuck
in that rut. My brain keeps racing about all the different ways that I could use it in
different classes. I’m ready to go back and do this in every one of my classes.
— Teacher, Pratt High School
22 To see the student-produced materials, see the Challenge-Based Learning website, at http://www.challengebasedlearning.org
23 The primary qualitative analysis techniques employed were cross-case analysis and clustering. For an excellent discussion of these and other
qualitative analysis techniques, see Miles and Huberman (1994).
students reported that the kids learned things that mattered Source: Partnership for 21st Century Skills http://www.21stcenturyskills.org/
The end results of the seven challenge-based projects exhibited a range of quality and depth, and the
researchers spent some time analyzing why some projects went so much farther than others. Given
the concerns expressed by teachers about time and scheduling, the expectation was that schools who
devoted less class time to the effort would see end products of lesser depth or quality, but that was not the
case. Schools used a variety of time frames in structuring their projects. Two chose a five-day model, one
an every-other-day model that ran two weeks, and three devoted an entire
three-week period to the projects. Personally, I got quite a bit out of this project.
I feel like our team’s work really helped to get
None of the difference in outcomes or quality of student work, however, could
be attributed to time allotted or scheduling. One of the one-week schools kids thinking about their grades, and when
had several of the most creative projects; one of the three-week schools was our solution is implemented, I believe it will
not able to complete their final projects. be very successful!
—9th grade student, O’Neill Junior-Senior High School
What appeared to be the most critical factors related to quality and depth of the final outcomes were first
the degree to which the students felt the work was meaningful and could actually make an impact on
the challenge. This dynamic appeared to energize the students to devote considerable extra effort to the
outcome. The second factor that emerged from the analysis was how the available time was used. Students
seemed to flounder when too much of the allotted time was devoted to “big picture” brainstorming, and
they then found themselves running out of whatever time they had, with the result either being a simply
“doable” solution that was not perceived as terribly worthwhile or impactful, or one so large it could not
be completed.
25 That figure is equivalent to 3.4% of students. More than 75% of the teachers saw positive ratings of 100%.
From the very start, students were excited about being involved in a national pilot of this scope. Because
they knew they were being studied, the Hawthorne Effect26 cannot be discounted. The allure of being
videotaped, with their activities regularly chronicled and knowing that there was an audience beyond the
classroom and even their community cannot be discounted as a motivator. Many spoke explicitly about
their hopes that the pilot project itself would lead to changes in schools.
I think that schools today need to change … if teachers would focus on more than one teaching
styles then less people would drop out and everyone would get better grades. And I think that it
will help us prepare for the real world. In school things are different, they give us papers and we
fill in the blanks. We never problem solve. I also hope that we can maybe change the way the
rooms set up, because as small of a thing as it is, it affects us. A lot of people give up just walking
in the door and seeing the rows of desks.
9th grade student, Pratt High School
26 The Hawthorne Effect is a term coined by Henry Landsberger in his 1958 book that looked at the results of several landmark studies of
industrial management at the Hawthorne Works factory between 1928-34. The term refers to a measureable effect caused by the act of
observation that in and of itself has been shown to cause statistically significant improvements in outcomes. See Landsberger, H. (1958).
Hawthorne Revisited, Ithaca, New York: Cornell University Press.
A significant number anticipated enjoying the real- Figures sum to more than 100 due to multiple responses. Stu-
dents were very positive both going into the effort and after,
world aspects of problem solving, making a difference, with only 3.7% reporting a less than positive experience.
Personal
thinking creatively, and teaching their peers. growth
Student Outcomes. One of the key attributes of a successful challenge-based learning project is the
sense that the work is real, that it will make a difference. As the pilot projects got underway, nearly 86%
of students felt they would be able to or possibly could make a difference in their community as a result
of working on this project; by the end of the effort, 80% were certain it did, and
The Student Experience:
another 10% thought it could. In the analysis, a clear relationship was found between
Do you think you can/did
those classes in which students felt that their ideas could make an impact and the make a difference?
Maybe/ Maybe/
Possibly Possibly
As noted in the overall outcomes, a two-thirds majority looked forward to learning
No
new skills or information, citing technical, critical thinking, communication, research, No
leadership, and presentation skills among those they expected to improve, all skills
noted as critical by the Partnership for 21st Century Skills.27 Nearly a third anticipated
personal growth in areas like confidence, personal fulfillment from making a
difference, learning about themselves, and cultivating a sense of accomplishment.
Yes
Yes
Other
are being used up. I also am really interested in learning what else
Pre-Project outcomes*
we can do to help conserve trees. I am also looking forward to being
documented along the way because then we will be able to see the
progress we are making.
Personal 9th grade student, Moreau Catholic High School
growth
Post-Project
Learning
new skills and
As the projects unfolded, the students’ first task was to
information
identify the guiding questions that would direct
Other
outcomes* their research, brainstorming ideas, and planning
their teamwork. Asked what they felt they had
Learning accomplished, a majority noted that their teams had
Personal new skills and
*eg life lessons, new friends, satisfaction, chance to growth information
play a leadership role
made progress narrowing down and researching
Overall, student reported outcomes aligned very their topics; most of these reported learning
closely with 21st Century Skills.
something new. Well over a third named specific
actions related to the process of challenge-based learning,
such as framing their guiding questions, brainstorming ideas, planning, or completing a project task. Nearly
one-fifth felt they had improved corollary skills such as teamwork and facility with technology.
At the mid-point of each project, students were clearly engaged and excited. Journal entries and videos
both document that kids were busily researching topics, refining solutions, and beginning to prepare
media projects and final presentations.
I love this project. I am learning more than I could have ever expected. Gathering information
is going very well. I never knew how big of an event World War I was, and I have never heard
about it.
9th grade student, Mooresville Graded Schools
This week we made a survey and had people answer some of our questions about grade apathy.
We also did many interviews of teachers and students, to see if [what] we thought really was
apathy actually was. Right now we are tying our information together and trying to figure out
a solution. I think we are going to interview a principal from another Nebraska school where
they have teams and get “points” for getting good grades and going out for activities. We think
this could be a good idea in our school.
9th grade student, O’Neill Junior-Senior-High School
When asked how they managed these challenges, it was clear that students were solution-oriented, and
overcame challenges by applying extra effort or time, working through things in their groups, being
persistent, and maintaining a positive attitude.
It was very hard at first because this project was self-directed. My group and I had never
experienced a self-learning project so it was difficult to know how and where to begin. I didn’t
like how you weren’t able to ask the teacher for an answer, or how you weren’t able to answer
the teacher. Instead you had to do both the asking and the answering which was very difficult
… [but] as we worked through it, it became easier and started to come more naturally. We
divided up the work so that we could compile everyone’s ideas into one. We also documented
our work, which helped us to understand what to do next …
10th grade student, Punahou School
By the final third of their projects, students were deeply involved in the multimedia presentations describing
their solutions.
When their projects were completed, students were asked to complete post-project surveys. The vast
majority of students (96.7%) felt the project turned out positively overall; only eleven students (3.3%) felt it
went fairly poorly or poorly. Students took away improved skills in teamwork, technology, critical thinking,
research, communication, and presentation (a third cited these) as well as personal growth and impact on
their peers and community (a quarter noted gains in these areas). Topic area learning was noted by one in
five as a positive gain.
The main accomplishment in the eyes of many students was the presentation they created. A similar
number noted the learning that occurred as they researched their topics. Improved skills were cited here
again; a quarter felt a sense of accomplishment in technology, teamwork, communication, and other
skills that correlated highly with the listing compiled by the Partnership for 21st Century Skills. Significant
numbers commented that they felt that they had an impact on their peers, school or community.
A key global indicator about the quality of the student experience is the degree to which students would
recommend the approach to their peers who might be considering such a class. Significantly, four of five
students said they would definitely recommend a challenge-based learning project to their peers; another
almost 10% reported that they might, depending on circumstances.28
28 For more on the student experience, and to hear students talking about their projects in their own voices,
see http://www.challengebasedlearning.org
In terms of background, the teachers involved in the project were very typical of the field. The group
included first year teachers and some with a great depth of experience; the average was 10.1 years in
the classroom, and seventeen subject areas were represented. While a technically savvy group overall,
with over two years experience working in a one-to-one laptop environment, there was also a range of
capability in technical background among the teachers involved.
The teachers were formally interviewed on video at five points during the project, but informal interactions
also were captured, and researchers spent a good deal of time simply listening as teachers worked through
the initial planning and throughout the project. All of the teachers were interviewed during the kickoff
meeting; as the project was underway, each teacher was interviewed at least once. Teachers were asked
what students were learning and how they were doing; how the project was unfolding; what surprises
they had encountered so far; and what was working well, and what was not.
One of the things that really struck me … was the challenge-based approach of having a topic,
asking a question, then asking further questions, refining… the whole process [is reflective of ]
the scientific method, exactly how you would go about doing the research and writing for a
paper traditionally … this is a great way to go about doing that. I think it’s going to really affect
who I am as a teacher.
Teacher, Punahou School
a difference. The teachers also acknowledged How did the project turn out?
that it would be a new experience for them
Kids worked Positive changes
and for the students. Some indicated that they Exceeded expectations well together in students
100% Time or
99.3% 72.8%
were feeling scared, uneasy, or skeptical about technical issues
17%
how the project would work. A few expressed
While teachers expressed strong reservations about whether the students were up to CBL, citing con-
reservations about whether the students would cerns about process, group dynamics, technical skills, and mastering the content, every single teacher
reported that the results exceeded their expectations. In the end, only time and technical issues re-
be comfortable with the open-ended method mained significant concerns. Figures sum to more than 100 due to multiple responses.
In terms of student reward, I think the project is going to be fantastic. If student engagement is
the problem … then getting them projects where they get to be active in class is definitely the
key to the solution. I mean, think about how many hours students spend in a classroom in a
week, and how many of those hours are spent sitting, physically sitting, just listening? I couldn’t
sit still and listen for that long. … I think [it’s] going to be great.
Teacher, Punahou School
The teachers anticipated a variety of obstacles to overcome and the need to work around important
constraints in order for the project to be successful. Chief among these were a variety of concerns
about the process of challenge-based learning, which
The Teacher Experience: Perceived hurdles, pre vs post project
was understood post-project to be part of their own
Biggest hurdles would be …
learning and preparations. The most often mentioned
constraint was the tight time schedule (noted in 34.6%
Time/school
Various process concerns
of the responses). Motivating students and getting them schedules
75% Getting thru the
34.6%
required material
interested in the project was seen as another potential 23.1%
challenge, as was the need to align the project with the Motivating
the kids
Biggest hurdles were … 26.9%
required curriculum so that they could ensure that the
required material was covered.
Time
27.6% Technology issues
6.7%
Interim Observations. Fourteen teachers completed interviews during the first phase of their projects,
another dozen at the midpoints, and the remainder as their projects wound down. Their comments and
observations reflect the actual experiences they were having in real time as the projects unfolded.
From the moment the projects began, the teacher comments reflected surprise on a number of levels.
Teachers noted that students that typically did not engage were diving into project work; students were
eagerly researching and collecting data, working on their guiding questions, sorting out their teams, and
getting their arms around the challenge. Most of the teachers
The Teacher Experience: Typical surprises expressed
observed new forms of thinking in their students, including
Students who typically did not participate were engaged and involved
learning about themselves, learning to ask good questions,
Attendance was higher than usual during the project
becoming more aware of their environment, and struggling not
Students and teachers alike learned a lot of new technology
Students showed noticeably positive changes in attitude and skills to jump directly to solutions. While some occasionally referred
Student changes occurred on dimensions such as taking on leadership roles, pride in work, and to the process as chaotic at times, they also all observed that
showing positive feedback and support for other students.
something new was happening.
It is the questions that they ask. When they ask a question that I didn’t even think of myself. Or
when they find a resource or figure out to use a resource that I didn’t even think of. I am having
these moments where I am like, “man, what a good idea!”
Teacher, Mooresville Graded Schools
I have been amazed at how engaged they are in what they are doing. You don’t very often walk
into a classroom and see the whole class totally engaged in what they are dong and these kids
are. Everyone is working on their computer and doing what they are supposed to.
Teacher, Pratt High School
Asked to comment on what was not working early on, one-fifth said everything was working
well. Another fifth encountered process issues, such as students trying to jump right to
the solution or failing to understand the challenge, and the difficulty of guiding
students without giving out answers. Time constraints were causing some
strain to others, while a few cited the formation of teams as a trouble
spot. Other issues were more local, such as a difficult trip to the library
or student absences, but with very few exceptions, all more at the
group than the class level, these sorts of concerns disappeared as the
projects unfolded.
When a student came back from Thanksgiving, and I had said, “See who
you can contact,” and [this] kid comes back with contact information from a
professor who teaches in London…Talk about taking this to an international level,
this girl. I can’t believe she had the guts to do that as a 14-year-old kid. She just
wanted a good resource, even if it was across the ocean.
Teacher, Mooresville Graded Schools
The level of engagement is so much higher. Think of it as an s-curve and there was a lull and
everyone was confused and not sure what was going on. The it just spiked in terms of what was
going on, activity levels. Now we are still at the top of that curve and everyone is working hard.
Teacher, Mooresville Graded Schools
Many teachers (83.3%) expressed surprise at the high levels of student enthusiasm they were seeing; one
teacher noted that a student who was out sick connected through video chat to take part in class from
home.
One of the biggest surprises for me was the enthusiasm from one of the particular classes of
students. They are the ones that have the most trouble academically. They are a class specifically
for learning study skills. But this particular research, and topic, and brainstorming they seem to
really be enjoying. So it is bringing out a creative side of them that they might not have been
aware of.
Teacher, Moreau Catholic
…[the] kids have made connections with resources in the community, human resources, experts,
local people that know more about the subject area than us … People in our community are
seeing what kids care about and what they are doing in the school. I think that is going to be a
huge byproduct of challenge-based learning.
Teacher, O’Neill High School
The amount and quality of work being done, and the skills students were developing also came as a
surprise; many teachers commented on this. In particular, teachers noted that students were mastering
the technology quickly and rapidly becoming creative with it. By mid-project, over ninety percent of
the teachers felt that one of the aspects of the project that was going especially well was the students’
attitudes and their involvement in the work. The use of technology and community resources was cited
as a positive factor by a third.
Eleven teachers recorded interviews toward the end of the projects, when students were primarily
working on their media presentations. Teachers observed that students were still very enthusiastic and
their solutions looked promising. Students were developing practical skills such as teamwork and time
management. By this point, the great majority of the teachers (81.9%) felt the projects were unfolding well,
but time remained an issue throughout the program.
engrossed, engaged. They were doing the project for the Having the chance to work with other teachers
Allowing and encouraging cross-grade-level interactions
sake of doing the project, not because of all of the different
Seeing the kids get so excited
external motivators that we have in the school. I saw the
Giving students the freedom to come up with their own ideas
potential of this curriculum model and I saw the potential Seeing students naturally use math skills from the normal parts of the class
of technology in the classroom. I felt like this was the best Emulating real world problem solving
use of technology I had seen in my classroom. Seeing kids learn things they can then teach adults
Seeing kids create a meaningful product about people in their community
Teacher, Punahou School
Having the chance to be creative
Forming new bonds with kids and other faculty
Teacher Outcomes. Clearly the teachers felt that challenged-
based learning was an effective strategy. Fully 100% of the
teachers said that their students exceeded their expectations in terms of quality and quantity of work.
Nearly all (99.3%) of the teachers noted that the student teams worked well and that students were
collaborating and learning from each other. A majority (72.8%) also observed positive attitudes and growth
in the students over the course of the project.
After the projects were completed, respondents felt the project turned out well and was a valuable
experience that students will remember; they were pleased with the content that was created and
excited to see what the students came up with. Teachers were stuck as much as the students were with
the engaging nature of the challenge-based learning process; fully half of the teachers expressed a wish
for more time to implement the ideas that their students developed. Many singled out the benefits for
students, including increased motivation, taking ownership of their learning, and directing their own
activities.
… there was a day when the kids had been out and about in the campus and had interviewed
some students. They came back and they were all excited and interested, and clearly their
interest in the project had increased. Then I read some of the journals they had done, and it was
clear to me that there was some thinking going on in the students that I hadn’t realized.
Teacher, Punahou School
Serendipitous opportunities were plentiful, although they varied from teacher to teacher, as might be
expected. One teacher found that the work merged well with her curriculum standards; another picked
up ideas for future practice from the work her students did. Another appreciated the opportunity to see
students working in a new environment.
Challenges, too, varied; while two teachers reported the time crunch as a significant challenge, others
struggled with managing groups of students working in different directions, or with accepting student
solutions that took a different tack than expected.
The biggest hurdle we ran into was the actual tech skills of our kids. Their skills I thought were
a little stronger than they were. They use it for a lot of different things but all of the sudden,
they fell back into their comfort zones [of ] writing a paper or doing a PowerPoint or keynote
presentation… It was a challenge to push them past their comfort zone.
Teacher, Pratt High School
Some teachers had difficulty adjusting their teaching practice to the challenge-based learning model;
50% felt that planning and structuring class time, remaining hands-off, and not pushing the students one
way or another were very challenging.
The teachers were united in feeling that the most meaningful outcomes related to the student experience.
All of the respondents noted benefits such as cross-grade interactions, real world problem solving, student
freedom and excitement, creativity, community involvement, and students teaching their peers and
adults what they had learned. Additionally, many teachers identified benefits to themselves, in the form of
opportunities to work with their colleagues and to form new bonds with both students and faculty.
In the final analysis, most teachers had similar responses to the approach as their students. They found it
fresh, exciting, and new. The learning felt real, meaningful, and authentic to everyone involved. The open-
ended process was challenging at times, because it required critical thinking and action to move forward,
and there were moments when both teachers and students felt the stress of evaporating time.
The aspects of the approach that offer the most promise also require careful planning. Teachers found
that engaging students in learning and asking them to set their own directions within a larger framework
meant shifting the locus of control, placing everyone in a new context. Understanding and planning for
that was thought to be key.
As the pilot was finished, the projects put away, and the analysis of the data completed, the overarching
feeling of everyone involved was that this was by any measure a most successful pilot. Not only was
challenge-based learning shown to work, and work effectively in populations of some of the most at-risk
kids in American schools, it was also clear that it can be done more effectively. That is the point upon
which this report will end — with a look to next steps and continuing efforts.
sort of the added boost that we need to do it, to get started. questions, a chance for teachers to express their concerns
and be heard, and an opportunity for them to collaborate
— Teacher, O’Neill Junior-Senior High School
on designing the challenges.
Bring teachers together in multidisciplinary teams to plan and carry out the project. Participating
teachers were enthusiastic about the opportunity to work directly with their peers at their own schools,
not only in conceiving the challenge, but also all throughout the project. They found the connection
with other teaching professionals to be very valuable in terms of sharing ideas and resources, helping
one another through tricky or uncomfortable spots, and helping students make connections between
Select the challenge carefully, and make it a real one. It is crucial for the challenge to actually
relate to the real world and for it to have an impact on the students’ families, local communities or school.
Student comments indicate excitement and engagement around the idea of being able to personally
have an impact, and a majority of students both anticipated that they would be able to make a difference
and felt that they had afterward.30 It is also important that the size of the challenge be in line with the time
and resources available for the project; if the challenge is too big, kids do not know where to start and
will feel stressed and pressured for time at the outset. The teacher’s guidance is extremely important both
in selecting appropriate challenges and in framing them in such a way that students can get their arms
around what is being asked of them.
Build 21st century skills into the project right from the start. While nearly every skill identified by
the Partnership for 21st Century Skills emerged naturally from the types of activities students engaged
in as they worked on the challenges, it would be very easy to hit them all. Teachers who are aware of the
list of skills can incorporate specific project components to build on them, such as the health awareness
component of the project on food sustainability at Manor New Technology High. Skills like financial and
economic literacy are a natural fit for challenges related to the economy, but almost any topic could have
a financial component. Teachers can plan final project requirements that incorporate subsets of the 21st
century skills, or encourage exploration and research that helps students develop certain skills.
Whatever the timeframe, teachers need to budget project time wisely. The pilot demonstrates
that outcomes are independent of the length of the project; challenge-based learning projects can be
designed to take place in a single day or last an entire school year. The critical issues around time are to
allocate it in proportion to the scope of the challenge, and to help students break down the overall project
length into reasonable segments. Enough time must be allowed for students to work through the big idea
and brainstorm research questions, but there is a point of diminishing returns when brainstorming must
end and research must begin. Likewise, students need plenty of time to do the research and brainstorm
solutions, but then they must stop brainstorming and select one solution to develop. These points in the
project are difficult for students to recognize, particularly if they are new to challenge-based learning.
Teachers must design the experience to create a feeling of pressure such that students understand how
to move on at the right points.
29 With regard to outcomes of the project, 38.4% of the teacher comments in the pre-project survey indicated an expectation that challenge-
based learning would have a positive impact their teaching practice; of those, a third mentioned the beneficial effects of working with
other teachers. In the post-project teacher survey, 37.5% of the comments about outcomes dealt with professional development and new
connections with other teachers and students.
30 See page 22, The Student Experience: Do you think you can make a difference?
Allow dedicated work time during the school day. Teachers reported that once the project got
going, students were very engaged in their work. Some teachers reported increased attendance during
the project; one teacher even remarked that a student who was home sick arranged to be present via
videoconference so as not to miss out. Students worked on their projects outside school hours, as well.
Clearly, the challenges were important and engaging to the students. Emphasize their significance by
scheduling daily time for project work.
I think that this project is going really well. I like having Give students access to technology, and provide adequate
technology support. Each of the schools in the pilot is a one-to-
the option to use the Internet to gather information
one school (every student has his or her own laptop with Internet
as well as using books. This allows me to be able to get
capability). Students and teachers alike noted that having access to
a lot more information pertaining to my specific topic the computers and to the Internet 24/7 was a critical component of
as opposed to having to scour a lot of books to get the the project.32 Students preferred to be able to do research wherever
same information. Also, I like being able to make the and whenever they needed to, and easily accessed information on
multimedia presentations a lot because they are so the fly as a normal part of their working strategies. Media literacy
and presentation skills are important parts of the 21st Century
much better than making a project with the traditional
Skills set, and fit naturally within the challenge-based learning
materials. I can convey the same information in a more
framework. Students clearly felt that preparing the multimedia
timely and interesting manner. I can’t really think of presentations of their proposed solutions was a source of great
anything that isn’t going well with this project. satisfaction. Naturally, problems occasionally arose, particularly
— 9th grade student, Mooresville Graded Schools with video formats, and it is critical to have someone on hand who
can troubleshoot, give guidance, and make any needed repairs or
updates to the technology so that students can continue working. In the planning stages, spend some
time discussing the media needs of the project. Consider setting out clear recommendations for media
size and format, perhaps including software settings for rendering or exporting video, so that students
clearly understand how to prepare their final work.
31 In open-ended responses, research was consistently cited by students as one of the aspects of the project that was going well throughout.
32 In pre-project surveys, 12.1% of students mentioned technology skills as something they expected to acquire during the project. In weekly
surveys, technology skills were reported as a key learning each week.
Practice, iterate, and improve the process. At the outset, teachers were very concerned with how the
process would unfold. They were apprehensive about giving up control and worried that students would
not pick up the reins and do the work. By the end of the project, however, those concerns had virtually
evaporated.33 Students, too, were nervous at the start; they
Yes, I would [recommend this kind of project to other students].
were not sure how to act in a situation where they directed
Not only that, I think that the work that people accomplish
their own learning. When it was all over, the majority of
students said they would recommend a similar project to should, some way, be published, so people would know about
other students, and overall they felt the project went fairly the changes that need to be made, and soon.
well or very well.34 —10th grade student, Manor New Technology High
W
e began this report with the observation that the children in our schools today will inherit
unprecedented problems that will need to be addressed in their lifetimes. We know that
decades of reform have not given us hope that the erosion of skills in our youth will subside.
Challenge-based learning is one of those ideas. Fresh, new, relevant to today’s issues, it is an approach
uniquely suited to our time. The findings of the Challenge-Based Learning pilot are encouraging, and clear.
They solidly support further experimentation, further research, and further work in the field.
More than that, they show it works. We know we need to make learning relevant to the challenges youth
will face in their lifetimes—and we can.
33 See page 25, The Teacher Experience: Perceived Hurdles, Pre vs Post Project.
34 Of the students who responded to the post-project survey question, Would you recommend a project like this to other students?, 88.1% said they
would or they might, while only 11.9% said they would not. Also see page 19, The Student Experience: Pre and Post Impressions.
Ancess, J., & Wichterle, S. (2001). Making School Completion Integral to School Purpose and Design. New York:
National Center for Restructuring Education, Schools, and Teaching. Retrieved on December 20,
2008 from http://www.civilrightsproject.harvard.edu/research/dropouts/ancess.pdf
Barton, P. (2005). One Third of a Nation: Rising Dropout Rates and Declining Opportunities. Educational Testing
Service Policy Information Report, 2005. Retrieved December 20, 2008 from http://www.ets.org/
research/pic/onethird.pdf
Berns, R. and Erickson, P. (2001). Contextual Teaching and Learning: Preparing Students for the New
Economy. The Highlight Zone: Research @ Work No. 5.
Boaler, J. (2002). Experiencing School Mathematics: Traditional and Reform Approaches to Teaching and Their
Impact on Student Learning. Lawrence Erlbaum Associates.
Bridgeland, J.M., DiIulio, J.J., & Morison, K.B. (March 2006). The Silent Epidemic, Perspectives of High School
Dropouts. Retrieved on December 20, 2008 from http://www.silentepidemic.org/epidemic/why.
htm
Chapman, L.H. (2007). An Update on No Child Left Behind and National Trends in Education. Arts Educational
Policy Review, 109(1), 25-36.
Cognition and Technology Group at Vanderbilt. (1992). The Jasper series as an example of anchored
instruction: Theory, program description, and assessment data. Educational Psychologist, 27, 291-
315.
The Greaves Group, Strategic Educational Consulting. (2006). America’s Digital Schools, A Five Year Forecast:
Mobilizing the Curriculum. The Greaves Group & The Hayes Connection. Retrieved on December 20,
2008 from http://www.ads2006.org/ads/index.php
Haney, W., Madaus, G., Abrams, L., Wheelock, A., Miao, J., & Gruia, I. (January 2004). The Education Pipeline in
the United States, 1970-2000. Retrieved on December 20, 2008 from www.bc.edu/research/nbetpp/
statements/nbr3.pdf
Laitsch, D. (2006). Assessment, High Stakes, and Alternative Visions: Appropriate Use of the Right Tools to Leverage
Improvement. Policy Brief. Education Policy Studies Lab. Tempe, AZ: Arizona State University.
Maxwell, N., Bellisimo, Y., Mergendoller, J. (March/April 2001). Problem-Based Learning: Modifying the
Medical School Model for Teaching High School Economics. The Social Studies, 92(2), 73-78.
Mergendollar, J.R., Markham, T., Ravitz, J., & Larmer, J. (2006). Pervasive Management of Project Based Learning,
Teachers as Guides and Facilitators. Buck Institute for Education.
Miles, M.B., Huberman, A. M. (1994). Qualitative Data Analysis. Thousand Oaks, California: Sage
Publications.
National Center for Education Statistics (NCES). (2007) Digest of Education Statistics. Retrieved January 22,
2007 from http://nces.ed.gov/programs/digest/d07/tables/dt07_097.asp
National Commission on Excellence in Education. (1983). A Nation at Risk: The Imperative for Educational
Reform. Washington, D.C.: US Department of Edcuation.
Neild, R.C., Stoner-Eby, S., Furstenberg, F. (2008). Grade and High School Dropout Connecting Entrance and
Departure: The Transition to Ninth. Education and Urban Society, 40(5), 543-569. Sage Publications.
Retrieved January 7th, 2009 from http://eus.sagepub.com/cgi/content/abstract/40/5/543
Partnership for 21st Century Skills. (2009) Framework for 21st Century Learning. Tucson, AZ: Partnership for
21st Century Skills.
Pearlman, B. (2006). Twenty-first century learning in schools: A case study of New Technology High School
in Napa, California. New Directions for Youth Development, 110. Wiley Periodicals, Inc. Published
online in Wiley InterScience www.interscience.wiley.com
Sanchez, C. (2007). U.S. Test Results Show Growth in Math, Not Reading. All Things Considered, September 27,
2007. National Public Radio. http://www.npr.org/templates/story/story.php?storyId=14698611
Stillwell, R. and Hoffman, L. (2008). Public School Graduates and Dropouts From the Common Core of Data:
School Year 2005–06. National Center for Education Statistics, Institute of Education Sciences, U.S.
Department of Education. Washington, DC. Retrieved on December 20, 2008 from http://nces.
ed.gov/pubsearch/pubsinfo.asp?pubid=2008353rev
Strong American Schools. (2008). A Stagnant Nation: Why American Students Are Still at Risk. Retrieved from
http://www.strongamericanschools.org/a-stagnant-nation-why-american-students-are-still-risk
Thomas, J.W. (2000). A Review of Project Based Learning. Report prepared for The Autodesk Foundation.
United States General Accounting Office. (2002). School Dropouts: Education Could Play a Stronger Role in
Identifying and Disseminating Promising Prevention Strategies. GAO-02-240.
Ward, J. D. and Lee, C. L. (2004). Teaching Strategies for FCS: Student Achievement in Problem-Based
Learning Versus Lecture-Based Instruction. Journal of Family and Consumer Sciences, 96(1), 73-76.
ISBN 978-0-9765087-4-8