Introduction and summary
How can high school students considering an engineering degree prepare for college? For most, the answer is enrolling in advanced math and science courses as they progress through high school—and maybe a computer science course if one is available. For Garett Lopez, a Colorado high school junior, his interest in pursuing engineering was piqued when he became certified in computer-aided drafting through a class at the beginning of his high school career. He is now on a graduation pathway that reflects the district’s effort to align course selection with student interest and long-term goals.
Lopez attends Cañon City High School (CCHS), a rural school in a small town two hours south of Denver. The town’s primary industries are tourism and corrections—the surrounding area is home to 13 prisons, including the infamous Supermax prison in Florence, Colorado.1 There has been a general sense among those living in the area that students wishing to pursue careers in science, technology, engineering, and math (STEM) must leave town to do so. But recently, the local school district partnered with local businesses in fields such as technology, environmental science, and emergency services to change that narrative. These partnerships aim to accelerate community development, show students opportunities for other local careers, and prepare them for success in those opportunities.
The recent academic changes that Lopez and his classmates are experiencing at CCHS incorporate insights from research into learning mindsets—beliefs that shape how one interprets educational experiences.2 The high school’s work is predicated on fostering what is known as a “purpose and relevance” mindset, which helps students find value in school by connecting what they learn to their current interests and long-term goals.3 This is related to but distinct from the more widely known “growth mindset,” or the belief that intelligence is malleable and can improve with effort; a “purpose and relevance” mindset is the belief among students that schoolwork is relevant to their life.4 Finding purpose and relevance in school is associated with a host of positive outcomes for students, including deeper learning,5 increased engagement in class,6 and longer persistence through college.7
At the beginning of Cañon City School District’s partnership efforts, business development and the needs of local industry priorities took precedent. The goal was to build a skilled workforce within the community; redesigning Cañon City’s high school experience was not the intended outcome. But it quickly became clear to district and business leaders that a new educational strategy was necessary to help students see the utility of what they were learning and spark interest in a range of newly available careers in the area. That has led to partnerships and internship opportunities for students with area technology companies, emergency service operations, veterinary practices, and river science firms. The school district’s leaders—including Superintendent George Welsh, Assistant Superintendent Adam Hartman, and high school Principal Bill Summers—began thinking about the knowledge students needed to acquire, the skills they needed to develop, and the experiences they needed exposure to in order to be ready for those kinds of opportunities after graduation.
Several years into this work, Cañon City School District is taking what Hartman calls a “12-K approach,” working backward from the 12th grade down to kindergarten to incorporate career-connected learning throughout elementary and secondary schools.8 The district uses a “graduate profile”—a listing of knowledge, skills, and experiences that school leaders want students to possess upon graduation from high school—to help create a shared language around those skills and traits and refocus high school completion requirements around core competencies, rather than simply the number of courses completed.9
Walking the halls of CCHS today, students, teachers, and visitors are greeted with signs displaying words such as “innovation,” “tenacity,” and “agency,” which signal some of the traits Cañon City’s graduate profile values most. CCHS’ course of study helps to ensure that students such as Lopez will graduate with these traits having been able to pursue the topics they are most interested in and understand how their education is relevant to their future careers. Four “pathways”—health; science, technology, engineering, agriculture, and math (STEAM); skilled trades, security, and industry; and arts, hospitality, and education—now guide which courses CCHS students take throughout their high school experience.10 Additionally, beginning with the class of 2021, all CCHS students must participate in an internship and complete a capstone project. And while internships are meant to complement the pathways that students have selected, students have the freedom to design an experience that will be most engaging and useful based on their current interests and future goals.
For Lopez, this meant getting certified in computer-aided drafting and designing his own capstone around his passion for engineering. All this helped him get excited about his math and science courses, strengthened his planned college applications, and made him feel more prepared to start the path toward an engineering degree when he goes to college next year.
In Hartman’s view, focusing on skills development is the most equitable approach to graduation requirements since it allows students to learn and demonstrate those skills in the way that works best for them.11 However, requiring that all students participate is crucial to the success of this approach. CCHS operated an internship program for several years, but it was optional. Allowing students to opt in to the internship program meant that it primarily served students who were already motivated to pursue additional learning experiences. In addition, a GPA requirement for participation in the program limited it to students already near the top of their class.
By giving students freedom to select the pathway they are most interested in, apply for a range of internships, and design their own capstone project while still requiring all students to complete all of these actions, CCHS has made the experience both more equal and more equitable. Still, as Lisa Tedesko, regional internship coordinator, notes, meeting students where they are is a necessity. For example, some students who are responsible to help pay the bills at home are allowed the option of maintaining a paid job in lieu of an internship. In addition, dozens of students with disabilities need access to specific transportation and a paraprofessional who can transport them to work and assist them while on the job.12
Certainly, pathways, internships, and capstones are not the only mechanism for activating a purpose and relevance mindset, but they are examples of what has worked for Cañon City and the school district. And as Hartman noted of his small rural district several times: “If it can work here, it can probably work anywhere.”13
A new CAP analysis of two national datasets explores how much early high school learning mindsets matter for later outcomes. In one longitudinal dataset from the High School Longitudinal Study (HSLS) of 2009, the authors examined how ninth grade students’ ratings of their math and science courses predicted future outcomes such as on-time high school graduation, enrollment in a four-year college, and pursuit of a STEM major. In another recent dataset from the National Assessment of Educational Progress (NAEP), the authors explored the relationship between eighth grade math NAEP scores and how those same eighth grade students felt about math in general, as well as how that relationship differed by state.
Key findings include:
- Mindsets matter: Students’ attitudes toward their ninth grade math courses were correlated with on-time high school graduation. Likewise, students’ attitudes toward both ninth grade math and science courses were correlated with four-year college enrollment and pursuit of a STEM major.
- Mindsets are especially important for students who are traditionally underrepresented in STEM: The relationship between STEM mindsets and pursuit of a STEM major was strongest for female students and students from families with low incomes.
- Mindsets differ by state: There are state-by-state differences in eighth grade student math interest and how students rate the importance of math.
Based on these findings, the Center for American Progress believes that state and local policymakers should invest in measuring student learning mindsets, expand equitable access to career and technical education (CTE) programs that make learning relevant to student interests, and advocate for scalable school redesign efforts that can increase student engagement and promote the availability of successful STEM opportunities, especially to students who are traditionally underrepresented in those fields.
An abundance of recent research in education and psychology has shown how student learning mindsets are related to future outcomes such as academic achievement, behavioral outcomes, and educational attainment.14 Put simply, a “mindset” is a belief that shapes how one interprets daily experiences.15 While a “growth mindset”—or belief that intelligence is malleable and can improve with effort—continues to dominate media attention when it comes to education, other learning mindsets such as a “purpose and relevance mindset” are less about how students learn and more about their perception of what they are learning.
Learning mindsets help students organize their goals into a single meaning system.16 By reframing academic challenges within a new meaning system, effective learning mindsets help students navigate these experiences with the resources available to them.17 Carol Dweck, a pioneer of mindset research, says that by changing these beliefs, educators “can influence whether they [students] see that world as overwhelming and threatening or whether they greet it with the confident words ‘I love a challenge.’”18
A purpose and relevance mindset helps students find value in school by connecting what they learn to their current interests and long-term goals.19 When students who find purpose and relevance in their schoolwork encounter challenges, they are more motivated to maintain effort and push through the challenge in service of a bigger purpose. Alternatively, when students do not care about what they are learning or do not see how it relates to their life experience, they are less likely to persist through those same challenges. Educators can promote purpose and relevance in their students by making instruction culturally relevant, connecting coursework to student hobbies, and explaining why school is important for self-transcendent goals that will help people, such as securing a job. All of these strategies routinely bolster academic and behavioral outcomes for students, both in primary and secondary school and through college.
Mindsets are not a panacea,20 and Dweck herself has acknowledged the problems with implementing mindset work at scale.21 Not only do educators lack the training to effectively cultivate a growth mindset in their students, a 2016 survey found that only 20 percent of teachers strongly believed that they were good at incorporating such a mindset into their instruction.22 Furthermore, equity is also a concern. One major criticism of learning mindsets is that they create a “deficit lens” that could give teachers permission to simply say, “that student doesn’t think they can learn so I don’t have to teach them.23 Parents of Black students specifically have voiced concern that a singular focus on mindset in the classroom fails to consider the many ways students must develop and demonstrate these strengths in nonacademic settings.24
While many of these critiques are valid, there is also important evidence—in both research and implementation—that learning mindsets, when done well and with equity front and center, can be especially powerful tools for students who are traditionally underserved.25 It is becoming clearer that the opportunity gap may also manifest itself as a gap in learning mindsets, as students from families with low incomes typically self-report less of a growth mindset than their peers.26 And the most robust effects of learning mindsets are consistently found for low-performing students,27 students of color,28 and students from families with low incomes.29
Direct-to-student interventions demonstrate positive effects on their own, but the largest gains come from changing the wider culture. STEM professors’ mindsets influence their students’ motivation, and having a teacher who believes intelligence is malleable can help close the achievement gap between white students and students of color.30 For example, one study found that schools in Chicago that do more to enhance student social and emotional well-being see larger positive effects with regard to academic persistence.31 In 2015, the National Study of Learning Mindsets began research involving more than 12,000 students in an effort to better understand the qualities of the students, classrooms, and schools that were most likely to benefit from a growth mindset intervention during the transition from middle school to high school.32 Preliminary findings published by the lead researchers in the prestigious journal Nature show that schools fostering climates of curiosity increased student achievement by half a grade point—on a GPA scale from 0.0 to 4.0.33
The benefits of making education interesting and relevant
“Getting an education in what you enjoy is important because you learn more.”
— Kodee Summers, CCHS senior
It is unsurprising that the National Study of Learning Mindsets found that schools fostering curiosity had some of the most positive outcomes given that intellectual curiosity is considered the third pillar of academic performance—alongside intelligence and effort.34 Unfortunately, schools are not effectively fostering intellectual curiosity throughout students’ K-12 experiences. In a recent survey that asked more than 21,000 high school students how they felt at school, nearly 75 percent of the reported emotions were negative.35 More concerning, the few positive emotions students offered were passive ones such as “happy” and “calm,” which do not reflect deep learning in the same way that “excited” and “engaged” might. Indeed, the share of students excited about school peaks at around 74 percent in fifth grade but drops steeply to 32 percent by 11th grade.36 More intentional efforts to foster a purpose and relevance mindset can help to change this narrative.
Interest is linked to motivation
Such a drop-off in student excitement is especially concerning given evidence that interest fuels motivation.37 Students who are not interested in what they are taught are not motivated to learn.38 But changing mindsets can help. Subject matter interest is moderately correlated with academic achievement across all subjects.39 Math interest specifically can predict the amount of time students spend on homework40 as well as their enrollment in more advanced math courses.41 Likewise, science interest predicts a host of positive outcomes, both in science classes and more broadly.42
Teachers shape interest and motivation.43 In an international study of Programme for International Student Assessment (PISA) scores, family background was found to have no effect on interest formation, but in all countries, there was a strong impact based on which schools student attended.44 Another study found that kindergarten teachers’ beliefs about their students’ math abilities predict how interested their students are in math up through sixth grade.45 But teacher preparation programs typically do not include social-emotional skill development, and teachers do not feel equipped with best practices to cultivate passions with fidelity.46
Unfortunately, without this training, many teachers fall into outdated and potentially harmful practices when attempting to boost student interest. Despite increasing evidence that there is no such thing as a “math person,” 37 percent of teachers believe that advanced math courses are only important if a student already shows ability or interest in math.47 What is more, new research suggests that one common strategy to boost student interest—simply telling them that math is important—can actually decrease interest in the subject, especially for students who already lack confidence in their math abilities.48
Purpose, relevance, and utility
“I take history because I like it, and I take science because it’s relevant to what I want to do. Pre-calc isn’t fun, but it’s important for life.”
— Garett Lopez, CCHS junior
Making school more relevant to students is one way teachers can effectively increase student interest.49 That is why Alex Carter, who works with the Colorado Education Initiative (CEI) in implementing career-connected learning for districts across Colorado, says: “Every student should see the relevance of their course of study.”50 In a 2017 survey, only half of students said that they thought what they learned in school was relevant to the real world.51 Schools across the country are now learning from experts such as Carter about connecting classes, especially STEM classes, to students’ interests.52
Helping students find purpose and relevance in their schoolwork helps them view school as more valuable, which can promote deeper learning.53 One way to do this is through short-term interventions that help students to build connections between specific concepts they learn—such as measuring an angle of a triangle—and their interests outside of school, such as skateboarding on a triangular ramp.54 In a series of studies, college students who wrote several short essays throughout the semester about the relevance of science material to their lives enjoyed their classes more and earned higher grades.55 In one of these studies, the GPA gap between Black and white students was 0.42 points in the group that wrote about the relevance of what they were studying, whereas Black and white students who only wrote a summary of the course content had a GPA difference of 1.22 at the end of the semester.56
These short-term strategies are a fast and simple way to help make school relevant in the moment. However, teachers can also help students connect school to their future selves in order to promote long-term learning and achievement—also known as “academic tenacity.”57 In one 10-session elective workshop, Black and Latinx eighth grade students wrote essays about the obstacles preventing them from becoming who they wanted to be and how they could overcome those obstacles. This writing assignment improved both their academic and behavioral outcomes, compared with students taking a typical elective class.58 The approach used in the elective writing workshop targets students’ sense of purpose, 59 a critical piece of adolescent development correlated with other character traits such as gratitude, compassion, and grit.60 Helping students find purpose in school can increase academic self-regulation,61 improve time spent learning a topic,62 raise GPA, and reduce the risk of a student dropping out of high school.63
Of course, many students do not automatically know exactly what they want to do when they grow up. Many researchers therefore encourage teachers to forgo telling students to “find their passion,” as if it is a predetermined thing inside of them, and instead help students to grow a passion.64
Tedesko, the Canon City internship coordinator, is trying to help other students understand that their internships do not need to be the exact job they want after high school.65 In a phone interview, senior Kodee Summers raved about her internship at a local history museum specifically because it opened her eyes to a college major she had not previously considered.66 She began the internship interested in archaeology but learned over time that she was actually more interested in anthropology. “I had no way to know what the reality of those two jobs would actually look like from my regular high school classes,” she shared.67 Similarly, Adam Hartman noticed some students paralyzed by what they saw as making a potentially life-altering choice when they selected a pathway in ninth grade. Hartman is now working to make it clear to students that it does not matter what specific path they ultimately pursue, just that they learn something from the experience.68
Historically underserved students can benefit most from connecting school to their interests and goals
“Getting people to talk about equity is one thing; really getting people to design with equity in mind continues to be a struggle
— Alex Carter, vice president of implementation at the Colorado Education Initiative
Interventions to increase interest, purpose, and relevance typically work best for students who were previously underperforming. Studies also routinely find different effects based on individual characteristics such as race, socioeconomic status, and gender. This may be because the interventions target a student’s identity.69 It can be hard for those who are traditionally underrepresented, including female students and students of color, to build a STEM identity when their classroom experience does not speak to their lived experiences. These unconscious biases, whether manifested in classroom decorations featuring exclusively male scientists70 or in a teacher’s grading practices or other behavior,71 can make students more likely to conform to stereotypes and steer clear of fields that they do not think they “should” pursue.72
Female students are both less likely to pursue a STEM major73 and more likely to leave the STEM pipeline during college,74 but these decisions are not explained by prior achievement. In high school, girls enroll in advanced courses and receive roughly the same grades and standardized test scores as boys.75 Instead, confidence in math ability predicts this gender divide. Math efficacy beliefs76 similarly bolster math-based career interest for first-generation college students77 and students of color,78 who report many of the same barriers as girls in interviews about their STEM aspirations.79 For Latinx students, attending a Hispanic-serving institution is an important point of access to a STEM degree,80 as Latinx students more frequently drop out of STEM pathways in other institutions of higher education.81 Meanwhile, parent support and other mentors are especially important for Black girls in math pipelines.82 These social and emotional supports are useful precisely because they help students see themselves represented in STEM.83 Schools must also do their part to implement social and emotional development, remove unconscious bias, and provide additional opportunities so that students can see every career as a viable possibility.
Unfortunately, students of color and students from families with low incomes face access barriers to schools with the resources to provide the key supports and additional opportunities needed to expand career possibilities.84 Moreover, there is evidence that schools with more resources serve predominantly white students and are less likely to design innovative new practices with equity in mind.85 As a result, students who may benefit the most from these opportunities are least likely to have access to them, no matter what school they attend. Even with access, there are risks that even well-intentioned opportunities will continue to exacerbate opportunity gaps for those students already underrepresented in STEM fields. For example, a CTE program in Connecticut produced significant positive outcomes for male students but no effect for female students, contributing to an increase in the CTE gender gap.86
It is critical that any effort to make school more purposeful does so with cultural relevance in mind and expands beyond limited ideas of what postsecondary success should look like. CCHS is working with the Homegrown Talent Initiative (HTI), a CEI project that strives to bring career-connected learning to rural districts through local partnerships. Another HTI district is working with a nearby tribal nation to offer hospitality pathways at a local casino. This approach not only engages members of the community, it offers students an opportunity to meet mentors who share their cultural background—which has demonstrated success for Native American students in at least one study.87
Redesigning the high school experience
A great deal is already known about how to get students through high school and to college. High school graduation rates have been rising since 2006 to a current high of almost 85 percent.88 But despite spending $3 billion per year on STEM instruction, the nation is still not seeing more STEM professionals later in life.89 Simply taking additional STEM classes in high school does not translate into additional likelihood of pursuing a STEM major in college.90 Moreover, the traditional approach to math instruction in high school fails to sufficiently prepare students for college math expectations and career demands.91
High school redesign is a concept that can—and should—look different across schools and districts.92 Broadly, it captures efforts to change the educational experience in order to better engage students and open up additional learning opportunities. This could mean apprenticeships, opportunities to earn college credit, or classes outside of traditional school hours for students with jobs, internships, or caregiving responsibilities. As Alex Carter explained, “Our philosophy was if we came in with a program we wanted them to implement, it wouldn’t sustain and there wouldn’t be local buy-in.”93
While design thinking is an important starting point to bringing innovative new experiences into schools, it must be accompanied by structural change and student, staff, and community input in order to have lasting, equitable impact.94 Social class continues to be a primary predictor of educational success, and while small or “light-touch” interventions can address some of these disparities, they are no match for outdated textbooks and run-down school buildings.95 Existing CTE opportunities show promise,96 but they still face critical barriers to widespread implementation that is both equitable and scalable.97
Supporting structural redesign requires both clarifying flexibilities in existing policies and creating new policies to ensure that high school credits and graduation requirements reflect the skills, knowledge, and experiences students need for postsecondary success. Previous research has found that schools and districts already have more flexibility to change high school standards than they realize. The vast majority of states currently allow high schools to grant credit through methods other than traditional seat time.
In states that still do not have this flexibility or that want additional guidance, there are plenty of examples that can be used as guides to craft new policies—from Colorado, where CCHS has benefited from the state’s “menu of options” for demonstrating college and career readiness,98 to Maine, where all students must demonstrate proficiency but can do so through assessments, portfolios, projects, or community service.99 It is important that these redesign efforts are done in partnership with the community, including local industry, but also with the state higher education system in order to ensure that high school graduates’ coursework is aligned with college entrance requirements. Currently, only four states’ high school diploma course expectations match their state university entrance requirements. Redesign efforts would only improve this alignment.100
Analysis of national data on learning mindsets and postsecondary outcomes
To better understand the relationship between interest and utility and student success, the authors analyzed two federal datasets to determine if there was a relationship between measures of these learning mindsets and key postsecondary outcomes.
The High School Longitudinal Study (HSLS) dataset includes more than 20,000 student surveys from a nationally representative sample of students entering high school in 2009, as well as follow-up surveys in 2012 and 2016 and data from high school transcripts and postsecondary, job, and education enrollment records.101 Recent studies of HSLS data have explored similar topics, including the relationship between student engagement and teacher support;102 the extent to which peer support predicts postsecondary readiness;103 support and barriers for students of color;104 and the change in STEM pursuit over time.105 A related 2014 study found that science attainment value, intrinsic value, and utility value all predicted STEM persistence, and that the effects differed by student race.106 To date, however, no other study of which the authors are aware has analyzed the specific relationship between the self-reported 2009 learning mindsets and all of the 2016 postsecondary outcomes measured in this report; nor have any explored the specific interacting factors of both individual- and school-level characteristics.
The other dataset used in this CAP analysis is from the National Assessment of Educational Progress, also known as the “Nation’s Report Card,” a standardized test distributed to a nationally representative group of students in all 50 states and the District of Columbia. In 2019, nearly every state showed a decade of stagnant or declining progress in math and reading.107 A prior analysis of the 2015 NAEP results suggested that students performed worse if they had teachers who failed to provide them with advanced coursework or engage in higher-order thinking.108 Plenty of other research has attempted to explain these disappointing results, but none have explored the relationship between NAEP scores and students’ self-reported effort, enjoyment, and interest in math.
How students feel about their ninth grade courses is associated with decisions they make after high school
Controlling for basic student-level demographics and school characteristics, high school learning mindsets predict a range of academic outcomes. This study showed that a one standard deviation increase in both how interesting and how useful students rated their ninth grade math course statistically significantly increased their predicted probability of graduating high school on time by about half a percentage point, or 0.5 percent. Although this is a small effect size, in comparison, a 2012 meta-analysis of college access programs found that the average college access program evaluated by a rigorous randomized controlled study did not statistically significantly affect high school graduation at all.109
With the exception of math utility, both math and science mindsets in ninth grade predicted four-year college enrollment. For those students who graduated high school on time, one standard deviation increase in math and science interest was associated with increases of 6.5 percent and 3.8 percent, respectively, in students’ likelihood of enrolling in a four-year college. The same increase in science utility was associated with a 4.5 percent increase in the likelihood of enrolling in a four-year college.
All learning mindsets were associated with eventual pursuit of a STEM major. For students who were enrolled in a four-year college, a one standard deviation increase in math and science interest was associated with 6.1 percent and 5.4 percent increases, respectively, in the likelihood of majoring in STEM. The predicted probability changes of utility scores were smaller in magnitude but still statistically significant. A one standard deviation increase in math and science utility corresponded with 2.5 percent and 4.4 percent increases, respectively, in the chance of students pursuing a STEM major in college; the same increase in math and science utility saw enrollment in a four-year college increase by 12 percent. These numbers are similar to the college access program meta-analysis, which found an overall increase of 12 percent as well as a 4 percentage point increase in two-year or four-year college enrollment for only those programs that were rigorously evaluated.110
In the 2019 NAEP dataset, student perceptions of math were correlated with NAEP performance. Eighth grade students who indicated that statements such as “I enjoy doing math” and “it is important to do well in math” were more like them typically received higher NAEP math scores.
Measuring change in learning mindsets
The Cañon City School District knows that its efforts to make school more relevant and interesting are changing student mindsets for the better. For several years now, the district has administered a recurring survey of student attitudes and school climate, and it is already seeing the effects of new pathways in survey responses even before one would expect to be able to detect academic outcomes.111
Student surveys are a useful tool throughout the redesign process and can serve three primary purposes:
- Determine what students want and need and incorporate their voice into redesign efforts.
- Track change in student beliefs over time and see the effects of new interventions.
- Ensure that changes are not having disparate effects on any group of students.
Notably, CCHS does not use these student surveys as an accountability measure or a measure of teacher performance. This is important, as many of the most prominent mindset researchers have cautioned against using mindset as such a measure,112 given the difficulty of measuring mindsets with reliability, validity, and cultural competence.113 While student surveys are an effective formative tool to use before and throughout a redesign process, they should not be a measure of success or failure in and of themselves.
Courses that are interesting and relevant are especially helpful for students traditionally underrepresented in STEM
The nation’s STEM fields have a gender diversity problem. However, CAP research shows that learning mindsets could make an important difference in addressing this imbalance. Specifically, the research finds that science mindsets are more associated with whether women major in a STEM field than they are for men. The impact is significant, with a one standard deviation increase in science interest and science utility related to 9 percent and 11 percent increases, respectively, in the likelihood of women pursuing a STEM major, compared with only 4 percent and 1 percent increases for men.
Notably, while these effects matter for individual student characteristics, school-level factors—such as school locale and the racial or socioeconomic demographics of the student body as a whole—were less important. Moreover, the effect of science mindsets on all three postsecondary outcomes was slightly more important in high-poverty schools than in other schools. Otherwise, the effects that both math and science learning mindsets in ninth grade have on graduation, college enrollment, and pursuit of a STEM major tend to look the same across schools serving different populations or located in different types of areas.
Student reports of math relevance correlated with improvements in math scores
Stagnant or decreasing math scores on NAEP assessments over the past decade have states, and the nation as a whole, concerned. While national NAEP results in eighth grade math scores have not improved substantially since 2003, the standardization of NAEP scoring allows for comparison between state-level fourth and eighth grade scores over time.114 The authors analyzed data to determine if student mindsets predicted the extent to which scores improved between fourth and eighth grade. It should be noted that the same students do not take the test both years; however, comparing 2015 school year fourth grade scores to 2019 school year eighth grade scores does represent the same age cohort.
The authors’ analysis found that student responses to survey items about whether “making an effort in math was worthwhile” were moderately correlated (r = .38) with the extent to which states saw improvement between fourth and eighth grade scores in 2015 and 2019. In other words, states where more eighth grade students in 2019 said that those “making an effort in math is worthwhile” were “quite a bit like me” or “exactly like me” also saw larger gains between fourth and eighth grade math scores. The percentage of students reporting high math interest and enjoyment, meanwhile, was not statistically significantly related to change over time. While there is no way to infer causation from these numbers, simply making math enjoyable may be less beneficial than redesign efforts that demonstrate its importance or relevance to students’ lives.
Many students may not believe making an effort is worthwhile because they simply do not understand why math is important. In five states—Florida, Minnesota, North Dakota, Oklahoma, and Oregon—only half of students indicated that the statement “math will help me even when I’m not in school” was “quite a bit like me” or “exactly like me.” The national average is not much higher: Only 54 percent of students across all states indicated that those statements were “quite a bit like me” or “exactly like me.” And interest in math is even lower than perceived utility: 39 percent of national eighth grade public school students reported that the statement “I am interested in what I learn in math” was “quite a bit like me” or “exactly like me.” In four states—Idaho, North Dakota, Utah, and Wyoming—less than 1 in 3 students gave either response.
“I don’t think any district should launch into this type of thing [redesigning schools] with whimsy … You’d better be ready to stay the course.”
— Adam Hartman, assistant superintendent of Cañon City School District
Redesigning schools to make learning more relevant to students’ current and future lives is difficult work. Hartman acknowledged that doing so is a big ask for teachers, as it requires shifting staff expectations, changing course structures, and maintaining rigorous curricula in CCHS’ new system—and doing it all at the same time has been a significant challenge.115 Garett Lopez, a CCHS junior and a member of the inaugural class for whom a capstone project was mandatory, said the rollout of the capstone initiative was a bit confusing and that some students still remain unsure of what exactly is expected of them.116
But despite these stumbles, the work is already showing short-term benefits. According to recent student surveys, internships help students connect school to their career aspirations and capstones let them pursue the topics they are most interested in. Moreover, the longitudinal data analyzed in this report suggest that similar approaches could bolster college enrollment and STEM pursuit elsewhere, especially for students who have traditionally shied away or been deterred from these paths.
Efforts to leverage learning mindsets and make education more relevant to students must begin at the local level through intentional curricula and CTE opportunities. Student voice should be front and center in these decisions in order to ensure that opportunities are available to—and expected of—everyone. States can help in these efforts by increasing flexibility in graduation expectations, making existing flexibilities clearer, and better aligning high school requirements with college standards. For its part, the federal government should invest in these opportunities and commit to measuring their success with validity and equity in mind.
This report identifies specific recommendations to help scale successful programs based on existing research and CAP’s new analysis of national datasets.
Recommendations for school districts and local communities
- School districts should lead efforts within their communities to develop graduate profiles outlining the knowledge, skills, and experiences that students should have by the time they complete high school. Successful efforts to develop these profiles must be culturally relevant and incorporate perspectives that represent the racial, ethnic, and socioeconomic diversity of the community. These profiles should include contributions from students, teachers, parents, administrators, community leaders, employers and the business community, and representatives from local institutions of higher education.
- Communities should ensure that they are expanding and providing equitable access to high-quality CTE, internships, and apprenticeships, as well as offering advanced courses. This means enabling flexible high school schedules to support participation in these activities, removing potential barriers such as transportation and required work attire, promoting paid internships and apprenticeships, equitably locating programs throughout communities, and disaggregating data on participation and success in these programs across high schools as well as racial and ethnic subgroups, disability status, and socioeconomic status.
- School districts should use well-designed student surveys to understand students’ learning mindsets. These surveys should cover students’ interest in and perceptions of the relevance of high school to their future and be used as a formative measure of success of high school redesign and improvement efforts. They should not be used for accountability for schools or staff, but rather to help administrators, school counselors, and teachers understand how pathways, course offerings and curricular changes, internships, and other efforts are affecting students’ engagement.
Recommendations for states
- States should provide resources, guidance, and technical assistance to school systems and communities to support equitable efforts to redesign the high school experience. This could begin with efforts similar to the philanthropically supported graduate profile and redesign work that the Colorado Education Initiative is leading with rural districts throughout the state. It should continue through efforts to scale up high-quality career pathways, internships, and other experiences to make learning more interesting and relevant for students. Attention and funding should prioritize empowering high-poverty communities with lower financial and staffing capacities to pursue redesign efforts on their own.
- States should redesign the K-8 experience to ensure that students and families enter high school prepared for quality programs.This effort should include frequent and regular communication with families, starting in elementary school, about college and career pathways and preparation.117 In middle grades, states should develop rigorous college and career preparation standards that emphasize making math and science more engaging, interesting, and relevant to students, as well as providing more opportunities to connect them with industry or postsecondary programs.118
- States should invest in developing frameworks for graduate profiles that are aligned with entry standards for four-year public institutions of higher education in the state. These graduate profiles could then be used as a starting point for schools and communities to customize the knowledge, skills, abilities, and career pathways that will prepare their students for success after high school.
- States should support the development and deployment of high-quality student surveys for use by districts—without accountability stakes attached. This can help them to identify strategies to improve engagement and make learning experiences more interesting and relevant to students.
Recommendations for the federal government
- Congress should increase investments in CTE funding and the Student Support and Academic Enrichment block grant. Additional funding in these areas would help to provide equitable access to high-quality career pathways, improve access to advanced coursework, and provide flexible funding that could be used to administer student surveys. These surveys should not be a part of school accountability systems, but rather provide students, teachers, counselors, and administrators with information on how to improve learning mindsets such as interest and relevance.
- Congress should provide funding to close gaps in access to technology. The coronavirus pandemic has laid bare that too many students lack the technology devices and broadband internet access needed to learn outside of the school day and building. Additional funding is required to ensure that access to flexible schedules and learning opportunities is not limited to wealthy students and communities.
Cañon City did not set out to dramatically change its schools. Local leaders were simply responding to the community’s desire to bolster local industry and retain talented young people who may have otherwise been inclined to seek employment elsewhere. Redesigning the high school experience to be more interesting and relevant for students seemed to be the best way to make that happen—an “educonomy,” as Alex Carter calls it.119 The local businesses have benefited from training young new workers early and increasing local talent. Now, national data provide evidence that the “educonomy” works for everyone, as students who are engaged in their courses will continue to reap the benefits years later.
About the authors
Abby Quirk is a research associate for K-12 Education at the Center for American Progress. She previously worked as a research coordinator at the University of Pennsylvania and helped to connect innovative schools with leading scientists through the Character Lab Research Network. Quirk received her bachelor’s degree in psychology with minors in education and religious studies from Hamilton College. She also holds a master’s degree in education policy from the University of Pennsylvania.
Neil Campbell is the director of innovation for K-12 Education at the Center. He was a special assistant and, later, a chief of staff in the Office of Planning, Evaluation and Policy Development at the U.S. Department of Education. Campbell previously worked at Education Elements and the Boston Consulting Group. He earned a bachelor’s degree in economics and political science from Case Western Reserve University and a master’s in business administration from Vanderbilt University.
Ulrich Boser is a senior fellow at American Progress and the CEO and founder of the Learning Agency and the Learning Agency Lab, which are devoted to scaling the science of learning. Previously, Boser worked as a contributing editor for U.S. News and World Report and a researcher for the newspaper Education Week. He also wrote Learn Better, a book that examines the new science of learning, and has served as an adviser to many institutions, including the Bill and Melinda Gates Foundation and the Hillary Clinton presidential campaign.
The authors would like to thank several individuals for their insights, feedback, and review of this report. Scott Sargrad, vice president of K-12 Education Policy at the Center, and Khalilah Harris, managing director of K-12 Education Policy at the Center, provided valuable feedback throughout the process. Alex Carter, vice president of implementation at the Colorado Education Initiative; Landon Mascareñaz, vice president of community partnership at the Colorado Education Initiative; and the leadership of Cañon City School District and Cañon City High School welcomed us during a visit to their school as part of their work with other districts. Lisa Tedesko, regional internship coordinator at Cañon City High School, coordinated student interviews. Megan Ferren, a special assistant for K-12 Education at the Center; Victoria Yuen, a policy analyst for Postsecondary Education at the Center; and Rasheed Malik, a senior policy analyst for Early Childhood Policy at the Center, reviewed the data analysis. Kinga Wysienska-Di Carlo, a senior research fellow at CONSIRT, assisted with and provided feedback on preliminary analyses and methodology.
The first dataset used in this analysis was the High School Longitudinal Study (HSLS) of 2009 from the National Center for Education Statistics (NCES), which includes survey data from a nationally representative sample of more than 20,000 students as well as data from their high school transcripts and postsecondary, job, and education enrollment records.
The present analysis uses HSLS’ composite “utility” and “interest” scores for both math and science from the student surveys. In 2009, students were asked a series of questions about their current—fall 2009—math and science courses. For each course, responses were combined into a standardized interest scale and a standardized utility scale in which higher values represent perceptions of greater interest and utility. Only students who were currently taking a math or science class and provided a full set of responses were assigned a value. The following items comprised the interest and utility scores, respectively:
- “You think [fall 2009 math/science class] is a waste of time” (response options: strongly disagree, disagree, agree, and strongly agree)
- “You think [fall 2009 math/science class] is boring” (response options: strongly disagree, disagree, agree, and strongly agree)
- “You are enjoying [fall 2009 math/science class] very much” (response options: strongly disagree, disagree, agree, and strongly agree)
- If ninth grader’s favorite or least favorite school subject is math/science
- If the answer to “I’m taking this class because I really enjoy math/science” is “yes”
- “What students learn in [fall 2009 math/science course] …”
- “… is useful for everyday life” (response options: strongly disagree, disagree, agree, strongly agree)
- “… will be useful for college” (response options: strongly disagree, disagree, agree, strongly agree)
- “… will be useful for a future career” (response options: strongly disagree, disagree, agree, strongly agree)
The outcomes of interest were high school graduation, four-year college enrollment, and pursuit of a STEM major in college. Students were considered to have graduated on time if they graduated before fall 2013. Students were considered not to have graduated on time if they dropped out, were still enrolled in fall 2013, or received a GED or special education degree. Students who transferred or whose status could not be determined were not included in graduation analyses. College enrollment was based on whether or not students ever enrolled in a four-year institution, as of the 2016 data collection. Pursuit of a STEM major was based on whether or not the student’s first degree major was in a STEM field, as defined by NCES codes.
The regression analyses using HSLS data included the following covariates: gender; race and ethnicity; whether or not the student had an Individualized Education Plan (IEP) in ninth grade; whether or not the student was an English language learner; socioeconomic status, which was a composite of parent education attainment, parent occupation, and family income; the percentage of the student’s grade eligible for free or reduced-price lunch; the percentage of students in school identified as white or Caucasian; and school locale—urban, suburban, rural, or town.
The second dataset used in this analysis was from the National Assessment of Educational Progress (NAEP), the largest nationally representative continuing assessment of student knowledge. For the present study, fourth grade math scores in 2015 and eighth grade math scores in 2019 were used, along with survey data from eighth grade students in 2019. The following survey items were analyzed:
- “It is important to do well in math” (response options: “not at all like me,” “a little bit like me,” “somewhat like me,” “quite a bit like me,” and “exactly like me”; analyses used the percentage of students who responded “quite a bit like me” or “exactly like me”)
- “Making an effort in math is worthwhile” (response options: “not at all like me,” “a little bit like me,” “somewhat like me,” “quite a bit like me,” and “exactly like me”; analyses used the percentage of students who responded “quite a bit like me” or “exactly like me”)
- “Math will help me even when I’m not in school” (response options: “not at all like me,” “a little bit like me,” “somewhat like me,” “quite a bit like me,” and “exactly like me”; analyses used the percentage of students who responded “quite a bit like me” or “exactly like me”)
- “I enjoy doing math” (response options: “not at all like me,” “a little bit like me,” “somewhat like me,” “quite a bit like me,” and “exactly like me”; analyses used the percentage of students who responded “quite a bit like me” or “exactly like me”)
- “I am interested in what I learn in math” (response options: “not at all like me,” “a little bit like me,” “somewhat like me,” “quite a bit like me,” and “exactly like me”; analyses used the percentage who responded “quite a bit like me” or “exactly like me”)
- Math interest/enjoyment index (a composite score created by NAEP of low, medium, or high; analyses used the percentage of students who scored “high”)