John Thompson writes here about the negative consequences of shallow reporting on NAEP data. Reporters are sensitive to whether scores are up or down, but tend to ignore contextual factors that may play a role in student performance.
He writes:
Despite the problems with education metrics, the decline in the nation’s 2022 math and reading scores on the National Assessment of Educational Progress (NAEP) test is worrisome – if we look at the big picture.
As Diane Ravitch explained, the decline in scores during the pandemic was a “duh” moment. Rather than publishing panicky headlines, these predictable drops in scores should be seen in the broader context of the decade of declines which followed the implementation of rushed and simplistic corporate school reforms. And, as we should have done previously, we must acknowledge what reformers should have previously understood – meaningful increases in learning require inter-connected, holistic team efforts, as opposed to metric-driven instructional shortcuts.
And we should also listen to Peggy Carr, commissioner of the National Center for Education Statistics (NCES), which administers the tests. “The new data, she said, ‘reinforces the fact that recovery is going to take some time.” Carr and other experts also warn that the “academic decline is part of a broader picture that includes worsening school climate and student mental health.”
For example, “Oklahoma NAEP results reflect pandemic-fueled decline in math and reading scores.” Eighth grade reading in Oklahoma (which reopened schools more quickly than most states) declined by 7 points, compared to a three-point average national decline. Our Eighth grade math scores declined by 12 points, compared to a nationwide decline of eight points. And the state’s and the nation’s “plunge” in history scores has been worse.
But the story behind those numbers is complicated. So, before we can understand the mixed messages of short- and long-term NAEP findings, we how they have often been misrepresented by the non-education press.
Chalkbeat properly quoted Peggy Carr, “There is nothing in this data that tells us there is a measurable difference between states and districts based solely on how long schools were closed.” And Education Week appropriately explained that all but the top-performing students saw declines, but the biggest drops were for the lowest-performing students, who were more likely to have parents who were “essential workers” who were disproportionately exposed to Covid, who were more likely to live in multi-generational households, and had the least access to medical care. Moreover, it further explained, “Reading scores for students in cities (where schools tended to be slower to reopen) stayed constant, as did reading scores for students in the West of the country.”
Yes, Covid closures led to an unprecedented decline in test scores, but many commentators should look more deeply at public relations spin dating back to the Reagan administration that inappropriately used NAEP test scores when arguing that public schools are broken. They stressed low levels of “proficiency” claiming that it correlated with grade level. And Jan Resseger explained:
A common error among journalists, critics, and pundits who misunderstand the achievement levels of the National Assessment of Educational Progress (NAEP). “Proficient” on NAEP is not grade level. “Proficient” on NAEP represents A level work, at worst an A-. Would you be upset to learn that “only” 40% of 8th graders are at A level in math and “only” 1/3 scored an A in reading?
On the other hand, the admittedly unprecedented (but expected) fall in NAEP scores during Covid followed a decade of stagnating or declining NAEP scores. Moreover, the recent release of falling history scores should lead to an open discussion about why the U.S. History scores have declined by 9% since 2014.
And Chalkbeat stresses the need for conversations about the last two years, when “nearly every state has considered a bill that would limit how teachers can discuss racism and sexism in their classrooms, and 18 states have bans or other restrictions in place, according to a tracker compiled by Education Week.” For reasons I explain later, I’m especially impressed with its recommendation regarding the need for “weaving the (historical) material into other places in their (classrooms’) schedule.”
I began teaching History at John Marshall H.S. in the early 1990s during the crack and gangs crisis and after the standardized testing of the 1980s peaked. For the next 1-1/2 decades, outcomes improved at Marshall and in the nation as a whole. Marshall had serious problems, but I couldn’t believe how many great teachers it had. We had the autonomy necessary to teach in a holistic inter-connected, cross-disciplinary manner. When I saw students carrying copies of Ralph Ellison’s The Invisible Man, I had the freedom to deviate from the curriculum schedule, and teach about Ellison’s childhood in Oklahoma City, and how it informed his novel. We took fieldtrips to the Capitol, and had regular classroom visits by legislators and local leaders. And we watched excellent programs on OETA (which our Gov. Kevin Stitt recently tried to defund.).
Rather than teach to the test, I’d post the day’s State Standards, and History in the News topic. Students would drop by before class to peek at the day’s History in the News question. They quickly learned how to “weave” historical narratives into contemporary issues.
Marshall improved more than any other OKCPS neighborhood high school until the No Child Left Behind Act of 2001’s and Race to the Top’s test-driven mandates became dominant. By the time I retired in 2010, my students who came from the poorest neighborhoods complained that they had been robbed of an education. When guest teaching up to 2020, I saw young teachers who wanted to offer culturally meaningful instruction but it was hard for educators and students to do something that they rarely saw in a 21st century classroom.
Getting back to the type of solutions discussed in Chalkbeat and Education Week, Education Watch’s Jennifer Palmer wrote a hopeful piece about a pilot program at F.D. Moon Middle School. It uses “a social studies curriculum built on encouraging students to engage in civil discourse and celebrate American ideals while also examining darker chapters of history.” The program was created by iCivics, founded by retired U.S. Supreme Court Justice Sandra Day O’Connor. Its U.S. History curriculum is “based on the Roadmap to Educating for American Democracy, a joint project with iCivics, Harvard, Tufts and Arizona State universities.”
Palmer witnessed the energy displayed by Beatrice Mitchell’s 8th grade social studies class. All of them “passed the U.S. naturalization test, a new graduation requirement starting this school year.” This stands in contrast to a recent survey which “found just 1 in 3 adults can pass the exam … Oklahoma’s passing rate was even lower at 1 in 4 adults.”
It is unclear whether this nonpartisan program will clash with the Oklahoma Board of Education’s special report on “diversity, equity and inclusion programs at the request of State Superintendent Ryan Walters.” As Palmer noted, “Walters, a former history teacher, claimed such programs are ‘Marxist at its core.’” At any rate, it’s not just history that must be woven into other subjects. If we hope to teach critical thinking and 21st century skills, schools must abandon their test-driven silos, and teach students to be independent thinkers who listen, and learn how to learn. And, holistic instruction must be restored, as one part of serving each whole child. A first step, however, should be the non-education press shifting from alarmist headlines to meaningful solutions reported in the education press.
Diane Ravitch's blog 