John Thompson, historian and retired history teacher, analyzes the use and misuse of Oklahoma’s school report cards.

He writes:

As usual, the 2023 Oklahoma school Report Card prompted headlines about “struggling” students. But counter-intuitively, State Superintendent Ryan Walters stressed the declines during his time in office!?!?

Two tales of the Report Card are being told. As the Tulsa World reports, Walters “claimed that the data was from ‘previous years,’ even though all of the academic achievement indicators are from state tests administered just seven months ago.” Yes, taking office as State Superintendent in January 2023, Walters hasn’t had time to achieve many gains in learning, even if he’d really tried to. But the chaos during 2023, combined with the disruption he’d spread since 2020 as head of the Education Department, provided plenty of time for disruption.

As the Oklahoman reports, Walters cited the greatest decline under his watch, 8th grade reading proficiency which saw “a 5.7 percent decrease,” although “No other grade had more than a 0.4 percent decrease in reading scores, and some others “saw a very small uptick in reading scores.” Walters then promised “we are taking a Back to Basics approach,” which is the opposite of what it takes to increase proficiency.

The wisest narrative, illustrated by the Education Watch’s Jennifer Palmer, places the 2023 Report Card within the context of the massive decline of scores due to Covid, and the 2022 report. The 2023 report saw “no big swings in proficiency rates in any of the three tested subjects content,” while noting the overlooked fact that “a score of basic means a student demonstrated foundational knowledge and skills.”

Then Palmer tweeted background information on the differences between what basic means, as opposed to the widely misunderstood grade of proficiency which, I must add, has been misrepresented since the Reagan administration in order to denigrate public education. Oklahoma’s 8th grade reading proficiency grade requires that “students demonstrate mastery over even the most challenging grade-level content and are ready for the next grade, course or level of education.” It requires mastery of grade level skills that include interpretation, evaluation, analysis across multiple texts, and critical thinking. Mastery in requires use of evidence, argumentative response and synthesis of to create “written works for multiple purposes.”

As Palmer tweeted, we need a more nuanced” understanding of “reading.” And “the 8th graders who didn’t score proficient, but are in the ‘basic’ category, can still do all this” and then she linked to the challenging goals that are required for that grade, which include: partial mastery of interpretation, evaluation, analysis across multiple texts, critical thinking, use of evidence, argumentative response and synthesis.

Granted, these definitions are not necessarily the same as the more reliable NAEP scores. But as Jan Resseger explains, the nation’s NAEP proficiency grade “represents A level work, at worst an A-” and, basically, the same applies to Oklahoma’s tests. She asks, “Would you be upset to learn that “only” 40% of 8th graders are at an A level in math and “only” 1/3rd scored an A in reading?”

Ressenger also cites the huge body of research explaining why School Report Cards aren’t a reliable tool for measuring school effectiveness. We need a better understanding why the proficiency has been weaponized against schools, but we also need to master the huge body of research which explains why Report Cards aren’t a fair, reliable, and valid measure of how well schools are performing.

I’ll just cite one of the scholars that Ressenger draws upon. Stanford’s Sean Reardon’s 2022 research explained why “test score gaps may result from unequal opportunities either in or out of school; [but] they are not necessarily the result of differences in school quality, resources, or experience.” Reardon documented:

The socioeconomic profile of a district is a powerful predictor of the average test score performance of students in that district. The most and least socioeconomically advantaged districts have average performance levels more than four grade levels apart. … Achievement gaps are larger in districts where black and Hispanic students attend higher poverty schools than their white peers… and where large racial/ethnic gaps exist in parents’ educational attainment. The size of the gaps has little or no association with average class size, a district’s per capita student spending or charter school enrollment.

And that brings us to chronic absenteeism. As the New York Times reports, across the nation, “nearly 70 percent of the highest poverty schools experienced widespread, chronic absenteeism in the 2021-22 school year,” and “in these schools, about a third or more of the student body was considered chronically absent.” Of course, the Times notes, “Students cannot learn if they are not in school, and they cannot benefit from interventions, such as tutoring, that are supposed to help them make up pandemic losses.”

And Palmer reports:

Across the state, 20% of students were chronically absent last year, a half a percent increase over 2022. Some student groups were even higher: 24% of Hispanic students, 25% of economically disadvantaged and 31% of Black students were chronically absent …” Moreover, excessive absences are more prevalent now than before the pandemic. In 2019, 14% of Oklahoma students were chronically absent.

Tulsa World had previously reported that “About half of the Tulsa high school students are chronically absent” and explained why this complex and serious problem is “showing no signs of improvement.” The World cited the work of Georgetown’s Phyllis Jordan who explained the need to reconnect “what’s going on in the school and what’s going on outside the school.”

On one hand, that is why Patrick Forsyth, a University of Oklahoma professor who had analyzed the state’s A-F report card system, said “using attendance to measure school effectiveness is like using rates of tobacco use to measure hospital effectiveness.” On the other hand, as the Oklahoman reported, the Attendance Works’ Hedy Chang said, chronic absenteeism is an “all-hands-on-deck moment.” She also called on schools to “learn the specific barriers to attendance that their students experience before crafting a response to those unique challenges.”

That gets us back to the tragedy of two tales about what the Report Card means. Sadly, Ryan Walters uses it as one more weapon for disrupting public education. The other side must use these flawed metrics not to punish but for diagnostic purposes.