Tom Ultican left private industry to teach physics and advanced mathematics in San Diego public schools. He has become a specialist in dissecting phony attacks on public schools. In this excellent post, he takes a look at “learning loss,” a favorite subject of reformers. Of course, students did not learn as much during the pandemic as they would have if they were in classrooms daily. It was hardly surprising that in the wake of a once-in-a-century worldwide health crisis, students’ lives were disrupted.
Ultican writes:
Crazy pants Eric Hanushek claims COVID “learning-loss” could cost American students $31 trillion in future earnings. He burst onto the education world’s conscientiousness with his 1981 paper, claiming “there is no relationship between expenditures and the achievement of students and that such traditional remedies as reducing class sizes or hiring better trained teachers are unlikely to improve matters.” This played well with billionaires from the Walton family but had no relationship with reality. Likewise, his January 2024 “learning-loss” claims were straight up baloney.
Learning-Loss Reality
In the summer and fall of 2020, NWEA, McKinsey, CREDO and others produced unfounded analysis of looming learning-loss disaster caused by school closures. Since there was no data, summer learning-loss was used as a proxy, a bad one. In 2019, Paul von Hippel’s investigation threw great doubt on the 1982 Baltimore study that powerfully supported summer learning-loss belief. He showed using modern testing analysis, learning-loss was doubtful and in some cases, students gained during the summer. This data, used to trumpet a national education crisis, had no validity.
Unfortunately, billionaire-financed organizations, out to undermine public schools, do not care.
From March 2020 to February 2021, almost a half-million people died of COVID-19. There were no vaccines or Paxlovid type drugs. Refrigerator trucks stored dead bodies and more than 2 million Americans were hospitalized, some on ventilators for months. Schools were closed; unemployment jumped to 15%, murder rates shot up by 30% and fear was rampant.
In this environment, teachers heroically switched to online education.
K-12 students lost parents, became isolated from friends and visited family members in hospitals. Many kids struggled with online classes over inadequate internet feeds, parents were losing jobs and children could not visit grandparents.
Of course the rates of learning decreased but less than one might expect.

NEAP Data Explorer Graphs
The National Assessment of Education Progress (NAEP) 8th grade data graphs above show a modest decrease in both math and reading scores between 2019 and 2022. Reading fell by three points and math by eight points on a 500 point scale. I do not see catastrophe in these declines because given the context of the pandemic they strike me as rather small, with no signs of pending economic collapse.
Students have been out of school for months with medical or other reasons. I and others with this experience can testify that we were able to recover quickly. Claiming learning-loss disaster from COVID shutdown does not make sense.
Another interesting result from the 2022 NAEP test data comes from Commissioner Peggy Carr of the National Center for Education Statistics. She said, “There’s nothing in this data that tells us there is a measurable difference in the performance between states and districts based solely on how long schools were closed.”
To add further weight, New York Times opinion writer David Wallace-Wells wrote:
“In New York City, the nation’s largest school district, schools reopened in September 2020. There, average scores for reading fell by about a point for fourth graders and improved by about a point for eighth graders; in math, fourth-grade scores fell by nine points (statewide scores fell by 12) and eighth-grade scores fell by four points (statewide scores fell by six). In Los Angeles, the second-largest district, schools stayed closed through January 2021. There, average scores actually improved in fourth-grade reading, eighth-grade math and eighth-grade reading, where they improved by a robust nine points (to 257 from 248). Scores fell only in fourth-grade math (to 220 from 224).”
This January, the New York Times interactive posted “Students Are Making a ‘Surprising’ Rebound From Pandemic Closures”, based on a joint project from Stanford and Harvard Universities. The executive summary states:
“Despite the lack of improvement during 2022-23 on assessments provided by NWEA and Curriculum Associates, we find that student achievement did improve between Spring 2022 and Spring 2023: in fact, students recovered approximately one-third of the original loss in math (0.17 grade levels out of the 0.53 grade levels decline from 2019-2022) and one quarter of the loss in reading (0.08 grade levels out of the 0.31 grade level decline from 2019-2022). Such improvements in grade levels in a single school year mean that students learned 117 percent in math and 108 percent in reading of what they would typically have learned in a pre-pandemic school year. These gains are large relative to historical changes in math and reading achievement on the National Assessment of Educational Progress.”
George Bush’s Secretary of Education, Margaret Spelling, says, “We’re slowly recovering, but not fast enough.” That is from the woman who claimed 100% of America’s students would be above average by 2014. Without being a statistician, it never rang true to me. Her failure to recognize the great work of public schools says she has an agenda…
Learning-loss is not the big danger facing America’s students. The real danger is the likes of McKinsey, NWEA, CREDO and research leaders like Eric Hanushek.

When I was a youngster attending K-12, I didn’t do much learning in class. I did horrible on tests, too.
Still, I was an avid reader, reading one or two books a day, while ignoring most classwork and almost all homework. My favorite places were libraries and used book stores. My family was too poor to pay full price for a book.
The only A I earned in high school was working in the library as an student assistant/aide. Most of my other grades were Ds. That’s why I graduated with high school with a GPA lower than the number one.
I never intended to go to college. Yet, I did. Before I left the Marines in 1968, I’d changed my mind. Considering my high school GPA, the community college near my parents home gave me a test to see if my reading level was high enough for college work.
The results determined I didn’t need to take any catch up classes. That I was already reading way above the level considered necessary for a first year college student.
The rest is history. If we’d had those Smartphones that makes humans dumber while damaging their brains growing up, things might have turned out very different for me.
LikeLike
Great article by Tom Ultican. Covers all the bases, from Hanushek’s decades of anti-public education weaselly disingenuous studies with zero input from ed research or educators on the ground, to clickbait articles in WaPo and NYT shouting “sky is falling” due to tiny drops in NAEP scores during a global pandemic, with zero coverage of recovery showing higher learning rate than pre-covid.
LikeLike
finally someone actually looks at the issue and writes what needs to be said
LikeLike
I’ve always been mystified at the idea that Hanushek could know or even guess at the kind of jobs the students in question would have and how they might be paid more based on their schooling. Would they be hourly workers and if so how could they earn more than their co-workers based on their education. Same question for salaried workers who often negotiate pay. How is their education factored into what they can earn? Did he account for the gender pay gap? I did a back of the envelope calculation about one of his claims of increased pay where he used a lifetime earnings estimate to illustrate his claim. My calculations showed that his own numbers added up to a difference of less than the cost of a cup of coffee per week.
LikeLike
Years ago, Rick Hanushek estimated that the U.S. economy was losing trillions of dollars every year because of test scores. I am not an economist so I don’t know how he arrived at that number.
But I recall Yong Zhao saying that if the naysayers were right, we would be a third world nation by now. We are not.
LikeLike