Paul L. Thomas was a high school teacher in South Carolina for nearly twenty years, then became an English professor at Furman University, a small liberal arts college in South Carolina. He is a clear thinker and a straight talker.
He wrote this article for The Washington Post. He tackles one of my pet peeves: the misuse and abuse of NAEP proficiency levels. Politicians and pundits like to use NAEP “proficiency” to mean”grade level.” There is always a “crisis” because most students do not score “proficient.” Of course not! NAEP proficient is not grade level! NAEP publications warn readers not to make that error. NAEP proficient is equivalent to an A. If most students were rated that high, the media would complain that the tests were too easy. NAEP Basic is akin to grade level.
He writes:
After her controversial appointment, U.S. Education Secretary Linda McMahon posted this apparently uncontroversial claim on social media: “When 70% of 8th graders in the U.S. can’t read proficiently, it’s not the students who are failing — it’s the education system that’s failing them.”
Americans are used to hearing about the nation’s reading crisis. In 2018, journalist Emily Hanford popularized the current “crisis” in her article “Hard Words,” writing, “More than 60 percent of American fourth-graders are not proficient readers, according to the National Assessment of Educational Progress, and it’s been that way since testing began in the 1990s.”
Five years later, New York Times columnist Nicholas Kristof repeated that statistic: “One of the most bearish statistics for the future of the United States is this: Two-thirds of fourth graders in the United States are not proficient in reading.”
Each of these statements about student reading achievement, though probably well-meaning, is misleading if not outright false. There is no reading crisis in the U.S. But there are major discrepancies between how the federal government and states define reading proficiency.
At the center of this confusion is the National Assessment of Educational Progress, a congressionally mandated assessment of student performance known also as the “nation’s report card.” The NAEP has three achievement levels: “basic,” “proficient” and “advanced.”
The disconnect lies with the second benchmark, “proficient.” According to the NAEP, students performing “at or above the NAEP Proficient level … demonstrate solid academic performance and competency over challenging subject matter.” But this statement includes a significant clarification: “The NAEP Proficient achievement level does not represent grade level proficiency as determined by other assessment standards (e.g., state or district assessments).”
In almost every state, “grade level” proficiency on state testing correlates with the NAEP’s “basic” level; in 2022, 45 states set their standard for reading proficiency in the NAEP’s “basic” range. Therefore, it is inaccurate to say that nearly two-thirds of fourth-graders are not capable readers.
The NAEP has been a key mechanism for holding states accountable for student achievement for over 30 years. Yet, educators have expressed doubt over the assessment’s utility. In 2004, an analysis by the American Federation of Teachers raised concerns about the NAEP’s achievement levels: “The proficient level on NAEP for grade 4 and 8 reading is set at almost the 70th percentile,” the union wrote. “It would not be unreasonable to think that the proficiency levels on NAEP represent a standard of achievement that is more commonly associated with fairly advanced students.”
The NAEP has set unrealistic goals for student achievement, fueling alarm about a reading crisis in the United States that is overblown. The common misreading of NAEP data has allowed the country to ignore what is urgent: addressing the opportunity gap that negatively impacts Black and Brown students, impoverished students, multilingual learners, and students with disabilities.
To redirect our focus to these vulnerable populations, the departments of education at both the federal and state levels should adopt a unified set of achievement terms among the NAEP and state-level testing. For over three decades, one-third of students have been below NAEP “basic” — a figure that is concerning but does not constitute a widespread reading crisis. The government’s challenge will be to provide clearer data — instead of hyperbolic rhetoric — to determine a reasonable threshold for grade-level proficiency.
What’s more, federal and state governments should consider redesigning achievement terms altogether. Identifying strengths and weaknesses in student reading would be better served by achievement levels determined by age, such as “below age level,” “age level” and “above age level.”
Age-level proficiency might be more accurate for policy and classroom instruction. As an example, we can look to Britain, where phonics instruction has been policy since 2006. Annual phonics assessments show score increases by birth month, suggesting the key role of age development in reading achievement.
In the United States, only the NAEP Long-Term Trend Assessment is age-based. Testing by age avoids having the sample of students corrupted by harmful policies such as grade retention, which removes the lowest-performing students from the test pool and then reintroduces them when they are older. Grade retention is punitive: It is disproportionately applied to students of color, students in poverty, multilingual learners and students with disabilities — the exact students most likely to struggle as readers.
Some evidence suggests that grade retention correlates with higher test scores. In a study of U.S. reading policy, education researchers John Westall and Amy Cummings concluded states that mandated third-grade retention based on state testing saw increases in reading scores.
However, the pair acknowledge that these were short-term benefits: For example, third-grade retention states such as Mississippi and Florida had exceptional NAEP reading scores among fourth-graders but scores fell back into the bottom 25 percent of all states among eighth-graders.
The researchers also caution that the available data does not prove whether test score increases are the result of grade retention or other state-sponsored learning interventions, such as high-dosage tutoring. Without stronger evidence, states might be tempted to trade higher test scores for punishing vulnerable students, all without permanent improvement in reading proficiency.
Hyperbole about a reading crisis ultimately fails the students who need education policy grounded in more credible evidence. Reforming achievement levels nationwide might be one step toward a more accurate and useful story about reading proficiency.
The article has many links. Rather than copying each one by hand, tedious process, I invite you to open the link and read the article.
As I was writing up this article, Mike Petrilli sent me the following graph from the 2024 NAEP. There was a decline in the scores of White, Black, and Hispanic fourth grade students “above basic.”
70% of White fourth-graders scored at or above grade level.
About 48% of Hispanics did.
About 43% of Blacks did.
The decline started before the pandemic. Was it the Common Core? Social media? Something else?

Should we be concerned? Yes. Should we use “crisis” language? What should we do?
Reduce class sizes so teachers can give more time to students who need it.
Do what is necessary to raise the prestige of the teaching profession: higher salaries, greater autonomy in the classroom. Legislators should stop telling teachers how to teach, stop assigning them grades, stop micromanaging the classroom.

In 2019, I proposed that the fall on NaEP scores among fourth graders was the result of the sharp increase in class sizes in the early grades that had occurred during the Great Recession as well as the imposition of the Common Core. You can read my analysis as well as the evidence here: https://nycpublicschoolparents.blogspot.com/2019/11/whats-really-behind-city-state-and.html
LikeLiked by 3 people
One more trend may have contributed to the decline in reading scores as I discussed: the increased use of digital reading programs, which sadly has continued and which many studies show undermines reading comprehension.
LikeLiked by 2 people
Good point!
LikeLike
The press often gets it wrong because they did not fact check their work. It the highly politically charged world of privatization, the misinformation spreads to all the media outlets without the media doing its due diligence.
Education requires investment. Smaller classes and a return to allowing teachers to actually teach without canned instruction would be steps in the right direction. Due the high number of poor students in public schools, the community schools approach that addresses the needs of the whole student would a helpful plan as well.
LikeLiked by 1 person
More mental masturbation regarding standardized test scores. NAEP suffers all the inherent invalidities outlined by N. Wilson in 1997. It doesn’t matter if it is considered high or low stakes, using any of the results for anything other than what it purports to assess is, as he says-“vain and illusory.” Or as I say BS.
I know it’s one of your pet projects Diane but it continues the standards and testing malpractice regime, harming not only the teaching and learning process but student learning. It is invalid, unethical and immoral as those involved should know that using the results of an assessment for any purpose other than what it is designed for is not only dubious but wrong.
The only thing one can say about a student’s, let’s say 4th grade NAEP English score, is that it shows what a particular student did on the test the particular day it was taken. NOTHING MORE. But NAEP is being touted as an assessment device from which we supposedly can divine all sorts of information about teachers, schools, districts and the overall state of American public education. And that is dead wrong.
Until the standardized testing malpractice regime (in all forms) is broken students will continue to be harmed.
LikeLike
The ability to be able to read a paragraph out loud and the ability to be able to comprehend the passage are two different things.
A dyslexic mathematician can comprehend a passage that they hear even if the dyslexic mathematician cannot read the paragraph out loud to people in the room.
Sorting students academically by birth year is junk science. Expecting that one reading curriculum will work for all the students in an age cohort is junk science. Students that learn to decode the identity of individual words easily and effortlessly would go crazy having to have the curriculum that dyslexic students need.
LikeLiked by 1 person
Many children read more in class while in school than they ever do at home or outside of school. The pandemic took that classroom reading time away from them.
If children/students fell behind, blame the parents/guardians for not having at least a half hour , or more, of tech-free, quiet reading time every day as a family.
LikeLike
These definitions of the NAEP levels come directly from the National Center on Education Statistics…
“The definition for each achievement level was developed by a broadly representative panel of teachers, education specialists, and members of the general public. Subject-and grade-specific detailed definitions are available in each subject section on this site. The policy definitions of the levels are:
Basic—This level denotes partial mastery of prerequisite knowledge and skills that are fundamental for proficient work at each grade.
Proficient—This level represents solid academic performance for each grade assessed. Students reaching this level have demonstrated competency over challenging subject matter, including subject-matter knowledge, application of such knowledge to real-world situations, and analytical skills appropriate to the subject matter.
Advanced—This higher level signifies superior performance.”
Sure sounds like ‘proficient’ was meant to indicate ‘on grade level.’
LikeLike
No, proficient is meant to be the equivalent of an A, or A-.
Basic is similar to grade level.
LikeLike
“Challenging subject matter” doesn’t sound like grade level. It sounds like the extra credit “challenge” questions at the end of the homework assignment.
LikeLiked by 1 person
Afraid of low test scores? Feeling stuck? Are you anxious all the time? Unable to want to read a book anymore? It might be your public schools. 7 out of 10 Americans age 5 to 65 suffer from NCLB and Arne Duncan Called Me Stupid Syndrome, or CMS. But young people can still enjoy many of the activities they once did and live a mostly free life with AI Online Test Prepia.
0.001% of students who tried Test Prepia achieved full remission within one test cycle. Side effects include boredom, depression, thoughts of suicide, uncontrolled drooling, hypertension, certain forms of metabolic disorders, and decreased reading ability which may lead to death. Test Prepia use has been associated with wasteful spending, privatization, and higher class sizes in some cases. But try Test Prepia now! Scan the QR code at the bottom of your screen. We can help you finance the exorbitant expense. You can live free of hyperbole-based hyperventilation about test scores. You’ll be glad you did. Or not.
$$$
LikeLike
Of course politicians who want to privatize the majority of eduation in the US with vouchers and ESAs say schools are failing. Their conclusions (hasty and uninformed as they may be) would be the same with any number below 90%, I think.
The point is that using NAEP means you have to use it properly to be academically honest (as much as you can be with a standardized test). The definition of “grade level” means whatever your state/district says it means for 4th-grade reading. On this national test, NAEP says basic in 4th-grade reading means a student can “make a general reference to an appropriate section of literary text or provide some support for ideas related to the plot or characters.” And it says a proficient student can “identify the key events to determine main idea and make complex inferences about the characters’ actions, motivations, or feelings, using relevant evidence within or across literary texts.”
With 40% of national students below basic in reading and 29% below proficient but above basic, it sounds like “grade level” is somewhere within the basic band (the 50% mark). That’s because “grade level” has to be norm-referenced based on where students are actually performing. To me that sounds about right … the mean 4th-grader in US classrooms is probably somewhere between making “general references” about literary texts and making “complex inferences.” NAEP is using performance level descriptors to define the levels because that’s how the test was set up. Of course, politicians don’t understand the difference between norm- and criterion-references assessments and probably have never read the PLDs for the test they’re demanding we all use to shutter the whole public school system in this country.
But really, what did you think would happen when you put Trump and McMahon in charge? Even the MAGA crowd can understand “grade level” even if it doesn’t mean what they think it means and even if NAEP doesn’t tell them anything about that when they use the proficient cut score to supposedly say anybody below that is “failing” (or being failed by the school system). This whole 4 years is going to be a big waste of time.
LikeLiked by 1 person
Dear current high school teachers, apologies for an off topic question, but do any of you have experience with the product Grade Guardian that is being used to track students academically? If so, what do you think about it?
LikeLike
It was really refreshing to see this article in WaPo. I think it may be the first time I’ve seen an MSM article devoted to elucidating the difference between NAEP-Proficient and “proficient” as used in the context of annual state-standardized test scores.
I found it humorous that so many of the commenters don’t really know the difference between percentile and percent. Add to that the coincidental similarity in numbers: NAEP-Proficient gauged at roughly 70th percentile—vs 70% scored at or above NAEP-Basic. Lots of confusion in comments. Many tartly exclaimed that 70th percentile was a low expectation for good performance, heck it’s barely average!
LikeLike