Archives for category: Research
« Older Entries

Freddy DeBoer: Whatever Happened to Raj Chetty and His Claims about Teachers?

By dianeravitch
September 3, 2026 //
6

Back in 2011, Harvard Professor Raj Chetty and two esteemed colleagues (John Friedman at Brown University and Jonah Rockoff at Columbia University) published a dazzling study of teachers, asserting that the best teachers are those whose students get improved scores. Those students have a higher income ($250,000 over their lifetimes), and enjoy a multitude of benefits, all because of that one teacher who induced them to have higher scores. President Obama cited Chetty’s research in his 2012 State of the Union address to show how important it was to find the “best” teachers and fire the “worst’ teachers.

Chetty’s work supported the Obama-Duncan Race to the Top plan to encourage evaluating teachers by the test scores of their students. States that evaluated teachers by their students’ scores were eligible to apply for a share of RTTT funding. Those who did not were not eligible.

Most states, eager for a share of the $5 billion prize, agreed to adopt what was called “value-added modeling” or “value-added measurement.” (VAM)

I posted dozens of times about the flaws of VAM, first of all, because the American Statistical Association said that teachers account for only 1-14% of score changes; most changes were attributable to home life and school system issues. Secondly, because the VAM concept is very unstable and is highly affected by student demographics. Only teachers of reading and math in grades 4-9 could even be assessed by the annual tests, which are mandated only in grades 3-8. Schools started attributing scores to teachers not in those subjects and not in those grades, tied to the work of other teachers in the school.

The Los Angeles Times engaged researchers to calculate VAM scores for the district’s teachers, and the newspaper published them alongside the names of teachers. It was humiliating for teachers, but Arne Duncan thought this disclosure was wonderful.

I happened to be in Los Angeles on the day that a fifth grade teacher committed suicide after he received a poor VAM score. No one knows if that was the reason for his suicide, but it may have been. By all accounts, he was a good teacher in a tough school.

The New York Post did the same for New York City teachers. It listed names and scores. The teacher identified by the newspaper as the city’s “worst” teacher was hounded by Post reporters seeking an interview. It turned out that she taught classes of new immigrants, who moved in and then out of her class as they learned enough English to join regular classes. Her students in September were not the same students by June. The VAM scores for her were meaningless, as they were for other teachers. Teachers of the gifted saw few if any gains because their students were at the top year after year. Expert math teacher Gary Rubinstein noticed that some teachers had high scores in one subject, but not in the other. Should half the teacher get a bonus while the other half was fired?

Freddie deBoer, an independent writer who earned a doctorate in English and education assessment, re-evaluated Raj Chetty’s famous study.

It’s a long review, and I won’t post it all. Please open the link and read it.

He begins:

For a long time I’ve been getting some version of the comment, “What about Chetty!” in response to my perspective on education, as in Raj Chetty, the economist who for the past decade has made a lot of waves asserting that our education problems are straightforwardly the product of bad teachers and that replacing them will have implausibly large economic effects. I tend to try and work from a broader perspective than “this is why I think this guy is wrong,” but I get this request so often, here you go. This is why I think Raj Chetty is wrong.

Few empirical claims in modern education policy have traveled farther than Chetty et al’s findings on teacher “value-added.” In his famous 2014 American Economic Review papers, he and his coauthors reported that students assigned to better (excuse me, higher value-added) teachers were more likely to attend college, earn higher salaries, save for retirement, and avoid teen pregnancy, and that replacing a teacher in the bottom five percent of the distribution with an average teacher would raise the present value of a single classroom’s lifetime earnings by roughly $250,000. Chetty’s research findings in this domain had been floating around for awhile at the time of publication, and President Obama cited the figure in his 2012 State of the Union address, and the judge who decided Vergara v. California leaned on it to strike down California’s teacher tenure laws. Take that, teachers! The findings are arresting, the dataset is impressive – 2.5 million children, linked to IRS tax records! – and the policy implications are clean: identify and remove bad (pardon me, low “value-added”) teachers, watch outcomes improve. It’s exactlythe kind of story our neoliberal policy establishment is desperate to tell, and was clearly catnip to the Obama administration, which was doggedly attached to a simplistic vision of delivery through better education, where the gutting of the uneducated labor market was ameliorated by turning every last child in the United States into a genius, scaling up the Stanford-to-Google pipeline until every American could pass through it.

Unfortunately, the Chetty story is ultimately another neoliberal just-so story, that is to say, a fable, a legend, a myth. The closer you look at what the “value-added” construct actually measures, how stable those measurements are, and how the Chetty results have fared under replication, the more reason there is to doubt both the magnitude of the claimed effects and, more fundamentally, whether “teacher quality” as the literature operationalizes it is a coherent, measurable attribute at all. (Spoiler: it is not.) Let us count the problems.

The construct itself puts the thumb on the scale. The first problem is conceptual. In the Chetty et al. studies, a teacher’s “value-added” is the residual variation in a student’s standardized test scores that remains after controlling for prior achievement and some demographic covariates. It’s not a measure of pedagogical skill, content knowledge, classroom climate, the cultivation of curiosity, or any other property normally meant by “good teaching.” It’s a statistical residual on a narrow set of assessments, usually math and reading tests in grades three through eight. That residual is then defined as quality. I want to be clear about this: any portion of variability in student outcomes that Chetty et al cannot or will not identify otherwise is assumed to be a product of teacher inputs. Since Chetty’s whole project is to argue that educational outcomes are the result of teacher quality, this is what we used to call begging the question – that is, he’s assuming the point he wants to prove, asserting the desired conclusion as a premise, by acting as though any uncaptured variation is necessary evidence of teaching quality. And it gets worse in the telling. When advocates and journalists and politicians summarize his work, the construct expands silently from “the part of test-score gains Chetty cannot otherwise explain” to “good teachers,” and the slippage is rarely flagged. But that’s the whole game, you guys.

Open the link and enjoy!

Categories Accountability, Education Industry, Research, Teacher Evaluations, Teachers and Teaching, VAM (value-added modeling)

Trump Administration Wants All Federal Grants to Be Subject to a Loyalty Test–Loyalty to Him and His Policies

By dianeravitch
June 8, 2026 //
7

Despite appearances, the most powerful person in the Trump administration is not Donald Trump: it’s Russell Vought, Director of Office of Management and Budget. He is the brains of this administration. Vought was at the Heritage Foundation and was one of the writers of project 2025. He controls the budget and makes the decisions about which government programs should live or die. Trump has impulses, whims, and passing fancies; Vought is methodical and determined to impose his rightwing views on the entire federal government. Every federal grant, Vought believes, should align with Trump’s anti-woke, anti-DEI agenda.

Tony Romm wrote about Vought’s strategy in The New York Times:

The White House is seeking to exert more control over billions of dollars in annual government grants, aiming to restrict a vast swath of funding — in health, housing, science and transportation — so that it primarily serves the purposes and organizations politically aligned with President Trump.

While the administration says that its primary goal is to safeguard taxpayer money, its proposal amounts to a major escalation in its attempt to reimagine the nation’s spending, even as Congress and the courts continue to rebuke the president for abusing such powers.

Mr. Trump’s ambitions were made clear in a roughly 400-page blueprint that was released to little fanfare on Friday. If finalized, it would require all federal grants to be approved by the president’s political appointees, who must ensure that the money would “demonstrably advance the president’s policy priorities.”

For the agencies that issue those awards and the nonprofit groups, local governments, universities and other entities that receive the money, the Trump administration would also impose a set of highly prescriptive and political criteria.

The government could not issue grants to projects or groups that “deny the biological reality of sex or the sex binary in humans,” for example. Nor could it seek to fund initiatives that “promote anti-American values,” contribute to illegal immigration, advance diversity, equity and inclusion or assist in voter registration.

The rules would further limit the ability of grant recipients to engage in some “issue advocacy.” Those that are funded would be scrutinized for their compliance with “religious liberty laws” and their “memberships and affiliations” with outside groups. And they could face the outright termination of their grants if the Trump administration someday determines that their actions are not in the “public interest.”

The restrictions echo the string of executive orders that Mr. Trump signed shortly after returning to office, many of which have been challenged or blocked in court. This time, however, the White House has pursued its restrictions by proposing a regulation, which is expected to become final after the government solicits public comment. The result could be applied far more broadly, and perhaps in ways that are harder to fight legally or undo later, according to budget experts.

The consequences could fall hardest on health and science, a field in which Mr. Trump has pursued some of the steepest cuts in his second term.

In exchange for federal assistance, researchers would face limits on the subjects that they can explore, the foreign labs with which they may collaborate and even the conferences at which they can appear. Dr. Georges C. Benjamin, the chief executive of the American Public Health Association, a professional organization and advocacy group, said the policy could “devastate innovation, science and research” in the United States.

Categories Bias, Budget Cuts, Censorship, Ethics, Evil, Extremism, Fascism, Funding, Health, Research

Paul Thomas: There Was No “Mississippi Miracle”

By dianeravitch
April 29, 2026 //
27

Paul L. Thomas of Furman University has been a persistent critic of the narrative about the “Mississippi Miracle.” The story gained great traction when New York Times‘ columnist Nicholas Kristof took it national on September 1, 2023, in an article titled: “America Has a Reading Problem. Mississippi Has a Solution.” The “miracle” supposedly was accomplished without doing anything to improve the lives of children and their families, without even raising teachers’ salaries. The “science of reading” did the trick; that, plus holding back third graders who didn’t pass the final reading test.

Many articles have been written since then recycling the claim that the “science of reading” was largely responsible for the impressive growth in Mississippi’s fourth grade reading scores on NAEP (the National Assessment of Educational Progress), which is administered every two years. If only states forced teachers to teach the “science of reading,” there would be no failure in reading (except, of course, for the students who were retained in third grade and not participants in the fourth grade testing.)

The “Mississippi Miracle” allegedly occurred within the context of a “Southern Surge,” where low-spending, non-union states like Alabama and Louisiana also participated in a miraculous increase in reading scores. These professors complexified that claim recently.

The most recent article confirming the “miracle” appeared in The Atlantic and was written by Rachel Canter, who participated in the Mississsippi reforms as leader of Mississippi First and is now at the Progressive Policy Institute in Washington, D.C.

Paul Thomas writes on his Substack blog:

“No story has caught the imagination of education reformers this decade quite like the ‘Mississippi miracle,’” Rachel Canter asserts in The Atlantic, adding:

Other states are now trying to emulate what Mississippi did. Those efforts largely revolve around adopting what’s known as the “science of reading”— a set of principles and teaching techniques, including phonics, that are grounded in decades of empirical research.

Canter, the Director of Education Policy at the Progressive Policy Institute, released as well a report on Mississippi reading and education reform, noting:

I personally spent 17 years helping state leaders run that race. As the head of Mississippi First, a nonprofit I founded in 2008, I played a hand in, and sometimes led, many of the state’s key education policy conversations with the legislature while also working with the Mississippi Department of Education to implement the reform agenda. This is my insider’s view of what policymakers, philanthropists, and pundits should know about what really happened.

Both Canter’s article and her report are lessons themselves in how education reform in the US works, specifically during this cycle driven by the “science of reading” and “science of learning.”

Notably, Canter mentions “empirical research,” yet neither a magazine article nor a think tank report meet the standards of “scientific” championed by “science of” reformers—experimental/quasi-experimental research published in peer-reviewed journals [1].

Also, Canter’s article introduces on a larger scale one of the many multiverses of the “science of reading” existing currently.

The article and report express what Mississippi officials have been arguing for a while: Mississippi reform is not a miracle; it is many years of hard and complex work.

Canter, in fact, seems to double-down on Mississippi reform is effective due to high-stakes accountability (the core of education reform since Reagan, reform that has never worked but perpetuated a permanent cycle of crisis and reform in the US).

I will return to Canter’s argument about Mississippi’s reform success, but I think the criticism of overly simplistic stories about the Mississippi “miracle” are valid and many are beginning to acknowledge that news articles and podcasts have driven reductive and misguided reading reform, policy, and classroom practice [2].

In short, a lesson we should learn, finally, is to reject “miracle” narratives in education. 

Lessons Ignored (And Questions Unanswered)

The problem with Canter’s article and report (beyond that they lack experimental rigor) is that her claims are just as misleading and often just as incomplete as the media stories being sold.

One lesson ignored in the Mississippi story is that it suffers from “the moment” syndrome. I have been asking since the start of the “miracle” narrative: Why haven’t we looked at the historical increase in grade 4 NAEP reading scores, including an ignored spike well before the 2019 christening of “miracle”?:

A bigger lesson, however, is taking greater care when deciding if reforms work as well as what causes that success. Related, as well, is assuring that the data used to decide success or failure represents learning.

Here the Mississippi story is much different that the media “miracle” or Cantor’s argument that high-stakes accountability has worked in the state.

Several questions must be answered.

If Mississippi’s reform has worked, why does the state have the same wealth and race gaps as in 1998?

If Mississippi’s reform has worked, why does the state continue to retain about 9000 K-3 students per year?

  • 2014-2015 – 3064 (grade 3) – 12,224 K-3 retained/ 32.2% proficiency
  • 2015-2016 – 2307 (grade 3) – 11,310 K-3 retained/ 32.3% proficiency
  • 2016-2017 – 1505 (grade 3) – 9834 K-3 retained / 36.1 % proficiency
  • 2017-2018 – 1285 (grade 3) – 8902 K-3 retained / 44.7% proficiency
  • 2018-2019 – 3379 (grade 3) – 11,034 K-3 retained / 48.3% proficiency
  • 2021-2022 – 2958 (grade 3) – 10,388 K-3 retained / 46.4% proficiency
  • 2022-2023 – 2287 (grade 3) – 9,525 K-3 retained/ 51.6% proficiency
  • 2023-2024 – 2033 (grade 3) – 9,121 K-3 retained/ 57.7% proficiency
  • 2024-2025 – 2132 (grade 3) – 9250 K-3 retained/ 49.4% proficiency

And most significantly, if Mississippi reform has worked, do the test score increases in grade 4 represent greater student learning?

There is little scientific evidence on this important question, but the evidence is suggesting a principle by Gerald Bracey: “Rising test scores do not necessarily mean rising achievement.”

First, an analysis of reading reform and a statistical analysis of Mississippi test score increases suggest that those increases are statistical manipulations caused by grade retention and not student learning.

When grade 8 data are compared to grade 4, those analyses seem accurate since states behind Mississippi in grade 4 catch and pass by grade 8 (include the subgroup of Black students):

The irony here is that in 2019 when Hanford declared Mississippi reading reform a “miracle,” many uncritically jumped on that bandwagon.

The Atlantic article is receiving the same uncritical and effusive response—although it is no more credible.

Canter offers just a different compelling but ultimately misleading story.

As of 2026, there simply is no empirical evidence Mississippi’s reading reform has worked.

There remains no “science” in the multiverse of “science of reading” stories.

[1] One frustrating aspect of the “science of reading” movement has been the demand for “science” while advocates tend to use anecdotes, cherry pick evidence, and ignore research counter to their stories. Note the expectations, often ignored, for “scientific” by The Reading League:

https://radicalscholarship.com/wp-content/uploads/2022/08/scientifically-based-research.jpg

[2] I have four open-access articles in English Journal, documenting with research that the media stories (specifically by Emily Hanford) are misleading and inaccurate.

If you want to help with the costs of keeping my public work open access and free, please DONATE.

Subscribe to Paul Thomas

Launched 4 months ago

P.L. Thomas, Professor of Education (Furman University, Greenville SC), is the poetry editor for English Journal. NCTE named Thomas the 2013 George Orwell Award winner. Follow his work @plthomasEdD.

Categories Accountability, Curriculum, Education Reform, Mississippi, NAEP, Research

The Corporate Takeover of Public Schools in Indianapolis

By dianeravitch
April 21, 2026 //
4

So-called reformers continue to pursue a fantasy: they believe that changing the governance of public schools will lead to improvement in the education of children.

And so they advocate for mayoral control, state takeovers, charter schools, vouchers.

They choose to ignore the overwhelming consensus among education researchers that the home lives of children has a far greater impact on children’s school performance than the governing structure.

Here is a case in point, offered by In the Public Interest.

If you’re worried about corporations taking over public schools, this next sentence will not allay your worry: The state of Indiana just turned over much of the responsibilities for the city of Indianapolis’ schools–public and charter–to something called the Indianapolis Public Education Corporation (IPEC).

“This new organization will be charged with building and transportation management for both charter and traditional public schools,” reports Governing. “It will also be charged with creating a single set of evaluation criteria for both types of schools.”

Admittedly, it’s a nonprofit corporation and its nine board members are appointed by the mayor with statutes to determine the corporate board’s membership: three come from the Indianapolis Public Schools [IPS] board of commissioners–which still exists, three from the charter school industry, and three with administrative and financial expertise. 

In reality, however, four board members are from the charter industry. Its board chairman is David Harris, who founded the Mind Trust-Indianapolis, the driving force pushing the charterization of the district. Harris is the President and CEO of Christal House International that operates the Christal House Academy charter chain. According to the organization’s 990 tax form, in 2025, Harris received $554,148 in compensation.

But IPEC inserts a layer of control and bureaucracy beyond–or, better put, around–Indianapolis’ elected school board. At least as troubling as that is the fact IPEC was given the authority to levy property taxes that it can use to fund–with public money–charter schools. This puts charter schools on equal footing–and funding–with public schools–a dangerous precedent that is certain to be attempted elsewhere. 

One of IPEC’s first orders of business is likely to be placing on the November ballot an operating referendum since IPS’ expires at the end of this year. While Indianapolis Public Schools expects a $40 million deficit for the year, that might have been addressed if IPS’s attempt to place an operating referendum on the 2023 ballot hadn’t been derailed by the charter school industry and the Greater Indianapolis Chamber of Commerce. 

For public school advocates, the implications of the new, non-elected board are clear–and disturbing.

“What is occurring in Indianapolis is part of a growing movement to destroy the neighborhood school governed by the community and replace it with a corporate vision of schooling that sees the marketplace and competition as the primary drivers of quality,” Carol Burris, executive director of the Network for Public Education, tells In the Public Interest. “We are now more than thirty years into the charter school experiment, and we have yet to see the miracle.”

Jeff Hagan
Communications Director

Categories Education Industry, Indiana, Indianapolis, Parents, Research, Students

Paul Thomas: The “Reading Crisis” Is Overblown

By dianeravitch
April 3, 2026 //
4

Paul Thomas is a professor at Furman University. He has taken a leading role in refuting claims for the “science of reading.”

There are many successful ways to teach reading. some children arrive at school knowing how to read, because a parent read with them every day. Phonics is important. The joy of reading is important. Comprehension is important. Legislatures should not mandate one way to teach.

In his latest post, he writes:

If you pay attention to the non-stop moral panicking around reading fanned by mainstream media, you may have seen this click-bait headline: Did New York blow $10 million on reading instruction that doesn’t work?

The article repeats tired and misleading (often false) stories about the failures of balanced literacy, NAEP reading scores, the “success” of Mississippi and Louisiana, the promise of structured literacy, and the National Reading Panel as well as the one research study on phonics that is linked.

Let’s consider these:

*No scientific studies identify a reading crisis in the US causally linked to balanced literacy, reading programs, lack of phonics instruction, or inadequacy of teacher education. (Aydarova, 2025; Reinking, Hruby, & Risko, 2023).

*The media hyper-focuses only on grade 4 NAEP reading scores, but notice how the story changes once we consider grade 8—states behind MS in grade 4 catch and pass MS by grade 8 (primarily because MS inflates their grade 4 scores by excessive grade retention, like FL):

*Structured literacy (scripted curriculum) is whitewashing the reading curriculum and restricting teacher autonomy and professionalism. (Khan, et al., 2022; Parsons, et al., 2025; Rigell, et al., 2022).

*The linked research suggests it replicates findings of the NRP; however, the NRP did not prove systematic phonics outperformed whole language or was a silver bullet. As Diane Stephens explains about the findings on phonics: “Minimal value in kindergarten; no conclusion about phonics beyond grade 1 for ‘normally developing readers’; systematic phonics instruction in grades 2-6 with struggling readers has a weak impact on reading text and spelling; systematic phonics instruction has a positive effect in grade 1 on reading (pronouncing) real and nonsense words but not comprehension; at-risk students benefit from whole language instruction, Reading Recovery, and direct instruction.” Further, while the article quotes from the research report, it doesn’t include this much more tentative hedge: “These findings suggest that SL approaches may yield larger positive effects on student learning compared to BL approaches.” At best, structured literacy is no better or worse than whole language or balanced literacy, but to be clear, there is no “settled science” that is works.

But the bigger problem is not that mainstream media continues to repeat misinformation, but that it fails to offer the full story.

Note that the “literacy experts” quoted in the article are supporting structured literacy programs (scripted curriculum), and some of those experts are co-authors of those programs.

Further, these experts are promoting a different teacher training program than the one being attacked in the article, and many states are spending 10s of millions of dollars on that program—LETRS. (My home state of SC a few years ago allocated $11 million for one year, for example.)

What’s missing in this story?

There are two high-quality studies that were released in 2025 on the effectiveness of LETRS, but so far, there have not been click-bait scare headlines about those findings:

*A review (Rowe & Thrailkill, 2025) of reading policy in North Carolina concludes:

Despite LETRS’ claim that it helps educators “distinguish between the research base for best practices and other competing ideas not supported by scientific evidence” (Lexia Learning, 2022, p. 4), we noticed a pattern of misinterpretation, selective inclusion, and omission of literacy research. LETRS is a prime example of a common problem with the deployment of research for educational policy and instructional decision-making, in that multiple claims are not substantiated by a close reading of the original research cited (cf. Hodge et al., 2020).

*And Gearin, et al. (2025) found:

[Abstract] We investigated whether Language Essentials for Teachers of Reading and Spelling: 3rd Edition (LETRS) was related to student reading ability by comparing the average third-grade reading achievement of schools that used LETRS to that of schools that used exclusively other professional development experiences in the context of Colorado’s Read Act. Guided by What Works Clearinghouse Standards, we conducted a quasi-experiment with propensity score matching and an active comparison group. We supplemented our primary intent-to-treat analysis with three sensitivity analyses designed to demonstrate the robustness of our claims. Effect estimates for completing a LETRS volume on educator knowledge ranged from 0.82 to 0.94. Students’ third-grade reading achievement did not statistically differ for schools that adopted LETRS compared with other professional development experiences in any model, suggesting that LETRS was comparable to the other programs at improving third-grade reading achievement at the school level.

The “science of reading” movement is a political, ideological, and market-based attack on teachers and public education, and the only people profiting off yet another moral panic are the media, political leaders, education reformers, entrepreneurs, and of course, the education market place.

The full story is never covered, because the real story about reading simply isn’t that profitable.

To get the links to research, open the article.

Categories Education Industry, Literacy, Research

Tom Ultican: Grade Retention is a Popular “Remedy” That Hurts Students

By dianeravitch
March 24, 2026 //
12

When an education policy is tried and failed, then tried again and continues to fail, that policy may justly beee called “zombie policy.” It survives despite experience..

Tom Ultican, retried teacher of physics and advanced mathematics in California, here describes such a policy. It is called “grade retention,” but is more commonly known as flunking a student because he or she is not “ready” to be promoted with peers. The short-term effect may seem successful: test scores. But the long-term effect on students’ success is typically negative.

Ultican writes:

Twenty-six American states have a mandatory third-grade retention policy for students who do not pass the state’s reading exam and Maryland is set to implement that policy in 2027. According to researchers, this is bad thinking based on intuition not science. Writing for Education Trust, Brittney Davis declared, “The research is clear that grade retention is not effective over time, and it is related to many negative academic, social, and emotional outcomes for students — especially students of color who have been retained.”  

Economist Jiee Zhong won her PhD from Texas A&M in 2024 and is now an assistant professor of economics at the University of Miami. Last year, she just finished a very impressive study on the effects of grade retention for Texas third graders. Texas abandoned mandatory third-grade retention in 2009.

Zhong studied outcomes of third-graders from 2002-03, 2003-04 and 2004-05 school years who took the Texas reading exam that carried retention consequences. This large data set allowed her to use a fuzzy regression discontinuity design to extract many results. By 2024, the students studied were all young adults over 26 years of age. She was able to evaluate their education, social and economic outcomes using powerful math techniques.

Zhong concluded:

“I find that third-grade retention significantly reduces annual earnings at age 26 by $3,477 (19%). While temporarily improving test scores, retention increases absenteeism, violent behavior, and juvenile crime, and reduces the likelihood of high school graduation.”

For one outcome, she investigated a group of students who barely passed or barely failed the reading test. She learned that the barely failing students earn $1,682 (11.3%) less at age 23 than the barely passing students. Zhong noted that 64.2% of barely passing students graduated from high school while just 55.1% of the barely failing students graduated. She observed that both of these results were statistically significant at a 5% level.

Zhong also noticed a racial disparity. She reports, “White students experience a sharp 43.8 percentage point decline in high school graduation probability, higher than the reductions for Black (17.6 percentage points) and Hispanic students (0.6 percentage points).”

These results from 2025 add more weight to similar results that previous researchers have reported.

The Retention Illusion

In January 2025, Duke University in Chapel Hill, North Carolina published a linked series of three policy briefs concerning grade retention by Claire Xia and Elizabeth Glennie, Ph.D. The Duke researchers stated, “The majority of published studies and decades of research indicate that there is usually little to be gained, and much harm that may be done through retaining students in grade.”

They also mention the grade retention illusion is held by many community members, administrators and teachers who believe grade retention is helpful and needed. The Duke researchers stated, “The findings that retention is ineffective or even harmful in the long run seem counterintuitive.” This belief is so strong that on the 31st Annual Phi Delta Kappa/Gallop Poll, 72% of the public favor stricter promotion standards even if significantly more students would be held back. Other studies show the public being strongly opposed to social promotion believing low-achieving students will continue to fall farther behind.

Please open the link to finish reading.

Categories Accountability, Failure, Research

The 74: New Report Finds “Science of Reading” is Weak on Teaching Comprehension

By dianeravitch
January 30, 2026 //
11

Jessika Harkay of The 74 reported the findings of a new research study about “the science of reading.”

The study found that students who had been consistently taught by teachers using “the science of reading” were gaining basic literacy skills, but were limited in their comprehension of what they read. They could read the words, but they couldn’t step back and explain what they had read.

This finding eerily duplicates a 2008 study of the original “science of reading.”

Let’s back up for a few minutes and see this new study in historical perspective. The “science of reading” was based on the recommendations of the National Reading Panel. That panel was established by Congress in 1997 to determine the best, most effective ways to teach reading. Most of its 14 members were academics. In 2000, the panel released its report, callled Teaching Children to Read: An Evidence-Based Assessment. It recommended that effective reading instruction should include:

  • Phonemic Awareness: Teaching children to manipulate sounds in speech.
  • Phonics: Explicit, systematic instruction in letter-sound correspondences.
  • Fluency: Guided oral reading to encourage automaticity.
  • Vocabulary: Direct and indirect instruction of word meanings.
  • Comprehension: Teaching specific strategies for understanding text. 

When George W. Bush became President in 2001, his education agenda featured the findings of the National Reading Panel. Dr. Reid Lyon, the organizer of the panel, became President Bush’s advisor. Bush’s No Child Left Behind legislation included $6 billion for reading instruction, based on the recommendations of the National Reading Panel, as well as an independent evaluation of its results.

Independent evaluators reviewed the progress of students in the districts that implemented the panel’s recommendations.

In 2008, they published their conclusions:

  • Reading First had a statistically significant positive impact on multiple practices promoted by the program, including the amount of instructional time spent on the five essential components of reading instruction (phonemic awareness, phonics, vocabulary, fluency, and comprehension) and professional development in scientifically based reading instruction.
  • Reading First did not produce a statistically significant impact on student reading comprehension test scores in grades one, two, or three.
  • Reading First had a statistically significant positive impact on first graders’ decoding skills in Spring 2007.

After the $30 million study, involving four major research organizations, reported that “the science of reading” improved decoding skills but not comprehension, enthusiasm for the NRP report waned.

But the NRP report found a second life less than a decade after it seemed to have faded.

Emily Hanford, a journalist who worked for American Public Media, began researching early literacy in 2016. Her 2022 podcast Sold a Story maintained that the source of poor literacy skills could be traced to the work of Marie Clay and Lucy Calkins, both of whom were advocates of balanced literacy, which did not incorporate the findings of the NRP.

Hanford became an advocate for “the science of reading” and the revival of phonics.

Many states enacted legislation mandating “the science of reading” and banning “three-cuing” and other elements of Calkins’ program.

“The science of reading” is unquestionably the dominant mode of teaching reading today.

Harkay wrote:

Four school districts in major urban areas using the science of reading found while students are grasping basic literacy skills, limitations toward deeper comprehension still exist, according to a new study.

The “Robust Reading Comprehension” report, conducted by nonprofit research organization SRI, examined literacy instruction in districts in Texas, Maryland, North Carolina and Virginia that have been using materials rooted in the popular phonics-based literacy approach for at least five years. 

Through numerous classroom observations, teacher surveys and interviews with district officials in Aldine Independent School District, Baltimore City Public Schools, Guilford County Schools and Richmond Public Schools, researchers found a majority of reading lessons lacked “depth” – meaning foundational skills were mainly limited to working on single words rather than reading them in sentences. 

Comprehension lessons in later elementary grades also mainly focused on completing a task, such as identifying a main character, rather than using a text for discussion and understanding its purpose.

“You’re not able to really think about the unpacking of a complicated sentence. You’re not thinking about really intentional vocabulary instruction or the building of kids’ word knowledge over time,” said Dan Reynolds, one of the lead authors of the report. “Ultimately, how should we be framing kids to read? Are we teaching our K-4 kids that reading is just tasks? Are we teaching them that they just need to label stuff and fill out graphic organizers?”

In recent years, nearly every state has passed science of reading laws, including many that have limited the type of programming and instructional materials a school can use – a move that has drawn some criticism that it’s too restrictive and that the instruction faces its own limitations.

The report defined surface literacy skills as a student’s ability to complete tasks and understand texts based on their literal meeting while robust instruction would further push a child to understand, evaluate and synthesize what they had read for its significance. 

The study said its “comprehension observations alone are more rigorous than nearly all studies conducted in the last 50 years.” It’s not expected to be representative of reading instruction across the country, Reynolds said, but “we have four big districts in four different states, and we saw this pattern happening in all four of them with three different curricula.”

The study also found that teachers struggled with implementing comprehension-focused learning materials and said many times the curriculum was too dense, required substantial planning or may not have been developmentally appropriate. Professional development opportunities for these educators were also limited.

(Progress and Potential: School System Approaches to Strengthening Literacy Instruction | SRI)

Researchers reported less than a quarter of observed comprehension lessons were engaging in robust learning. More than two-thirds of the lessons focused on “surface-level” comprehension. 

“It seems that these curriculums are designed to build knowledge and they don’t develop meaning, and so then why read about the Civil War or about insects?” said Katrina Woodworth, director at SRI’s Center for Education Research & Improvement. “The point is to both teach reading and to build students’ knowledge base so that they have more scaffolding for future learning of both content and meaning.” 

The SRI researchers also found that many review tools that measure comprehension don’t make a distinction between surface-level and robust instruction and skills. So, while educators are tasked with meeting a baseline standard, like having a child compare and contrast a text, it may be “unintentionally encouraging teachers to focus on surface-level goals,” the report said.

Without distinction, it weakens instruction for students and can later manifest as a skills disadvantage, Reynolds said.

“Districts had done so much to get the kids all the way there [with literacy], but it was losing voltage in the end,” Reynolds said. “If we can actually shift the way that districts are thinking about improving their comprehension instruction, they can take that all the way home and deliver really high quality comprehension instruction because so many pieces are already in place.”

Reynolds and one of his fellow co-authors, Sara Rutherford-Quach, said they saw glimpses of “magic” in the classroom when students understood a passage in wide-ranging contexts, which is the type of instruction they’re hoping to see districts incorporate more of in early grades.

“The kids were way more engaged,” Rutherford-Quach said. “Surface-level is important and necessary in some cases, … but it really is fundamentally different when you start talking about meaning and making it matter to the kids, and you see that they’re invested in it.”

(Beyond the Surface: Leveraging High-Quality Instructional Materials for Robust Reading Comprehension | SRI)

Reynolds added that it’s unlikely robust comprehension could make up 100% of lessons in the classroom, but “we are thinking that if we can shift that needle from 24% robust lessons up to 50 or 60, then that would be a real catalyst for comprehension growth.”

The report recommended district leaders create “a shared vision for robust comprehension and define what it means for students, teachers, schools and the district,” and align how to best measure the extent of learning. It also called for better professional learning structures that could help model and rehearse robust comprehension work. 

Previous reporting from The 74 found the percentage of recent high school graduates who lack “robust” comprehension skills is the highest it’s ever been, according to 2023 data. The sooner districts can engrain literacy skills that go beyond just explicit tasks, the easier it will be as they continue through the K-12 system, Reynolds said.

“I see the distinction between surface level and robust comprehension as critical to comprehension in fifth grade, but I also see it in the kids when they’re in 12th grade. Surface level comprehension and robust comprehension is the difference between a two on the AP exam and a three,” he said.

One evaluation in 2008. Another evaluation in 2026. Same conclusions. What have we learned?

The ultimate expert, Jeanne Chall, had it right. A former kindergarten teacher who became a renowned Harvard professor, she was commissioned by the Carnegie Corporation to review the research on reading. In her 1967 book, Learning to Read: The Great Debate, she concluded that the best approach was: both. Start early with phonics, she said, then transition to excellent children’s literature. If we continued to swing from extreme to extreme–from phonics to whole word, from whole word to phonics–she predicted, we would forever be trapped in that pendulum.

She was right.

Categories History, Literacy, Research

John Thompson: Bad, Failed Ideas Revived in Oklahoma

By dianeravitch
January 16, 2026 //
2

John Thompson, historian and retired teacher, reports on the latest education news from Oklahoma: the Chamber of Commerce is intent on reviving the failed test-and-punish agenda of the Bush-Obama years, plus the so-called “Mississippi Miracle,”which is credited with amazing results in reading.

John writes:

Once again, attacks on under-funded Oklahoma public schools are examples of the threats the nation’s schools face. Yes, we’ve gotten rid of State Superintendent Ryan Walters, but I’m more worried about today’s  “accountability-driven” mandates, such as those pushed by the Chamber of Commerce. 

On the other hand, our public schools have a history of receiving support from holistic, bottom-up efforts by a variety of excellent social work agencies, nonprofits, volunteers, and innovative educators.

These partners remind me of 1990’s, when student performance was growing. The head of the Oklahoma City Public School System curriculum department dropped into my History classroom, saying that she had been watching me teach, and I might like to try something new. She suggested that I start the year with the 20th century to get my kids hooked on history. Then, around Thanksgiving, we would return to the beginning of the subject, and reteach the 20th century.

It was a brilliant approach, supported by cognitive science. And it showed inner city students respect by nurturing meaningful, challenging instruction. The result was that my kids worked from bell-to-bell, from day one to their graduation day, learning how to learn.

I doubt that would be allowed today, when “everyone” is pressured to be on the “same page,” often requiring the same type of data-driven instruction.

Then, as the No Child Left Behind Act of 2001 approached, our principal gave us aligned and paced curriculum guidelines; They are now pervasive. She said that she knew we wouldn’t use it, but rather than throwing it away, we should keep it handy in case a top administrator visited the class.

Before NCLB, we had the autonomy to adjust our lessons in order to promote in-depth learning. For instance, when my students came to class carrying Ralph Ellison’s The Invisible Man, which they were reading in their English class, I would quickly change my schedule. Our History class would learn about Ellison’s childhood in Oklahoma City, and how his famous “Battle Royal” scene was inspired by a cruel joke that was played on him when he applied for a job.  

And, around that time, the bipartisan MAPS for Kids succeeded in saving the OKCPS from a financial collapse by raising taxes.  MAPS for Kids listened to educators, parents, top national education and cognitive science researchers, and students; it called for the meaningful instruction which treated high-challenge kids with the same respect and opportunities that are bestowed on students in the exurbs.  

I was in the room when MAPS and OKCPS leaders agreed that educators should receive a clear message – their job is to teach the Standards of Instruction, not to standardized tests.

I was then in the room when top district administrators were supposed to reveal the agreement to a committee of principals. The committee chair started with summaries of ridiculous policies that had been imposed over the years. Principals replied with absurd, but hilarious stories, about the tumultuous effects of non-educators’ political demands. 

But, the administrator then said that we would have to dramatically expand standardized testing. 

When I pushed back, a highly respected administrator put her hands on my shoulders, and said, “John, I’ve always  said you don’t make a hog heavier by weighing it. But this is politics. We have no choice.”

When NCLB and subsequent corporate school reforms were implemented, the supposed goal was using top-down, accountability mandates to rapidly transform schools serving our poorest children of color. But in my experience, those were the students who were most damaged by output-driven reforms that forced teachers to be “on the same page” when teaching the same lessons.

I didn’t have the expertise to get involved in the debates over aligned and paced instruction in pre-k and elementary schools, but the idea that it should be forced on high-challenge secondary students was absurd. Educators pushed back as much as we could, but our resistance was condemned as “low expectations.” And reformers who blamed us Baby Boomers for making “excuses,” sought to replace us with young teachers, such as those in Teach for America, who were trained in the culture of data-driven accountability

Reformers also brought frequent benchmark testing into schools. Lacking explicit stakes, benchmarks could have created a culture of testing for diagnostic, not accountability, purposes. In my experience, however, the test prep culture, combined with more frequent tests, further undermined the teacher autonomy required for holistic instruction.  

Today, the campaign for the “Science of Reading,” now known as the “Mississippi Miracle,” is driven by “extensive use of formative and benchmark assessments to track student progress and inform instructional differentiation.” The American Federation of Teachers’ president Randi Weingarten supported much or most of the “Science of Reading” but she “doesn’t advocate for what we have found so disrespectful: scripted curricula or ‘teacher proof’ programs.”

And we face new threats when, as is happening in Oklahoma,” the ideology-driven, reward-and-punish parts of the “Mississippi Miracle,” are combined with the Moms for Liberty’s focus on “back to basics” foundational skills and phonics.

Despite the lack of evidence that the Miracle increases long-lasting reading comprehension, as opposed to short-term test gains for 4th graders, Oklahoma’s Chambers remain committed to retention based on reading test scores, like we did in 2015-2016 when we were second to Mississippi in retaining k-3rd grade students. They ignore that tragic results which seemed likely to occur in 2004, and in 2012, and 2015 when Oklahoma briefly required the passing of four End-of-Instruction tests to graduate from high schools.  

But, I would remind the Chamber of its call for recruiting and retaining high-quality teachers in order to attract and retain business investors for Oklahoma. After all, the best way to attract high-quality teachers, and parents of students, is to allow for high-quality, holistic teaching and learning, not make them work in a 21st century version of a Model T assembly line.

Categories Accountability, Education Industry, Failure, Literacy, Oklahoma, Research

Paul Thomas: Research vs. “The Science of Reading”

By dianeravitch
January 16, 2026 //
14

Paul Thomas was a teacher in South Carolina for many years; he is now a professor of education at Furman University. He believes that the movement to mandate “the science of reading” is a fraud, as is the so-called “Mississippi Miracle.” The key to the alleged miracle, he says, is holding back third-graders with low reading scores. That is the magic bullet, not the reading curriculum.

In this post, he compares the claims for SOR with research.

He writes:

Journalists and politicians are both drawn to and depend on compelling stories.

Regretfully, whether or not those stories are factually true is less and less important, and in some cases, what makes the stories compelling is over-simplification while the truth is complicated or often not clearly defined.

The stories told about education have a long history of being trapped in compelling but false claims. Currently, the most popular and compelling education story is about reading proficiency among US students; this story is grounded in a very compelling story about reading reform in Mississippi, identified as reform labeled the “science of reading.”

The repetition of the so-called Mississippi “miracle” has occurred dozens of times since 2019—and here are just two of the most recent:

•Rahm Emanuel on Twitter:

•And yet another article in The New York Times: How Mississippi Transformed Its Schools From Worst to Best.

Everything about the Mississippi story fits perfectly into the larger stories that Americans love.

So there is now a recurring accusatory question: If high-poverty poverty state with a large proportion of Black students can radically improve reading proficiency among their students, why don’t all states adopt that policy?

From that, it gets uglier because the implication and direct accusations that follow are damning: The education establishment, bolstered by teachers unions, simply don’t think poor and Black students can learn; the education establishment uses poverty as an excuse and will not let go of the soft bigotry of low expectations.

Throughout the stories being told about reading, teachers, and education, there is a discouraging pattern: The stories are not supported by the evidence (ironically, the stories behind the “science of reading” lack scientific research), and in many cases, the evidence contradicts the story being told.

Is poverty an excuse for student achievement and is teacher quality/knowledge a major reason students underachieve?

Poverty, inequity, and other out-of-school factors are the primary cause factors in measurable student achievement (test scores), accounting for 60% or more of those scores.

Teacher quality impacts measurable student achievement at rates of about 1-14%.

Research:

If you want to read the research that directly contradicts the received wisdom about how to teach reading, open the link.

Categories Literacy, Mississippi, Research

Trump Administration Will Close Major Center for Research on Climate Change

By dianeravitch
December 18, 2025 //
3

The Trump administration is engaged in a war against science and medicine. It has eliminated funding in many crucial areas of research conducted by universities and by the National Institutes of Health. Incalculable damage has been done to set back the search for cures for cancer, Alzheimer’s, heart disease, infectious diseases, HIV, respiratory diseases, and pediatric cancer. People will die because of the ignorance of those who close down ongoing, vital research.

Trump has consistently claimed that “climate change” is a hoax. He has said that the term “climate change” refers to the weather. He hates wind farms and has cut federal funding for them. He has hated wind farms since wind turbines were built near his Trump International Golf Links in Scotland. He sued to block them but repeatedly lost.

Now he is closing down a major hub of climate research.

The New York Times reported:

The Trump administration said it will be dismantling the National Center for Atmospheric Research in Colorado, one of the world’s leading Earth science research institutions.

The center, founded in 1960, is responsible for many of the biggest scientific advances in humanity’s understanding of weather and climate. Its research aircraft and sophisticated computer models of the Earth’s atmosphere and oceans are widely used in forecasting weather events and disasters around the country, and its scientists study a broad range of topics, including air pollution, ocean currents and global warming.

But in a social media post announcing the move late on Tuesday, Russell Vought, the director of the Office of Management and Budget, called the center “one of the largest sources of climate alarmism in the country” and said that the federal government would be “breaking up” the institution.

Mr. Vought wrote that a “comprehensive review is underway” and that “any vital activities such as weather research will be moved to another entity or location.”

USA Today first reported on the White House plans.

Scientists, meteorologists and lawmakers said the move was an attack on critical scientific research and would harm the United States.

The National Center for Atmospheric Research was originally founded to provide scientists studying Earth’s atmosphere with cutting-edge resources, such as supercomputers, that individual universities could not afford on their own. It is now widely considered a global leader in both weather and climate change research, with programs aimed at tracking severe weather events, modeling floods and understanding how solar activity affects the Earth’s atmosphere.

The center’s research has often proved useful in unexpected places, such as when its studies of downdrafts in the lower atmosphere in the 1970s and 1980s led to development of wind shear detection systems around airports that helped address the cause of hundreds of aviation accidents during that era.

Categories Environment, Evil, Extremism, Medicine, Research, Science, Stupid, Trump
« Older Entries