John Merrow has been covering education for decades, most recently as education correspondent for the PBS Newshour, and he has learned quite a lot, most of which he puts into his forthcoming book, Addicted to Reform (out on August 1).
One important thing that he learned was that test-based accountability is not a worthy goal for education.
In this post, he identifies what he calls “the canary in the mine,” the bird that falls dead when the methane gas overwhelms it, a warning to coal miners to get the hell out. [Thanks to Reader Stephen Ruis for correcting my original description.]
The canary in the mine is the Broad Prize for Excellence in Urban Education. You see, Eli Broad is obsessed with testing and measurement, and he felt certain that the prospect of a $1 million prize would incentivize urban districts to push up their test scores.
But, the Broad Prize was not awarded in 2015 nor was it awarded in 2016.
Apparently, it has been canceled permanently.
Here’s why: It turns out that the NAEP scores of most of the Broad Prize winners (public school districts) have been flat for years. These districts have been living and dying by test scores, and it’s not working well enough to impress the Foundation’s judges.
It turns out that the big idea of incentivizing districts to raise test scores didn’t work. Scores were “sluggish.” Broad was operating on the assumption that the scores would go up and up and up, but he was wrong. Changes are incremental at best, and big changes are suspect, especially on a large-scale assessment like NAEP.
So, no surprise, Broad dedicates the biggest chunk of his millions to charter schools, not public schools. Unlike urban public schools, which must enroll everyone, the charter schools know the secrets of test score success: selective admissions and significant attrition.
Merrow writes:
Apparently it’s pretty simple for the folks administering the Broad Prize in Urban Education: Successful School Reform boils down to higher test scores. There is no public sign that anyone at the Foundation is questioning whether living and dying by test scores is a sensible pedagogy that benefits students. There is no public evidence that anyone at the Foundation has considered what might happen if poor urban students were exposed to a rich curriculum and veteran teachers, which is essentially the birthright of students in wealthy districts. Just the dismal conclusion that traditional districts are incapable of reform, followed by its decision to double down on charter management organizations, despite the truly offensive record of some of them of excluding special needs children and driving away students who seem likely to do poorly on standardized tests.
What can we conclude: Eli Broad and his foundation have learned nothing and know nothing about pedagogy or how children learn.
Sad. So sad.

Re “‘the canary in the mine,’ the bird that sings out and warns people when the air is dangerously foul” … egad, the bird didn’t sign out, it fell off its perch, being more sensitive to the effects of the methane and other gases that were putting the miner’s at risk.
LikeLike
Thanks, Stephen, I fixed that.
LikeLike
“Canary in a Coal Mine”
The mine canary sings
When gas has just begun
Sings Taps and other things
Before the day is done
LikeLike
Sings Taps till mineshaft rings
LikeLike
And watching a “Broad Prize” regime takeover a school, that is exactly what happened to the good, authentic educators in the building. They were shoved off their perch of PROFESSIONAL, bullied into submission or exile and defamed. Because…the first living creature that just HAD to go was any assortment of canaries who might warn the other teachers that Broad Prize was a deadly infection, weaponized to destroy their profession and their democracy.
LikeLike
All too true.
LikeLike
Gates’ attack on higher ed. is in full gear with the requisite student outcome measures heavily promoted.
The stink tank, New America (Wikipedia reports- funded by Google’s Eric Schmidt, Gates, Lumina and the U.S. State Dept.) calls for student outcome measures and state funding for both private and public universities. The two strategies can pave the way for Bill Gates’ for-profit schools-in-a-box (an investment of Gates, Z-berg, Pearson,…). When coupled with Gates’ Frontier Set, where two higher ed. systems, AASCU and APLU, and 31 universities (5% of HBCU’s) have signed on, New America’s plan “Starting from Scratch or a New Vision for Higher Ed.” will be achieved. Georgia’s participation in Frontier Set is described, “will implement BUSINESS (my caps) models for COLLABORATIVE (my caps) course development and delivery”.
Universities, as a foundation of democracy are a threat to the oligarchy (and, a profit opportunity).
A former New America employee co-wrote the Center for American Progress’ plan to replace faculty’s role in accreditation, with student outcome measures. (Forbes, Nov, 2016).
LikeLike
GATES is reprehensible and dispicable. He’s just making sure he has MONEY FLOW. He cares not a wit. He needs to just GO AWAY and crawl under a rock.
LikeLike
So much of “reform” is based on false assumptions, bias and outright lies. Merit pay or prizes do not raise scores. VAM assumes lazy teachers are coasting so they need the “lightning jolt” of VAM to shake them off their pedestals. Districts cannot fire their way to success. Miracle charters are mostly lies except for their big “innovation” of cherry picking the best and cheapest to teach and casting off those that cannot raise scores. Choice solves no problems. In fact, it creates a whole new set of problems including enhanced segregation. Vouchers are a pitiful waste of money. There is no evidence to support their so called value; yet Trump and DeVos continue to look for way to force their adoption. While there are many ways to build in accountability, test scores are not the answer. In fact, If raising scores is the goal, they could probably improve them by paying people a living wage. Scores, however, are a red herring. The real goal is mass privatization.
LikeLike
So muchAll of “reform” is based on false assumptions, bias and outright lies”Fixed it for you.
“Normalies-ation”
False assumptions and outright lies
Have now become the norm
Propaganda to privatize
The gist of school “reform”
LikeLike
“Canary in a Goldmine”
The mother lode’s attracting
The Gates have opened wide
Canary isn’t acting
The public school just died
LikeLike
“The Broad Prize”
Broadly speaking,
Broad Prize
Awarded to conform
Badly wreaking
Broad lies
Purported to “reform”
LikeLike
When all this began, I worried that basing all of this on test scores would become a thing that re-defined what education was. Once we had decided that good education was only defined by good scores on tests, I feared all other suggestions would seem intellectually squishy to policy makers. Thus it would be that all education would be debased by the test makers and their methods.
I note above that the tests themselves are making many look backward. If NAEP kills reform, at least the reform by test, there will be at least one good test.
LikeLike
One test to rule them all
One test to find them
One test to bring them all
And in the darkness bind them
(With apologies to JRR Tolkien
LikeLike
“If NAEP kills reform, at least the reform by test, there will be at least one good test.”
Well, NO! NAEP suffers all the onto-epistemological errors and falsehoods and psychometric fudges as the rest of the standardized tests as proven by Noel Wilson in his never refuted nor rebutted treatise. By definition the results and any usage of them are COMPLETELY INVALID.
LikeLike
Blame also accrues to the mainstream media for validating this bogus “award” from a man who literally boasts of his ignorance about education.
Newspapers, the NY Times and Washington Post in particular, disgracefully reported the awarding of the Broad prize with a straight face, as if it was legitimate, and not a choreographed media event intended to sell an ideology based on Overclass greed and power seeking.
LikeLike
I appreciate what John Merrow has said. Some of us have been saying this for years. decades even. And we’ve been saying it while others were pushing “accountability,” and “standards-based reform,” and “rigor” as the path to an authentic public education. We were saying it while politicians cited meaningless platitudes, and while the mainstream press reported goofiness, and while educational ‘leaders’ — from principals and superintendents, to school boards and top union officials and education organizations — jumped on the “national standards, national tests and national curriculum” bandwagon.
Often, because we argued what Merrow is saying now, we were branded as “troublemakers.”
The ignorance remains, though. Now it’s SATs, and ACTs, and Advanced Placement, and STEM.
Way past time for a change.
LikeLike
This push for STEM is really to flood the market and make robots of STEM graduates.
LikeLike