Rick Hess writes about a new study of teacher evaluation systems in 19 states by Matthew Kraft and Allison Gilmour. It shows that the new systems have made little difference. Instead of 99% of trachers rated effective, 97% are rated effective.
This was Arne Duncan’s Big Idea. It was an essential element of Race to the Top. The assumption behind it was that if kids got low test scores, their teachers must be ineffective.
It failed, despite the hundreds of millions–perhaps billions– devoted to creating these new systems to grade teachers. Think of how that money might have been used to help children and schools directly!
Hess writes:
“Emboldened by a remarkable confidence in noble intentions and technocratic expertise, advocates have tended to act as if these policies would be self-fulfilling. They can protest this characterization all they want, but one reason we’ve heard so much about pre-K in the past few years is that, as far as many reformers were concerned, the big and interesting fights on teacher evaluation had already been won. They had moved on.
“There’s a telling irony here. Back in the 1990s, there was a sense that reforms failed when advocates got bogged down in efforts to change “professional practice” while ignoring the role of policy. Reformers learned the lesson, but they may have learned it too well. While past reformers tried to change educational culture without changing policy, today’s frequently seem intent on changing policy without changing culture. The resulting policies are overmatched by the incentives embedded in professional and political culture, and the fact that most school leaders and district officials are neither inclined nor equipped to translate these policy dictates into practice.
“And it’s not like policymakers have helped with any of this by reducing the paper burden associated with harsh evaluations or giving principals tools for dealing with now-embittered teachers. If anything, these evaluation systems have ramped up the paperwork and procedural burdens on school leaders—ultimately encouraging them to go through the motions and undercut the whole point of these systems.”

To Hess’s point: principals invest approximately 25 hours per teacher to complete their entire evaluation process. If you have a staff of 70-100 teachers as large high schools do….?!
LikeLike
From a teacher who spent YEARS inside the test-score insanity where administrator after administrator and evaluator after evaluator came and went — the plain fact is that they DON’T. They just play the game for a year or two and move on. It’s all smoke and mirrors.
LikeLike
Yeah, my administrator spends maybe an hour and a half total on my evaluation all year, and the evaluations are spread between three administrators.
LikeLike
Diane, this is disingenuous. Reformers think 10%+ are ineffective. The recent WaPo article by Emma Brown indicated principals themselves thought about 25% were ineffective but didn’t have the courage to rate them that way. That same article shows improved performance in DC due to fewer renewals.
But to get improved performance, a state must actually implement the system. See the closing arguments by VDOE/Loudoun County and me in the Davison v VDOE case about releasing the SGP data. One has to wonder why a union would ask a lawmaker to change the law on protecting SGP data when a lawsuit is ongoing….
On a related note, Duane Swacker may be interested in this lawsuit against a sitting district attorney for censoring documents on his public Facebook page that are critical of his conduct. 1st Amendment rights are not negotiable.
LikeLike
What do the principals know about teaching? As some politicians have said in that past 200% of all teachers are highly effective. The rest of the professions, such as engineers, doctors and nurses are only 1000% highly effective.
LikeLike
Vsgp:
Is the lawsuit such that the district’s lawyer on his own time and own computer and facebook page, censored others that wrote on it, and now is being sued for 1st amendment violations?
LikeLike
Come on already.
“In what other profession are those with the most experience 93% of those targeted for removal from their jobs based on alleged incompetence, while what remains an undisclosed staggering savings to the school district involved is the real motive for these teachers removal.”
Teacher evaluation systems are rigged and we know why. Let’s look at LA “For every teacher at the top of the salary scale LAUSD , for example, gets rid of it has a combined $60,000 savings in salary and benefits, when it hires a young and no experience “teacher” straight out of college on an emergency credential, who doesn’t even rank in on the salary scale until they clear their credential. And that’s in just the first yea”r.
“So why is this motive for attacking more expensive high seniority teachers never mentioned in the tenure discussions of Vergara and elsewhere as a possible motive for removing high seniority teachers, while disingenuous and patently false arguments in favor of miraculously “qualified” novice teachers losing their jobs because of tenure preference for supposedly incompetent tenured teachers is the only voice heard?”
“Ninety-three percent of the thousands of tenured high seniority teachers targeted on false charges often alleging morals code violations of Ed. Code Section 44939- which leapfrogs over their collective bargaining rights to grievance and independent arbitration- just happen to be at the top of the salary scale.”
THEY GET AWAY WITH THIS because we teachers have no access to the laws that govern the workplace… they can say anything they want, not just that a teacher is incompetent… THEY DID IT and emptied the schools of the veteran teachers.
THIS is what happened to NYC which had great teachers whose practices educated millions. They got away with it… NO ACCOUNTABILITY, just like in the banks. where the CEOs actually profited from their mendacity as the baks were about to fail. They bailed out the banks, but not the schools
The Inconvenient Truth Behind Waiting for Superman on Vimeo
LikeLike
These procedures involved neither “noble intentions,” nor “technical expertise.” They were imposed by arrogant know-nothings who were trying (and have so far largely failed, fortunately) to use pseudo-science to degrade and attack teachers, in order to expand their wealth and power.
LikeLike
It “failed” to result in mass firings, but perhaps it succeeded in affirming that the vast majority of teachers are hard working and doing a good job. If two different systems are getting nearly the same results doesn’t that perhaps give more faith to the “measurement” of “performance”?
LikeLike
But, Greg — in the “national debate” — it doesn’t. It has had no effect. The drumbeat against teachers goes on. The Ed Reform crowd rarely stops to examine their own (bad) data, nor do they let its existence impede them in their headlong rush to destroy public schools. Trust me. A few people have wised up, but from the rest, you will continue to hear how teachers are ineffective, cost too much, ask for too much, and are seeking excuses for their own failures. The REAL goal here was to start a national hum around teacher disparagement (that way, even if you don’t fire them, they leave out of disgust and discouragement, and no one in college now will want to take their place)– and they have largely succeeded.
LikeLike
I would like to see the Government worker equivalent of PDAS enforced, with members of the Senate and House evaluated on performance of how the programs they put in place are or aren’t successful and then if they are not that we would get them “assistance” and eventually we would usher them out of their profession. Maybe the presidential PDAS is in order, lawyers, doctors….if they give their patients all the data and how to loose weight and get off blood pressure meds and they do not then the doctors are totally to blame and we should clear them out of their jobs, right? Oh wait only teachers are evaluated like this. Only in our profession are we held to a higher standard than any other office in the country…… Every profession has bad employees but teaching seems to be the only one blamed and sent to the court of public opinion condemnation without a represented right to trial sighting ALL OF THE OTHER MITIGATING FACTORS in students not being “successful” and that only being how they test( which is just a money hungry pit of greed since test do little to prove a person’s ability to function later in their adult life). Sigh, double sigh…..
LikeLike
Made little difference? Au contraire❢
They have made a huge difference in the bank accounts of testing companies — and that is the only difference they and their puppet pols care about.
LikeLike
Hess pontificates but does not enlighten.
1. The study he tries to leverage for sweeping claims about education is a version of the Widget Effect, first produced in 2009 by The New Teacher Project with funds from the Carnegie Corporation. The report blasted teacher evaluations and failures of dismissals. Weisberg, Daniel, Sexton, Susan, Mulhern, Jennifer, Keeling, David, The Widget Effect: Our National Failure to Acknowledge and Act on Differences in Teacher Effectiveness. The effort to define “effective” teachers by limited criteria and pedagogically irrelevant criteria was not just Arne Duncan’s idea.
2. This study that Hess is referring to is not peer reviewed.
3. The generalizations Hess wants to leverage for discussion come from 24 principals who participated in 40-60 minute interviews in July-August 2013,–one urban school district in the Northeast.
4. The study conclusions are not earth shaking.
5. The evaluation systems were imposed on the principals. The principals knew they were starved for time and shortchanging teachers on “feedback.” Principles in middle school and high school knew they were not qualified to make judgments about the content of instruction by the required observation and protocols for conferencing.
6. The bibliography for the extended abstract suggests that the principals were using Charlotte Danielson’s system, Framework for Teaching, and a version available in 2013, when this study was done. That Framework has no validity for every grade and subject
7. The abstract and key conclusions of the study that Hess mentions are here…https://www.sree.org/conferences/2016s/program/downloads/abstracts/1694.pdf
8. Hess says: “While past reformers tried to change educational culture without changing policy, today’s frequently seem intent on changing policy without changing culture. The resulting policies are overmatched by the incentives embedded in professional and political culture, and the fact that most school leaders and district officials are neither inclined nor equipped to translate these policy dictates into practice.”
Hess doesn’t get it. Either way, culture-to-policy or policy-to-culture he is blaming school officials for failing to “translate policy dictates into practice.”
Hess fails to acknowledge that if you start with lousy top-down policies from people who know little or nothing about education and fail to recognize that as THE problem, then non-compliance with dumb policies may actually be sign of pedagogical and managerial wisdom.
Hess is wrong if he thinks that “the big and interesting fights on teacher evaluation” have already been won and that the “point of the whole system” is no longer in dispute.
Sorry thinking. Here are some on-going disputes: Stack rankings of teachers based on the misleading idea that test scores are objective measures, the deceptive association of “growth” in learning with gains in test scores, the continued use of invalid and unreliable VAM and SLOs; the use of one-size fits all observation checklists, the introduction of biased student surveys into teacher evaluations, the myth that “great” teachers can “close the achievement gap” if only we test more and disaggregate the scores—all in the name of teacher evaluation and school accountability.
None of these have vanished from the policy landscape or from the lives of teachers and students or the agendas of savvy parents.
LikeLike
Rick Hess: New Teacher Evaluation Systems Have Made Little Difference”
…which (luckily) is more difference than Rick Hess has made.
LikeLike
The whole enterprise seems ignorant of the marketplace. The kind of paperwork and bad faith* involved in high-stakes teacher evaluation has chased teachers from the field. and even if it hadn’t– it doesn’t make much sense to sit back & opine that 10-25% should be fired if you don’t know how to attract better replacements
*bad faith = as done in Hess’s article, claiming the agenda of teacher evaluation systems is to figure out who needs help & deliver it, & acclaim high performers. Pardon me but what a crock.
LikeLike
Exactly! Did you read my comment here?
LikeLike
Yes indeed your post– an exposé of the bad faith involved– provoked mine. I’m just embellishing: even if ed-reformers were, as they claim, applying sensible business practice to public education, they couldn’t justify the nonsense that passes for teacher evaluation. In fact it smacks of the over-regulation conservatives understand constricts competition in the marketplace, which it is doing, by shrinking the available pool of qualified teachers.
Hess’s piece is doubly disingenuous. First, he claims that the real problem is not with the policy– it’s just that darn it, it’s not being correctly implemented by administrators [solution: training!]. And second, his ludicrous claim that teacher-evaluation programs are all about ‘identifying teachers who need help’ [& delivering it], and rewarding those who excel– all of which which might have some credulity if such programs were not unfunded mandates.
Meanwhile anyone who can read a road map gets that ed-reform is just another piece of reducing U.S. overhead (health/ ed/ welfare) markup on its products so as to compete globally w/ ‘developing countries’.
LikeLike
Exactly. there was a piece in The Washington Post, which I got when someone posted it here. A study shows how privatizing the public sector COSTS MORE…even as it destroys our jobs.
https://www.washingtonpost.com/blogs/ezra-klein/post/study-privatizing-government-doesnt-actually-save-money/2011/09/15/gIQA2rpZUK_blog.html
They>>>
Click to access eic-oct_11.pdf
are shutting down public education, but it is the Plutocrats at the top who benefit from an ignorant nation they can rule by fear… witness the people who turn out for TRUMP!
If our schools were working, could this man who quotes Mussolini exist as a candidate!
LikeLike
They ARE employing sensible business practices — but you have to understand the business model and its objectives. The objective was never to “make schools better” or “increase educational choice/opportunity,” etc. The objective was always to make the most money for shareholders/investors as possible. Anyone knows that a successful way to do this is to make the product as cheaply as possible. One problem comes when your customers (families) leave for other alternatives — but if you have gotten rid of all of the opposition — by privatizing everything — and driven the cost of your model down to the point where you can make money regardless — well then it hardly matters.
It is a win win at the top. Taxes go down, because you are not supporting an infrastructure that actually DID care about educating kids — and your companies make money for investors. Period. Job done. The “value” of the experience/product to the customer is irrelevant and need no t be (n fact, in pure capilatism, should not be) part of the model (unless and until it is so bad it drives you out of business (which is where monopolies, captive markets, etc. all come in..
LikeLike
YES, I KNOW THIS… I saw the names of the EIC:
Click to access eic-oct_11.pdf
But ultimately it is nOT about money. It is about getting our citizens young.
Then, the double whammy hits them.
TV with its diet of aggression and violence and utter lies, and schools that do not teach the history of humankind, the outcomes of policies, the literature, or the benefits of civility, integrity and the values that once benefited a tribe,or any society.
With the schools gone, neighborhoods and communities uprooted, religious institutions disappearing, all the sacred values are GONE, and so easily replaces.
2 books you might enjoy
I LOVE this book:
“In The Absence of the Sacred,” by Jerry Mander (yes that is his name) http://www.scottlondon.com/reviews/mander.html
The Social Contract – Book Review of ‘The Hidden Persuaders’ and ‘The Waste Makers’ by Vance Packard
http://www.thesocialcontract.com/artman2/publish/tsc1004/article_903.shtml
LikeLike
Could this kind of ignorance by at least a part of the reason that our best teachers are leaving the profession and fewer and fewer people are entering it?
Also
Any evaluation system is based on the yardsticks for measurements plus the competency of those evaluating those to be evaluated.
I have seen good administrators and BAD ones. If you do not believe there is politics involved in those being evaluated I got news for you.
LikeLike
Seriously, Gordon. Do you read nothing that I post. See my comment above, and know this… for 2 decades the top teachers were removed in the most horrendous way possible, with no access to their civil rights. Now, VAM does the rest, as the novice teacher, who has paid a fortune for education is unsupported in the practice, mandated to use anti-learning curricula, and blamed when the kids don’t learn.
It is all about the CIVIL RIGHTS OF TEACHERS… Gordon, “In what other profession are those with the most experience 93% of those targeted for removal from their jobs based on alleged incompetence, while what remains an undisclosed staggering savings to the school district involved is the real motive for these teachers removal.”
It is all about money.
and, I apologize to all who read me here, for posting this again but GORDON, this happened to me,and to tens of thousands of teachers.
http://www.perdaily.com/2011/01/lausd-et-al-a-national-scandal-of-enormous-proportions-by-susan-lee-schwartz-part-1.html
LikeLike
If NJDOE could get all the teacher rated ineffective, fire them, open charters schools, hire scabs. If.
LikeLike
Next week, Rick Hess observes wet pavement and declares, “It’s rained today.”
LikeLike
D.C. Schools started this and now they’re going back to teacher evaluations by principals.
LikeLike
Any teacher evaluation system designed to fire its way to excellence is rendered moot by the simple fact that there is no secret supply of highly effective teachers waiting in the wings.
These Danielson/Marzano/VAM/SLO driven evaluation systems have produced more dog and pony shows than anything. A high quality, content rich, academic program developed and fine-tuned over years of painstaking work are given short shrift by the generic rubrics that fail to recognize what really counts.
LikeLike