Archives for category: Teacher Evaluations

Celia Oyler is a teacher educator at Teachers College, Columbia University.

In this post, she explains that the Chancellor of the Néw York Board of Regents, Merryl Tisch, does not understand how the teacher evaluation plan she snd 10 other Regents just approved works.

Tisch thinks she solved the problem of VAM mistakes by permitting teachers like Sheri Lederman to appeal ratings that are clearly wrong.

Oyler says that Sheri Lederman’s rating, egregiously wrong, was not an “aberration.” The whole system is flawed.

“What is extremely important for all New York State educators and families to understand is that the Chancellor of the Board of Regents does not understand a very basic aspect of a policy she has foisted upon us.”

Hillsborough County in Florida was one of the major beneficiaries of the Gates Foundation’s fetish for teacher evaluation and bonus pay. Gates pledged “up to” $100 million, but is refusing to pay the last $20 million because there has been so little evidence of the link between bonuses and test scores. Duh. If the Gates Foundation read the research on incentive pay, it would have spent the money reducing class sizes for the neediest children.

The Gates program has cost a total of $271 million, including Gates’ $80 million.

The Hillsborough plan inspired state legislation:

“Enacted a year after Hillsborough launched its project, Senate Bill 736 in the Florida Legislature phased out teacher tenure and tied pay to supervisor evaluations and student test scores.”

The program never met its goal of firing 5% of teachers every year:

“The original proposal and a 2010 timeline called for the district to fire 5 percent of its teachers each year for poor performance. That would amount to more than 700 teachers. The thinking was they would be replaced by teachers who earned entry level wages, freeing up money to pay the bonuses for those at the top.

“But the mass firings never happened. While an undetermined number of teachers resign out of dissatisfaction or fear that they will be fired, only a handful of terminations happen because of bad evaluations.”

The Gates Foundation has another flop.

MaryEllen Elia, the superintendent of the Hillsborough school district when it received the Gates grant,, was fired by the school board, then hired this year as state superintendent in Néw York.

“Late in the process, the foundation rejected several of the district’s funding requests for Empowering Effective Teachers, which involves evaluating teachers using specially trained peers and bumping their pay with the idea that it would boost student performance.

“Each of the proposals were robustly outlined and presented,” a district report said.

“But Gates officials responded by pointing to language in the original agreement saying the foundation had promised “up to” $100 million, not necessarily the whole amount, according to the report.

“The district picked up the unpaid costs.

“Much of the disagreement amounted to a change in Gates’ philosophy, Brown said. “After a few years of research,” she said, “they believed there was not enough of a connection between performance bonuses and greater student achievement.”

Now for some laughs, enjoy Peter Greene’s take on Gates’ cancellation of $20 million. He reminds us that Hillsborough was a jewel in Gates’ crown in 2012.

Peter writes:

“Well, that was 2012. A few other things have happened in the meantime. Back in 2010, Arne Duncan and Dennis Van Roekel stopped by to make a fuss, but that was about the last time that anybody wanted to throw an EET party.

“That fire 5% of the sucky teachers thing? It should have gotten rid of 700 (700!!!) teachers– you know, the expensive ones, because everyone knows that the bad teachers that need to be rooted out are, coincidentally, the older teachers who cost a bunch of money. But it never happened.

“And that $100 million grant that Kinser was so proud of? Funny thing. Gates officials would now like you to know that the grant actually said “up to” $100 million.

“I am kind of excited about that, because I know realize that I can tell, say, a used car dealer that I will pay “up to” seventy grand for a car and just pay five thousand bucks. I could promise to buy a new house with “up to” $10 million and just fork over a check for $10.75. I do regret not knowing this trick when my children were young and I could have bribed them to do chores with offers of “up to” $100 for mowing the lawn.”

Now for a deep analysis, read Mercedes Schneider’s analysis of the Hillsborough debacle. The Gates money was a Trojan horse. Not only did it fail to produce a new generation of super-teachers, it drained the district’s reserves.

The Gates money–$80 million, not the promised $100 million–was a cause of great celebration when it was announced. Hillsborough would be a “national model.” In the end, Superintendent Elia was fired in January 2015, the district lost millions, and Gates learned…what?

Mercedes writes:

“Of course, Gates had some ideas about how this “teacher effectiveness” business should work. The report linked above has as its second sentence, “A teacher’s effectiveness has more impact on student learning than any other factor under the control of school systems, including class size, school size, and the quality of after-school programs.” When pro-corporate-reform organizations toss around such statements, they never seem to follow it with the fact that factors external to the classroom hold far more sway that does the teacher. (In analyzing the proportion of teacher influence captured via value-added modeling– VAM– the American Statistical Association notes that teacher influence accounts for between 1 and 14 percent of variance in student test scores. Thus, between 86 and 99 percent of a student’s test score is out of the teacher’s control.)

“Nevertheless, ignoring that the teacher controls so little of student outcomes in the form of market-driven-reform-loving test scores, in its efforts to try to purchase higher student test scores, the Gates Foundation offered ten school districts nationwide the multi-million-dollar-funded opportunity to prove that teachers could indeed be cajoled into producing better “student achievement” (i.e., ever-higher test scores) when such teachers were measured by their students’ test scores and offered more money for “raising” said scores.

“As a 2009 winner of an Empowering Effective Teachers grant, Hillsborough was thrilled (“We’ll be a national model!”). A December 21, 2015 archive of Hillsborough schools’ “Empowering Teachers” webpage includes a number of enthusiastic responses regarding the newly-acquired, $100 million Gates grant. Front and center in these celebratory public statements is then-Hillsborough superintendent, MaryEllen Elia (Then-Governor Charlie Crist: “I commend Superintendent MaryEllen Elia and the Hillsborough County School District for their enthusiasm and commitment to working with the Bill and Melinda Gates Foundation during the next seven years to improve student academic performance through rewarding high quality teachers both professionally and monetarily. The foundation’s generous grant award of $100 million will greatly enhance the work the district has already done in this area.”)

“However, part of the Hillsborough-Gates agreement involved Hillsborough’s ponying up money of its own– which ended up eating into the Hillsborough schools’ reserves and threatening its bond rating. As reported in the August 04, 2015, Tampa Bay Tribune, the Empowering Effective Teachers initiative is not the only financial stressor affecting the Hillsborough bond rating, but it is nevertheless noteworthy.”

How many more such defeats can the reformers take before they figure out that their ideas are failures?

A key Republican leader, who is closely tied to Florida’s booming and profitable charter industry, slipped into the state budget a bill to pay a bonus to teachers with high SAT scores. His bill is known as “Best and Brightest,” assuming that those with the highest SAT scores are or will be the best teachers.

In this post, Florida teacher Melissa Halpern explains the absurdity of this plan. Veteran teachers will get the bonus if they can locate their SAT scores, even if they took the test 20 years ago, but only if they also received a “highly effective” rating based on test scores.

Halpern explains the absurdity:

“Let’s start with the very notion of rewarding a correlation. Incentives work when people have the power to respond to them with effort and action, when they can initiate a cause of success. What if studies found that teaching performance correlated with race, gender, or socioeconomic status (all of which are correlated with SAT scores, by the way)? Would we ever find it acceptable to offer a gender bonus? Of course not. Aside from being discriminatory, such an incentive would be illogical; it offers no room for effort, no goal to work toward.

“Sometimes it’s difficult to discern which correlations are actually causal, but common sense helps. While a teacher’s 20-year-old SAT score is probably not the cause of her success in the classroom, her training, credentials, and years of experience might be; incidentally, these are all proven correlations with teacher performance that Florida has downplayed under its current “merit pay” system, which replaced the old experience-based salary schedule in 2010….

“It seems, then, that the Best and Brightest incentive is not really an incentive at all, and that whatever it is, it certainly wasn’t devised to reward experienced teachers in the first place.

“So who does stand to benefit from this program? Primarily new teachers, especially those who might like to grab a bonus for a short teaching stint, and bail for a career that actually pays. Teach For America corp members, who are only held to a two-year teaching commitment, might just fit the bill.

“Interestingly, teachers coming out of TFA tend to populate the revolving employment doors of charter schools run by for-profit companies—much like the ones with whom Rep. Fresen happens to have close business ties.

“It shouldn’t come as a shock that a Florida legislator might vote for a financially motivated policy in the name of public education—at least it makes their ultimate goal of privatizing education a little more transparent.”

Audrey Amrein Beardsley patiently waded through a report produced by the George W. Bush Institute in Texas and discovered an argument that the language of the Texas State Constitution leads inexorably to high-stakes testing and value-added-modeling for teachers. The key word is “efficiency,” you see, and Texas can’t have an “efficient” education system without measuring everything. Some people would argue that a system cannot be “efficient” unless it has adequate resources to accomplish its purposes. But no, the folks at the GWBI think that what the writers of the Constitution had in mind was measurement.

Beardsley writes:

The Texas Constitution requires that the state “establish and make suitable provision for the support and maintenance of an efficient system of public free schools,” as the “general diffusion of knowledge [is]…essential to the preservation of the liberties and rights of the people.” Following this notion, The George W. Bush Institute’s Education Reform Initiative recently released its first set of reports as part of its The Productivity for Results Series: “A Legal Lever for Enhancing Productivity.” The report was authored by an affiliate of The New Teacher Project (TNTP) – the non-profit organization founded by the controversial former Chancellor of Washington DC’s public schools Michelle Rhee; an unknown and apparently unaffiliated “education researcher” named Krishanu Sengupta; and Sandy Kress, the “key architect of No Child Left Behind [under the presidential leadership of George W. Bush] who later became a lobbyist for Pearson, the testing company” (see, for example, here).

Authors of this paper review the economic and education research (although if you look through the references the strong majority of pieces come from economics research, which makes sense as this is an economically driven venture) to identify characteristics that typify enterprises that are efficient. More specifically, the authors use the principles of x-efficiency set out in the work of the highly respected Henry Levin that require efficient organizations, in this case as (perhaps inappropriately) applied to schools, to have: 1) Clear objective outcomes with measurable outcomes; 2) Incentives that are linked to success on the objective function; 3) Efficient access to useful information for decisions; 4) Adaptability to meet changing conditions; and 5) Use of the most productive technology consistent with cost constraints.

The authors also advance another series of premises, as related to this view of x-efficiency and its application to education/schools in Texas: (1) that “if Texas is committed to diffusing knowledge efficiently, as mandated by the state constitution, it should ensure that the system for putting effective teachers in classrooms and effective materials in the hands of teachers and students is characterized by the principles that undergird an efficient enterprise, such as those of x-efficiency;” (2) this system must include value-added measurement systems (i.e., VAMs), as deemed throughout this paper as not only constitutional but also rational and in support of x-efficiency; (3) given “rational policies for teacher training, certification, evaluation, compensation, and dismissal are key to an efficient education system;” (4) “the extent to which teacher education programs prepare their teachers to achieve this goal should [also] be [an] important factor;” (5) “teacher evaluation systems [should also] be properly linked to incentives…[because]…in x-efficient enterprises, incentives are linked to success in the objective function of the organization;” (6) which is contradictory with current, less x-efficient teacher compensation systems that link incentives to time on the job, or tenure, rather than to “the success of the organization’s function; (6), in the end, “x-efficient organizations have efficient access to useful information for decisions, and by not linking teacher evaluations to student achievement, [education] systems [such as the one in Texas will] fail to provide the necessary information to improve or dismiss teachers.”

The two districts highlighted as being most x-efficient in Texas, and in this report include, to no surprise: “Houston [which] adds a value-added system to reward teachers, with student performance data counting for half of a teacher’s overall rating. HISD compares students’ academic growth year to year, under a commonly used system called EVAAS.” We’ve discussed not only this system but also its use in Houston often on this blog (see, for example, here, here, and here). Teachers in Houston who consistently perform poorly can be fired for “insufficient student academic growth as reflected by value added scores…In 2009, before EVAAS became a factor in terminations, 36 of 12,000 teachers were fired for performance reasons, or .3%, a number so low the Superintendent [Terry Grier] himself called the dismissal system into question. From 2004-2009, the district
fired or did not renew 365 teachers, 140 for “performance reasons,” including poor discipline management, excessive absences, and a lack of student progress. In 2011, 221 teacher contracts were not renewed, multiple for “significant lack of student progress attributable to the educator,” as well as “insufficient student academic growth reflected by [SAS EVAAS] value-added scores….In the 2011-12 school year, 54% of the district’s low-performing teachers were dismissed.” That’s “progress,” right?!?

The other exemplary district, according to the report, is Dallas. It may or may not be relevant that the superintendents who led these two districts are now gone (Mike Miles of Dallas) or on their way out the door (Terry Grier of Houston).

The current Texas State Constitution was adopted in 1876. Do you think the Founding Fathers of the Lone Star State gave a tinker’s dam about VAM? As a native Texan, I say no. Do you think those rough-and-ready guys could have passed a high-stakes test? Sorry, but I think they had plenty of smarts, but not the kind that the George W. Bush Institute treasures. My thought: Why not ask Sandy Kress and the other GWBI fellows to take the 11th grade math test?

Fred LeBrun of the Albany Times-Union says the battle over Cuomo’s teacher evaluation plan is not over yet. What the Regents adopted last week was an extension of emergency regulations, and there is still a 30-day period of public comment. In fact, they can’t be made final until the November meeting. In the meanwhile, parents and educators can keep up the pressure and keep planning for the biggest opt out in American history next spring. Suppose they give a test and no one takes it?

LeBrun writes:


There was a simple if potent resolution on the agenda of the state Board of Regents meeting last week calling for final passage of the onerous new teacher evaluation system Gov. Cuomo rammed through the Legislature earlier in the year. 

A vote was taken of the 16 Regents, and it was widely reported in the media that they had done their duty and given, if reluctantly and after much debate, final approval as the law required them to do by a vote of 10 to 6.

In fact, that wasn’t the case at all. They did their duty alright, but it wasn’t to give final approval.

What the Regents voted to do instead was quite clever, a lovely little avoidance procedure.

They proposed three new amendments to the emergency regulations they had passed back in June drafted by the state Education Department as dictated by the law. These new amendments of themselves offer some small relief for teachers and schools — a brighter shade of lipstick — but their real value is elsewhere.

What the Regents actually approved was an extension of the emergency regulations triggered by the proposed new amendments, that restarts a 30-day public comment period. Emergency regs have a shelf life of 90 days.

Because the comment period would extend beyond the date for the next monthly Regents meeting, a vote isn’t possible on the new emergency regs to make them final until the November meeting.

So what, you ask? Well this: what the Regents managed to do is find just enough wiggle room in a tightly scripted law to kick the can down the road and basically approve nothing at all. At least, not yet.

Nothing stops them during the November meeting from introducing another amendment or two, and resetting the clock again.

Before you know it, the Legislature is back in session where the real relief must come, as the Regents, parents and educators know full well.

The only permanent fix for a bad law is to change it.

The 10-6 vote, incidentally, reflects just how frustrated the Regents are, and perhaps reflects as well as the internal split on just how radical a change is needed to the law. Six refused to endorse a bad law even by extending emergency regulations.

The majority subscribed to the view that lousy law though it is, there was a risk to federal aid and a vulnerability to litigation by failing to approve interim regs. So Cuomo’s signature teacher evaluation law remains in limbo and still fluid.

All this buys time for those who seek major revisions in the teacher evaluation law, and joined at the hip, the state’s reliance on high stakes standardized tests.

High among those eager for change are the Regents themselves, who are becoming strident about reasserting their legal role as the proper policy makers for education in the state. A role that has been usurped by the governor.

The Regents have certainly gotten an earful from educators in the field and get it that the system is beyond broken; it’s in shambles. It needs a complete overhaul and not just cosmetic change.

The Hudson Valley Alliance for Public Education issued a statement pledging to increase the number if opt outs next spring, in response to the Board of Regents’ decision to endorse a punitive, test-based teacher evaluation system. In the new system, test scores will count for 50% of a teacher’s evaluation, despite the American Statistical Association’s warning that a teacher accounts for 1-14% of variation in test scores.

Supporters of VAM think that the teachers’ union is pulling the strings and persuading parents to express such views. They think parents are dupes and fools. They are wrong.

Parents understand that when test scores matter so much, teachers will spend more time on test prep and less time on untested subjects. This is educationally unsound, and it hurts their children.

The parents support opt out to protect their children.

Here is the statement of the Hudson Valley Alliance:

“Parents across the Hudson Valley are dismayed by yesterday’s vote by the Board of Regents to adopt teacher evaluation regulations that will double down on high stakes testing and the harmful effects of test-prep driven education. While we applaud the courage of those Regents who voted no, Hudson Valley parents are disappointed with Regent Finn’s failure to protect public school children in our area.

“Under Chancellor Tisch’s leadership, the Regents majority have failed to challenge flawed legislation that harms public school children” said Carol Newman Sharkey, Orange County public school parent. “It is clear that Chancellor Tisch must be removed from her position when her term is up this year.”

“The Regents failed to rise up against the Governor’s tyrannical demands and instead have allowed bad education policies to displace whole child and sound pedagogical practices. They have stood idly by while Cuomo makes a mockery out of public schools putting cronies, political ambition, and charter schools above children” said Tory Lowe, co-founder of Kingston Action for Education and Ulster County public school parent.

“This vote ensures that the opt out movement will continue to grow. Parents seeking to protect their children will not back down or be appeased by false promises of better tests. At the end of the day, you cannot measure teaching and learning with a test score. Until there is real change, parents will continue to reject a corrupt system that destroys authentic teaching and learning” said, Bianca Tanis, New Paltz public school parent.

Since the adoption of the Common Core-aligned assessments, the Regents have voted to limit the number of students entitled to extra support in the form of Academic Intervention Services while simultaneously labeling teachers and students as failures.

“Once again, NYSED seems to talk out of both sides of its mouth. The message that SED continues to spread is that almost 70% of the students in grades 3-8 aren’t “proficient”, but yet schools don’t have to provide AIS (i.e. – “flexibility”) if their level of failure isn’t low enough. Either our children who are scoring ‘1s and 2s’ on the state tests are struggling and they deserve to get the academic support to help them meet the standards, or the standards themselves are inappropriate. They cannot have it both ways” said Tim Farley, Columbia County public school parent.

Stacey Kahn, Ulster County public school parent said “We suggest that Chancellor Tisch and Commissioner stop insulting the intelligence of the public. We will refuse the tests until the Regents majority starts making decisions that put children before politics and corporate sponsors.”

“What took place at the Regents meeting only underscores what parents and educators have known for quite some time – Chancellor Tisch must go. It is critical that parents, educators, and concerned community members turn their eyes towards our state legislators who have the power to amend destructive education law and remove Chancellor Tisch and some of her colleagues as they seek reappointment in the new year. New York students deserve responsible and informed leadership that will ensure an equitable, community-driven, and child-centered education. We will accept nothing less” said Anna Shah, Dutchess County public school parent.

“The 10 NYS Board of Regents members who lacked the courage to vote against Governor Cuomo’s public school privatization agenda have now emboldened parents towards increased activism. Through the use of social media, traditional media and speakers forums parents will continue to inform and educate. They will forge ahead against these harmful policies using their best weapons…involvement in the political process (our eyes will on our legislators) and of course the 500,000 test refusals for Spring 2016,” said Lauren Isaacs Schimko, public school parent, Rockland County educator & Administrator of “Pencils DOWN Rockland County” on Facebook.

HV Alliance for Public education, is a grassroots organization dedicated to advocating for the rights of parents and public school children against harmful testing practices in the Hudson Valley. To join the Alliance or to learn more, please visit us here:

https://www.facebook.com/groups/485430588295878/

Audrey Beardsley reports here on the trial of teacher evaluation in New Mexico.

She is testifying Monday so she keeps her views to herself, but she quotes others.

This is a quote from an article written by another observer at the trial:

“Joel Boyd, [a highly respected] superintendent of the Santa Fe Public Schools, testified that ‘glaring errors’ have marred the state’s ratings of teachers in his district.” He testified that “We should pause and get it right,” also testifying that “the state agency has not proven itself capable of identifying either effective or ineffective teachers.” Last year when Boyd challenged his district’s 1,000 or so teachers’ rankings, New Mexico’s Public Education Department (PED) “ultimately yielded and increased numerous individual teacher rankings…[which caused]..the district’s overall rating [to improve] by 17 percentage points.”

State Senator Bill Soules, who is also a recently retired teacher, testified that “his last evaluation included data from 18 students he did not teach. ‘Who are those 18 students who I am being evaluated on?’ he asked the judge.”

Jeff Bryant reports that the Seattle teachers’ strike is nearing an end. The teachers are very pleased with the gains they made on behalf of their students.

Was a pay increase part of the settlement? Yes. Seattle teachers live in one of the most expensive cities in the nation and have gone for years without a cost of living increase.

But what mattered most to teachers and what precipitated the strike were their concerns about conditions for their students.

Jesse Hagopian, a spokesman for teachers, said: “For the first time, our union was able to make social justice the center of the debate. We took a huge step forward.”

Also in the settlement terms, according to a local television news outlet, were student-centered demands including requests for guaranteed 30 minutes of recess for all elementary students, additional staff such as school counselors and therapists, a reduction in the over-testing of students, and the creation of new teams in 30 schools to ensure equitable learning opportunities and treatment of students regardless of race.

While recess may seem to be an unworthy demand to the reform-minded editors of the [Seattle] Times, classroom teachers understand it to be something critical to the health, development, and academic success of their students, as numerous research reports have found.

Having access to school counselors, therapists, and other specialists is critical to many students, but in inadequately funded school districts, such as Seattle, these are the positions that are routinely the first to be cut.

The demand for less testing is also, ultimately a student-centered demand. As Hagopian explains, this time to Erin Middlewood for The Progressive magazine, “’We oppose these tests because there are too many of them and they’re narrowing the curriculum and they’re making our kids feel bad, but they’re also part of maintaining institutional racism,’ says Hagopian, who serves as an adviser to Garfield’s Black Student Union.”

Hagopian sees the increasingly popular campaign to opt out of standardized tests as being connected to the Black Lives Matter movement because money that should be used to support and educate children and youth of color is being directed to punitive measures such as testing and incarceration.

Bianca Tanis is a public school parent and teacher of special education in the Hudson Valley of New York. In this post, she expresses her disgust and dismay that Regents Chancellor Merryl Tisch continues to promote the Cuomo plan to make test scores 50% of educator evaluation, while pretending to make meaningless amendments.

Tisch, who has been a Regent for 20 years, assumes that the Cuomo plan will weed out ineffective teachers in high-poverty schools, but fails to suggest how effective teachers will be drawn to these schools. In the past, she has proposed exempting the affluent white suburbs, where scores are highest, from the Cuomo program. She believes that poor children, minority children will benefit if their teachers and principal live in fear of low test scores, if their school eliminates the arts and physical education and social studies to concentrate in test prep.

Tisch dismisses the statement of the American Statistical Assiciation, which warns against using test scores to judge individual teachers, as if it was the opinion of a few individuals.

Over the three years of Common Cire testing, this approach to evaluation has proven to be unreliable and unstable. It is also deeply demoralizing and has contributed to the growing national teacher shortage. This is Arne Duncan’s legacy. It will also be Cuomo and Tisch’s legacy.

Today, the New York Board of Regents will vote to approve the harsh and punitive educator evaluation plan that Governor Andrew Cuomo rammed through the Legislature last spring as part of a budget bill.

In doing so, the Regents will abandon their Constitutional authority over education policy. The New York State Constitution grants full control over education to the Board of Regents. It grants none to the Governor. The Governor does not appoint a single member of the 17-member Board of Regents. The State Legislature selects them. The Governor does not appoint the state Commissioner of Education. That is the job of the Regents.

Today the Regents will approve Cuomo’s plan to tie 50% of educator evaluations to student test scores. The Governor’s plan was shaped in his office, without benefit of hearings, public discussion, public debate, or expert testimony.

The Regents have the power to reassert their Constitutional authority. But they are weak. They will fold to the will of a Governor whose determination to rule is greater than the Regents’ commitment to the State Constitution. Or to the children, or to the educators, or to the best interests of education in New York.

Parents have been ignored throughout this charade of the Governor flexing his political muscle. They will have a chance to be heard next spring, when the tests are administered. More students will opt out, more than the 220,000 who refused the tests in 2015. Will it be 300,000? 400,000? This is parents’ only means to be heard. They will be heard.