Archives for category: Teacher Evaluations

The Rochester Teachers Association is suing the state over its teacher evaluation system, alleging that it does not take into account the impact of poverty on classroom performance.

RTA says the evaluations are “junk science.”

“ALBANY, N.Y. March 10, 2014 – The Rochester Teachers Association today filed a lawsuit alleging that the Regents and State Education Department failed to adequately account for the effects of severe poverty and, as a result, unfairly penalized Rochester teachers on their APPR (Annual Professional Performance Review) evaluations.

“The suit, filed in state Supreme Court in Albany by New York State United Teachers on behalf of the RTA and more than 100 Rochester teachers, argues the State Education Department did not adequately account for student poverty in setting student growth scores on state tests in grades 4-8 math and English language arts. In addition, SED imposed rules for Student Learning Objectives and implemented evaluations in a way that made it more difficult for teachers of economically disadvantaged students to achieve a score of “effective” or better. As a result, the lawsuit alleges the Regents and SED violated teachers’ rights to fair evaluations and equal protection under the law.

“SED computes a growth score based on student performance on state standardized tests, which is then used in teacher evaluations.

“Nearly 90 percent of Rochester students live in poverty. The lawsuit says SED’s failure to appropriately compensate for student poverty when calculating student growth scores resulted in about one-third of Rochester’s teachers receiving overall ratings of “developing” or “ineffective” in 2012-13, even though 98 percent were rated “highly effective” or “effective” by their principals on the 60 points tied to their instructional classroom practices. Statewide, just 5 percent of teachers received “developing” or “ineffective” ratings.

“The State Education Department’s failure to properly factor in the devastating impact of Rochester’s poverty in setting growth scores and providing guidance for developing SLOs resulted in city teachers being unfairly rated in their evaluations,” Iannuzzi said. “Rochester teachers work with some of the most disadvantaged students in the state. They should not face stigmatizing labels based on discredited tests and the state’s inability to adequately account for the impact of extreme poverty when measuring growth.”

“RTA President Adam Urbanski said an analysis of Rochester teachers’ evaluations for 2012-13 demonstrated clearly the effects of poverty and student attendance, for example, were not properly factored in for teachers’ evaluations. As a result, “dedicated and effective teachers received unfair ratings based on student outcomes that were beyond their control. The way the State Education Department implemented the state testing portion of APPR adds up to nothing more than junk science.”

In one of what is likely to be a tidal wave of lawsuits, the Tennessee Education Association sued the state because a teacher was denied a bonus based on the state’s flawed evaluation system.

“The Tennessee Education Association (TEA) has filed a lawsuit on behalf of a Knox County teacher who was denied a bonus under that school system’s pay plan after Tennessee Value-Added Assessment System (TVAAS) data for 10 of her students was unknowingly attributed to her.

“TVAAS is Tennessee’s system of measuring student growth over time. It generates data based on student test scores on TCAP and end of course tests.

“In this specific case, the teacher, Lisa Trout, was assigned TVAAS data for 10 students after being told her evaluation would be based on system-wide TVAAS data because she taught at an alternative school.

“The TEA lawsuit cites two different memos which indicated that Ms. Trout could expect an evaluation (and bonus eligibility) to be based on system-wide data. At the conclusion of the school year, Ms. Trout was informed that her overall evaluation score, including observations and TVAAS data was a 4, making her eligible for a bonus under the Knox County pay plan.”

The system, the suit alleges, is arbitrary:

“The TEA goes on to contend that Ms. Trout and similarly situated teachers for whom there is little or no specific TVAAS data are held to an arbitrary standard in violation of the 14th Amendment of the U.S. Constitution.

“Specifically, the suit notes: ” … the majority of teachers in the Knox County Schools … have had their eligibility for additional compensation (under the APEX bonus system) determined on the basis of the test scores of students they do not teach and/or the test scores of their students in subjects unrelated to the subjects they teach.”

“The suit alleges that such a system violates the Equal Protection Clause of the 14th Amendment because some teachers are evaluated and receive bonuses based on the scores of their own students while other teachers are held accountable for students they do not teach and over which they have no influence or control.

“In short, the entire system is flawed and should be discarded.”

Audrey Amrein Beardsley invited Stanford Professor Emeritus Edward Haertel to explain why a video called “The Oak Tree Analogy” is flawed.

Apparently there are districts that use this video to try to explain teacher evaluations based on growth or decline of test scores.

Whether you are talking about oak trees or corn or teachers, VAM is Junk Science.

And if you want to know more, read Haertel’s excellent review of the research on VAM here.

Marc Tucker has written an excellent post on the failure of punitive accountability.

The working theory behind the Bush-Obama “reforms” is that teachers are lazy and need to be motivated by rewards and punishments and the threat of public shaming.

This is in fact a theory drawn from the early twentieth century writings of Frederick Winslow Taylor, who studied the efficiency of factory workers.

Tucker writes:

Let’s start by examining the premises behind the prevailing system.  The push for test-based accountability systems to evaluate teachers have their origin in the work of a professor of agricultural statistics in Tennessee who discovered that differences in teacher quality as measured by analyses of student test scores over time accounted for very large differences in student performance.  Many observers concluded from this that policy should concentrate on using these statistical techniques to identify poor teachers and remove them from the teaching force.  At the same time, other observers, believing that the parents would choose effective schools for their children over ineffective schools if only they had information as to which schools are effective, pushed to use student test data to identify and publicly label schools based on the available test score data.  And, finally, policymakers passed the NCLB legislation, requiring the identification of schools as chronically underperforming and remedies involving the replacement of school leaders and staff, and, in extreme cases, closing schools down.

All of these accountability systems are essentially punitive in design and intent.  They threaten poor performing schools with public shaming, takeover and closure and poor performing individuals with public shaming and the loss of their jobs and livelihood.  The introduction of these policies was not accompanied by policies designed to improve the supply of highly qualified new teachers by making teaching a more attractive option for our most successful high school students—a key component of policy in the top-performing countries.  There is a lot of federal money available for training and professional development for teachers but no systematic federal strategy that I can discern for turning that money into systems of the kind top-performing countries use to support long-term, steady improvements in teachers’ professional practice.  I conclude that policymakers have placed their bet on teacher evaluation, not to identify the needs of teachers for development, but to identify teachers who need to be dismissed from the service.  And, further, that the way to motivate school staff to work harder and more efficiently is to threaten them with public shame and the loss of their job.

Race to the Top incorporates the ideas of economist Eric Hanushek of the Hoover Institution at Stanford University, who has argued in various writings that the way to improve results (test scores) is to “deselect” the bottom 5-10% of teachers based on the test scores of their students.

As Tucker shows, modern cognitive psychology recognizes that people are motivated to do their best not by humiliation and punishment, but by a sense of purpose, professionalism, and autonomy.  Unfortunately, neither our Congress nor the policymakers in the Obama administration are familiar with modern cognitive psychology, with the work of scholars and writers like Edward Deci, Dan Ariely, or Daniel Pink, nor with the organizational theory of Edwards Deming, who acknowledged that people want to do their best and must be allowed and encouraged to do it, not threatened with dire punishments.

Washington State legislators refused to accept Arne Duncan’s demand that teachers be evaluated by a flawed and erroneous method, and the state seems certain to lose its NCLB waiver.

“That would mean that, starting in 2014-2015, school districts throughout the state would lose control over roughly $38 million in Title I funds designed to help low-income students.

“Loss of the waiver would also mean districts throughout the state would have to redirect an additional $19 million in Title I money toward professional development and teacher training, according to OSPI.

“It’s going to result in the loss of programs for our students who are the most in need,” said Sen. Bruce Dammeier, a Puyallup Republican who supported changing the teacher-evaluation system to keep the state’s waiver.

“The U.S. Department of Education told Washington leaders in August that the state’s waiver would be at risk unless lawmakers moved to mandate the use of statewide tests in teacher evaluations.

“Schools today may use solely local tests to measure student growth when evaluating teachers and principals – a standard the federal government has deemed unacceptable.

“But several lawmakers said they didn’t want to interfere with the state’s new teacher and principal evaluation system — which is being used for the first time this year — just to meet federal demands.

“Of course I am concerned from the perspective of a local district,” said state Rep. Sharon Tomiko Santos, a Seattle Democrat who chairs the House Education Committee.

“Yet I am concerned on the other hand that we (would) establish bad policy for the entire state of Washington.”

Read more here: http://www.theolympian.com/2014/03/13/3032949/teacher-evaluation-change-to-keep.html#storylink=cpy

If you want to learn about the growing movement to opt students out of mandated state and federal testing, go to this meeting in Denver.

Parents, scholars, and educators will convene in one of the nation’s most test-driven, test-obsessed cities and states, where the fate of teachers, principals, and schools depends on standardized test scores, a law foolishly enacted without any evidence at all in 2010. Test scores in Colorado counts for 50% of educator evaluations due to SB191, one of the worst laws in the nation (though by no means unique). In typical “deform” style, the law promises that it will produce “great teachers and great schools” by firing educators whose students don’t get ever higher test scores.

Where is the evidence? Read this summary of the research by Professor Edward Haertel, emeritus, from Stanford University, in an address to the Educational Testing Service. Please note that he concludes that “value-added measures” (the rise or fall of test scores) should not count for a set percentage of any teacher’s evaluation because they are too inaccurate and unstable.

He is measured and polite.

Another way to describe test-based accountability is “junk science.”

Jersey Jazzman warns that New Jersey’s new teacher evaluation plan is expensive, wasteful, inaccurate, and has no basis in research whatever. Other than that….it stinks.

In short, he calls it Operation Hindenburg, and if you don’t know about the Hindenburg, I suggest you google it. (Watch out, as the data miners will start offering you bargain deals on used blimps.)

New Jersey’s new teacher evaluation system — code name: Operation Hindenburg — is not cheap. Superintendents around the state have been warning us about this for a while: the costs of this inflexible system are going to impose a significant financial burden on districts, making this a wasteful, unfunded mandate.

JJ writes:

But if you don’t believe me, and you don’t believe these superintendents, why not listen to a couple of scholars who have produced definitive proof of the exorbitantly high costs of AchieveNJ:

In 2012, the New Jersey State Legislature passed and the Governor signed into law the Teacher Effectiveness and Accountability for the Children of New Jersey (TEACHNJ) Act. This brief examines the following questions about the impact of this law:
• What is the effect of intensifying the teacher evaluation process on the time necessary for administrators to conduct observations in accordance with the new teacher evaluation regulations in New Jersey?
• In what ways do the demands of the new teacher evaluation system impact various types of school districts, and does this impact ameliorate or magnify existing inequities?
We find the following:
On average, the minimum amount of time dedicated solely to classroom observations will increase by over 35%. It is likely that the other time requirements for compliance with the new evaluation system, such as pre- and post-conferences, observation write- ups, and scheduling will increase correspondingly.
The new evaluation system is highly sensitive to existing faculty-to-administrator ratios, and a tremendous range of these ratios exists in New Jersey school districts across all operating types, sizes, and District Factor Groups. There is clear evidence that a greater burden is placed on districts with high faculty-to-administrator ratios by the TEACHNJ observation regulations. There is a weak correlation between per-pupil expenditures and faculty-to-administrator ratios.
The change in administrative workload will increase more in districts with a greater proportion of tenured teachers because of the additional time required for observations of this group under the new law.
The increased burden the TEACHNJ Act imposes on administrators’ time in some districts may compromise their ability to thoroughly and properly evaluate their teachers. In districts where there are not adequate resources to ensure administrators have enough time to conduct evaluations, there is an increased likelihood of substantive due process concerns in personnel decisions such as the denial or termination of tenure. [emphasis mine]

– See more at: http://jerseyjazzman.blogspot.com/2014/03/nj-pays-high-cost-for-bad-teacher.html#sthash.ytDauLdH.dpuf

 

John Thompson, an experienced teacher and historian, is convinced that Common Core will die unless there is a moratorium on high-stakes testing.

The early returns from states that have tested the “rigorous” Common Core show high failure rates, especially among poor and minority youth.

Thompson writes:

Real world, there are only so many hours in a day, and time is running out on the opportunity to supply materials, training and, above all, the supports that low-income students will need to meet Common Core standards. Soon, we will face the logistical, political, and legal consequences of denying high school diplomas to students because they failed Common Core and “Common Core-type” graduation examinations, without having an opportunity to be taught Common Core or “Common Core-type” material.

How will we respond to failure rates of 50-60-70% of more among the neediest students?

But that’s not all.

Using the Common Core test results to evaluate teachers is causing massive demoralization among teachers.

The rush to implement Common Core–without proper preparation of students or teachers, with appropriate materials, without a massive investment in instruction–has caused a perfect storm of hostility, pushback, and resentment among both parents and educators.

Students are being hurt by this reckless experiment.

I won’t name names, but I will say that I recently heard a major national figure in education candidly state that “the Common Core is dead.”

Maybe yes, maybe no.

Maybe, like a chicken whose neck was wrung off, it is still running around in circles, unaware that it is dead.

To date, the course corrections have been phony.

The standards must be decoupled from the tests.

Teachers should not be evaluated by scores on tests that do not reflect their skill as teachers, but do reflect who was in their classroom.

The standards must be thoroughly reviewed by expert practitioners in every state, including early childhood educators and specialists in teaching children with disabilities.

Otherwise, the Common Core indeed will be a footnote in history.

Peter Greene has a ball with the U.S. Department of Education’s latest fantasy plan: Every child has a civil right to a “highly qualified teacher.”

Who is a “highly qualified teacher”? Any teacher who can raise test scores or anyone who belongs to Teach for America and leaves before the third year of test scores are reported.

It is all super but here is the laugh-out-loud deconstruction of Duncan-style logic:

“Discussion of teaching as a civil right often circles back around to the assertion that poor students have more lousy teachers than non-poor students. This assertion rests primarily on a model of circular reasoning. Follow along.

“A) Teachers are judged low-performing because their students score poorly on tests.

“B) Students low test scores are explained by the fact that they have low-performing teachers.

“Or, framed another way, this argument defines a low-quality teacher as any teacher whose students don’t do well on standardized tests. The assumption is that teachers are the only single solitary explanation for student standardized test scores. Nothing else affects those scores. Only teacher behavior explains the low scores. That’s it.

“Ergo, the best runners are runners who run down hills. Runners who are running uphill are slow runners, and must be replaced by those good runners– the ones we find running downhill. Or, the wettest dogs are the ones who are out in the rain, while the driest ones are the ones indoors. So if we take the indoor dogs outside, we will have drier dogs in the yard. While it rains.

“As long as we define low-quality teachers as those who teach low-achieving students (who we know will mostly be the children of poor folk), low-achieving students will always be taught by low-quality teachers. It’s the perfect education crisis, one that can never, ever be solved.”

David Welch is a Silicon Valley entrepreneur who is spending millions of dollars in legal fees to try to strip teachers of any due process rights or job security.

Who is he and who are his allies?

This investigative report provides some answers, though no one can truly explain the animus towards teachers that blames them for poverty, inequitable funding, large classes, poor leadership, racism, incompetent administrators, and myriad factors beyond their control. Even the most expert, dedicated teachers will lose if Welch wins.