Archives for category: Teacher Evaluations

The Tennessee Education Association filed a second lawsuit against the use if value-added assessment (called TVAAS in Tennessee), this time including extremist Governor Haslam and ex-TFA state commissioner Huffman in their suit.

The teachers rightly say that the evaluations are unfair, a point on which most reputable researchers are in their corner.

“TEA’s lawsuit was filed on behalf of Knox County teacher Mark Taylor, an eighth grade science teacher at Farragut Middle School. Taylor was unfairly denied an APEX bonus after his TVAAS estimate was based on the standardized test scores of only 22 of his 142 students.

“Mr. Taylor teaches four upper-level physical science courses and one regular eighth grade science class,” said Richard Colbert, TEA general counsel. “The students in the upper-level course take a locally developed end-of-course test in place of the state’s TCAP assessment. As a result, those high-performing students were not included in Mr. Taylor’s TVAAS estimate.”

“While Mr. Taylor’s observation score was ‘exceeding expectations,’ his low TVAAS estimate based on only 16 percent of his students dropped his final evaluation score below the threshold to receive the APEX bonus,” Colbert said.

“Unfortunately, Mr. Taylor’s situation is not an uncommon one. Many teachers across the state – particularly at the high school level – are being unfairly evaluated on an arbitrary percentage of their students.”

Gosh, Arne Duncan only recently hailed Tennessee as one of the stars of Race to the Top. Not so much.

The Rochester Teachers Association is suing the state for its flawed evaluation system, which unfairly judges teachers.

Erica Bryant explains why in this article.

“Years ago, I visited the Kennedy Space Center and bought a coffee mug from the gift shop. It is decorated with some NASA equations, including one used to calculate the speed an object needs to escape Earth’s gravity. This formula fits on one line.

“By contrast, the document that describes how to measure student growth for the purpose of evaluating New York’s teachers and principals is 112 pages.”

Even in 112 pages, the teacher evaluation system is unfair and senseless and penalizes teachers who work with the poorest students.

What a mess in Connecticut!

Robert A. Frahm writes in the Connecticut Mirror about how teachers and principals are struggling with the state’s test-based evaluation system. Teachers waste time setting paperwork goals that are low enough to make statistical “gains.” If they don’t, they may be rated ineffective.

Every principal spends hours observing teachers—one hour each time—taking copious notes, then spending hours writing up the observations.

Connecticut, one of the two or three top scoring states in the nation on NAEP (the others are Massachusetts and New Jersey), is drowning its schools and educators in mandates and paperwork.

Why? Race to the Top says it is absolutely necessary. Connecticut didn’t win Race to the Top funding, but the state is doing what Arne Duncan believes in. Stefan Pryor, the state commissioner, loves evaluating by test scores, but that’s no surprise because he was never a teacher; he is a law school graduate and co-founder of a “no excuses” charter school chain in Connecticut that is devoted to test scores at all times. The charter chain he founded is known for its high suspension rate, its high scores, and its limited enrollment of English learners.

Researchers have shown again and again that test-based accountability is flawed, inaccurate, unstable. It doesn’t work in theory, and it has not worked in five years of experience.

The article quotes the conservative advocacy group, National Council for Teacher Quality, which applauds this discredited methodology. NCTQ is neither an accrediting body nor a research organization.

Our nation’s leading scholars and scholarly organizations have criticized test-based accountability.

In 2010, some of the nation’s most highly accomplished scholars in testing, including Robert Linn, Eva Baker, Richard Shavelson, and Lorrie Shepard, spoke out against the misuse of test scores to judge teacher quality.

The American Educational Research Association and the National Academy of Education issued a joint statement warning about VAM.

Many noted scholars, like Edward Haertel, Linda Darling Hammond, and David Berliner, have warned about the lack of “science” behind VAM.

The highly esteemed National Research Council issued a report warning that test-based accountability had not succeeded and was unlikely to succeed. Marc Tucker recently described the failure of test-based accountability.

But the carefully researched views of our nation’s leading scholars were tossed aside by Arne Duncan, the Gates Foundation, and the phalanx of rightwing groups that support their agenda of demoralizing teachers, clearing out those who are veterans, and turning teaching into a short-time temp job.

The article cites New Haven as an example:

“Four years ago, New Haven schools won national attention when the district and the teachers’ union developed an evaluation system that uses test results as a factor in rating teachers. Since then, dozens of teachers have resigned or been dismissed as a result of the evaluations. Last year, 20 teachers, about 1 percent of the workforce, left the district after receiving poor evaluations.”

Four years later, can anyone say that New Haven is now the best district in Connecticut? Has the achievement gap closed? Time for another investigative report.

The Rochester Teachers Association is suing the state over its teacher evaluation system, alleging that it does not take into account the impact of poverty on classroom performance.

RTA says the evaluations are “junk science.”

“ALBANY, N.Y. March 10, 2014 – The Rochester Teachers Association today filed a lawsuit alleging that the Regents and State Education Department failed to adequately account for the effects of severe poverty and, as a result, unfairly penalized Rochester teachers on their APPR (Annual Professional Performance Review) evaluations.

“The suit, filed in state Supreme Court in Albany by New York State United Teachers on behalf of the RTA and more than 100 Rochester teachers, argues the State Education Department did not adequately account for student poverty in setting student growth scores on state tests in grades 4-8 math and English language arts. In addition, SED imposed rules for Student Learning Objectives and implemented evaluations in a way that made it more difficult for teachers of economically disadvantaged students to achieve a score of “effective” or better. As a result, the lawsuit alleges the Regents and SED violated teachers’ rights to fair evaluations and equal protection under the law.

“SED computes a growth score based on student performance on state standardized tests, which is then used in teacher evaluations.

“Nearly 90 percent of Rochester students live in poverty. The lawsuit says SED’s failure to appropriately compensate for student poverty when calculating student growth scores resulted in about one-third of Rochester’s teachers receiving overall ratings of “developing” or “ineffective” in 2012-13, even though 98 percent were rated “highly effective” or “effective” by their principals on the 60 points tied to their instructional classroom practices. Statewide, just 5 percent of teachers received “developing” or “ineffective” ratings.

“The State Education Department’s failure to properly factor in the devastating impact of Rochester’s poverty in setting growth scores and providing guidance for developing SLOs resulted in city teachers being unfairly rated in their evaluations,” Iannuzzi said. “Rochester teachers work with some of the most disadvantaged students in the state. They should not face stigmatizing labels based on discredited tests and the state’s inability to adequately account for the impact of extreme poverty when measuring growth.”

“RTA President Adam Urbanski said an analysis of Rochester teachers’ evaluations for 2012-13 demonstrated clearly the effects of poverty and student attendance, for example, were not properly factored in for teachers’ evaluations. As a result, “dedicated and effective teachers received unfair ratings based on student outcomes that were beyond their control. The way the State Education Department implemented the state testing portion of APPR adds up to nothing more than junk science.”

In one of what is likely to be a tidal wave of lawsuits, the Tennessee Education Association sued the state because a teacher was denied a bonus based on the state’s flawed evaluation system.

“The Tennessee Education Association (TEA) has filed a lawsuit on behalf of a Knox County teacher who was denied a bonus under that school system’s pay plan after Tennessee Value-Added Assessment System (TVAAS) data for 10 of her students was unknowingly attributed to her.

“TVAAS is Tennessee’s system of measuring student growth over time. It generates data based on student test scores on TCAP and end of course tests.

“In this specific case, the teacher, Lisa Trout, was assigned TVAAS data for 10 students after being told her evaluation would be based on system-wide TVAAS data because she taught at an alternative school.

“The TEA lawsuit cites two different memos which indicated that Ms. Trout could expect an evaluation (and bonus eligibility) to be based on system-wide data. At the conclusion of the school year, Ms. Trout was informed that her overall evaluation score, including observations and TVAAS data was a 4, making her eligible for a bonus under the Knox County pay plan.”

The system, the suit alleges, is arbitrary:

“The TEA goes on to contend that Ms. Trout and similarly situated teachers for whom there is little or no specific TVAAS data are held to an arbitrary standard in violation of the 14th Amendment of the U.S. Constitution.

“Specifically, the suit notes: ” … the majority of teachers in the Knox County Schools … have had their eligibility for additional compensation (under the APEX bonus system) determined on the basis of the test scores of students they do not teach and/or the test scores of their students in subjects unrelated to the subjects they teach.”

“The suit alleges that such a system violates the Equal Protection Clause of the 14th Amendment because some teachers are evaluated and receive bonuses based on the scores of their own students while other teachers are held accountable for students they do not teach and over which they have no influence or control.

“In short, the entire system is flawed and should be discarded.”

Audrey Amrein Beardsley invited Stanford Professor Emeritus Edward Haertel to explain why a video called “The Oak Tree Analogy” is flawed.

Apparently there are districts that use this video to try to explain teacher evaluations based on growth or decline of test scores.

Whether you are talking about oak trees or corn or teachers, VAM is Junk Science.

And if you want to know more, read Haertel’s excellent review of the research on VAM here.

Marc Tucker has written an excellent post on the failure of punitive accountability.

The working theory behind the Bush-Obama “reforms” is that teachers are lazy and need to be motivated by rewards and punishments and the threat of public shaming.

This is in fact a theory drawn from the early twentieth century writings of Frederick Winslow Taylor, who studied the efficiency of factory workers.

Tucker writes:

Let’s start by examining the premises behind the prevailing system.  The push for test-based accountability systems to evaluate teachers have their origin in the work of a professor of agricultural statistics in Tennessee who discovered that differences in teacher quality as measured by analyses of student test scores over time accounted for very large differences in student performance.  Many observers concluded from this that policy should concentrate on using these statistical techniques to identify poor teachers and remove them from the teaching force.  At the same time, other observers, believing that the parents would choose effective schools for their children over ineffective schools if only they had information as to which schools are effective, pushed to use student test data to identify and publicly label schools based on the available test score data.  And, finally, policymakers passed the NCLB legislation, requiring the identification of schools as chronically underperforming and remedies involving the replacement of school leaders and staff, and, in extreme cases, closing schools down.

All of these accountability systems are essentially punitive in design and intent.  They threaten poor performing schools with public shaming, takeover and closure and poor performing individuals with public shaming and the loss of their jobs and livelihood.  The introduction of these policies was not accompanied by policies designed to improve the supply of highly qualified new teachers by making teaching a more attractive option for our most successful high school students—a key component of policy in the top-performing countries.  There is a lot of federal money available for training and professional development for teachers but no systematic federal strategy that I can discern for turning that money into systems of the kind top-performing countries use to support long-term, steady improvements in teachers’ professional practice.  I conclude that policymakers have placed their bet on teacher evaluation, not to identify the needs of teachers for development, but to identify teachers who need to be dismissed from the service.  And, further, that the way to motivate school staff to work harder and more efficiently is to threaten them with public shame and the loss of their job.

Race to the Top incorporates the ideas of economist Eric Hanushek of the Hoover Institution at Stanford University, who has argued in various writings that the way to improve results (test scores) is to “deselect” the bottom 5-10% of teachers based on the test scores of their students.

As Tucker shows, modern cognitive psychology recognizes that people are motivated to do their best not by humiliation and punishment, but by a sense of purpose, professionalism, and autonomy.  Unfortunately, neither our Congress nor the policymakers in the Obama administration are familiar with modern cognitive psychology, with the work of scholars and writers like Edward Deci, Dan Ariely, or Daniel Pink, nor with the organizational theory of Edwards Deming, who acknowledged that people want to do their best and must be allowed and encouraged to do it, not threatened with dire punishments.

Washington State legislators refused to accept Arne Duncan’s demand that teachers be evaluated by a flawed and erroneous method, and the state seems certain to lose its NCLB waiver.

“That would mean that, starting in 2014-2015, school districts throughout the state would lose control over roughly $38 million in Title I funds designed to help low-income students.

“Loss of the waiver would also mean districts throughout the state would have to redirect an additional $19 million in Title I money toward professional development and teacher training, according to OSPI.

“It’s going to result in the loss of programs for our students who are the most in need,” said Sen. Bruce Dammeier, a Puyallup Republican who supported changing the teacher-evaluation system to keep the state’s waiver.

“The U.S. Department of Education told Washington leaders in August that the state’s waiver would be at risk unless lawmakers moved to mandate the use of statewide tests in teacher evaluations.

“Schools today may use solely local tests to measure student growth when evaluating teachers and principals – a standard the federal government has deemed unacceptable.

“But several lawmakers said they didn’t want to interfere with the state’s new teacher and principal evaluation system — which is being used for the first time this year — just to meet federal demands.

“Of course I am concerned from the perspective of a local district,” said state Rep. Sharon Tomiko Santos, a Seattle Democrat who chairs the House Education Committee.

“Yet I am concerned on the other hand that we (would) establish bad policy for the entire state of Washington.”

Read more here: http://www.theolympian.com/2014/03/13/3032949/teacher-evaluation-change-to-keep.html#storylink=cpy

If you want to learn about the growing movement to opt students out of mandated state and federal testing, go to this meeting in Denver.

Parents, scholars, and educators will convene in one of the nation’s most test-driven, test-obsessed cities and states, where the fate of teachers, principals, and schools depends on standardized test scores, a law foolishly enacted without any evidence at all in 2010. Test scores in Colorado counts for 50% of educator evaluations due to SB191, one of the worst laws in the nation (though by no means unique). In typical “deform” style, the law promises that it will produce “great teachers and great schools” by firing educators whose students don’t get ever higher test scores.

Where is the evidence? Read this summary of the research by Professor Edward Haertel, emeritus, from Stanford University, in an address to the Educational Testing Service. Please note that he concludes that “value-added measures” (the rise or fall of test scores) should not count for a set percentage of any teacher’s evaluation because they are too inaccurate and unstable.

He is measured and polite.

Another way to describe test-based accountability is “junk science.”

Jersey Jazzman warns that New Jersey’s new teacher evaluation plan is expensive, wasteful, inaccurate, and has no basis in research whatever. Other than that….it stinks.

In short, he calls it Operation Hindenburg, and if you don’t know about the Hindenburg, I suggest you google it. (Watch out, as the data miners will start offering you bargain deals on used blimps.)

New Jersey’s new teacher evaluation system — code name: Operation Hindenburg — is not cheap. Superintendents around the state have been warning us about this for a while: the costs of this inflexible system are going to impose a significant financial burden on districts, making this a wasteful, unfunded mandate.

JJ writes:

But if you don’t believe me, and you don’t believe these superintendents, why not listen to a couple of scholars who have produced definitive proof of the exorbitantly high costs of AchieveNJ:

In 2012, the New Jersey State Legislature passed and the Governor signed into law the Teacher Effectiveness and Accountability for the Children of New Jersey (TEACHNJ) Act. This brief examines the following questions about the impact of this law:
• What is the effect of intensifying the teacher evaluation process on the time necessary for administrators to conduct observations in accordance with the new teacher evaluation regulations in New Jersey?
• In what ways do the demands of the new teacher evaluation system impact various types of school districts, and does this impact ameliorate or magnify existing inequities?
We find the following:
On average, the minimum amount of time dedicated solely to classroom observations will increase by over 35%. It is likely that the other time requirements for compliance with the new evaluation system, such as pre- and post-conferences, observation write- ups, and scheduling will increase correspondingly.
The new evaluation system is highly sensitive to existing faculty-to-administrator ratios, and a tremendous range of these ratios exists in New Jersey school districts across all operating types, sizes, and District Factor Groups. There is clear evidence that a greater burden is placed on districts with high faculty-to-administrator ratios by the TEACHNJ observation regulations. There is a weak correlation between per-pupil expenditures and faculty-to-administrator ratios.
The change in administrative workload will increase more in districts with a greater proportion of tenured teachers because of the additional time required for observations of this group under the new law.
The increased burden the TEACHNJ Act imposes on administrators’ time in some districts may compromise their ability to thoroughly and properly evaluate their teachers. In districts where there are not adequate resources to ensure administrators have enough time to conduct evaluations, there is an increased likelihood of substantive due process concerns in personnel decisions such as the denial or termination of tenure. [emphasis mine]

– See more at: http://jerseyjazzman.blogspot.com/2014/03/nj-pays-high-cost-for-bad-teacher.html#sthash.ytDauLdH.dpuf