Archives for category: Teacher Evaluations

John Thompson, teacher and historian, explains here why teachers are beating up reformers. Shocking but true. Charters don’t outperform public schools unless they exclude low performers. Vouchers are sending kids to church schools that do not perform as well as public schools. Teacher evaluation by test scores is a disaster. The testing culture has demoralized teachers. The reformers have no idea how to “fix” schools.

He writes:

“During the high tide of corporate reform in 2010, their scorched earth public relations campaign against teachers and unions was doubly effective because they all sang from the same hymnal. Since then, however, reformers’ failures to improve schools have been accompanied by political defeat after defeat. Now they are on the same page with a kinder, gentler message.

“Now, the most public message is that a toxic testing culture has mysteriously appeared in schools. As the Center for American Progress, in Testing Overload in America’s Schools, recently admitted “a culture has arisen in some states and districts that places a premium on testing over learning.” So, the reformers who made that culture of test prep inevitable now want to listen to teachers, and create a humane testing culture.

“As Alexander Russo recently reported, in Why Think Tankers Hate the Vergara Strategy, some indicate that the Vergara campaign against teachers’ legal rights is a dubious approach. I’m also struck by the number of reformers, who complain about unions’ financial and political power, and who seem to by crying that We Reformers Are Being Beaten Up by Teachers.

“Yes! Reformers Are Being Beaten Up by Teachers!

“I communicate with a lot of individual reformers who agree that test-driven accountability has failed, but they can’t yet visualize an accountability system that could satisfy their reform coalition and teachers. I repeatedly hear the pained protest that, Testing Isn’t Going Away.

“So, what alternative do we have?

“Talk about Low Expectations! Are they saying that a democracy can’t prosper without test and punish imposed from on high? Do they believe that families and students are just as feckless as teachers, and none of us will teach and learn without reward and punish regimes that toughen us up for economic combat in the global marketplace?”

This is an important article in the Shanker Blog by two scholars at the University of Pittsburgh. They are Carrie R. Leana, George H. Love Professor of Organizations and Management, Professor of Business Administration, Medicine, and Public and International Affairs, and Director of the Center for Health and Care Work, at the University of Pittsburgh, and Frits K. Pil, Professor of Business Administration at the Katz Graduate School of Business and research scientist at the Learning Research and Development Center, at the University of Pittsburgh.

Leanna and Pil write:

“Most current models of school reform focus on teacher accountability for student performance measured via standardized tests, “improved” curricula, and what economists label “human capital” – e.g., factors such as teacher experience, subject knowledge and pedagogical skills. But our research over many years in several large school districts suggests that if students are to show real and sustained learning, schools must also foster what sociologists label “social capital” – the value embedded in relations among teachers, and between teachers and school administrators. Social capital is the glue that holds a school together. It complements teacher skill, it enhances teachers’ individual classroom efforts, and it enables collective commitment to bring about school-wide change.

“We are professors at a leading Business School who have conducted research in a broad array of settings, ranging from steel mills and auto plants to insurance offices, banks, and even nursing homes. We examine how formal and informal work practices enhance organizational learning and performance. What we have found over and over again is that, regardless of context, organizational success rarely stems from the latest technology or a few exemplary individuals.

“Rather, it is derived from: systematic practices aimed at enhancing trust among employees; information sharing and openness about both problems and opportunities for improvement; and a collective sense of purpose. Over a decade ago, we were asked by a colleague in the School of Education about how our research might be applied to improving public schools. Since then, we’ve spent a good deal of time trying to answer that question through several large-scale research studies.

“One thing we noticed immediately in our work with schools was the intense focus on the individual educator. This is prevalent not just among school reformers but in the larger culture as well, as evidenced in popular movies ranging from “To Sir with Love” in the 1960s to “Waiting for Superman” nearly fifty years later. And every self-respecting school district has a version of the “Teacher of the Year” award, which has now risen to state and even national levels of competition. In recent years, however, we have also witnessed a darker side to accountability, as districts around the country publicly shame teachers who do not fare well on the accountability scorecards.

“Accountability models find their roots in the discipline of economics rather than education, and are exemplified in the value-added metrics used to evaluate teacher performance. These metrics assess annual increments in each student’s learning derived from standardized tests in subject areas like math and reading. These are then aggregated to arrive at a score for each teacher – her “value added” to students’ learning. Anyone with access to the internet can find teacher rankings based on these scores in many districts across the country.

“Needless to say, many teachers, and the unions that represent them, argue that value-added measures of student performance fail to capture the complex factors that go into teaching and learning. At the same time, reliance on such metrics may undermine the collaboration, trust, and information exchange that make up social capital and, in this regard, do far more harm than good.”

They go on to explain why current “reforms” actually are counter to the coloration and trust that are most needed and most successful.

They add:

“What do these findings tell us about effective education policy? Foremost, they suggest that the current focus on teacher human capital – and the paper credentials and accountability metrics often associated with it – will not yield the qualified teaching staff so desperately needed in urban districts. Instead, policy makers must also invest in efforts that enhance collaboration and information sharing among teachers. In many schools, such social capital is assumed to be an unaffordable luxury or, worse, a sign of teacher weakness or inefficiency. Yet our research suggests that when teachers talk to and substantively engage their peers regarding the complex task of instructing students — what works and what doesn’t — student achievement rises significantly.

“Building social capital in schools is not easy or costless. It requires time and, typically, the infusion of additional teaching staff into the school. It requires a reorientation away from a “Teacher of the Year” model and toward a system that rewards mentoring and collaboration among teachers. It also asks school principals and district administrators to spend less time monitoring teachers and more time encouraging a climate of trust and information sharing among them. The benefits of social capital are unequivocal, and unlike many other policy efforts, initiatives that foster it offer far more promise in terms of measurable gains for students.”

They conclude by asking you to give them feedback. Their email addresses are on the Shanker Blog. Contact them and let them know what you think. Here is their survey. Take a moment and respond.

Steven Singer, teacher, describes the accumulating series of insults and indignities heaped upon teachers by the federal and state governments and by politicians who wouldn’t last five minutes in a classroom.

He writes, in indignation and fury:

“You can’t do that.

“All the fear, frustration and mounting rage of public school teachers amounts to that short declarative sentence.

“You can’t take away our autonomy in the classroom.

“You can’t take away our input into academic decisions.

“You can’t take away our job protections and collective bargaining rights.

“You can’t do that.

“But the state and federal government has repeatedly replied in the affirmative – oh, yes, we can.

“For at least two decades, federal and state education policy has been a sometimes slow and incremental chipping away at teachers’ power and authority – or at others a blitzkrieg wiping away decades of long-standing best practices.

“The latest and greatest of these has been in Philadelphia, Pennsylvania.

“Earlier this week, the state-led School Reform Commission simply refused to continue bargaining with teachers over a new labor agreement. Instead, members unilaterally cancelled Philadelphia teachers contract and dictated their own terms – take them or get out.

“The move was made at a meeting called with minimal notice to hide the action from the public. Moreover, the legality of the decision is deeply in doubt. The courts will have to decide if the SRC even has the legal authority to bypass negotiations and impose terms.

“One doesn’t have to live or work in the City of Brotherly Love to feel the sting of the state SRC. For many educators across the nation this may be the last straw.

“For a long time now, we have watched in stunned silence as all the problems of society are heaped at our feet…..”

“Teachers dedicate their lives to fight the ignorance and poverty of the next generation and are found guilty of the very problem they came to help alleviate. It’s like blaming a doctor when a patient gets sick, blaming a lawyer because his client committed a crime or blaming a firefighter because an arsonist threw a match.

“The Philadelphia decision makes clear the paranoid conspiracy theories about school privatization are neither paranoid nor mere theories. We see them enacted in our local newspapers and media in the full light of day.

Step 1: Poor schools lose state and federal funding.

Step 2: Schools can’t cope with the loss, further reduce services, quality of education suffers.

Step 3: Blame teachers, privatize, cancel union contracts, reduce quality of education further.

“Ask yourself this: why does this only happen at poor schools?…”

“Poverty has been the driving factor behind the Philadelphia Schools tragedy for decades. Approximately 70% of district students are at or near the poverty line.

“To meet this need, the state has bravely chipped away at its share of public school funding. In 1975, Pennsylvania provided 55% of school funding statewide; in 2014 it provides only 36%. Nationally, Pennsylvania is 45th out of 50 for lowest state funding for public education.”

“Since the schools were in distress (read: poor), the state decided it could do the following: put the district under the control of a School Reform Commission; hire a CEO; enable the CEO to hire non-certified staff, reassign or fire staff; allow the commission to hire for-profit firms to manage some schools; convert others to charters; and move around district resources.

“And now after 13 years of state management with little to no improvement, the problem is once again the teachers. It’s not mismanagement by the SRC. It’s not the chronic underfunding. It’s not crippling, generational poverty. It’s these greedy people who volunteer to work with the children most in need.

“We could try increasing services for those students. We could give management of the district back to the people who care most: the citizens of Philadelphia. We could increase the districts portion of the budget so students could get more arts and humanities, tutoring, wraparound services, etc. That might actually improve the educational quality those children receive.

“Nah! It’s the teachers! Let’s rip up their labor contract!

“Take my word for it. Educators have had it.”

Don’t be a scapegoat any longer, Singer says.

Here is his clarion call, his war cry: Refuse to give the tests they use to label you and call you a failure.

“It follows then that educators should refuse to administer standardized tests across the country – especially at poor schools.

“What do we have to lose? The state already is using these deeply flawed scores to label our districts a failure, take us over and then do with us as they please.

“Refuse to give them the tools to make that determination. Refuse to give the tests. How else will they decide if a school is succeeding or failing? They can’t come out and blame the lack of funding. That would place the blame where it belongs – on the same politicians, bureaucrats and billionaire philanthropists who pushed for these factory school reforms in the first place.

“This would have happened much sooner if not for fear teachers would lose their jobs. The Philadelphia decision shows that this may be inevitable. The state is committed to giving us the option of working under sweatshop conditions or finding employment elsewhere. By unanimously dissolving the union contract for teachers working in the 8th largest district in the country, they have removed the last obstacle to massive resistance.

“Teachers want to opt out. They’ve been chomping at the bit to do this for years. We know how destructive this is to our students. But we’ve tried to compromise – I’ll do a little test prep here and try to balance it with a real lesson the next day. Testing is an unfortunate part of life and I’m helping my students by teaching them to jump through these useless hoops.

“But now we no longer need to engage in these half measures. In fact, continuing as before would go against our interests.

“Any Title 1 district – any school that serves a largely impoverished population – would be best served now if teachers refused to give the powers that be the tools needed to demoralize kids, degrade teachers and dissolve their work contracts. And as the poorer districts go, more affluent schools should follow suit to reclaim the ability to do what’s best for their students. The standardized testing machine would ground to a halt offering an opportunity for real school reform. The only option left would be real, substantial work to relieve the poverty holding back our nation’s school children.

“In short, teachers need to engage in a mass refusal to administer standardized tests.

“But you can’t do that,” say the politicians, bureaucrats and billionaire philanthropists.

“Oh, yes, we can.”

Jonathan Pelto reports that Governor Dannel Malloy of Connecticut announced he will stay the course on his corporate education reform policies, despite the huge scandal associated with the Jumoke charter school. Jumoke was one of the governor’s star charters until it was revealed that its CEO had a criminal past and a fake doctorate. Malloy supports tying teacher evaluation to test scores, despite the fact that this method has worked nowhere. And as Pelto reminds us, he proposed eliminating (not reforming but eliminating) teachers’ due process rights. He also advocated a no-union policy in the state’s poorest schools. He seems to have bought hook, line, and sinker the reformer claim that unions and tenure depress student test scores, even though the highest performing schools in the state have unions and tenure.

Why would a Democratic governor advocate for the failed policies of corporate reform? One guess. Connecticut has a large concentration of hedge fund managers, whose ideology and campaign contributions are aligned. In their highly speculative business, no one has unions or tenure. When stocks or investments go bad, they dump them. They think that schools should live by their principles. They should read Jamie Vollmer’s famous blueberry story. You can’t throw away the bad blueberries. Unless you run a charter school. Then you can exclude bad blueberries and kick out other bad blueberries.

Governor Cuomo made clear that he thinks the current system of teacher evaluation in New York is inadequate. Too many teachers have been found to be effective or highly effective. In his way of thinking, the proportion of ineffective teachers would be as high as the proportion of students with low scores. With a “meets proficiency” rate of only 31% on the state’s Common Core tests, most teachers would be found ineffective, and there would be a whole lot of firing. Then Cuomo would have the challenge of replacing most of the state’s teachers. He knows nothing about education, about teaching, or about children. I could give him a reading list, but he wouldn’t read it. It is frightening to have consequential decisions made by a man who is so uninformed.

 

Cuomo, who never attended a public school, never taught a day in his life, never sent his own children to public school,  wants to crack down on teacher evaluation.

 

He seems not to know that New York has one of the most inequitably funded school systems in the nation. Certainly he knows nothing about the needs of children other than his own and those of his privileged friends. He thinks that breaking teachers and harassing them with test scores will drive up test scores. He is not a stupid man. He is just stupid on the subject of education. As we know, he is in love with charter schools. They get high scores by keeping out the hardest to educate chidden. That must be his ideal.

 

Statewide, the teacher evaluations found only 1 percent of teachers were rated “ineffective” and 5 percent of teachers rated “developing.” Cuomo, while not elaborating on any specific policy revisions, stressed the need for change in the current education system.
The governor also seemed to say that school funding could be based on performance, although a spokesman said he was speaking more narrowly about competitive grants.
“We’re now saying to the public education system, ‘You have to perform and you’re not just going to get funded for process, you’re going to get funded for performance.’ That is a big deal and that is a big shift,” Cuomo said.
Cuomo assailed the current budget process as well, in which school officials come to Albany each year to lobby for more money.
“We’ve gotten to a point where were spending more money per student than any other state in the nation and we’re in the middle of the pack,” he said. “And the whole culture of education in Albany is more money, more money, more money.”

 

 

Audrey Amrein-Beardsley has updated her reading lists on value-added assessment. Most of the studies cited show that it is inaccurate, unstable, and unreliable. The error rate is high. Students are not randomly assigned to teachers. Ratings fluctuate from year-to-year. About 70% of teachers do not teach tested courses. Perhaps that is why other nations do not judge teachers by the rise or fall of the test scores of their students. Unfortunately in this country, at this time, we have a cult worship of standardized testing, which is used to evaluate students, teachers, principals, and schools. People’s lives hang on the right answer. In a just world this practice would be recognized for what it is: Junk science.

Here are her top 15 studies. Open the link to find the top 25. Open the link to find links for all these readings. With Beardsley’s help, you too can be an expert.

American Statistical Association (2014). ASA statement on using value-added models for educational assessment. Alexandria, VA.

Amrein-Beardsley, A. (2008). Methodological concerns about the Education Value-Added Assessment System (EVAAS). Educational Researcher, 37(2), 65-75. doi: 10.3102/0013189X08316420.

Amrein-Beardsley, A., & Collins, C. (2012). The SAS Education Value-Added Assessment System (SAS® EVAAS®) in the Houston Independent School District (HISD): Intended and unintended consequences. Education Policy Analysis Archives, 20(12), 1-36.

Baker, E. L., Barton, P. E., Darling-Hammond, L., Haertel, E., Ladd, H. F., Linn, R. L., Ravitch, D., Rothstein, R., Shavelson, R. J., & Shepard, L. A. (2010). Problems with the use of student test scores to evaluate teachers. Washington, D.C.: Economic Policy Institute.

Baker, B. D., Oluwole, J. O., & Green, P. C. (2013). The legal consequences of mandating high stakes decisions based on low quality information: Teacher evaluation in the Race-to-the-Top era. Education Policy Analysis Archives, 21(5), 1-71.

Darling-Hammond, L., Amrein-Beardsley, A., Haertel, E., & Rothstein, J. (2012). Evaluating teacher evaluation. Phi Delta Kappan, 93(6), 8-15.

Fryer, R. G. (2013). Teacher incentives and student achievement: Evidence from New York City Public Schools. Journal of Labor Economics, 31(2), 373-407.

Haertel, E. H. (2013). Reliability and validity of inferences about teachers based on student test scores. Princeton, NJ: Education Testing Service.

Hill, H. C., Kapitula, L., & Umland, K. (2011). A validity argument approach to evaluating teacher value-added scores. American Educational Research Journal, 48(3), 794-831. doi:10.3102/0002831210387916

Jackson, C. K. (2012). Teacher quality at the high-school level: The importance of accounting for tracks. Cambridge, MA: The National Bureau of Economic Research.

Newton, X., Darling-Hammond, L., Haertel, E., & Thomas, E. (2010). Value-added modeling of teacher effectiveness: An exploration of stability across models and contexts. Educational Policy Analysis Archives, 18(23), 1-27.

Papay, J. P. (2010). Different tests, different answers: The stability of teacher value-added estimates across outcome measures. American Educational Research Journal, 48(1), 163-193. doi:10.3102/0002831210362589

Paufler, N. A. & Amrein-Beardsley, A. (2014). The random assignment of students into elementary classrooms: Implications for value-added analyses and interpretations. American Educational Research Journal, 51(2), 328-362. doi: 10.3102/0002831213508299

Rothstein, J. (2009). Student sorting and bias in value-added estimation: Selection on observables and unobservables. Education Finance and Policy, 4(4), 537-571. doi: http://dx.doi.org/10.1162/edfp.2009.4.4.537

Schochet, P. Z. & Chiang, H. S. (2010). Error rates in measuring teacher and school performance based on student test score gains. Washington DC: U.S. Department of Education.

A study commissioned by school leaders in New York’s Lower Hudson Valley reviewed the state’s teacher evaluation system and concluded that it was irreparably flawed.

“The study, released Friday, found that the state formula for calculating evaluations forces school districts to inflate classroom-observation ratings so teachers do not get poor overall scores.

“If districts were to give more accurate grades to teachers after classroom visits, the study found, many teachers would “unjustly” receive overall ratings of “developing” or “ineffective.” Such districts would “end up looking like they have an underperforming workforce,” the report said.

“This is not something that can be fixed; the state Education Department needs to start over,” said Louis Wool, Harrison schools superintendent, who was president of the Lower Hudson Council of School Superintendents when the group commissioned the study last year.

“The study reviewed 2012-13 evaluation results for 1,400 teachers in 32 districts in Westchester, Rockland, Putnam and Dutchess counties. The superintendents group provided the data to Education Analytics, a non-profit organization in Madison, Wisconsin, which did the study.

“Researchers credited New York state with improving its methods of measuring teacher effectiveness. In fact, the report called New York “a pioneer” in developing a modern evaluation system. But researchers said there are few examples nationally of effective implementation and that strong use of data may not necessarily translate into good policy.”

The state apparently wants a system that gives many teachers low scores so they can be fired; schools and districts want to retain their decision-making power over which teachers should be kept or terminated. The state is trying to take that authority away from schools and districts by creating a mechanical formula. The formula doesn’t work, and no such formula works anywhere in the country. The biggest problem in teaching today is recruiting, supporting, and retaining good teachers, not finding and firing bad ones. Any administrator worth her salt knows how to do the firing part.

The state should not start over. The state should get out of the way.

Arne Duncan issued waivers to 43 states to allow them to avoid the sanctions of the No Child Left Behind Law, passed in 2001, signed into law in January 2002. NCLB is an utter disaster, recognized as such by everyone except the people who had a direct hand in writing it. It requires that 100% of all children in grades 3-8 must be “proficient” on state tests of reading and mathematics or the school will face dire consequences.

 

In no nation in the world are 100% of all children proficient in reading and math. Congress’s mandate was a cruel joke on the nation’s public schools.

 

In order to get Duncan’s waiver, states had to agree to Duncan’s terms. One of them was that the state had to create a teacher evaluation system based on test scores. Washington State initially agreed, but as the research accumulated showing that this strategy was not working anywhere, the legislature refused to pass such a system.

 

Duncan revoked the waiver he had in his lordly manner extended. Now almost every school in the state is a failing school and must spent at least 20% of their federal funding on private tutoring or allow students to transfer to “non-failing” schools, if they can find one.

 

This article by Motoko Rich in the New York Times shows the ugly consequences of Duncan’s policies have been on the public schools of Washington State. Schools that have shown dramatic improvement in recent years are now declared failures. Duncan says the state must suffer the consequences of its failure to follow his orders.

 

This man is not fit to be Secretary of Education. He is a promoter of privatization and high-stakes testing. His period in office has been marked by massive demoralization of teachers and educational stagnation (his own term). From his actions, it appears that he doesn’t care for public education and hopes it will be replaced by privately managed charters and vouchers. His action in this case has caused harm to the students and teachers of Washington State. The headline of the article says he put schools “in a bind.” It would be more accurate to say that Duncan has rained chaos on the schools and children of Washington State. The sooner he is out of office, the sooner we can turn to realistic ways of helping children and schools.

Thanks to Pam Hricik for sending this gem of a question.

Read this and evaluate Mr. Jackson.

Fearless Peter Greene criticizes economist Thomas Kane for his latest paper, called “Never Diet Without a Bathroom Scale and Mirror: The Case for Combining Teacher Evaluation and the Common Core.”

Kane directed the study called Measures of Effective Teaching for the Gates Foundation.

Greene calls the new study “grade A baloney.” Kane calls for “a massive adult behavior change exercise,” not an easy thing to accomplish.

But Greene writes:

“The bathroom scale image is brave, given the number of times folks in the resistance have pointed out that you do not change the weight of a pig by repeatedly measuring it. But I am wondering now– why do I have to have scales or a mirror to lose weight? Will the weight loss occur if it is not caught in data? If a tree’s weight falls in the forest but nobody measures it, does it shake a pound?

“This could be an interesting new application of quantum physics, or it could be another inadvertent revelation about reformster (and economist) biases. Because I do not need a bathroom scale to lose weight. I don’t even need a bathroom scale to know I’m losing weight– I can see the difference in how my clothes fit, I can feel the easier step, the increase in energy. I only need a bathroom scale if I don’t trust my own senses, or because I have somehow been required to prove to someone else that I have lost weight. Or if I believe that things are only real when Important People measure them.

“Kane envisions the Core and new evaluations going hand in hand, leading to more successful implementation of the Core (he does not address the question of why a successful Core is a Good Thing, Much To Be Desired). And his vision of how evaluation will provide a connection to standards as well as the kind of continuous feedback by people who don’t know what they’re doing and whose judgment can’t be trusted.”

Kane says that one of the big problems in American education is teacher autonomy. He believes that teacher work must be carefully monitored, guided, and measured. He refers to Japanese lesson study as exemplary, but does not mention Finland, where teachers are highly prepared, then given considerable autonomy to do the work they were prepared for.

Greene says:

“My experience is that every good teacher I’ve ever known is involved in a constant, daily cycle of reflection and self-examination, using a rich tapestry of directly-observed data to evaluate her own performance, often consulting with fellow professionals. It’s continuous and instantly implemented, then instantly evaluated and modified as needed. It’s nimble, and it involves the professional judgment of trained experts in the field. That seems like a pretty good system to me.”