Archives for category: Teacher Evaluations

Richard Rothstein explains that VAM is an unproven methodology with negative consequences for the quality of education.

Rothstein says he is not surprised that Chicago teachers oppose its use. He wonders why other teachers have not gone on strike for the same reason.

It has not worked anywhere.

It narrows the curriculum.

It relies too heavily on tests that were not designed to measure teacher quality.

The teachers are being used as guinea pigs for an unproven methodology that will harm education.

Marcus Winters recommends using value-added assessment to get rid of “ineffective” teachers. His paper was published by the conservative Manhattan Institute, which regularly issues his and others’ critiques of unions, tenure, seniority and any kind of job protection for teachers.

Many studies–and practical experience–have demonstrated that value-added assessment is unstable, unreliable and inaccurate. A teacher with a high rating may have a low rating the next year. The National Academy of Education and the American Educational Research Association published a joint paper warning that VAA says more about which students are assigned to the class than about teacher quality.

And then there is the problem that there is no district that has been able to demonstrate that VAA actually identifies ineffective or effective teachers. When New York City published its value-added ratings, the allegedly “worst” teacher in the city taught immigrant students who cycled in and out of her class as they learned English. As Linda Darling-Hammond and others have warned, value-added assessment will encourage teachers to shun the students with the highest needs and gifted students. Neither will produce the expected gains.

It is interesting  and curious that Arne Duncan’s favorite innovation happens to be the favorite solution of the right to find and fire “ineffective” teachers.

I will never understand why the rightwingers are so devoted to high-stakes testing, which is known to produce narrowing of the curriculum, teaching to the test, gaming the system, and cheating. What’s to like? Maybe they like it because it gives them a club with which to bash teachers, their unions, and public education.

The Los Angeles Times printed a thoughtful editorial about the teachers’ strike and about evaluating teachers by student test scores.

These days it is unusual to find an editorial or opinion column asking whether the tests were designed to measure teacher quality. They were not. Frankly, the test publishers ought to be yelling bloody murder about the inappropriate use of the tests, but they are making so much money that it’s hard to hear their complaints or to expect them.

I wish more writers would look at the research about the inaccuracy and instability of value-added assessment. I wish they would think a bit about how this high-stakes testing invariably leads to teaching to the test, narrowing the curriculum, score inflation, and cheating.

The one thing it does not produce is good education. If it did, we would see it in all the best private schools. But not a single one of them uses value-added assessment or even standardized tests. That would insult the intelligence of their teachers.

Dana Goldstein has written an interesting commentary on the history of teacher unionism.

Chicago was the home of the very first teachers’ union, and it was founded by a tough female teacher named Margaret Haley.

Haley hated the factory-style schools of the day, objected to rigid standardization, and wanted dignity for the teaching profession. I will quote some of her words on another post.

For now, read Dana’s overview of the origins of the teachers’ union in Chicago. I told Dana, by the way, that I don’t agree with her conclusions, where she suggests that teachers need to give up “old notions of rigid job security and near nonexistent teacher evaluation.” Maybe I am quibbling over words, but I would hate to see teachers become at-will employees with no academic freedom, living in fear of community opposition to teaching controversial ideas and books. I am not sure about “near nonexistent teacher evaluation.” That sounds like a straw man. It is not teachers who decide how they should be evaluated; it’s the central office. If they fail to evaluate teachers, shame on them. The issue is not whether there should be evaluation, but whether it will be sound and not based on spurious metrics.

A few weeks ago, the New York Times published an editorial saying that teachers needed more carrots and sticks to make them work harder and produce higher test scores. The assumption is that they are not working hard now (a Gates-Scholastic survey in the spring said the typical teacher works an 11-hour day now); and that waving a bonus in front of them would raise student test scores (even though merit pay has never worked, even with a bonus of $15,000 for doing so); and that the threat of firing might move the needle (even though it is the kids who need to “produce,” and threats don’t produce better education).

Today the Times blames the Chicago teachers’ strike on the teachers and suggests it is all the fault of their leader, Karen Lewis, who is enjoying a power play. He thinks the teachers should accept evaluation based on student scores because everyone else is doing it.

But let’s give him the benefit of the doubt.

Maybe he didn’t have time to read the research that shows this method is junk science.

Maybe the Times missed the story about the strike having been authorized by more than 90% of the union’s membership.

Maybe the editorialist didn’t hear about classes of more than 40 children.

Maybe he didn’t know about the schools with no art teachers, no library, no social worker.

Maybe he was absent that day.

The real difference between the CTU and Mayor Rahm Emanuel is not money. By all accounts, the union and the mayor are close on compensation.

The real differences are about the corporate reform agenda. The mayor wants merit pay, more charters, evaluation of teachers by test scores, and all the other components of the national corporate reform agenda.

But little noticed by the national media is that none of these so-called reforms works or has any evidence to support it. Merit pay has failed wherever it was tried. Teacher evaluation by student test scores is opposed by the majority of researchers, and practical experience with it has led to confusion and uncertainty about whether student scores can identify the best and worst teachers. The charters in Chicago and elsewhere do not get better test scores than the regular public schools. Even in Detroit, only 6 of 25 charter high schools got better scores than the much-lamented Detroit public schools.

If you add the scores on standardized tests for five years in a row, can you tell who the best and worst teachers are?

No.

But that’s the theory behind value-added assessment.

The idea is that an “effective” teacher raises test scores every year. The computer predicts what the test scores are supposed  to be, and the teacher who meets the target is great, while the one who doesn’t is ineffective and should be shunned or banished.

But study after study shows that value-added assessment is rife with error. As this paper from the National Academy of Education and the American Educational Research Association shows, value-added assessment is unstable, inaccurate and unreliable. Teachers who get high ratings one year may get low ratings the next year. Teachers are misidentified. Data are missing. The scores say more about which students were in the classroom than the teachers’ “quality” and ability to teach well.

Teachers of the gifted are in trouble because the students are so close to the ceiling that it is very difficult to “make” them get higher scores.

Teachers of special education are in trouble because their students have many problems taking a standardized assessment. A teacher wrote me last year to tell me that her students would cry, hide under their desks, and react with rage; one tore up the test and ate the paper.

Teachers of English language learners are in trouble because many of their students don’t know how to read English.

A superintendent in Connecticut wrote me to say that his state department of education is pushing the Gates’ MET approach. I urged him to read Jesse Rothstein’s critique. In fact, the MET study won the National Education Policy Center’s Bunkum award for research that reached a conclusion that was the opposite of its own evidence.

For a fast and accurate summary of what research says about value-added assessment, read this article by Linda Darling-Hammond.

VAM is junk science. Bunk science.

Just another club with which to knock teachers, wielded by those who could never last five minutes in a classroom.

Count on Stephanie Simon of Reuters to get the story that eluded every other reporter.

She is the one that got the inside story on Louisiana, TFA, and for-profit investors.

Now she has the scoop on Chicago.

The strike in Chicago is not about money.

It is a national story.

It’s about the survival of public education.

Read her story.

Jessie B. Ramey attended a meeting at the White House with a delegation of Pennsylvania educators.

Ramey wrote an open letter to Roberto Rodriguez, President Obama’s education advisor, asking the White House to stop berating educators and public education.

Based on the story in The Atlantic claiming that Michelle Rhee is “taking over the Democratic Party,” it becomes imperative for President Obama to distance himself from Rhee’s anti-teacher ideas.

Does President Obama support charter schools, like Rhee? Yes.

Does President Obama support for-profit schools, like Rhee? He hasn’t said.

Does President Obama worry about a dual school system in American cities, with charters for the haves and public schools for the have-nots? We need to know.

Does President Obama want entire school staffs to be fired because of low test scores? He said no at the Convention but he supported the firing of the staff at Central Falls High School in Rhode Island and his Race to the Top turnaround strategy supports mass firings. Does he approve or disapprove?

Does President Obama truly want to stop the odious practice of teaching to the test? Will he explain how teachers can avoid teaching to the test if their pay and their job depends on student test scores?

President Obama must let the nation’s teachers know that he is with them. He can do so by disassociating himself from Rhee’s anti-teacher agenda, as well as from policies pushed by his own Race to the Top.

And he could go to Chicago and tell Rahm Emanuel to settle with the teachers and do what is right for the children of Chicago.

The following comment is evidence that the corporate reformers’ narrative about the “broken” evaluation system is wrong. I say “wrong” as a euphemism. I actually think it is a calculated lie, one that has been promulgated to advance a political agenda: to eliminate collective bargaining rights, to eliminate seniority and tenure, to demand that teachers have zero job protections, not even due process. All of this will make it possible to fire “bad” teachers, with no hearings or delay. The “bad” teachers are the ones who can’t raise test scores every single year.

If you don’t agree with this train of thought, then you are branded as a paid lackey for the teachers’ union, a defender of the status quo, and worse.

But what if the narrative is a giant lie? What if the evaluation system is working quite well in most places? What if low test scores are caused not by “bad” teachers, but by socio-economic conditions that shape children’s interest in schooling?

What if our society has been sold a bill of goods, intended to distract us from addressing real problems?

This reader writes:

I taught in Westchester County, New York, for 35 years (retiring in June 2011).  I was on the faculty of two high schools and served as department chair in the second of those two.  In both schools, working with several administrative teams, I nearly always found administrators working in the collaborative, supportive way described in Carol Burris’s excellent and reassuring post.  This does not mean that I found all these administrators equally visionary or thoughtful or smart, but I found them all supportive and, when necessary, willing to rid the school of those who couldn’t rise to the its standards or fit its culture.  I rarely saw weak teachers tenured.  I saw a few tenured teachers eased out.  I agree that “[a]lthough…it makes sense to make the 3020a dismissal process shorter and less costly, it should never be easy.”  /  With all this in mind, I was struck by a recent New York Times’ article celebrating the fact that, last year only 50% of teachers up for tenure actually received tenure in the NYC schools. (Many were granted a 4th year to pursue tenure.)  The Times was convinced that this showed a rising standard of excellence.  But this ignores a fact widely understood in public schools: That a teacher should not be invited back for a third year unless he or she is clearly on the track to receiving tenure.  In 2010, according to the Times, 80% of candidates received tenure–a fact the article bemoaned, though 80% seems a little low to me.