Kevin Welner is director of the National Education Policy Center at the University of Colorado in Boulder.

If you open the link to this article, you can find Welner’s links to research and contrary views on the issue.

SEPTEMBER 24, 2012 8:09 PM

Teacher evaluation and Seamus
By Kevin Welner
Since it’s campaign season, I figured it might be fun to respond to this question using an extended metaphor, with teacher evaluation policy playing the role of Gov. Romney’s Irish Setter, Seamus, and policy makers (including Pres. Obama’s EdSec Arne Duncan) playing the role of Gov. Romney.
In reading on, please remember that I’m trapped here in a “swing state,” subjected to a barrage of distorted photos of candidates overlaid with announcers’ voices portending our collective doom should we vote for the other guy. So bear with me for a bit; hopefully this will resonate even with the non-brain-addled in the non-swing states.
The Seamus story is well-known, at least to regular readers of Gail Collins’ column in the New York Times. The Romneys went on a family vacation, which included a 12-hour drive to Canada (Lake Huron). Seamus, the family dog, was put in his crate and strapped to the roof of the station wagon. The trip was carefully planned, down to specified rest stops. But Seamus fouled up the plans a bit when he expressed his displeasure in liquid fecal form, thus soiling himself and his surroundings. So Mitt Romney had to stop and hose down the dog, crate and car. They all then continued on their way. Seamus survived and, according to Gov. Romney, he “loves fresh air” and continued to like car rides, even up there in his crate.
In writing this, I can’t help but note that this all took place in the summer of 1983—the same year as “A Nation at Risk.” Coincidence?? (I’ve really got to get away from these campaign commercials…)
So how is teacher evaluation akin to Seamus? Just as the Romney family and Seamus needed to get to Canada one way or the other, we can all agree that we need good systems of teacher evaluation. The question is how we get there. Our “reformer” friends have come up with an efficient plan: use statistical growth models based on students’ test scores. Let’s strap teacher evaluation to the kids’ tests! What could go wrong?
Plenty, it turns out. This option comes with many serious weaknesses and unintended consequences. The research tells us that “lawmakers should be wary of approaches based in large part on test scores: the error in the measurements is large—which results in many teachers being incorrectly labeled as effective or ineffective; relevant test scores are not available for the students taught by most teachers, given that only certain grade levels and subject areas are tested; and the incentives created by high-stakes use of test scores drive undesirable teaching practices such as curriculum narrowing and teaching to the test.”
But since nobody can come up with an alternative that is as efficient in generating concrete numerical rankings, we stumble (or drive) forward. Even when the brown muck starts to drip down the windows, we merely perform a quick clean-up and continue on our way.
Gov. Romney’s car trip was well-planned and was executed with an unyielding emphasis on efficiency. And at the end of the day, he and his family made their way to Lake Huron. But, notwithstanding Gov. Romney’s protestations to the contrary, it seems unlikely that Seamus or any other dog in that situation would come back wanting more. Yes, the careful planning and efficiency of the trip were remarkable, but there are less stressful and unpleasant ways for a dog to make that 12-hour trip—ways that aren’t as likely to lead to undesirable, unintended consequences.
This, lord help me, is what I’m thinking about when I consider the current push for more effective teacher evaluation systems. My conclusion is we should indeed go on that trip. But let’s invite our teachers and their evaluation systems inside the station wagon, and let’s plan the trip with a complete understanding of how best to get from Point A to Point B.
Last week, the NEPC published a 3-page brief explaining the importance of balanced evaluation approaches that include all stakeholders in decision-making about evaluation systems. Not easy. Maybe not even efficient. But we won’t have to stop mid-way through to get out the hose.