Patrick Hayes is a teacher in Charleston, South Carolina, who is leading the fight to block test-based, value-added evaluations of teachers in that district. As many posts on this blog have iterated and reiterated, most researchers think that VAM is flawed and error-ridden. (Check out Audrey Amrein-Beardsley’s blog VAMboozled and Edward Haertel’s ETS lecture.)

Hayes read about the errors in the Mathematica study of VAM in D.C., and left the following comment:

“This is awful news for DC teachers. Down here in Charleston, it’s the greatest Christmas gift imaginable.

“We’re fighting VAM-based merit pay tooth and nail. Guess who our district hired to do the work?

“Here’s the only question I have: was this what Mathematica had in mind in 2010 when they said that VAM has a 36% error rate?

http://ies.ed.gov/ncee/pubs/20104004/pdf/20104004.pdf

“Is that before or after they foul up the data?

“Tell you what, don’t ask Mathematica. I can tell you from personal experience: they REALLY don’t like talking about that study.

“I know it was before Arne Duncan handed out nearly a billion dollars in grant funding for value-added systems.

“When Mathematica published this, TIF grants were still comparatively small potatoes.

“Funny thing is, Arne’s the one who picked up the tab for that study. His name appears on page 3. Go figure.”