Since the announcement of Race to the Top, schools have become even more obsessed with test scores than they were under No Child Left Behind (which still exists in law). To be eligible to get a portion of Race to the Top’s $4.35 billion, states had to agree to evaluate their teachers to a significant degree by the test scores of their students. Later, when states needed waivers from NCLB’s mandate that every child must be proficient by 2014 or their schools would be labeled “failing,” Secretary Duncan made the waivers conditional on states’ agreement to evaluate teachers by the test scores of their students. Unfortunately at the time the U.S. Department of Education insisted on what was known as “value-added-modeling” (VAM), testing experts did not agree that it was fair or reliable as a measure of teacher effectiveness. On October 5, 2009, the Board on Testing and Assessment of the National Research Council wrote a letter to Secretary Duncan warning him of the pitfalls and limitations of VAM. Secretary Duncan ignored their advice and their caution. So now the entire nation is ensnared in an unscientific, unproven method to evaluate teachers.
John Ogozolek, who teaches in upstate New York, developed an analogy to try to make sense of VAM evaluations:
The analogy I was using this past week involves home repairs. Imagine your house needs a new roof or a new bathroom or even a new foundation. But then some big multi-national construction corporation shows up with a scheme of its own -not only to fix what your house might need but to renovate the entire place, top to bottom. Plus, they’re here to “fix” every other home in town, too -with the EXACT SAME “PLAN”.
So, you’re trying to have a rational discussion with the foreman of this alleged construction crew then you hear a chainsaw kick on down the hallway. You run down there just as some guy starts ripping apart your kid’s bedroom furniture, splinters flying. You can barely hear what the smiling worker is saying over the din but you get the idea when he hands you your own chainsaw and motions for YOU to join in, too. What the hell is the plan, you scream. “We…don’t….have….one”, he yells back, “We’re building the plane as we’re flying it”
WHAT….?
They are destroying your entire house. But, of course, it doesn’t really matter to them. If they burn down the town from one end to another, they’d only be happier. They don’t want you, they don’t want your house.
Their plan to renovate the world reminds me of the wacky “modern” architecture that leveled entire neighborhoods in cities 50 years ago and left us with mammoth housing projects….the urban “renewal” that ended up being worse than the tragic problems it sought to cure. It was all so much about science and “progress” back then, too, you know. I reread Tom Wolfe’s critique of modern architecture (“From Bauhaus to Our House”) a few years ago, when the Race to the Top crap first really hit the fan. How could such madness grip an entire culture and come to shape our world? I just had to shake my head…..yup, here we go again.
The statistical argument about VAM is great….it’s powerful……I’ve used it myself since reading about it on this blog. We should shout it from the rooftops. But I don’t think some of the people who are attacking public schools and destroying what goes on in our classrooms really care.
It’s like a good carpenter thinking about how to use a specific tool…..meanwhile a giant, smoke-belching excavator is sidling up on its greasy tracks, crushing whatever is in its way and swinging the good ole wrecking ball……

Value Addled Morons …
’nuff sad …
LikeLike
succinct!
LikeLike
Sad thing about vam is that it started out as a way to separate the socioeconomic factor that is responsible for high test scores of affluent students. VAM can be done poorly or it can be done well. Pity that Arne Duncan has chosen poorly. Pres. Obama campaigned on a platform of no more junk science and he advertised Dr. Linda Darlinghamond.
LikeLike
“VAM: The Scarlet Letter”
http://youtu.be/dfMymU86Bjo
LikeLike
Don’t forget that acceptance of the Common Core State Standards was also one of the conditions of the NCLB waiver blackmail conducted by A.D.
LikeLike
To provoke thought, an old dead Greek guy comes in handy once in a while:
“A good decision is based on knowledge and not on numbers.” [Plato]
Of course, like anything, this can taken out of context and misused and abused by the enablers and enforcers of the self-styled “education reform” movement.
IMHO, it is a good reminder that one should always be cautious when people use math to intimidate and obfuscate.
Especially when, as in the case of the leaders of the self-proclaimed “new civil rights movement of our time,” they themselves don’t understand what VAM is and how it works and what it can and can’t do.
Not surprising, since they are so rigorously credulous, always willing to believe in any fantastical notion, magical cure-all, or pixie dust when it’s in their own self-interest. Just put a number on it and—Bazinga!—it’s a ‘hard data point’!
😏
Case in point: Michelle Rhee, former Chancellor of DCPS and former supernova in the “education reform” firmament. How could she have seriously entertained for even a moment the [according to her] statement by her principal in the early 1990s that she had taken “her” [forget that pesky co-teacher with whom she shared a classroom!] from the 13th to the 90th percentile? How could she have kept a straight face? For almost anyone else, it would have required employing an iron will to contain the raucous laughter that would have been pouring out of their mouths upon hearing such patent foolishness.
And then there was her amazing statement, based on what I assume was a CCSS-inspired “close reading” of a Teach Plus report, that “just 1.7 percent of classroom time is devoted to preparing for and taking standardized tests.” The report itself specifically says that the “1.7 percent figures do not reflect the many time demands that may be associated with testing such as preparing students or analyzing data” and cites many teachers explaining that it “takes a lot of time to prepare for the tests” and “[m]ore than 35 percent of instructional time is spent on these assessments per year” and “I would say overall we lose about 15-20 days of instruction to testing to statewide testing. Another 20 days we are instructing, but it is focused on test prep” and the like.
😱
Link: http://jerseyjazzman.blogspot.com/2014/04/why-is-michelle-rhee-wrong-about.html
[brackets mine]
So all those fanciful numbers and stats that feed VAM, with all it’s black box formulae and not-available-to-the-public data, is just another example of what a Scotsman described in the 19th century:
“He uses statistics as a drunken man uses lamp posts – for support rather than for illumination.”
Just another bunch walking down the street, opening their overcoats on a warm day with expensive watches hanging down inside, and wanting to know if you want to buy a “genuine Rolex” for a 13th percentile rather than a 90th, er, for $25.
My advice: don’t buy.
Just my dos centavitos worth…
😎
LikeLike
‘ “He uses statistics as a drunken man uses lamp posts – for support rather than for illumination.” ‘
I can think of another way a drunken man might use a lamp post that might create an even earthier analogy.
LikeLike
Perhaps Jim Hightower can come in handy here:
“Even the smallest dog can lift its leg on the highest building.”
Yep, and even on those so high and mighty as Bill Gates and Arne Duncan and Eva Moskowitz and Chris Christie and John Deasy and Michelle Rhee and..
You get the idea.
Perhaps that is why the owner of this blog is so partial to dogs.
😎
LikeLike
Thanks for a great analogy, Krazy, not only of VAM, but of it’s peddlers. A good laugh as well, you gave me my dose.
LikeLike
I recall reading a graduation speech that Linda Darling-Hammond delivered that compared blaming teachers for poor student performance to blaming bank tellers for the 2007 financial unraveling that spawned the Great Recession. Naturally, VAM’s are a part of the “blame the teachers” mindset. Another analogy would be blaming your dentist for cavities. Of course, YOU had nothing to do with the condition of your teeth… Yeah right.
We have to stick together as a profession so that we can actually teach without the harbinger of unfair evaluation methods looming at every turn.
LikeLike
Reblogged this on peakmemory and commented:
Value added measures of teaching are “unscientific” and “unproven.”
LikeLike