Valerie Strauss notes the growing number of studies that debunk the value of judging teacher quality by the rise or fall of test scores, and naturally she wondered what Secretary Arne Duncan thought about them.
There was the report of the American Statistical Association, which said: l
“VAMs should be viewed within the context of quality improvement, which distinguishes aspects of quality that can be attributed to the system from those that can be attributed to individual teachers, teacher preparation programs, or schools. Most VAM studies find that teachers account for about 1% to 14% of the variability in test scores, and that the majority of opportunities for quality improvement are found in the system-level conditions. Ranking teachers by their VAM scores can have unintended consequences that reduce quality.”
Days ago, a new Gates-funded study found no correlation between “quality teaching and the appraisals teachers received.”
Another study by a team led by Marianne P. Bitler, an economist at the University of California, said that VAM ratings had about the same relationship to reading and math scores as to changes in a student’s height.
VAM is the centerpiece of Race to the Top..
Strauss called the u.S. Department of Education to ask whether Secretary Duncan was aware of the research and whether it had changed his views. The answers: yes, he was aware of the research; no, it had not changed his views.

thick. as. a. brick
LikeLike
LikeLike
Hooray for Jethro Tull, and here’s an analogy for David Coleman, Arne Duncan and company to ponder:
Jethro Tull is to American Idol what
truly innovative instruction is to the Common Core.
Meantime, our wise Diane Ravitch doesn’t know how it feels…
(to be thick as a brick)
LikeLike
bawahahahaha!
LikeLike
The lyrics say it all!
LikeLike
My children had gerbils whose capacity to evaluate research were equivalent to Arne’s.
LikeLike
cx.
were [superior] to
LikeLike
Not very bright gerbils, eh? 😉
LikeLike
No, these were not the brightest gerbils. They were cuter than Arne is, though.
LikeLike
cx.
“. . . were [superior] to Arne’s.”
LikeLike
two words, Arne:
independent validation
Look them up. Have someone explain them to you V E R Y S L O W L Y
LikeLike
This administration walks the ‘centrist’ line and attempts to catch in its grasp as many ‘deformers’ as it can in the hope that ‘deformers’ will vote the Democratic ticket. This approach is self destructive foolishness.
LikeLike
Don’t confuse me with the facts. My mind has already been made up.
LikeLike
Exactly. Evidence has no standing in this argument.
LikeLike
This is like asking the Koch brothers if global warming exists
LikeLike
LOL or asking them to try and make their business environmentally friendly.
LikeLike
I know it doesn’t do a bit of good, but I just used your text Diane to post another letter to the White House web page.
LikeLike
“You know, I know this steak doesn’t exist. I know that when I put it in my mouth, the Matrix is telling my brain that it is juicy and delicious. After nine years, you know what I realize? Ignorance is bliss.” – Cypher, The Matrix
LikeLike
Arne is a windup toy. Pull the string, and he says what he is paid to say. The fact that he is a noneducator makes him perfect for this job. He doesn’t have the qualms that might come from having had any actual experience or education in these matters.
LikeLike
sad, but I think you are right. And a wind-up toy that sees everything else as a toy There was no need to desensitize him, as he was never sensitized in the first place. Effectively, he’s telling all of us, “it rubs the lotion on its skin. it does this whenever it’s told.”
LikeLike
The research completely eliminates the VAM and the common core but ARNE isn’t research oriented, he is billionaire oriented. If they say black is white and white is black he agrees. He’s staked his whole career on Gates, and Broad etc being right. Of course they aren’t right, but Arne will never admit it unless they do first. And they have all their money behind a PR machine and media blitz that tells everyone it’s working fine it’s great, it’s our only hope and of course it is our demise if we can’t stop it.
LikeLike
No one should be surprised: VAM is both an ideology – under it, students are defined as products to be enhanced/monetized – masquerading as “science,” and a weapon to be used against teachers and the public schools.
High stakes exams are the linchpin for so-called education reform, since they are the vehicle for attacking the public schools, the unions, and teacher autonomy. The entire hostile takeover of public education rides on the passive acceptance of the tyranny of the exams, so expect Duncan to defend them and their accessories to the end.
LikeLike
Junk science is as junk science does, so why should the junk scientist behind the junk science ever change his mind???? His arrogance and ignorance know no bounds.
LikeLike
from the Rheeformish Lexicon:
Coleman, the. (Weights and measures) Measure of the co-incidence of arrogance and ignorance, as in “Arne Duncan has distinguished himself by consistently scoring 9.8 Colemans or higher throughout his tenure as Secretary of the Department for the Regimentation, Standardization, Centralization, Distortion, Narrowing, Dehumanization, and Privatization of U.S. Education, formerly known as the USDE.
LikeLike
The arrogance extends to the SLOs, not just the VAMs. SLOs are the metric for evauating 70% of teachers. USDE has been pushing these “alternatives.” All are based on the Denver pay-for performance pilot. All have no evidence to support their efficacy. And that comes from three reports (2013-2014) from Arne’s USDE.
And then there is the study intended to determine whether all of the flawed polices for teacher evaluation will have the “intended impacts”… This belated study commissioned by USDE will have results by 2017 long after the damage has been done, and with metrics known to be flawed for well over a decade. —-American Institutes of Research. (2012, February 23). AIR selected to conduct study measuring the impact of teacher and leader evaluation systems on student learning and performance. Press Release. http://www.air.org/news/index.cfm?fa=viewContent&content_id=1755
LikeLike
Thank you, Laura, for continuing to spell this out.
LikeLike
VAM – measuring the transfer of knowledge by osmosis.
Now that the question of how much learning moves through a masonry wall from a teacher to a student not in their class has been answered.
Next, VAM will answer the age old classic of how much gain occurs from an unopened textbook located near a sleeping student. Both in and outside a backpack for scientific control purposes of course.
LikeLike
Research and evidence are for losers who can’t handle competition. The world is so very simple if you limit yourself to a worldview that holds rankings and competition as the only worthwhile human endeavors.
LikeLike
Motoko Rich @motokorich 3h
When students “happen to be going about their daily activity” digitally, data can be collected, Pearson’s Kristen DiCerbo
This stuff is comedy gold 🙂
I know she’s trying to make this sound appealing, less contrived and artificial, but all it does it make it sound worse to the average person.
You wonder if kids themselves will rebel at some point, and ask that they NOT be constantly tracked and monitored every second of every day in school. You just start to imagine this crazy system where they’re counting keystrokes per minute, monitoring productive output per hour, and on and on.
I just think about myself in third grade, wandering off mentally, looking out the window…
I feel a little sorry for them 🙂
LikeLike
Here’s a lesson in cross-marketing for you.
PARCC promotes the tweets of the charter school lobbying group “Stand For Children”‘, on the PARCC site:
http://www.parcconline.org/field-test-update
As the New Yorker called it “the tight-knit group of ed reformers”
LikeLike
I’m pretty sure VAMification (ramification based on a fuzzy math) is the center of Arneology.
LikeLike
data-based/researched-based, rigorous (because some permutation of “rigor” needs to be in every sentence about education) decision making for thee, but not for me…
LikeLike
When things get bleak I try to make my colleagues chuckle by saying, in that smarmy reformy tone we all know so well and in regard to silly things like decorating a bulletin board or discussing where to go for a group after dinner drink:
“I find your lack of rigor to be quite disturbing in this context. Where’s the complexity? Where’s the essential question? Where’s the higher order thinking? You are not being effective!”
I also say:
“I can smell the complex bouquet of rigor in this hallway!”
They laugh and let go of a little stress. So do I.
The word “rigor” is despised by me and I now take every chance to mock it and rob it of its reformy power.
LikeLike
Chris in Florida,
When you hear “rigor,” think rigor mortis.
LikeLike
Indeed, mocking is one of the few things left to us; we should, by all means, use of it. And there is no word in the education world that is more deserving of being mocked at this present time than “rigor.”
LikeLike
Who will be held accountable for the PARCC mistakes? Who will Bill and Arne blame?
Correction to Instructions in Paper-Based Test Manual
https://www.parcconline.org/correction-instructions-paper-based-test-manual
“We recently discovered an error that needs to be addressed in the Test Administrator Manual for Paper-Based Testing on page 128 (within the administration script for Mathematics Grades 4 through High School EOY Session 1). Please inform your test administrators that the following sentence on page 128 (near the middle of the page) needs to be replaced.
Original Sentence
Find the page after the first STOP sign Test Booklet and follow along while I read the directions for Session 2
Replacement Sentence
Turn to the first page of the Test Booklet and follow along while I read the directions.
For more information regarding PARCC and the 2014 Field Test, please visit the PARCC website at http://www.parcconline.org/field-test.
If you have questions regarding the administration of the PARCC Field Test, please contact Pearson’s PARCC Support Center: 1-888-493-9888 (open Monday through Friday, 6:00am to 8:00pm CT) or PARCC@support.pearson.com.
For state policy questions please contact your state field test contact.”
LikeLike
Laura McGiffert Slover, Chief Executive Officer, PARCC
https://www.parcconline.org/staff
“Prior to becoming CEO, Laura served as the senior vice president at Achieve, a bipartisan education reform organization that has been serving as the project manager for PARCC since 2010. She has been working in various roles to support states since 1998, when she joined Achieve. From 2009-10, Laura led Achieve’s efforts to support the development of the Common Core State Standards.”
LikeLike
More on Ms. Slover:
http://www.lauraslover.com/home/?q=bio
LikeLike
“A new Gates funded study” -a real change of thinking? -or just getting ahead of the opposition?
LikeLike