Archives for the month of: December, 2013

Last Friday, before the winter break, D.C. officials quietly released the news that the D.C. IMPACT evaluation system contained technical errors. It was the perfect time to reveal an embarrassing event, hoping no one would notice. Spokesmen minimized the importance of the errors, saying they affected “only” 44 teachers, one of whom was wrongfully terminated.

But Professor Audrey Amrein-Beardsley explains that what happened was “a major glitch,” not a “minor glitch.” It was not a one-time issue, but an integral part of a deeply flawed method of evaluating teachers. No amount of tinkering can overcome the fundamental flaws built into value-added measurement of teacher quality.

Beardsley writes:

VAM formulas are certainly “subject to error,” and they are subject to error always, across the board, for teachers in general as well as the 470 DC public school teachers with value-added scores based on student test scores. Put more accurately, just over 10% (n=470) of all DC teachers (n=4,000) were evaluated using their students’ test scores, which is even less than the 83% mentioned above. And for about 10% of these teachers (n=44), calculation errors were found.

This is not a “minor glitch” as written into a recent Huffington Post article covering the same story, which positions the teachers’ unions as almost irrational for “slamming the school system for the mistake and raising broader questions about the system.” It is a major glitch caused both by inappropriate “weightings” of teachers’ administrator’ and master educators’ observational scores, as well as “a small technical error” that directly impacted the teachers’ value-added calculations. It is a major glitch with major implications about which others, including not just those from the unions but many (e.g., 90%) from the research community, are concerned. It is a major glitch that does warrant additional cause about this AND all of the other statistical and other errors inherent not mentioned but prevalent in all value-added scores (e.g., the errors always found in large-scale standardized tests particularly given their non-equivalent scales, the errors caused by missing data, the errors caused by small class sizes, the errors caused by summer learning loss/gains, the errors caused by other teachers’ simultaneous and carry over effects, the errors caused by parental and peer effects [see also this recent post about these], etc.).

The “errors” cannot be corrected because the method itself is the problem. The errors and flaws are integral to the method. VAM is Junk Science, the use of numbers to intimidate the innumerate, the use of data to quantify the unmeasurable.

Whitney Yax has prepared an infographic that describes the web of connections and experience among the New York Regents Research Fellows.

You will not be surprised to learn that many have a background in Teach for America, the New York City Department of Education, and New Schools for New Leaders.

Nine of the 25 fellows had classroom experience.

I received this email today. It is a valuable reminder to our friends who wave the flag to defend the politics of greed and indifference to the sufferings of others.

 

Friends,

During these days of shopping madness and conspicuous consumerism, it makes sense to remind ourselves that Francis Bellamy, a Christian Socialist, wrote the “Pledge of Allegiance” in 1892 as an antidote to Gilded Age greed,  misguided materialism, and hyper-individualism. But you’d never know that by reading CNN contributor Bob Greene’s column earlier this week called  “The Peculiar History of the Pledge of Allegiance. “  He sort of air-brushed Bellamy’s politics out of that history. This is typical of how pundits and politicians often rewrite and distort history to reflect their own peculiar views. So I’ve written this column, “The Socialist Origins of the Pledge of Allegiance,” for Huffington Post today, to remind us of the continuing relevance of this iconic statement of progressive patriotism.  

America now confronts a new version of the Gilded Age, brought upon by Wall Street greed and corporate malfeasance. These trends have triggered a growing grassroots movement involving a diverse coalition of community groups, immigrant rights organizations, unions, consumer advocates, and human rights activists — demanding stronger regulations to protect consumers, workers, and the environment from abusive corporations and to promote living wages, fairer trade, and higher taxes on the very rich to pay for better schools, safer roads, and student loans.  So when we recite the Pledge of Allegiance, we should remind ourselves that it was written by a socialist who believed that “liberty and justice for all” meant more equality and a stronger democracy.

Feel free to repost and circulate. Thanks.

 

Peter

 

——————————————————————

Peter Dreier
Dr. E.P. Clapp Distinguished Professor of Politics
Chair, Urban & Environmental Policy Department
Occidental College
1600 Campus Road
Los Angeles, CA 90041
Phone: (323) 259-2913
FAX: (323) 259-2734
Website: http://employees.oxy.edu/dreier

New book:  The 100 Greatest Americans of the 20th Century: A Social Justice Hall of Fame (Nation Books) — published July 2012

 

“The hottest places in hell are reserved for those who in times of great moral crises maintain their neutrality” – Dante

Blogger Jonathan Pelto reports that Governor Dannell Malloy of Connecticut plans to spend $1 million to a public relations firm to sell the idea of Common Core.

This suggests that he is concerned about the kind of public backlash that was caused by the botched implementation of Common Core in New York.

Connecticut is one of the three highest performing states on NAEP, and parents are not likely to take kindly to the new Common Core tests, which are likely to produce a sharp decline in test scores, as they have in other states. There are quite a lot of “suburban moms” in Connecticut. Lots of moms and dads who will not be easily persuaded that their children are failures. Not by Governor Malloy or Commissioner Stefan Pryor or a public relations firm with a $1 million contract.

Will Bunch, Philadelphia columnist, writes here about American exceptionalism.

Why do we have endless battles over small distractions while ignoring the most glaring problems in our midst?

Why do we have talk show hosts babbling about the latest burp in the culture wars while remaining silent about the stark inequality that blights our country?

Why do we celebrate the “success” of our billionaires instead of changing our tax code to assure liberty and justice for all?

Why do we call schools serving the neediest children “failing schools” instead of recognizing that their low scores are the consequence of massive social neglect and indifference? Why does our Secretary of Education insist on firing their teachers instead of thanking them for their willingness to work in schools that serve the students who struggle the most to live and learn?

Tim Walker moved to Finland with his family. They have moved permanently, as Tim’s wife is Finnish. Tim now teaches fifth grade in Helsinki. He experienced culture shock. Here is what he learned: children need time to refresh, teachers need time to refresh. Both groups take frequent breaks during the day. But that’s not all: read on.

Consider this historical satire. It was written by Paul Horton, who teaches history at the University of Chicago Lab School.

 

A Modest Proposal for the Gang of Four

(Arne Duncan, Bill Gates, Michelle Rhee, Jeb Bush)

Your plan for defeating the yellow dogs of reaction has not been effective. You need to get serious. Because you know very little about the history of revolutionary progress (Mr. Duncan, you were fed the phrase “Potemkin Village” by someone with a reactionary history degree) you need some motivation. If you cannot make this happen within two years, you will not benefit from a future in the Foundation Politburo, you will not be granted a passport, and you will not be allowed to shop in party stores.

 

To continue the Cultural Revolution in Education we need to break the spirit of the reactionary teachers who insist that there might be value in teaching literary and philosophical classics, languages, culture, and what some describe as the “Humanities.” The Humanities are nothing but selfish, evil Bourgeois reaction that slows the creation of “21st Century Skills” acquisition. All else is pretense: we need 21st century workers and we need them ready for community colleges that will feed our factory dormitories with skilled workers.

 

We will achieve the global VAM (value added measurement) threshold in four years. Reactionary teachers all over the world will be pitted against each other and resistance will be crushed.

 

Until then, we need to “Clamp-down” harder (The Clash) to create fear so that the reactionary house of cards will fall very easily.

 

Strategic Plan:

 

Year One: Invite criticism from teacher’s unions and compile a list of members of teacher’s unions.

 

–selectively quote teacher union criticisms of revolutionary reform in revolutionary (corporate) media outlets

 

–target all union members in appearances on major talking heads show segments

 

–create “forums” at major universities, Chambers of Commerce, and civic organizations to explain the voluntary nature of all reform efforts

 

–instruct Red Guard (Teach for America) to receive ideological instruction at Foundation Politburo School

 

–hire Red Guard into the College Board, Pearson Education, Educational Testing Service, state and local superintendent jobs

–elect Red Guard into jobs on state school boards, into state legislatures and senates

 

–cozy Red Guard up to Congressmen and Senators, especially those who sit on Education and Budget Committees

 

–Red Guard will coordinate with ALEC to sponsor “parent trigger legislation” to create more charters and jobs for Red Guard

 

–pay for Red Guard as Education policy staff for all elected officials

 

–pay Red Guard to attack, spit on, and humiliate commenters to reactionary blog posts

 

–hire Red Guard as public and charter school administrators to attack the reactionary yellow dogs who speak of “democratic process,” “progressive education,” and “laboratories for democracy.”

 

–instruct Red Guard administrators to create intentional “hostile workplace” to intimidate reactionary teachers. All union members should see their files thicken and be exposed to frequent “shake-downs.” The older, more depressed teachers should be further intimidated by frequent negative observations and assessments. At assessment conferences, the sentence “we have viewed your e-mail messages over the past five years and we strongly encourage you to resign” should be shared at the end of negative evaluation.

 

–pay Red Guard Administrators a bonus for every experienced teacher who resigns or retires

 

 

Year Two: Learning from the New York Experience

 

–have state superintendents “cut” scores so that only those in impoverished neighborhood schools fail

 

–use “low student attendance” and “overcrowding” to close public schools in underserved areas. This is often a two-step process: close schools for low attendance, then consolidate to create overcrowding to justify opening more charters

 

–use sticks and carrots to coopt local and national political officials

 

–congressmen in suburban districts will be told: “if you go with the program we have campaign funds from potential investors for you, if not, you are political toast.”

 

–corporate leaders will speak often at meetings in well funded suburban districts to gain the support of upper income parents and opinion leaders

 

–have all revolutionary (corporate) media outlets supplied with talking points that repeat “higher standards,” “21st century skills,” “low test scores mean higher standards,” “voluntary,” “state driven,” “charters are innovative,” and “teachers are lazy reactionaries” every day.

 

–block all revolutionary media access to reactionaries

 

–pay for astroturf (disguised Red Guard) protests in favor of new charters at school board and city-council meetings

 

 

Year Three: Reeducation Camp: Rat Islands (The Aleutians)

 

–the Red Guard will be instructed to eliminate all complainers

 

–reactionaries will be deported to work camp

 

–reactionaries will be instructed to respect data and will be forced to write programs for educational video games for “Turn it Up” corporation

 

–Are you a reactionary?

 

 

Think about it!

 

 

The Friendly Foundation Politburo (Comrade Narrow)

David Gamberg, superintendent of schools in both Southold and Greenport, New York, is an educator who cares about the whole child. He knows what matters most. He knows that test scores are not what matter most in the development of a healthy child.

In this post, he describes the music classes in second grade in Southold. He sees the joy that the teachers and students share.

And he can’t help but reflect on teachers and schools and districts that have been hurt by budget cuts; on schools that have lost their teachers of the arts; on teachers who are testing their students–not teaching them to sing or dance–so as to be evaluated themselves.

In this reflection, we are briefly reminded of what education is about and how lost our national and state policymakers are.

Let us all hope they find their way. And if they can’t, let’s hope they listen to David Gamberg and educators like him.

Patrick Hayes is a teacher in Charleston, South Carolina, who is leading the fight to block test-based, value-added evaluations of teachers in that district. As many posts on this blog have iterated and reiterated, most researchers think that VAM is flawed and error-ridden. (Check out Audrey Amrein-Beardsley’s blog VAMboozled and Edward Haertel’s ETS lecture.)

Hayes read about the errors in the Mathematica study of VAM in D.C., and left the following comment:

“This is awful news for DC teachers. Down here in Charleston, it’s the greatest Christmas gift imaginable.

“We’re fighting VAM-based merit pay tooth and nail. Guess who our district hired to do the work?

“Here’s the only question I have: was this what Mathematica had in mind in 2010 when they said that VAM has a 36% error rate?

http://ies.ed.gov/ncee/pubs/20104004/pdf/20104004.pdf

“Is that before or after they foul up the data?

“Tell you what, don’t ask Mathematica. I can tell you from personal experience: they REALLY don’t like talking about that study.

“I know it was before Arne Duncan handed out nearly a billion dollars in grant funding for value-added systems.

“When Mathematica published this, TIF grants were still comparatively small potatoes.

“Funny thing is, Arne’s the one who picked up the tab for that study. His name appears on page 3. Go figure.”

Last Friday, officials at the central office of the District of Columbia Public Schools quietly released the news that the teacher ratings on its highly touted IMPACT system contained errors. It was not clear how many teachers were affected. If you want to bury a policy disaster, the best time to announce it is on a Friday before a long holiday, on the assumption it will be ignored and forgotten.

Researchers have warned for the past three years that grading teachers by the test scores of their students is error-ridden, inaccurate, and unstable. Earlier this year, the distinguished psychometrician Edward Haertel of Stanford warned in a major lecture that value-added scores should not be used as a fixed percentage when evaluating teachers and should have multiple safeguards to avoid error. Did anyone at the U,S. Department of Education or anywhere else take heed? Of course not.

As Valerie Strauss notes in the linked article, this inherently flawed and demoralizing process has been widely accepted (it is a major element of Race to the Top; in addition, states that want waivers from the impossible mandates of NCLB must agree to adopt this procedure, no matter how ill-conceived it is.)

Strauss writes:

“Testing experts have long warned that using test scores to evaluate teachers is a bad idea, and that these formulas are subject to error, but such evaluation has become a central part of modern school reform. In the District, the evaluation of adults in the school system by test scores included everybody in a school building; until this year, that even included custodians. In some places around the country, teachers received evaluations based on test scores of students they never had. (It sounds incredible but it’s true.)”

Only a few weeks ago, Audrey Amrein-Beardsley wrote on her blog that the ratings on the D.C. IMPACT system made no sense.

Now the company that created the rating system has acknowledged the errors.

Let’s see if some enterprising journalist digs into this fiasco.