Archives for category: Teacher Evaluations

With the Obama administration’s latest policy pronouncement, the federal grip on American education grows tighter and stupider every day.

The latest: the administration plans to reward the best teacher-training institutions and drive the “worst” ones out of business. This is like Race to the Top for teacher preparation programs.

What are their measures? Of course, student test scores loom large.

“The goal: To ensure that every state evaluates its teacher education programs by several key metrics, such as how many graduates land teaching jobs, how long they stay in the profession and whether they boost their students’ scores on standardized tests. The administration will then steer financial aid, including nearly $100 million a year in federal grants to aspiring teachers, to those programs that score the highest. The rest, Duncan said, will need to improve or “go out of business.”

Thus, programs that send their graduates to work in urban districts with high-needs students will get low ratings. Duncan will drive them out of business. Smart institutions will steer their graduates to affluent suburbs, where scores will go up regardless of what they do.

The message from the U.S. Department of Education to the nation’s colleges of teacher education:

1. Do not send your graduates to teach struggling students who are likely to get small or no gains on standardized tests, such as students with extreme disabilities and English language learners, as well as gifted students, who are unlikely to post gains because of the ceiling effect.

2. Teach to the test. Drill the students hour after hour. Extend the school day whenever possible so there is more time for test prep.

3. Don’t waste time on non-tested subjects like the arts, history, civics, and science. They don’t count.

4. Invest in Pearson and McGraw-Hill stock.

The evidence is overwhelming that value-added measures for teachers are inaccurate, but neither secretary Duncan nor the White House care about evidence.

As reporter Stephanie Simon points out:

“The formulas for measuring how much “value” a teacher adds to a student’s test scores are complex and often carry a sizable margin of error.

“Earlier this month, the American Statistical Association warned that such formulas must be used with caution because teachers generally account for less than 15 percent — and in some studies, as little as 1 percent — of the variability in student test scores. Value-added models spit out precise-sounding numbers that purport to quantify a teacher’s impact on her students, but in fact the formulas “typically measure correlation, not causation,” the group concluded.

“A recent study funded by the Education Department found that value-added measures may fluctuate significantly due to factors beyond the teachers’ control, including random events such as a dog barking loudly outside a classroom window, distracting students during their standardized test. A 2010 study, also funded by the Education Department, found the models misidentify as many as 50 percent of teachers — pegging them as average when they’re actually better or worse than their peers, or singling them out for praise or condemnation when they’re actually average.

“Yet another challenge: Calculating scores for educators who do not teach subjects or grades assessed with standardized exams. Nationally, some 70 percent of teachers — including most high school and early elementary teachers, plus art, music and physical education teachers — fall into that category.

“Despite such complications, [White House policy director Cecilia] Muñoz made clear in a call with reporters on Thursday that Obama wants student test scores, or other measures of student growth, to figure heavily into states’ evaluations of teacher prep programs.

“This is something the president has a real sense of urgency about,” she said. “What happens in the classroom matters. It doesn’t just matter — it’s the whole ballgame.” So using student outcomes to evaluate teacher preparation programs “is really fundamental to making sure we’re successful,” Muñoz said. “We believe that’s a concept … whose time has come.”

Yes, using student test scores to evaluate teachers, principals, schools, and teacher colleges is “a concept… whose time has come,” despite the fact that there is no evidence for it, despite the fact that the nation’s leading scholarly organizations have warned about its limitations and misuse, despite the fact that it fails to account for factors beyond the teachers” control, and despite the fact that it misidentifies teacher effectiveness at an alarmingly high rate.

Read more: http://www.politico.com/story/2014/04/barack-obama-arne-duncan-teacher-training-education-106013.html#ixzz2zuFEulXw

Randi Weingarten, on behalf of the American Federation of Teachers, sent representatives to the Pearson shareholders’ meeting in London and wrote the following letter to the leaders of the world’s biggest testing corporation. By shrouding the tests in secrecy, Pearson denies information to teachers to help diagnose student needs. The tests become useless by having no diagnostic value. Speculation abounds about hidden “Pineapple” questions and other test errors. If the lives of students and teachers and principals hinge on the tests, the tests must be made public after they are administered. Otherwise, teachers will be fired and students will be failed and schools will be closed without seeing the validity of the instruments of punishment. This is wrong.

For Immediate Release
April 25, 2014

Contact:

Marcus Mrowka
202/531-0689
mmrowka@aft.org

Kate Childs Graham
202/615-2424
kchilds@aft.org

AFT’s Weingarten to Pearson: Lift Gag Order on Testing, Meet with Stakeholders

WASHINGTON— In conjunction with the annual Pearson shareholder meeting in London, AFT President Randi Weingarten today released a letter sent to Pearson executives, board members and shareholders calling on the corporation to remove “gag orders” preventing educators from expressing concerns about Pearson-developed tests and to meet with educators, parents and other stakeholders to address their concerns regarding these tests. Pearson is the largest testing company in the world and derives 57 percent of its profits from the U.S.

Representatives from the AFT are at the shareholder meeting this morning to deliver the letter and discuss the concerns of educators, parents, students and shareholders. The AFT also launched an online action allowing educators, parents and others across the world to make the same demands of Pearson executives and board members.

“Principals and teachers in New York who recently administered the Pearson-developed Common Core tests have said they are barred from speaking about the test content and its effects on students,” wrote Weingarten. “This appears to be a result of a Pearson contract term that has been construed as disallowing them from expressing their concerns and views. …On behalf of teachers, parents, students and your shareholders, including our pension plans, I ask you to immediately remove these prohibitions (referred to as “gag orders” in the press) from existing and future contracts.”

Weingarten continued, “These gag orders and the lack of transparency are fueling the growing distrust and backlash among parents, students and educators in the United States about whether the current testing protocols and testing fixation is in the best interests of children. When parents aren’t allowed to know what is on their children’s tests, and when educators have no voice in how assessments are created and are forbidden from raising legitimate concerns about the quality of these assessments or from talking to parents about these concerns, you not only increase distrust of testing but also deny children the rich learning experience they deserve.”

Weingarten’s full letter to Pearson can be found below.

April 24, 2014

John Fallon
Chief Executive
Pearson PLC
80 Strand
London WC2R ORL
UK
john.fallon@pearson.com

Glen Moreno
Chairman
Pearson PLC
80 Strand
London WC2R ORL
UK
Glen.moreno@pearson.com

Dear Mr. Fallon and Mr. Moreno:

I was deeply disturbed to read recently in the New York Times and other newspapers of the issues teachers, principals, parents and students raised about Pearson tests. Principals and teachers in New York who recently administered the Pearson-developed Common Core tests have said they are barred from speaking about the test content and its effects on students. This appears to be a result of a Pearson contract term that has been construed as disallowing them from expressing their concerns and views. Elizabeth Phillips, the principal at Public School 321 in Brooklyn, N.Y., summarized these concerns in a recent New York Times opinion piece. On behalf of teachers, parents, students and your shareholders, including our pension plans, I ask you to immediately remove these prohibitions (referred to as “gag orders” in the press) from existing and future contracts.

These gag orders and the lack of transparency are fueling the growing distrust and backlash among parents, students and educators in the United States about whether the current testing protocols and testing fixation is in the best interests of children. When parents aren’t allowed to know what is on their children’s tests, and when educators have no voice in how assessments are created and are forbidden from raising legitimate concerns about these assessments’ quality or talking to parents about these concerns, you not only increase distrust of testing but also deny children the rich learning experience they deserve.

Continuing these practices may also have severe financial consequences for your corporation. Growing mistrust and concerns by parents, teachers and others over the asserted lack of transparency at InBloom appears to have been a driving factor in the company’s recent decision to end operations.

This is the third consecutive year that Pearson’s standardized tests have led to headline risk and reputational damage to the company. We’re concerned that Pearson is using gag orders to cover up-rather than address-problems with its standardized tests. If Pearson is going to remain competitive in the educational support and testing business, the company must listen to and respond to the concerns of educators like Elizabeth Phillips who report that the company has ignored extensive feedback.

Parents, students and teachers need assessments that accurately measure student performance through questions that are grade-appropriate and aligned with state standards-especially since standardized tests have increasingly life-altering consequences for students and teachers. By including gag orders in contracts, Pearson is silencing the very stakeholders the company needs to engage with. Poll after poll makes clear that parents overwhelmingly trust educators over all others to do what is best for their children; educators’ voices, concerns and input should be included in the creation and application of these assessments.

We intend to bring these concerns to the attention of senior management, the board and other shareholders during your annual meeting on Friday, April 25. We also are asking that you meet as soon as practical with stakeholders to discuss a comprehensive response to their concerns and to this serious threat to the company’s reputation, brand and share price. If you have representatives in the United States who meet with potential customers routinely to sell Pearson products, we believe you also can meet with stakeholders.

We look forward to your reply. Pearson must move quickly to address a serious and emerging threat to its brand, business model and ability to generate long-term value for shareholders.

Sincerelv.

Randi Weingarten
President

Washington State thoughtfully rejected Arne Duncan’s threat to cancel its waiver from the absurd demands of No Child Left Behind. The decision to say no to federal demands and intimidation was bipartisan.

The Legislature refused to bend to Duncan’s insistence that the state adopt test-based evaluation, which has consistently failed across the nation and has been declared inaccurate by the nation’s leading scholarly organizations.

The Washington State legislature understands federalism. Secretary Duncan does not. He thinks he is charge of the nation’s schools–every one f them. As someone who spent eight years running the Chicago public school system, one of the nation’s lowest-performing, he should have earned humility. Unfortunately, he enjoys a sense of certainty that is astonishing, almost as astonishing as his indifference to research and evidence.

The sense of the Washington State legislature was succinctly expressed by Chris Rekydal, a Democrat.

Unlike Duncan, Rekydal understands that the Tenth Amendment to the Constitution leaves education policy to states and localities.

He said in a statement:

“As a legislator who voted for our state’s robust home-grown teacher-principal evaluation system and one of the authors of our state’s new rigorous 24-credit graduation framework, I am disappointed in the federal government’s decision to repeal our waiver.

“This is a tremendous moment in our nation’s history where a state that strongly supported the President in 2008 and again in 2012 soundly rejected the federal government’s demands to structure our teacher-principal evaluation system to the specific criteria established by the U.S. Dept. of Education.

“My message to President Obama and Secretary Duncan is that Washington State is committed to education reform that is collaborative, bipartisan, and focused on student success and teacher growth. Our legislative decision to reject the federal government’s demands was done with substantial deliberation and a deep respect for state and local control.

“The bipartisan rejection of this federal government demand during the 2014 legislative session is a strong and unifying message that our state fully embraces our constitutional 10th Amendment guarantee to develop, fund, and administer our state’s education system as the citizens of the state of Washington and their elected representatives determine, not as federal officials deem it appropriate.

“Washington State has one of the leading K-12 systems in the United States. With 89% of our adult population having earned a high school diploma or greater, we are a national leader in student success, employment growth, and earnings.

“I strongly encourage federal officials to use this moment in history to model Washington State’s success instead of using us as an example of federal government power and leverage. I challenge the federal government to turn a corner on education reform, fix the deeply-flawed and failed No Child Left Behind Act, and get back to empowering the states instead of coercing them.

“No Child Left Behind is a failed policy of the Bush administration that focuses on student failure and school punishment. This is no way to run a public education system. Enacting bad policy at the state level as a result of bad policy at the federal level will not help schools – and certainly won’t help students – be successful.”

In a stunning reversal,the Tennessee Legislature overwhelmingly repealed a law to evaluate teachers by test scores, and the law was swiftly signed by Governor Haslam. On a day when Arne Duncan withdrew Washington State’s failure to enact test-based teacher valuation system, this is a remarkable turn of events.

Joey Garrison of The Tennessean reports:

“Gov. Bill Haslam has signed into law a bill that will prevent student growth on tests from being used to revoke or not renew a teacher’s license — undoing a controversial education policy his administration had advanced just last summer.

“The governor’s signature, which came Tuesday, follows the Tennessee General Assembly’s overwhelming approval this month of House Bill 1375 / Senate Bill 2240, sponsored by Republicans Rep. John Forgety and Sen. Jim Tracy, which cleared the House by a unanimous 88-0 vote and the Senate by a 26-6 vote.

“That marked a major repudiation of a policy the Tennessee Board of Education in August adopted — at Education Commissioner Kevin Huffman’s recommendation — that would have linked license renewal and advancement to a teacher’s composite evaluation score as well as data collected from the Tennessee Value-Added Assessment System, which measures the learning gains of students.

“The bill to reject the policy had been pushed chiefly by the Tennessee Education Association, the state’s largest teachers’ organization, which engineered a petition drive to encourage Haslam to sign the legislation despite it passing with large bipartisan support.

“Huge, huge win for teachers,” the TEA wrote on its Twitter page, thanking both bill sponsors as well as Haslam for “treating teachers as professionals.”

“Eyeing a 2015 implementation, the state board in January had agreed to back down from using student learning gains as the sole and overriding reason to revoke a license. Composite evaluation scores, in which 35 percent is influenced by value-added data, were to centerpiece.”

********************
Two interesting points here: one, Duncan has been hailing Tennessee as a demonstration of the “success” of Race to the Top, in which test-based evaluation of teachers is key. What happens now?

Second, state Commissioner Kevin Huffman is so unpopular that anything he supports is likely to be rejected. His enemies hope he doesn’t leave Tennessee because whatever he recommends generates opposition, even among his allies.

 

Subject: POLITICO Breaking News

The Education Department is pulling Washington state’s No Child Left Behind waiver because the state has not met the department’s timeline for tying teacher evaluations to student performance metrics.

Washington is the first state to lose its waiver. The loss will give local districts less flexibility in using federal funds. For instance, they may now be required to spend millions on private tutoring services for at-risk students. The waiver revocation could also result in nearly every school across the state being labeled as failing under NCLB.

Washington had pledged in its waiver application to make student growth a significant factor in teacher and principal evaluations by the 2014-15 school year. But the state Legislature refused to pass a bill mandating that student performance on statewide assessments be included in teacher evaluations. The department placed the state on “high-risk” status in August. Arizona, Kansas and Oregon are also at risk of losing their waivers.

For more information… http://www.politico.com

 

Secretary of Education Arne Duncan handed out numerous waivers to states to avoid the 2014 deadline in the No Child Left Behind law.

Under the law, every state must assure that every single child in grades 3-8 is proficient on state tests of reading and mathematics.

No state met the deadline. If the law remains in effect (it was supposed to be reauthorized in 2007, but gets extended year after year), every state would be declared a failed state, and virtually every public school in the United States would be closed or privatized or suffer some other sanction for failing to meet an impossible goal. It bears pointing out that no nation in the world can claim that 100% of its students are proficient in reading and math.

But Duncan didn’t hand out waivers wholesale. Instead, he made the waiver conditional on the state agreeing to accept his conditions, which were similar to the conditions in Race to the Top. In effect, states are now following Race to the Top requirements but without the prize money.

One of the central conditions of the waiver, like Race to the Top, was that states must agree to evaluate their teachers and principals based to a significant degree on the test scores of their students.

Washington State has failed to create such a system. Today Arne Duncan withdrew Washington State’s NCLB waiver to punish it for failing to do as he demanded.

Perhaps legislators in Washington State noticed that this method of evaluating teachers and principals has failed wherever it was tried.

Perhaps they read the joint report of the National Academy of Education and the American Educational Research Association, which cautioned that “value-added measurement” was inaccurate and unstable, and that it measures who is in the classroom rather than teacher quality. The legislators probably did not have a chance to read the recent report of the American Statistical Association, which also cautioned on the use of VAM, because of its imprecision and its unintended effects. But they may have read Stanford Professor Edward Haertel’s advice that states should not set numerical percentages for the use of test scores to evaluate teachers. All of these reports reach the same conclusion: that Duncan’s favorite solution to raising teacher quality does not have evidence to support it.

Let’s hope that Washington State says no to the illegitimate demands of the Secretary of Education. Duncan is overreaching. He is not the nation’s superintendent of schools. He should learn about federalism and about the limited role of the federal government in the area of education.

Meanwhile, I hope that the state of Washington sues the Secretary of Education and helps him learn about federalism and about the importance of evidence in policymaking.

Here is Duncan’s official letter to Washington State, notifying them that they are being punished for defying his orders.

Here is Peter Greene’s deconstruction of Arne Duncan’s letter to Washington State: read here.

Laura H. Chapman left the following comment. The word “desperate” to describe this quest for a scientific, data-based means of judging teachers is mine. Something about it smacks of anti-intellectualism, the kind of busywork exercise that an engineer would design, especially if he had never taught K-12. This is the sort of made-up activity that steals time from teaching and ultimately consumes a lot of time with minimal rewards.

Chapman writes:

Please give at least equal attention to the 70% of teachers who have job assignments without VAMs (no state-wide tests). For this majority, USDE promotes Student Learning Objectives (SLOs) or Student Growth Objectives (SGOs), a version of 1950s management-by-objectives on steroids.

Teachers who have job-alike assignments fill in a template to describe an extended unit or course they will teach. A trained evaluator rates the SLO/SGO (e.g. “high quality” to “unacceptable” or “incomplete”).

The template requires the teacher to meet about 25 criteria, including a prediction of the pre-test to post-test gains in test scores of their students on an approved district-wide test. Districts may specify a minimum threshold for these gains.

Teachers use the same template to enter the pre-and post-test scores. An algorithm determines if the gain meets the district threshold for expectations, then stack ranks teachers as average, above or below average, or exceeding expectations.

1. The Denver SLO/SGO template is used in many states. This example is for art teachers—-Denver Public Schools. (2013). Welcome to student growth objectives: New rubrics with ratings. http://sgoinfo.dpsk12.org/
2. One of the first attempts to justify the use of SLOs/SGOs for RttT—-Southwest Comprehensive Center at WestEd (n.d.). Measuring student growth in non-tested grades and subjects: A primer. Phoenix, AZ: Author. http://nassauboces.org/cms/lib5/NY18000988/Centricity/Domain/156/NTS__PRIMER_FINAL.pdf

3. This USDE review shows that SLOs/SGOs have no solid research to support their use—-Gill, B., Bruch, J., & Booker, K. (2013). Using alternative student growth measures for evaluating teacher performance: What the literature says. (REL 2013–002). Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Mid-Atlantic. http://ies.ed.gov/ncee/edlabs.

4. The USDE marketing program on behalf of SLOs/SGOs—-Reform Support Network. (2012, December). A quality control toolkit for student learning objectives. http://www2.ed.gov/about/inits/ed/implementation-support-unit/tech-assist/slo-toolkit.pd

5. The USDE marketing campaign for RttT teacher evaluation and need for district “communication SWAT teams” (p. 9) —- Reform Support Network. (2012, December). Engaging educators, Toward a New grammar and framework for educator engagement. Author. http://www2.ed.gov/about/inits/ed/implementation-support-unit/tech-assist/engaging-educators.pdf

6. Current uses of SLOs/SGOs by state—-Lacireno-Paquet, N., Morgan, C., & Mello, D. (2014). How states use student learning objectives in teacher evaluation systems: a review of state websites. Washington, DC: US Department of Education, Institute of Education Sciences. http://ies.ed.gov/ncee/edlabs/regions/northeast/pdf/REL_2014013.pdf

7. Flaws in the concepts of “grade-level expectation” and “a year’s worth of growth” —-Ligon, G. D. (2009). The optimal reference guide: Performing on grade level and making a year’s growth: Muddled definitions and expectations, growth model series, Part III. Austin, TX: ESP Solutions http://www.espsolutionsgroup.com/espweb/assets/files/ESP_Performing_on_Grade_Level_ORG.pdf

Colorado has one of the most punitive teacher evaluation systems in the nation, passed in 2010. It was written by State Senator Michael Johnston, ex-TFA. Contrary to the conclusions of the American Statistical Association, the American Educational Research Association, and eminent researchers such as Linda Darling-Hammond and Edward Haertel of Stanford, Colorado’s SB 191 bases 50% of teachers’ evaluation on student test scores. This creates tremendous pressure to narrow the curriculum only to what is tested and to teach to the test. Senator Johnston vainly insisted that his legislation would produce “great teachers” and “great schools.”

Pauline Hawkins, a teacher in Colorado, explains here why she is resigning as a teacher in Colorado. The environment she leaves with regret was created by George W. Bush, Arne Duncan, and Michael Johnston.

Hawkins writes:

Dear Administrators, Superintendent, et al.:

This is my official resignation letter from my English teaching position.

I’m sad to be leaving a place that has meant so much to me. This was my first teaching job. For eleven years I taught in these classrooms, I walked these halls, and I befriended colleagues, students, and parents alike. This school became part of my family, and I will be forever connected to this community for that reason.

I am grateful for having had the opportunity to serve my community as a teacher. I met the most incredible people here. I am forever changed by my brilliant and compassionate colleagues and the incredible students I’ve had the pleasure of teaching.

I know I have made a difference in the lives of my students, just as they have irrevocably changed mine. Teaching is the most rewarding job I have ever had. That is why I am sad to leave the profession I love.

Even though I am primarily leaving to be closer to my family, if my family were in Colorado, I would not be able to continue teaching here. As a newly single mom, I cannot live in this community on the salary I make as a teacher. With the effects of the pay freeze still lingering and Colorado having one of the lowest yearly teaching salaries in the nation, it has become financially impossible for me to teach in this state.

Along with the salary issue, ethically, I can no longer work in an educational system that is spiraling downwards while it purports to improve the education of our children.

I began my career just as No Child Left Behind (NCLB) was gaining momentum. The difference between my students then and now is unmistakable. Regardless of grades or test scores, my students from five to eleven years ago still had a sense of pride in whom they were and a self-confidence in whom they would become someday. Sadly, that type of student is rare now. Every year I have seen a decline in student morale; every year I have more and more wounded students sitting in my classroom, more and more students participating in self-harm and bullying. These children are lost and in pain.

It is no coincidence that the students I have now coincide with the NCLB movement twelve years ago–and it’s only getting worse with the new legislation around Race to the Top.

I have sweet, incredible, intelligent children sitting in my classroom who are giving up on their lives already. They feel that they only have failure in their futures because they’ve been told they aren’t good enough by a standardized test; they’ve been told that they can’t be successful because they aren’t jumping through the right hoops on their educational paths. I have spent so much time trying to reverse those thoughts, trying to help them see that education is not punitive; education is the only way they can improve their lives. But the truth is, the current educational system is punishing them for their inadequacies, rather than helping them discover their unique talents; our educational system is failing our children because it is not meeting their needs.

I can no longer be a part of a system that continues to do the exact opposite of what I am supposed to do as a teacher–I am supposed to help them think for themselves, help them find solutions to problems, help them become productive members of society. Instead, the emphasis on Common Core Standards and high-stakes testing is creating a teach-to-the-test mentality for our teachers and stress and anxiety for our students. Students have increasingly become hesitant to think for themselves because they have been programmed to believe that there is one right answer that they may or may not have been given yet. That is what school has become: A place where teachers must give students “right” answers, so students can prove (on tests riddled with problems, by the way) that teachers have taught students what the standards have deemed are a proper education.

As unique as my personal situation might be, I know I am not the only teacher feeling this way. Instead of weeding out the “bad” teachers, this evaluation system will continue to frustrate the teachers who are doing everything they can to ensure their students are graduating with the skills necessary to become civic minded individuals. We feel defeated and helpless: If we speak out, we are reprimanded for not being team players; if we do as we are told, we are supporting a broken system.

Since I’ve worked here, we have always asked the question of every situation: “Is this good for kids?” My answer to this new legislation is, “No. This is absolutely not good for kids.” I cannot stand by and watch this happen to our precious children–our future. The irony is I cannot fight for their rights while I am working in the system. Therefore, I will not apply for another teaching job anywhere in this country while our government continues to ruin public education. Instead, I will do my best to be an advocate for change. I will continue to fight for our children’s rights for a free and proper education because their very lives depend upon it.

My final plea as a district employee is that the principals and superintendent ask themselves the same questions I have asked myself: “Is this good for kids? Is the state money being spent wisely to keep and attract good teachers? Can the district do a better job of advocating for our children and become leaders in this educational system rather than followers?” With my resignation, I hope to inspire change in the district I have come to love. As Benjamin Franklin once said: “All mankind is divided into three classes: Those that are immovable, those that are movable, and those that move.” I want to be someone who moves and makes things happen. Which one do you want to be?

Sincerely,

Pauline Hawkins

A few days ago, I published a post about a paper by Kirabo Jackson, explaining that the non-cognitive effects of teachers are often more important than the test scores of their students.

 

As it happened, mathematician Robert Berkman read the paper and explains here why it is another nail in the coffin of value-added measures, which judge teacher quality by the rise or fall of student test scores.

 

Berkman writes:

 

In this post, I’m going to examine one of the studies that no doubt had a profound impact on the members of AMSTAT that led them to this radical (but self-evident) conclusion. In 2012, the researcher C. Kirabo Jackson at Northwestern University published a “working paper” for the National Bureau of Economic Research, a private, nonprofit, nonpartisan research organization dedicated to promoting a greater understanding of how the economy works (I’m quoting here from their website.) The paper, entitled “Non-Cognitive Ability, Test Scores, and Teacher Quality: Evidence from 9th Grade Teachers in North Carolina” questions the legitimacy of evaluating a teacher based on his/her students’ test scores. Actually, it is less about “questioning” and more about “decimating” and “annihilating” the practice of VAM.

 

He adds:

 

What should be noted is that Jackson is not an educational researcher, per se. Jackson was trained in economics at Harvard and Yale and is an Associate Professor of Human Development and Social Policy. His interest is in optimizing measurement systems, not taking positions on either side of the standardized testing debate. Although this paper should reek with indignation and anger, it makes it’s case using almost understated tone and is filled with careful phrasing like “more than half of teachers who would improve long run outcomes may not be identified using test scores alone,” and “one might worry that test-based accountability may induce teachers to divert effort away from improving students’ non-cognitive skills in order to improve test scores.”

But lets get to the meat of the matter, because this paper is 42 pages long and incorporates mind-boggling statistical techniques that account for every variable one might want to filter out to answer the question: are test scores enough to judge the effectiveness of a teacher? Jackson’s unequivocal conclusion: no, not even remotely.

 

The only puzzle is why Arne Duncan keeps shoving VAM down the throats of states and school districts.

 

 

PS: Berkman added his credentials in a comment:

“I’m a math teacher who has worked with pre-K through college aged students for 30 years. My degrees are in Urban Studies, and Elementary Math Education. I have also done extensive work in neuroscience and numeracy, as well as technology and education, not to mention cognitive science.”
 

 

 

Paul Thomas follows Anthony Cody’s previously cited post by describing the unrelenting attack on teachers, which has intensified with the use of statistically inappropriate measures.

He writes:

“As Cody notes above, however, simultaneously political leaders, the media, and the public claim that teachers are the most valuable part of any student’s learning (a factually untrue claim), but that high-poverty and minority students can be taught by those without any degree or experience in education (Teach for America) and that career teachers no longer deserve their profession—no tenure, no professional wages, no autonomy, no voice in what or how they teach.

And while the media and political leaders maintain these contradictory narratives and support these contradictory policies, value-added methods (VAM) of evaluating and compensating U.S. public teachers are being adopted, again simultaneously, as the research base repeatedly reveals that VAM is yet another flawed use of high-stake accountability and testing.”

Thomas cites review after review to demonstrate that VAM is inaccurate and deeply flawed. Yet the evidence is ignored and VAM is being used as a political weapon by the odd bedfellows of the Obama administration and rightwing governors as well as some Democratic governors, like Andrew Cuomo of New York and Dannell Malloy of Connecticut, to attack teachers. President Obama made a point of praising the Chetty study in his 2012 State of the Union address, not waiting for the many reviews that showed the error of measuring teacher quality by test scores.

Thomas writes:

“The rhetoric about valuing teachers rings hollow more and more as teaching continues to be dismantled and teachers continue to be devalued by misguided commitments to VAM and other efforts to reduce teaching to a service industry.

“VAM as reform policy, like NCLB, is sham-science being used to serve a corporate need for cheap and interchangeable labor. VAM, ironically, proves that evidence does not matter in education policy.”

Sara Stevenson, librarian at O. Henry Middle School in Austin, published an article in the Austin American-Statesman, written as a warning to Texas Education Commissioner Michael Williams. The article appeared on April 11, amd it is behind a paywall is I have no link.

Stevenson did an excellent job of reviewing the research literature on value-added measurement and warned Commissioner Williams that VAM is neither accurate nor stable. Further it is very demoralizing to teachers to be publicly shamed by these ratings. She mentions the suicide of Roberto Riguelas, a teacher in Los Angeles who committed suicide only days after his rating was published by the Los Angeles Times.

She writes:

“Texas Education Commissioner Michael Williams is tasked with crafting a plan to tie teacher evaluations to STAAR test scores. The Obama administration requires states receiving waivers from this year’s impossible 100 percent passing rate on Bush’s No Child Left Behind law to incorporate student test scores as part of the state teacher evaluation formula. Williams should just say no.

“First of all, value-added measurement, or VAM, is junk science. It has been debunked in multiple studies. Researchers with the RAND Corp. concluded that there were so many cases of error and bias in the formulations that they reject using VAM for high-stakes decisions. Stanford professor Edward Haertel also warns against using these unstable measures for high-stakes purposes. Furthermore, a Vanderbilt study concludes that tying teacher evaluations to VAM undermined professionalism and demoralized teachers.”

And she concludes:

“Student success in school is multi-determined. For instance, the most important factor is socioeconomic status. This is not to say poor kids can’t learn. It’s just something researchers have proven over and over again. Therefore, you could, theoretically, take the worst teacher at Hill Country Middle School in the Eanes school district, where 2 percent of students qualify for free or reduced lunch, and her students would score higher than students of the most dedicated, selfless teacher at Pearce Middle School in East Austin, a school made up of more than 95 percent of students who qualify for free or reduced lunch.

“Considering both research and common sense, it would be harmful for Texas to tie teacher evaluation to student test scores. Imposing these criteria on Texas teachers will force the best to flee and find other means of employment. Who will risk his career to teach our neediest students? This trend will not bode well for our youngest citizens, who will determine our future.

“Texas legislators need to say no to the VAM bandwagon.”