Archives for category: Teacher Evaluations

In this thoughtful article, Charles Taylor Kerchner of Claremont Graduate University explains that Michelle Rhee’s belief in using test scores to reward and punish teachers is guaranteed to produce adverse consequences like cheating.

Her reliance on test scores plus her “fear-based management style” is the Achilles’ heel of reform policy, he says.

“This is the lesson of organizational history, not an isolated “bad judgment” aberration. It’s about more than school test scores in the District of Columbia, Atlanta, Texas or even Rhee’s possibly outsized claims of how well her students did during the three years she taught school in Baltimore. The policies Rhee endorses create bad incentives. Bad incentives lead to disastrous results. They certainly played a part in the largest business collapses in recent history: Enron, WorldCom, Lehman Brothers and the collapse of the subprime mortgage market.”

There is a way to build better schools: “What motivates teachers most? Student success: If an organizational system of curriculum, pedagogy, professional training and school organization helps students experience success, then teachers are highly motivated. Teachers are motivated by being part of a winning team, a school that does well at its own mission, which most often is not test score maximization. Teachers are motivated by being part of an occupation that is honored and trusted. These are the lessons from a century of study.”

This is worth reading and pondering.

You think it can’t happen here?

You think your state is immune?

Read about the war on public education in Texas and think again.

Some part of this radical agenda is being promoted in almost every state.

Yours too.

This comment was written by Bonnie Lesley of “Texas Kids Can’t Wait”:

“I worry a lot whether public schools will continue to exist in some states. Our organization, Texas Kids Cant Wait, has felt overwhelmed at times this legislative session about the sheer number of privatization bills, all either sponsored by Sen. Dan Patrick or by someone close to him. We have been battling a big charter (what is in reality the gateway drug to privatization) expansion bill, a parent-trigger bill, opportunity scholarships, taxpayer savings grants, achievement district, “FamiliesFirstSchools”, home-rule districts, vouchers for kids with disabilities, online course expansion, numerous bills to close public schools and turn them over to private charter companies, and on and on. A friend said it is as if they threw a whole bowl full of spaghetti at the wall, believing something would stick.

Every one of the ALEC bills we have seen introduced in other states has been introduced in Texas this year.

The privatizers have also held hostage the very popular bills such as HB 5 to reduce testing significantly unless their privatization bills advanced, and advance they have. So lots of folks are playing poker with kids’s lives and futures.

What keeps many of us fighting 20 hours a day and digging into our own pockets to fund the work is our understanding that these bills are not the end game. We’ve read the web sites, beginning with Milton Freidman’s epistle on the Cato Institute’s website, that lay out the insidious plan we are seeing played out. We have also read Naomi Klein’s brilliant book, Shock Doctrine.

First, impose ridiculous standards and assessments on every school.

Second, create cut points on the assessments to guarantee high rates of failure. (I was in the room when it was done in the State of Delaware, protesting all the way, but losing).

Third, implement draconian accountability systems designed to close as many schools as possible. Then W took the plan national with NCLB.

Fourth, use the accountability system to undermine the credibility and trust that almost everyone gave to public schools. increase the difficulty of reaching goals annually.

Fifth, de-professionalize educators with alternative certification, merit pay, evaluations tied to test scores, scripted curriculum, attacks on professional organizations, phony research that tries to make the case that credentials and experience don’t matter, etc.

Sixth, start privatization with public funded charters with a promise that they will be laboratories of innovation. Many of us fell for that falsehood. Apply pressure each legislative session to implement more and more of them. Then Arne Duncan did so on steroids.

Seventh, use Madison Avenue messaging to name bills to further trick people into acceptance, if not support, of every conceivable voucher scheme. The big push now as states implement Freidman austerity budgets to create a crisis is to portray vouchers as a cheaper way to “save” schools. The bills that would force local boards to sell off publicly owned facilities for $1 each is also part of the overall scheme not only to destroy our schools, but also to make it fiscally impossible for us to recover them if we ever again elect a sane government. Too, districts had to make cuts in their budgets in precisely the areas that research says matter most: quality teachers, preschool, small classes, interventions for struggling students, and rigorous expectations and curriculum. See our report: http://www.equitycenter.org. Click on book, Money STILL Matters in bottom right corner.

Eighth, totally destroy public education with so-called universal vouchers. They have literally already published the handbook. You can find it numerous places on the web.

Ninth, start eliminating the vouchers and charters, little by little.

And, tenth, totally eliminate the costs of education from local, state, and national budgets, thereby providing another huge transfer of wealth through huge tax cuts to the already-billionaire class.

And then only the wealthy will have schools for their kids.

Aw, you may say. They can’t do that! My response is that yes, they most certainly will unless you and I stop it!”

In this video of 23 minutes, you will get a synopsis of why value-added modeling doesn’t work.

The video is a preview of a collection of research papers that will be available online in a few months, and published in 2014 by Teachers College Press in 2014.

The more we learn about the real consequences of VAM, the more we understand that it has perverse consequences.

We know already that it puts too much emphasis on test scores, and we saw what that produced in Atlanta, DC, El Paso, and other districts.

We know it narrows the curriculum, as only the tested subjects count.

We know it encourages teaching to the test.

We know that it is unstable and unreliable.

We know that good teachers may get low ratings because they teach kids who have high needs.

We know that the composition of the class has a greater effect on the teacher’s rating than the teacher’s “quality.”

We know that the test scores are affected by many factors, not just what the teacher does.

When the papers are available, I will post a link.

I usually agree with Matt Di Carlo. He is one smart guy.

But not always.

That’s okay. Friends can disagree and still be friends (I proved that by blogging with Deborah Meier for five years).

I think that value-added methods of using test scores to rate teacher quality are “junk science.”

Matt disagrees

Now, granted, I am but a historian, not a social scientist, but I do read lots of social science. I noted that the National Academy of Education and AERA held a briefing on Capitol Hill and issued a joint statement warning about the pitfalls of VAM. Here is a salient point from their report: “With respect to value-added measures of student achievement tied to individual teachers, current research suggests that high-stakes, individual-level decisions, or comparisons across highly dissimilar schools or student populations, should be avoided.”

Edmund Gordon, one of our nation’s most eminent psychologists, recently led a commission to study assessment practices. He concluded that the overemphasis and misuse of standardized testing to hold students, teachers, and schools accountable is not only ineffective but “immoral.”

I would say that “immoral” is an even stronger condemnation than “junk science.”

Campbell’s Law suggests that the use of high-stakes testing degrades education. Threatening to fire teachers if their students’ scores don’t go up does not produce better education. It produces worse education. It promotes narrowing of the curriculum. It promotes cheating. It encourages teachers and schools to avoid the neediest students.

Teaching is so much more than test scores. To think that teachers may be defined significantly by the rise or fall of the test scores of their students requires a belief in the intrinsic value of standardized tests that I do not share. We may learn something from wide assessments with no-stakes, like NAEP. But using these flawed instruments to fire teachers and close schools is–in my judgment–wrong. They were not designed for those purposes. And the first rule of psychometrics is that tests should be used only for the purpose for which they were designed.

All things considered, the term “junk science” seems appropriate, as does Dr. Gordon’s phrase: ineffective and immoral.

One reason parents flee public schools, if they can afford it, is to escape the dead hand of testing that now strangles learning. The sooner we can put testing in its place as a diagnostic tool for teachers to assess what they have taught (not as a Pearson-designed 14-hour ordeal), the sooner we will restore the rightful purposes of education and the dignity of the teaching profession.

My, how things change in only one year.

Last year, Governor Jindal rushed through his legislation to strip teachers of tenure, base 40% of their evaluation on test scores, make all teachers at-will employees, subject to dismissal with one bad rating, and everything else that Jindal and White could dream up to make it hard on teachers.

When challenged in court, the law was declared unconstitutional because it covered too many subjects.

So the governor returned to the Legislature seeking to revive his punitive evaluation system. The Legislature voted unanimously to delay its punitive effects, despite the protestations of Jindal and White. They wanted to start the firings ASAP. The legislators said wait.

Maybe they started wondering who would want to teach in the state’s schools.

Or they noticed Jindal’s sagging poll numbers.

Carol Corbett Burris has been one of the leaders of the battle against the Néw York State educator evaluation system, which was developed after the state won a Race to the Top grant of $700 million. Burris helped created the principals’ rebellion against test-based evaluations of teachers and principals.

She also was recently selected by her peers as New York’s Principal of the Year. She is principal of South Side High School in Rockville Center.

Here Carol explains why she is disappointed by Teachers College’s decision to honor the Chancellor of the Board of Regents, whose policies Carol and her colleagues oppose.

I quoted TC’s press release earlier today, in which it saluted Merryl Tisch for her leadership in tying teacher evaluation to test scores. It applauded more for her support for judging education schools by the test scores of the students of their graduates. To ice the cake, the press release heralded Tisch’s willingness to permit museums and other non-traditional institutions to grant masters’ degrees. Odd that TC would like that.

But I mention the press release because I have heard that the press office is revising it to remove any reference to the state’s zealous devotion to standardized testing. It may have disappeared by now.

Carol Burris writes:

“As a proud TC grad, I am saddened. It appears to be one more more betrayal of the progressive ideals on which the college was founded. The fact that the press release hails her work in evaluating teachers by test scores (opposed by most TC scholars) and data that ties schools of education to public school results, confounds me. What does TC stand for? I guess in the future we can expect TC student teachers to be placed in Scarsdale so that the school gets good ratings. Which of the following statements make her worthy of the award?

–M Tisch saying that if educators are not prepared for CCSS they are –”living under a rock”
http://www.edweek.org/ew/articles/2013/03/27/26newyork_ep.h32.html

–M Tisch saying in NYT that now that teachers are evaluated under APPR, the public will not dislike them so much

–M Tisch donates 1 million, along with Bill Gates and charter schools, to fund the Fellows who have pushed the corporate agenda and test score evaluation policies.
http://www.cityandstateny.com/cash-flow/

I feel most sorry for the idealistic young teachers who worked hard for their degrees. They understand what is happening.”

A comment on the post about “Zombie Education Policies”:

Having spent years in business, I cringe at blindly applying business models to education. 360 evaluation is a business fad that will join MBOs and matrix management. I tried student evaluations. Students are usually upset over not getting a certain grade on the most recent test, angry over a detention, or at the other extreme, like the teacher and don’t want to say anything negative. I eavesdropped on two of my high school students evaluating their teachers and a “good” teacher had more to do with being lenient, funny, and good looking. It took me years to later appreciate my good teachers – not at the time the most popular. Most parents mean well, but often have only glimpses of the classroom from their child’s perspective. Often the truth is difficult and not always well received. Peers are OK, but not all peers are objective or can separate politics. Administrators may not have spent enough years in a math or language arts classroom – perhaps moving up through phys ed – to understand content and delivery. Third party evaluations are too disconnected and have conflicts of interest.

So a better solution? First, and this principle is also overlooked in business, IF IT AIN’T BROKE, DON’T FIX IT. Not all schools are failing, and then, not all for the same reason. Blanket, scorched earth solutions never work and just replace one set of problems with another. Improving upon what exists takes skill and savvy. Second, if you want to know what makes a good teacher, ask a good teacher. We all know who they are. Mentoring is by far the best system with centuries of success. Make it work. Third, start listening to teachers, not politicians, billionaires, and opportunists. The latter have other interests. Teachers, in contrast to the constant demonizing, are in the classroom everyday and want their students to learn.

The best approach to education is there is no single approach to education. Students are individuals and human. Not data points in a multi-level statistical model. Teachers know this. Will anybody else listen?

Louise Marr sent this from her book:

**********£*******
“Every spring, the Philadelphia public school students take the standardized tests, or PSSAs. (Starting in 2013, the district has switched to a different test called the Keystone Exams.) These tests are a huge part of how schools are evaluated and rated. It is from these scores that Annual Yearly Progress (AYP) is determined. There is a big push to prepare the eleventh graders for the tests from the beginning of the year to test day, usually after the first of the year. This particular year at Vaux, the students took the test over a course of several days. They were divided into several different classrooms for three to four hours in the morning, with two teacher proctors per room. All eleventh graders take the test, even the SPED students. Schools across the country take statewide tests very seriously, because of the implications that they present. In the five high schools where I have taught, there has been a common atmosphere at test time: the school is quiet and rules must be strictly enforced. In the classroom that I proctored at Vaux, it was sometimes a challenge to maintain the serious atmosphere.

There were five students in the room I proctored. Four were SPED students. One was MMR, and read at first grade level. He was given the same test. After a few minutes, he put his head down, because he did not understand the reading. Teachers are not allowed to help, only to say, “Do the best you can.” He didn’t even bother to ask.

Takierrah and Courtney were working on their tests, until Courtney looked up and caught Takierrah looking at her.

“Stop looking at me!”

“You’re ugly, I will f*** you up.” “I can’t stand your black ass.” “You’re black too!”

“No, I’m light-skinned.”

“You’re still ugly.”

“I’m cuter than you.”

“Get outta my face.”

“I’m not in your face, because if I was, I would f*** you up.”

They did manage to settle down without a physical confrontation,
but this scene made a huge impression on me. These tests would be used to evaluate the progress of our school. They were obviously way above the comprehension level of the Special Education students, yet the students were not given any accommodations at all. When I asked an administrator about this, she just shrugged, “That’s just the way it is.”

From the book, “Passed On: Public School Children in Failing American Schools”
by Louise Marr. Chapter 3: No Longer a Special Education

This thoughtful and provocative essay by Shawn Gude situates present-day corporate reform in its historical context. Gude shows the connections between early 20th century social efficiency and the present-day demand for testing, standardizing, and data-based decision-making.

Here is an excerpt:

“There’s a special resemblance between the struggles against scientific management, or Taylorism, and today’s teacher resistance to corporate reform schemes. Just as factory workers fought top-down dictates, deskilling, and the installation of anemic work processes, so too are teachers trying to prevent the undemocratic implementation of high-stakes testing and merit pay, assaults on professionalism, and the dumbing down and narrowing of curricula.

“There are more obvious parallels: Proponents of scientific management counted some prominent progressives in their ranks, just like the contemporary left-neoliberals hawking education reform. The nostrums of both Taylorism and the education accountability movement paper over foundational conflicts and root causes. Many of those who espouse education reform cast their solutions as unimpeachably “scientific” and “data-driven,” yet as with scientific management partisans, the empirical grounding of their prescriptions is highly dubious. And proponents of scientific management and corporate school reform share an antipathy toward unions, often casting them as self-interested inhibitors of progress.”

And here is another excerpt:

“When education is reduced to test prep, rich curricula and the craft of teaching are imperiled. The vapid classroom of neoliberal school reform mirrors the vapid workplace of Taylorism. Teach for America, which implicitly advances the idea that the sparsely trained can out-teach veteran educators, engenders deskilling and deprofessionalization. Non-practitioners dictating to practitioners how they should do their work mirrors management’s disciplining of workers; both militate against work as a creative activity. The appropriation of business language — the head of the Chicago Public Schools is the “CEO” — reinforces the idea that schools should be run like corporations. Merit pay individualizes and severs educators’ ties to one another, forcing them to compete instead of cooperate. So too with the anti-union animus that neoliberal reformers and scientific management proponents display.”

Read the essay. You will understand the roots of the corporate reforms of our day.

The corporate reform movement has been bashing teachers and public education without let-up for the past several years. The bashing became super-charged after the introduction of Race to the Top in 2009, because it explicitly blames teachers for low test scores despite evidence to the contrary.

The “reformers” claim they want “great teachers” in every classroom, and the way to do it is to fire teachers whose students get low scores, to close schools with low scores, and to deny teachers the right to due process. This is their formula, and they are sticking to it even though no other nation in the world has launched a vendetta against the teaching profession and public schools.

Now the California Commission on Teacher Credentialing reports a sharp decline in the number of people who want to teach.

Teresa Watanabe writes that:

” Interest in teaching is steadily dropping in California, with the number of educators earning a teaching credential dipping by 12% last year — marking the eighth straight annual decline.

“The California Commission on Teacher Credentialing reported this month that 16,450 educators earned their credential in 2011-12, compared with 23,320 in 2007-08.

“The number of students enrolling in teacher preparation programs has also decreased, to 34,838 in 2010-11 from 51,744 in 2006-07.”

This fraudulent reform movement is not going to achieve any of its stated goals. It will not lead to a great teacher in every classroom. Left unchecked, it will turn teaching into a temp job and dismantle public education. This will benefit the haves, not the have-nots. And that may explain why the haves are dumping millions of dollars into state and local school board races, to elect candidates who share their contempt for career educators and democratic control of public education.