Archives for category: Teacher Evaluations

Audrey Amrein-Beardsley has devoted a large portion of her professional life to criticizing the work of William Sanders, creator of the value-added model for measuring teacher effectiveness. She reports in this post that he passed away at his Tennessee home at the age of 74.

Sanders’ model was tried out first in Tennessee in the late 1980s and then widely disseminated to other states. Many teachers lost their jobs because they didn’t get the gain scores that the Sanders’ model predicted.

Sanders was trained in animal genetics. His hometown obituary reports that:

He received a bachelors of Science degree in animal science in 1964, and a doctorate in Statistics and Quantitative Genetics in 1968….

Beginning in 1972, Sanders created and led a statistical and consulting group for the Institute of Agricultural Research for The University of Tennessee system. Over the next 28 years, Sanders worked with scientists to plan experiments and analyze the resulting data on research projects ranging from agronomy to physics. One of his research projects modeled the nutrient flow in the Peace River system in Florida, which proved that the environmental degradation in the Gulf was not a function of the development along the west coast as was previously thought but rather was a result of the phosphate mining activity in Central Florida. Other projects were as wide ranging as developing a forecasting system for Bike Athletic to improve forecasts for over 2,500 different inventory units to working with a longtime friend to develop a process that improved calibration of an invention that measures fiber properties.

He achieved lasting fame by transferring his attention from agricultural assessments to teacher assessments. He seemed never to recognize that assessing the effectiveness of teachers was far more complicated than studying animals and plants, which may be raised in a controlled environment.

Although his methodology was critiqued by scholars like Amrein-Beardsley, the American Statistical Association, and the American Educational Research Association, Sanders continued to peddle it to credulous school board members looking for a simple formula to determine teacher “effectiveness.”

Amrein-Beardsley writes:

Sanders thought that educators struggling with student achievement in the state should “simply” use more advanced statistics, similar to those used when modeling genetic and reproductive trends among cattle, to measure growth, hold teachers accountable for that growth, and solve the educational measurement woes facing the state of Tennessee at the time. It was to be as simple as that…. I should also mention that given this history, not surprisingly, Tennessee was one of the first states to receive Race to the Top funds to the tune of $502 million to further advance this model; hence, this has also contributed to this model’s popularity across the nation.

Arne Duncan too bought the horse manure that Sanders was selling and that he patented. Keeping his methodology secret and proprietary posed a challenge to scholars. But there were always buyers, no matter what the scholars said. States that wanted to be eligible for Race to the Top funding had to adopt a test-based evaluation system, which was a boon for Sanders’ model.

Give credit where credit is due: Even though the Republican majority in the Senate seems eager to privatize public schools, for fun and credit and to satisfy their inner Ayn Rand, they did something right: they eliminated former Secretary of Education John King’s regulations to measure the effectiveness of teacher education. King wanted to judge teacher education institutions by student test scores. It was likely if not inevitable that teachers who went to affluent districts would get better results than those who taught in the neediest schools.

Teacher educators lambasted King’s effort to micromanage teacher education and warned that his demands would drive teachers away from high-needs schools.

This is one example where deregulation was necessary and didn’t make matters worse.

The Senate also voted to roll back an Obama administration rule to “hold schools accountable,” which passed by only 50-49, over vociferous Democratic opposition. Frankly, I don’t know which rule this is. If it was the Obama-Duncan-King test-based accountability, then I think its repeal or elimination is a step forward. As we saw again and again over the past eight years, the Obama Department of Education had an obsessive devotion to test-based accountability that harmed students, teachers, and schools. If this is what the Senate knocked down, count me in. Even the znational Academy of Sciences issued a report critical of test-based accountability, but Duncan was as smitten with standardized testing as DeVos is smitten with vouchers.

The Good Old Days

Don’t you miss the good old days?
The days of school deforming ways?
When Arne ruled with iron hand
With Common Core and test and VAM?
And Cuomo plotted night and day
The way to make the schools obey?
And Rhee was riding on her broom
And closing schools and spreading doom?
And charter schools in neighborhoods
Were popping up like shrooms in woods
And billionaires were here and there
And all about and everywhere?
Don’t you miss reformy times
Immortalized by someDAM rhymes?
Well, good old days of yesteryear
Have never left, are still right here
The good old days were never gone
The school deform lives on and on

For more than the past decade, Bill Gates has dabbled in education. He launches initiative after initiative, with slim or no research, and all of them flop. While he dabbles–whether it is the Common Core or evaluating teachers by test scores–he messes up other people’s lives with no accountability for his screw-ups. He just moves on to his Next Big Idea.

Mercedes Schneider points out that the Gates Foundation spends more money “reforming education” in the U.S., but has nothing to show for it.

Curiously, the Gates Foundation’s annual letter doesn’t even mention education! (Correction: Leonie Haimson pointed out that education was not mentioned in the Foundation’s annual letter; its annual report is not published yet. So maybe we will hear some Trump-style claims about the successes of VAM and charters, and other DeVos strategies for privatization.)

Will he butt out? Will he admit error?

I saw him on TV Saturday night warning about the dangers of bio-terrorism. A few weeks ago, he met with Donald Trump in his golden penthouse and came away expressing admiration, prophesying that Trump had the chance to be transformative, like John F. Kennedy, by driving education innovation with new technologies. What’s on his mind? Saving humanity or market share?

Thoughts on the recent events in education reform, by our blog Poet:

 

 

 

“The Maestro”

 
(A brief historical recap for those who have already forgotten — or perhaps never knew)

 

 

Chetty played the VAMdolin
At Nobel-chasing speed
Arne played the basket-rim
And Rhee, she played the rheed

 

Coleman played his Core-o-net
Eva played the lyre
Billy Gates played tete-a-tete
With Duncan and with higher

 

Sanders* beat his cattle drum
Devalue added model
Pseudo-science weighted sum
Mathturbated twaddle

 

John King played the slide VAMbone
But Maestro was Obama
Who hired the band and set the tone
For current grizzly drama

 

 

*William Sanders, who tweaked his algorithm for modeling cattle growth to model the intellectual growth of students and evaluate teachers.

 

Compared to Trump, Obama is a portrait of dignity, reason, and intellect.  The Washington Monthly published a list of his top 50 accomplishments. Note that there is no mention of K-12 education. As readers of this blog  know, Obama’s education policies were a continuation of the George W. Bush policies of measure-and-punish. Arne Duncan did whatever Gates and Broad wanted. He advanced privatization by his constant promotion of charter schools and his refusal to demand accountability for them.  He demoralized teachers by insisting that they be evaluated by test scores of their students. He trumpeted the lie that our public schools are failing. He was an agent of the right wingers who want to replace public education with an array of bad choices. When unions were under attack in Wisconsin and in the courts, the Obama administration was not there. It collaborated in the destruction of the Democratic base.

 

This is too was Obama’s legacy: the assault on public schools, teachers, and unions.

 

 

Bruce Baker of Rutgers University is frustrated. He and colleagues have published study after study about the uses and misuses of standardized test scores to measure teachers and schools.The evidence is clear, he writes. Yet states remain devoted to failed, erroneous methods that pack any evidence!

 

“It blows my mind, however, that states and local school districts continue to use the most absurdly inappropriate measures to determine which schools stay open, or close, and as a result which school employees are targeted for dismissal/replacement or at the very least disruption and displacement. Policymakers continue to use measures, indicators, matrices, and other total bu!!$#!+ distortions of measures they don’t comprehend, to disproportionately disrupt the schools and lives of low income and minority children, and the disproportionately minority teachers who serve those children. THIS HAS TO STOP!”

 

 

Today, you should be relaxing and having some fun. Here is a good way to begin.

 

I plan to post good thoughts, silly, happy thoughts today.

 

That means I will not mention Little Hands, the Orange One. All day. (Unless it is absolutely necessary.)

 

So here goes.

 

W. James Popham is an international expert on educational assessment.

 

He has a great sense of humor.

 

In this video, he explains value-added assessment.

 

Sit back and enjoy!

Peter Greene listened to a podcast produced by the Thomas B. Fordham Institute and made a shocking discovery: One of the leading figures of the reform movement–Checker Finn–acknowledged that after 20 years of reform, there was no change!

 

 

 

State Senator Michael Johnston, architect of Colorado’s failed, punitive teacher evaluation law, may run for governor.

 

Johnston, an alumnus of Teach for America, is a devout believer in standardized testing. His law, passed over the objection of the state’s teachers, makes test scores 50% of teacher evaluations.

 

I happened to be in Denver the day that his bill came to a vote. We were scheduled to debate at lunch time,  but young Senator Johnston showed up after I finished speaking. I got to hear him, but he never heard me. He told the audience that his bill would produce great teachers, great principals, great schools. All by basing evaluations on test scores.

 

Senator Johnston’s fantabulous claim never came true. Six years after passage of his law, Colorado has the harshest teacher evaluation statute in the nation and apparently no will to change it.

 

What are the results? When measured by the National Assessment of Educational Progress, Colorado is in stagnation since passage of Senate Bill 191. Scores in fourth and eighth grade math and English are flat or have declined. None have gone up.

 

His greatest achievement was a bust. Since its passage, the theory that teachers can be evaluated by the test scores of their students has repeatedly been debunked by scholarly associations like the American Statistical Association, but Mr. Johnston is unable or unwilling to admit his ruinous error or to take steps to repeal it.