Archives for category: Teacher Evaluations

We have heard from corporate reformers that Denver is the best city in the country when it comes to school choice (although DeVos says we shouldn’t be so quick to praise Denver because it doesn’t yet have vouchers). Teachers should be flocking to Colorado, especially Denver.

Yet the Denver Post reports that the state of Colorado has a teacher shortage that is becoming a crisis. Teacher salaries have actually declined in Colorado by 7.7% over the past decade. In 2010, the legislature passes a teacher evaluation law that bases 50% of teachers’ rating on standardized test scores of their students; the law remains on the books even though it has had zero effect, and the underlying theory has been widely discredited. (The author of the bill, former State Senator Mike Johnston, plans to run for governor.)

Rural districts, where salaries are lowest, are hit hardest by the shortage.

The state’s teacher shortage, which mirrors a national trend, grows larger each year. As many as 3,000 new teachers are needed to fill existing slots in Colorado classrooms while the number of graduates from teacher-preparation programs in the state has declined by 24.4 percent over the past five years.

Meanwhile, enrollment in the state’s teacher preparation programs in 2015-16 remained flat from the previous academic year with 9,896 students. On top of that, at least a third of the teachers in Colorado are 55 or older, and closing in on retirement.

Plenty of factors — low salaries, a culture obsessed with student testing, the social isolation that comes with teaching in small towns — send students scrambling from teaching careers, say experts.

There is also a pall that hangs over teaching that hasn’t existed in the past, said Mike Merrifield, a 30-year teaching veteran and now a state senator.

“Teachers are constantly being bashed,” Merrifield said. “It’s not the same job it used to be….”

Urban school districts are slightly more immune to the downward trend than rural districts. The highest average salary for K-12 teachers in Colorado is $63,000 in Boulder Valley. At Colorado’s rural schools, the average teacher salary is about $22,700 — $14,000 less than the state average for teachers.

Metro areas can offer teachers higher salaries, greater housing options and more opportunities to teach specialized classes. But the secluded nature of rural schools may be the biggest drawback for many new teachers.

Nancy E. Bailey, who teaches in Tennessee, posted a blog about the legislature’s habit of using poor Memphis as its experimental district, where disruption is the rule and failure is persistent. Jim Gifford, a high school English teacher in Murfreesboro wrote the post on Nancy’s blog.

Tennessee Legislators Cry, “Thank God for Memphis!”

Tennessee had the bad fortune to win a bundle of Race to the Top cash, so some district had to be the donkey where everyone pinned the tail. It was Memphis. Every bad reformer idea lands on the students, teachers, and schools of Memphis (Shelby County).

Bill Gates dumped a barrel of money into Memphis to try out his pet ideas about teacher evaluation. Oops!

Then came the so-called Achievement School District. A total disaster!

Now legislators have decided to experiment with vouchers. Where? Memphis, of course.

The people who live in Memphis don’t like the idea of vouchers. But nobody cares what they think.

Arthur Goldstein has been teaching for more than 30 years in the New York City public schools.

He has a terrific blog about teaching in New York City.

Here, he describes how he will be rated as a teacher by an insane system.

He begins here:

NY City’s brilliant and infallible Engage system has mandated that I be rated on a test the overwhelming majority of my students will not be taking. As far as I can determine, this is a side effect of the rather awful regulation called CR Part 154. You see, I’m an ESL teacher, but teaching ESL isn’t real teaching. That’s because under Part 154 anything not regarded as “core content” is utterly without value. After all, if it can’t be measured with a standardized test, what proof is there that it even exists?

And yet, in fact, there is a standardized test to measure ESL progress. Sure it’s a stinking piece of garbage, but it exists. This test is called the NYSESLAT. It used to test language acquisition, albeit poorly, but it’s been redesigned to measure just how Common Corey our students are. For the last few years I’ve lost weeks of instruction so I could sit in the auditorium and ask newcomers endless questions about Hammurabi’s Code. I’m not sure what effect this had on non-English speaking students, but I know more about Hammurabi’s code than I ever have.

You may have read me lamenting the fact that I’d be measured on such a poor test once or twice. Last year, in fact, I must have done OK with it since I got an effective rating. I have no idea how exactly I did this. I don’t teach to that test nor do I go out of my way to learn what’s on it. With the oral part is so outlandish and invalid it doesn’t seem worth my while to study the written part. So why the hell aren’t I rated on this test?

It’s complicated, and I can only guess. But Part 154 largely couples ESL with another subject area. In my school, that area is English. It’s kind of a natural pairing, until you realize the high likelihood of ELL newcomers sitting around trying to read To Kill a Mockingbird when they can’t yet tell you what their names are. After all, when English teachers take the magical 12 credits that render them dual-licensed, how can we be sure part of that training entails instruction to NOT give ELLs materials they CANNOT READ? Maybe the focus is on making stuff more Common Corey. Who knows?

Van Schoales is part of the corporate reformer group that has controlled public education in Colorado for most of the past decade. When I visited Denver in 2010 to talk about my recently published book “The Death and Life of the Great American School System: How Testing and Choice Are Undermining Education,” Van was running Education Reform Now on behalf of Democrats for Education Reform, the hedge-fund managers organization that lobbies for charters and high-stakes testing. I recall what a very nice guy he was and how generous he was in introducing me, even though we disagreed.

At the very time I arrived in Denver, the state legislature was nearing a vote on a teacher and principal evaluation plan devised by a young state senator named Michael Johnston, whose background was in Teach for America and New Leaders for New Schools. Several members of the legislature, who were former teachers, showed up for my lecture in Boulder and spoke to me afterwards about their concerns about this fast-moving bill. Johnston’s legislation, known as Senate Bill 10-191, promised to evaluate teachers and principals based on the test scores of their students. Fifty percent of their evaluation would be tied to test scores. I was scheduled to debate Johnston on the day of the vote, but he did not enter the room until the minute I finished speaking, so he never heard my side of the debate. Johnston, however, was flushed with excitement about his legislation. He said that if every educator was evaluated by test scores, then Colorado would have “great schools, great principals, and great teachers.” I tried my best to dissuade him and the audience of their obsession with the value of standardized testing, but it was too late. The legislature passed 10-191, and Johnston was considered a rising star.

Except, as Van Schoales now admits in this article in Education Week, the corporate reformers were wrong. SB 10-191 did not work out as planned, even though the framers relied on the very best Ivy League prognosticators.

He writes:

Back in May 2010, hundreds of the nation’s education foundation, policy, and practice elites were gathered for the NewSchools Venture Fund meeting in Washington to celebrate and learn from the most recent education reform policy victories in my home state of Colorado and across the country.

The opening speeches highlighted the recent passage of Colorado Senate Bill 10-191—a dramatic law which required that 50 percent of a teacher evaluation be based upon student academic growth. This offered a bold new vision for how teachers would be evaluated and whether they would gain or lose tenure based on the merits of their impact on student achievement.
Colorado would be one of several “ground zeros” for reforming teacher evaluation in the country. Many, including myself, thought these new state policies would allow our best teachers to shine. They would finally have useful feedback, be differentiated on an objective scale of effectiveness, and lose tenure if they weren’t performing. Teachers would be treated like other professionals and less like interchangeable widgets.

Colorado’s law and similar ones in other states appeared to be sound, research-backed policy formulated by education reform’s own “whiz kids.” We could point to Ivy League research that made a clear case for dramatic changes to the current system. There were large federal incentives, in addition to private philanthropy fueled by the Bill & Melinda Gates Foundation, encouraging such changes. And to pass these teacher-evaluation laws, we built a coalition of reform-minded Democrats and Republicans that also included the American Federation of Teachers. Reformers were confident we had a clear mandate.

And yet. Implementation did not live up to the promises.

Ah, implementation! The Soviet experiment might have worked had it been implemented the right way. When allegedly great ideas don’t work out in reality, then something is wrong with the idea. For one thing, it never had the support of educators, who were expected to make Michael Johnston’s big idea work. It didn’t work.

What went wrong? Almost everything.

Most teachers don’t teach tested subjects. The majority of teachers teach in states’ untested subject areas. This meant processes for measuring student growth outside of literacy or math were often thoughtlessly slapped together to meet the new evaluation law. For example, some elementary school art-teacher evaluations were linked to student performance on multiple-choice district art tests, while Spanish-teacher evaluations were tied to how the school did on the state’s math and literacy tests. Even for those who teach the grades and subjects with state tests, some debate remains on how much growth should be weighted for high-stakes decisions on teacher ratings.

Few educators “embraced” the new evaluation system. They complied, but they never believed.

Teacher evaluators were giving teachers higher scores than they allegedly deserved. This, of course, was a problem with the district and school culture, not the model, which was supposedly flawless.

Last, every one of the state’s charter schools waived themselves out of the teacher evaluation system.

Van Schoales doesn’t mention that test-based accountability has been criticized by leading scholarly organizations, like the American Statistical Association and the American Education Research Association.

Value-added measurement, or VAM, has fallen into disrepute for two reasons. First, it has not produced positive results anywhere. There is a solid body of research that has shown that it doesn’t work and will never work, because students are not randomly assigned, because home influences outweigh teacher influences on student test scores, and because most teachers do not teach the tested subjects.

Colorado had the perfect teacher evaluation plan, in theory, perfect enough to excite the corporate reformers, Arne Duncan, Bill Gates, et al. Except it didn’t work. I salute Van Schoales for admitting that the experiment failed.

Unfortunately it is still the law in Colorado. Educators are still evaluated by flawed and invalid measures. Seven years after passage of SB 10-191, Colorado does not have “great schools, great principals, great teachers.” Actually, it does have great schools, great principals, and great teachers in affluent districts, as it did in 2010. It even has great educators and schools in urban districts, but only if they are not measured by their students’ test scores. Don’t blame the victims of this effort to turn educators into widgets. The best evaluation of professionals is done by human judgment, taking multiple factors into account, not by standardized test scores.

Due to term limits, Michael Johnston is no longer in the State Senate. In January, he announced that he is running for Governor of Colorado. On his wikipedia page, he still boasts about SB 10-191. He owes an apology to the thousands of dedicated educators who were subjected to his invalid teacher evaluation plan, many of whom were unjustly terminated and lost their careers.

Jonathan Pelto reports that Connecticut will no longer use scores on SBAC or SAT to evaluate teachers.

http://jonathanpelto.com/2017/04/06/connecticut-will-no-longer-use-sbac-sat-part-teacher-performance-evaluations/

Since this approach has failed everywhere, this is a great development.

Every state should drop this failed methodology that was promoted by the Gates Foundation and Arne Duncan but has not worked.

I am writing this post for the journalists who cover education. Please fact-check every word that DeVos says. She literally doesn’t know what she is talking about.

This is the New York Times’ report on Betsy DeVos‘ press conference at Brookings.

She claims that the Bush-Obama policies of test-and-punish failed because throwing money at the problem doesn’t work. Any teacher could have told you that NCLB and Race to the Top were failures, not because they threw money at the problems, but because they spent money on failed strategies of high-stakes testing, evaluating teachers by test scores, closing schools, and opening charters.

She is so ill-informed that she would be well advised never to speak in public.

Her comparison of selecting a public school to hailing a taxi is offensive: schooling is a right guaranteed in state constitutions, taking a cab or car service is a consumer choice. She was echoing her mentor Jeb Bush, who compared choosing a school to buying a carton of milk, when he addressed the GOP convention in 2012.

As you will see if you read the account in the story, she has the unmitigated gall to say that her crusade for consumer choice in education–whether charters, vouchers, homeschooling, cyberschooling, whatever–serves the “common good.” What an outrage! Providing a high-quality public school,in every zip code serves the common good. Tossing kids to the vagaries of the free market subverts the common good. Anyone who has been reading this blog for any period of time has learned about the entrepreneurs who open charter schools to make money, about the sham real estate deals, about the voucher schools that teach science from the Bible, about the heightened segregation that always accompanies school choice. Wherever George Wallace and his fellow defenders of racial segregation are, they are rooting for DeVos.

Furthermore, she is utterly ignorant of the large body of research showing that charters do not get better results than public schools, voucher schools get worse results, and cybercharters get abysmal results.

Then she makes a crack about how America’s scores on international couldn’t get worse. She is wrong, and Grover Whitehurst should have told her so. Our scores on the international tests have never been high. Over the past Hal century, we have usually scored in the middle of the pack. Yes, our scores could get much worse. We could follow the Swedish free-market model and see our scores tumble.

Grrr. It is frustrating to see this kind of ignorance expressed by the Secretary of Education, although Arne Duncan should have lowered our expectations.

Please read “Reign of Error” and learn that test scores are the highest ever for whites, blacks, Hispanics, and Asians (although they went flat from 2013-2015, probably in response to the disruptions caused by Common Core); graduation rates are the highest ever; dropout rates are the lowest ever. When our students took the first international test in 1964, we came in last in one grade, and next to last in the other. But in the years since, our economy has surpassed all the other nations with higher scores. The test scores of 15-year-olds do not predict the future of the nation.

The National Coucil for Teacher Quality issued a report calling for higher admission standards for entrants into teaching, specifically, higher SAT and ACT scores. This report was reviewed on behalf of the National Education Policy Center. It is interesting and strange that so many people think that scores on the SAT or ACT have remarkable predictive powers. The cardinal rule of psychometric is that a test should be used only for the purpose for which it was designed. These tests were designed to gauge likely success in college, but multiple studies have concluded that the students’ four-year grade-point-average is more reliable than either the SAT or ACT. Why would anyone think they predict good teachers? NCTQ should turn its attention to making the teaching profession more fulfilling and rewarding. At a time of teacher shortages, raising the bar will exacerbate the shortage.

The NCTQ is Gates-funded and endorses VAM to rate teachers. So they start with a strong bias towards standardized testing.

NEPC says:

BOULDER, CO (March 23, 2017) – A recent report from the National Council on Teacher Quality (NCTQ) advocates for a higher bar for entry into teacher preparation programs. The NCTQ report suggests, based on a review of GPA and SAT/ACT requirements at 221 institutions in 25 states, that boosting entry requirements would significantly improve teacher quality in the U.S. It argues that this higher bar should be set by states, by the Council for the Accreditation of Educator Preparation (CAEP), and by the higher-education institutions themselves.

However, the report’s foundational claims are poorly supported, making its recommendations highly problematic.

The report, Within Our Grasp: Achieving Higher Admissions Standards in Teacher Prep, was reviewed by a group of scholars and practitioners who are members of Project TEER (Teacher Education and Education Reform). The team was led by Marilyn Cochran-Smith, the Cawthorne Professor of Teacher Education for Urban Schools at Boston College, along with Megina Baker, Wen-Chia Chang, M. Beatriz Fernández, & Elizabeth Stringer Keefe. The review is published by the Think Twice Think Tank Review Project at the National Education Policy Center, housed at University of Colorado Boulder’s School of Education.

The reviewers explain that the report does not provide the needed supports for its assertions or recommendations. It makes multiple unsupported and unfounded claims about the impact on teacher diversity of raising admissions requirements for teacher candidates, about public perceptions of teaching and teacher education, and about attracting more academically able teacher candidates.

Each claim is based on one or two cherry-picked citations while ignoring the substantial body of research that either provides conflicting evidence or shows that the issues are much more complex and nuanced than the report suggests. Ultimately, the reviewers conclude, the report offers little guidance for policymakers or institutions.

Find the review by Marilyn Cochran-Smith, Megina Baker, Wen-Chia Chang, M. Beatriz Fernández, & Elizabeth Stringer Keefe at:
http://nepc.colorado.edu/thinktank/review-admissions

Find Within Our Grasp: Achieving Higher Admissions Standards in Teacher Prep, by Kate Walsh, Nithya Joseph, & Autumn Lewis, published by the National Council on Teacher Quality, at:
http://www.nctq.org/dmsView/Admissions_Yearbook_Report

Audrey Amrein-Beardsley has devoted a large portion of her professional life to criticizing the work of William Sanders, creator of the value-added model for measuring teacher effectiveness. She reports in this post that he passed away at his Tennessee home at the age of 74.

Sanders’ model was tried out first in Tennessee in the late 1980s and then widely disseminated to other states. Many teachers lost their jobs because they didn’t get the gain scores that the Sanders’ model predicted.

Sanders was trained in animal genetics. His hometown obituary reports that:

He received a bachelors of Science degree in animal science in 1964, and a doctorate in Statistics and Quantitative Genetics in 1968….

Beginning in 1972, Sanders created and led a statistical and consulting group for the Institute of Agricultural Research for The University of Tennessee system. Over the next 28 years, Sanders worked with scientists to plan experiments and analyze the resulting data on research projects ranging from agronomy to physics. One of his research projects modeled the nutrient flow in the Peace River system in Florida, which proved that the environmental degradation in the Gulf was not a function of the development along the west coast as was previously thought but rather was a result of the phosphate mining activity in Central Florida. Other projects were as wide ranging as developing a forecasting system for Bike Athletic to improve forecasts for over 2,500 different inventory units to working with a longtime friend to develop a process that improved calibration of an invention that measures fiber properties.

He achieved lasting fame by transferring his attention from agricultural assessments to teacher assessments. He seemed never to recognize that assessing the effectiveness of teachers was far more complicated than studying animals and plants, which may be raised in a controlled environment.

Although his methodology was critiqued by scholars like Amrein-Beardsley, the American Statistical Association, and the American Educational Research Association, Sanders continued to peddle it to credulous school board members looking for a simple formula to determine teacher “effectiveness.”

Amrein-Beardsley writes:

Sanders thought that educators struggling with student achievement in the state should “simply” use more advanced statistics, similar to those used when modeling genetic and reproductive trends among cattle, to measure growth, hold teachers accountable for that growth, and solve the educational measurement woes facing the state of Tennessee at the time. It was to be as simple as that…. I should also mention that given this history, not surprisingly, Tennessee was one of the first states to receive Race to the Top funds to the tune of $502 million to further advance this model; hence, this has also contributed to this model’s popularity across the nation.

Arne Duncan too bought the horse manure that Sanders was selling and that he patented. Keeping his methodology secret and proprietary posed a challenge to scholars. But there were always buyers, no matter what the scholars said. States that wanted to be eligible for Race to the Top funding had to adopt a test-based evaluation system, which was a boon for Sanders’ model.

Give credit where credit is due: Even though the Republican majority in the Senate seems eager to privatize public schools, for fun and credit and to satisfy their inner Ayn Rand, they did something right: they eliminated former Secretary of Education John King’s regulations to measure the effectiveness of teacher education. King wanted to judge teacher education institutions by student test scores. It was likely if not inevitable that teachers who went to affluent districts would get better results than those who taught in the neediest schools.

Teacher educators lambasted King’s effort to micromanage teacher education and warned that his demands would drive teachers away from high-needs schools.

This is one example where deregulation was necessary and didn’t make matters worse.

The Senate also voted to roll back an Obama administration rule to “hold schools accountable,” which passed by only 50-49, over vociferous Democratic opposition. Frankly, I don’t know which rule this is. If it was the Obama-Duncan-King test-based accountability, then I think its repeal or elimination is a step forward. As we saw again and again over the past eight years, the Obama Department of Education had an obsessive devotion to test-based accountability that harmed students, teachers, and schools. If this is what the Senate knocked down, count me in. Even the znational Academy of Sciences issued a report critical of test-based accountability, but Duncan was as smitten with standardized testing as DeVos is smitten with vouchers.

The Good Old Days

Don’t you miss the good old days?
The days of school deforming ways?
When Arne ruled with iron hand
With Common Core and test and VAM?
And Cuomo plotted night and day
The way to make the schools obey?
And Rhee was riding on her broom
And closing schools and spreading doom?
And charter schools in neighborhoods
Were popping up like shrooms in woods
And billionaires were here and there
And all about and everywhere?
Don’t you miss reformy times
Immortalized by someDAM rhymes?
Well, good old days of yesteryear
Have never left, are still right here
The good old days were never gone
The school deform lives on and on