Van Schoales is part of the corporate reformer group that has controlled public education in Colorado for most of the past decade. When I visited Denver in 2010 to talk about my recently published book “The Death and Life of the Great American School System: How Testing and Choice Are Undermining Education,” Van was running Education Reform Now on behalf of Democrats for Education Reform, the hedge-fund managers organization that lobbies for charters and high-stakes testing. I recall what a very nice guy he was and how generous he was in introducing me, even though we disagreed.
At the very time I arrived in Denver, the state legislature was nearing a vote on a teacher and principal evaluation plan devised by a young state senator named Michael Johnston, whose background was in Teach for America and New Leaders for New Schools. Several members of the legislature, who were former teachers, showed up for my lecture in Boulder and spoke to me afterwards about their concerns about this fast-moving bill. Johnston’s legislation, known as Senate Bill 10-191, promised to evaluate teachers and principals based on the test scores of their students. Fifty percent of their evaluation would be tied to test scores. I was scheduled to debate Johnston on the day of the vote, but he did not enter the room until the minute I finished speaking, so he never heard my side of the debate. Johnston, however, was flushed with excitement about his legislation. He said that if every educator was evaluated by test scores, then Colorado would have “great schools, great principals, and great teachers.” I tried my best to dissuade him and the audience of their obsession with the value of standardized testing, but it was too late. The legislature passed 10-191, and Johnston was considered a rising star.
Except, as Van Schoales now admits in this article in Education Week, the corporate reformers were wrong. SB 10-191 did not work out as planned, even though the framers relied on the very best Ivy League prognosticators.
He writes:
Back in May 2010, hundreds of the nation’s education foundation, policy, and practice elites were gathered for the NewSchools Venture Fund meeting in Washington to celebrate and learn from the most recent education reform policy victories in my home state of Colorado and across the country.
The opening speeches highlighted the recent passage of Colorado Senate Bill 10-191—a dramatic law which required that 50 percent of a teacher evaluation be based upon student academic growth. This offered a bold new vision for how teachers would be evaluated and whether they would gain or lose tenure based on the merits of their impact on student achievement.
Colorado would be one of several “ground zeros” for reforming teacher evaluation in the country. Many, including myself, thought these new state policies would allow our best teachers to shine. They would finally have useful feedback, be differentiated on an objective scale of effectiveness, and lose tenure if they weren’t performing. Teachers would be treated like other professionals and less like interchangeable widgets.
Colorado’s law and similar ones in other states appeared to be sound, research-backed policy formulated by education reform’s own “whiz kids.” We could point to Ivy League research that made a clear case for dramatic changes to the current system. There were large federal incentives, in addition to private philanthropy fueled by the Bill & Melinda Gates Foundation, encouraging such changes. And to pass these teacher-evaluation laws, we built a coalition of reform-minded Democrats and Republicans that also included the American Federation of Teachers. Reformers were confident we had a clear mandate.
And yet. Implementation did not live up to the promises.
Ah, implementation! The Soviet experiment might have worked had it been implemented the right way. When allegedly great ideas don’t work out in reality, then something is wrong with the idea. For one thing, it never had the support of educators, who were expected to make Michael Johnston’s big idea work. It didn’t work.
What went wrong? Almost everything.
Most teachers don’t teach tested subjects. The majority of teachers teach in states’ untested subject areas. This meant processes for measuring student growth outside of literacy or math were often thoughtlessly slapped together to meet the new evaluation law. For example, some elementary school art-teacher evaluations were linked to student performance on multiple-choice district art tests, while Spanish-teacher evaluations were tied to how the school did on the state’s math and literacy tests. Even for those who teach the grades and subjects with state tests, some debate remains on how much growth should be weighted for high-stakes decisions on teacher ratings.
Few educators “embraced” the new evaluation system. They complied, but they never believed.
Teacher evaluators were giving teachers higher scores than they allegedly deserved. This, of course, was a problem with the district and school culture, not the model, which was supposedly flawless.
Last, every one of the state’s charter schools waived themselves out of the teacher evaluation system.
Van Schoales doesn’t mention that test-based accountability has been criticized by leading scholarly organizations, like the American Statistical Association and the American Education Research Association.
Value-added measurement, or VAM, has fallen into disrepute for two reasons. First, it has not produced positive results anywhere. There is a solid body of research that has shown that it doesn’t work and will never work, because students are not randomly assigned, because home influences outweigh teacher influences on student test scores, and because most teachers do not teach the tested subjects.
Colorado had the perfect teacher evaluation plan, in theory, perfect enough to excite the corporate reformers, Arne Duncan, Bill Gates, et al. Except it didn’t work. I salute Van Schoales for admitting that the experiment failed.
Unfortunately it is still the law in Colorado. Educators are still evaluated by flawed and invalid measures. Seven years after passage of SB 10-191, Colorado does not have “great schools, great principals, great teachers.” Actually, it does have great schools, great principals, and great teachers in affluent districts, as it did in 2010. It even has great educators and schools in urban districts, but only if they are not measured by their students’ test scores. Don’t blame the victims of this effort to turn educators into widgets. The best evaluation of professionals is done by human judgment, taking multiple factors into account, not by standardized test scores.
Due to term limits, Michael Johnston is no longer in the State Senate. In January, he announced that he is running for Governor of Colorado. On his wikipedia page, he still boasts about SB 10-191. He owes an apology to the thousands of dedicated educators who were subjected to his invalid teacher evaluation plan, many of whom were unjustly terminated and lost their careers.
Wow-still stuck with the 50% in Colorado. Even Governor Susanna had to go to 35% this week after much pressure. Colorado please get with the program.
Colorado: Still embracing a failed way to evaluate teachers.
Like driving a car with no brakes. What could go wrong?
Secretary of Education Skandera came to New Mexico from Florida she instituted a Teacher evaluation system very, very similar to Colorado. Fifty percent of the evaluation would be based on one standardized test (PARCC). Also, Teachers were only allowed to be sick three days before their evaluation was downgraded. So if a Teacher had a sick family member or was very sick they had better not be out of the classroom more than three days of be deemed by Public Education Department as an ineffective Teacher.
This year the NM Legislator passed both houses that the sick leave part had to be changed. Governor Martinez veto this bill. A week or two later Martinez and Skandera came out and changed the rules. Reduced the 50% test evaluation part to 35% and increased the sick leave days to six. It is all a political game. The evaluation is still based on a standardized test and sick leave plus a very small part on observation by the Principal. Martinez and Skandera want to seem like they are trying to play nice. Nobody believe it.
What happened is all the Teachers, the Unions, and Parents started raising hell. Martinez and Skandera had to do something to placate the masses.
Teacher evaluation based on standardized test scores and sick leave does not work. Wake up Legislators and Governors across America.
It is time for Martinez and Skandera to get the hell out of NM and never come back.
moene, I know that many New Mexico teachers were hoping that Skandera would join DeVos, her ally in DC.
But the Republicans vetoed Skandera because of her fervent support for Common Core, which she learned from Jeb Bush.
DeVos is also close to Jeb and I suspect she is also a CC advocate, but she has gone silent about it.
I would say that 90 to 95% of all people living in NM wanted Skandera gone. IF she had gone to work for DeVos then the people of the US would of had double trouble in the world of public education.
I served on the NM Public Education Commission for 8 year. Four of those years when Skandera first arrived. I refused to run for another term of office because I could not, would not deal with Skandera and Martinez anymore. I figured I could do more to help Students and Teachers at home in Las Cruces than I could I Santa Fe. Skandera and Martinez have been a disaster as far as education is concerned in NM.
Teachers may know this already but I’m a public school parent and have been one for a very long time and parents do not agree on what makes a good teacher. The differences of opinion are huge. Two parents can be talking about the exact same teacher and one will rave and the other will be horrified.
This idea that we’re using some kind of objective measure of “effectiveness” is just not true. It is much, much more complicated than that.
We have more men teaching school in the lower grades than we used to have in my district. It’s pronounced enough that it’s caused comment among parents. I noticed it just because I had kids in the same schools 20 years ago and there do seem to be more men. That’s not “good” or “bad” it’s just a fact. But. There are people here who pronounce that that’s “good” for no other reason than the teacher is a man. This isn’t science, folks! It’s opinion.
Are the education “chiefs” outside of “chiefs for change” ever invited anywhere or listened to?
It seems like a mistake to give this one group such a loud voice particularly if your aim is “science” – can we admit that a lot of this is more like opinion and one narrow set of opinions is hugely elevated in ed reform?
Van Loves Data… so what is the REAL reason for this sudden change of heart? Prediction: there will be a push to change teacher evaluation from ONE end of the year test to CONSTANT data collection, via online hidden data.
States will follow Tom Vander Ark’s “End of data poverty” blueprint: http://www.gettingsmart.com/2015/05/the-end-of-the-big-test-moving-to-competency-based-policy/
Yes, SB191 is a broken system. More data collection is not the answer. Students are already in a state of surveillance. https://www.washingtonpost.com/news/answer-sheet/wp/2015/11/12/the-astonishing-amount-of-data-being-collected-about-your-children/?utm_term=.b14b9bf549ab
Tying student test scores to accountability is a bad practice- it drives curriculum and creates a contentious high-pressure situation for children. (Colorado students are STILL being bullied and punished for opting out.) Student data should not be a commodity or a weapon to use against teachers. Online assessments should not be an excuse to share, profile, or monetize student data.
Before policy makers come up with a new accountability plan or education vision, I would hope they consider: any student data shared outside of the school should belong to, be in control of, the parent. We need to fix the 2011 loophole in FERPA that now allows student data to be shared outside of the school without parent knowledge or consent.
Since data is your new credit score and your identity, all citizens (especially children) should own their data, don’t you think?
“Van Schoales is the CEO of A+ Colorado, a community-based “action tank” for education reform. A former teacher and school leader, he is in his third decade of working to improve public education.” That is the description in EdWeek for Van Schoales.
Readers should know that that Van Schoales is better described as a shill for the charter industry. A+ Colorado is not exactly “community based.” It is one octopus arm of a national network organized to promote “choice” and charter schools. Here is the back story.
A+ Colorado is a member of the PIE Network (Policy Innovators in Education) active in 30 states and funded by the usual suspects, none of them friendly to public schools.
The funders of PIE, listed by grant size, are: Bill and Melinda Gates Foundation, The Walton Family Foundation, Bloomberg Philanthropies, Eli and Edythe Broad Foundation, Joyce Foundation, The Charles and Lynn Schusterman Family Foundation, New Venture Fund, and McKnight Foundation.
Members of the PIE Network get their policy perspectives from these “policy partners,” none of them friendly to public schools: Center for American Progress, Center on Reinventing Public Education, Data Quality Campaign, Education Resource Strategies, Foundation for Excellence in Education, National Alliance for Public Charter Schools, National Council on Teacher Quality, The Education Trust, and Thomas B. Fordham Institute.
If you are in Colorado and work on behalf of public schools, you should not let A+ Colorado lose to “innovate” in your schools. Innovate means untried, new, risky business, and these days, takeover and privatize everything in sight.
Call for TEMP workers to grade Colorado tests for $12.50/hour…read and weep.
In the past, these temp. workers received $10.50/hour.
https://kelly.secure.force.com/CandidateExperience/CandExpJobDetails?id=a7V80000000Pixg&ReferrerSource=http%3A%2F%2Ftpc.googlesyndication.com%2Fsafeframe%2F1-0-7%2Fhtml%2Fcontainer.html&rx_paid=1&rx_source=Adwords_Longmont&utm_source=google
Last year one radio ad solicited test graders who would then be allowed to work in “casual attire.” Did anyone but me hear “stoners welcome”…..
As “one of education reform’s own ‘whiz kids'” Michael Johnston is a frightening example of proving the old and very true adage: A Little Knowledge Is A Dangerous Thing. And as a poorly informed and yet very-quick-to-get-on-the-VAM-wagon, Love-Love-Love-TFA supporter, Van Schoales has spent years proving the very same thing about our nation’s loudly opinionated but carefully arms-length DFERs.
The really sad thing about Van is he knows better and in many cases knows what is happening in Denver is not working. We have always had a civil relationship, and just last week he commented on my post. It is ironic that he is criticizing me for exactly what he writes about in this Education Week piece:” …implementation did not live up to the promises.” That is what have stated repeatedly about what is happening in DPS.
https://kaplanforkids.wordpress.com/2017/03/28/m-o-t-s-reform-systems-grow-educational-outcomes-slow/
Instead of admitting failures and making changes, so-called reformers find themselves doubling down on the failures with the never-ending hope something will change to show success. Sounds a lot like what is going on in Washington right now.
Also, Van’s claim that “Reformers were confident we had a clear mandate” puzzles me a bit. As I’ve stated before in 2009 our side won the election. One turncoat changed the entire direction of this district and even then community after community has begged DPS to stop the so-called reform. So, I’m not sure where his mandate came from. Perhaps from “reformers” who had little direct experience with DPS or whose children weren’t being subjected to so-called “reforms.” People like Van whose kids went to, for example the magnet Denver School of the Arts, the furthest thing from a “no excuses” charter and all the other “reforms” one could imagine.
a mandate from heaven?
LOL
Actually I have a kid at DSST and have had the other three in other charters, magnets and district schools. I and many others have taken full advantage of the increased number of quality school options even though there are still far to few for underserved and low-income kids. And the truth is that Denver has continued to improve for all groups of kids even though the gaps have grown (not fast enough but improved). Look for our latest report on DPS in a few weeks apluscolorado.org
Van,
The reformers have had control of Denver schools since Michael Bennett became superintendent in 2005. That’s 12 years.
When do you predict that every child in Denver will be high-performing?
When will Colorado roll back Michael Johnston’s failed teacher evaluation law?
The test-based “Value-Added Method” (VAM) of evaluating teachers has been “slammed” — quoting The Washington Post — by the very people who know the most about data measurement: The American Statistical Association (ASA). The findings of the ASA provide a firm basis by which every teacher who is unfavorably evaluated on students’ standardized test scores to vigorously oppose the evaluation, citing the ASA’s authoritative, detailed, seven-page VAM-slam “Statement on Using Value-Added Models for Educational Assessment”.
Even the anti-public school, anti-union Washington Post newspaper said this about the ASA Statement: “You can be certain that members of the American Statistical Association, the largest organization in the United States representing statisticians and related professionals, know a thing or two about data and measurement. The ASA just slammed the high-stakes ‘value-added method’ (VAM) of evaluating teachers that has been increasingly embraced in states as part of school-reform efforts. VAM purports to be able to take student standardized test scores and measure the ‘value’ a teacher adds to student learning through complicated formulas that can supposedly factor out all of the other influences and emerge with a valid assessment of how effective a particular teacher has been. THESE FORMULAS CAN’T ACTUALLY DO THIS (emphasis added) with sufficient reliability and validity, but school reformers have pushed this approach and now most states use VAM as part of teacher evaluations.”
The ASA Statement points out the following and many other failings of testing-based VAM:
“System-level conditions” include everything from overcrowded and underfunded classrooms to district-and site-level management of the schools and to student poverty.
A copy of the VAM-slamming ASA Statement should be posted on the union bulletin board at every school site throughout our nation and should be explained to every teacher by their union at individual site faculty meetings so that teachers are aware of what it says about how invalid it is to use standardized test results to evaluate teachers.
Fight back! Never, never, never give up!