Archives for category: Teacher Evaluations

Last week, Bill Gates wrote an opinion piece for the Wall Street Journal in which he explained how to solve the world’s biggest problems.

The article was titled, modestly, “My Plan to Fix the World’s Biggest Problems.”

The answer is simple: Measurement.

To prove his point in education, he pointed to the Eagle Valley High School, near Vail, Colorado. He said that the school adopted his recommendations about measuring teacher quality, and test scores went up.

He wrote:

Drawing input from 3,000 classroom teachers, the project highlighted several measures that schools should use to assess teacher performance, including test data, student surveys and assessments by trained evaluators. Over the course of a school year, each of Eagle County’s 470 teachers is evaluated three times and is observed in class at least nine times by master teachers, their principal and peers called mentor teachers.

The Eagle County evaluations are used to give a teacher not only a score but also specific feedback on areas to improve and ways to build on their strengths. In addition to one-on-one coaching, mentors and masters lead weekly group meetings in which teachers collaborate to spread their skills. Teachers are eligible for annual salary increases and bonuses based on the classroom observations and student achievement.

What he didn’t mention was another interesting and sad fact about the school.

Last May, it laid off its three foreign language teachers and replaced them with a computer program.

The school has money to pay bonuses, but apparently cannot afford to retain foreign language teachers.

One teacher had been in the school for 21 years and was four years away from retirement.

The community turned out to support her, but the board voted to dismiss her in the middle of Teacher Appreciation Week.

The board bought a foreign language teaching program. The students will have to pay $150 per semester to take the computer course.

Is this good education? Would they do that at Lakeside Academy in Seattle, where Bill Gates went to school?

Or would they boast of their foreign language department?

The Education Policy Analysis Archives is releasing a series of articles about VAM that you should read.

Here are links to the first three. Forgive the formatting. I am copying the email I received. There are more on the way, including a dissection of the much over-hyped Raj Chetty, et al, analysis that made the front-page of the New York Times and was cited by President Obama in his State of the Union address last year.

Education Policy Analysis Archives has just published the introduction and two articles of EPAA/AAPE¹s Special Issue on Value-Added:What America’s Policymakers Need to Know and Understand, Guest Edited by Dr. Audrey Amrein-Beardsley and Assistant Editors Dr. Clarin Collins, Dr. Sarah Polasky, and Ed Sloat 

>>http://epaa.asu.edu/ojs/article/view/1311
>>
>>Baker, B.D., Oluwole, J., Green, P.C. III (2013) The legal consequences
>>of
>>mandating high stakes decisions based on low quality information: Teacher
>>evaluation in the race-to-the-top era. Education Policy Analysis
>>Archives,
>>21(5). Retrieved [date], from http://epaa.asu.edu/ojs/article/view/1298
>>
>>Pullin, D. (2013). Legal issues in the use of student test scores and
>>value-added models (VAM) to determine educational quality. Education
>>Policy
>>Analysis Archives, 21(6). Retrieved [date], from
>>http://epaa.asu.edu/ojs/article/view/1160.

Mercedes Schneider, a teacher in Louisiana who holds a Ph.D. in statistics and research methods, has been analyzing the board membership of the National Council of Teacher Quality. NCTQ is working with U.S. News & World Report to grade every teacher education program in the nation. Dr. Schneider wanted to see the qualifications of those who are judging the nation’s teacher education programs and making pronouncements on teacher quality. This is the fourth installment of her inquiry.

Arthur Goldstein is a high school teacher in New York City. He blogs at New York City Educator.

The New York State Legislature gave Mayor Bloomberg control of the New York City public schools in 2002. Here is Arthur Goldstein’s assessment of Mayor Bloomberg’s decade of near-total control:

When Michael Bloomberg came into office, there was quite a lot of talk about mayoral control. After all, as always, the schools were in crisis. Op-eds warned end of the world was imminent if we did not address this crisis immediately. Mayor Bloomberg’s predecessor, Rudolph Giuliani, had attempted to procure control, but was frequently preoccupied with lawsuits (like the one demanding the right to bring his mistress into the home he shared with his wife and young children).

Bloomberg had a vision, a vision in which our Board of Education was replaced with a Panel for Educational Policy. In order to give some semblance of democracy to this vision, each borough president was allowed to select a representative. But Mayor Bloomberg would get 8 of the 13 votes, and any borough that stood in his way could go to hell. Also, any mayoral rep that voted against Bloomberg’s wishes, or contemplated doing so, would be fired. Thus, we learned much about Michael Bloomberg’s interpretation of democracy.

Also, to fix the supposed problem of educators presuming to run schools, Bloomberg would do away with the quaint notion of a master educator becoming principal, traditionally short for “principal teacher.” Instead, he’d get more business-oriented types to whip teachers into shape. I’ve only met one Leadership Academy grad, but I was amazed at his ability to speak jargon and slogans in lieu of English. Most teachers, like me, would much rather place their faith in someone who spent at least a good decade in the classroom.

To improve education, Bloomberg would close schools, and their problems were to magically disappear with their names. Large Neighborhood High School would become four schools, the International School of Niceness, the Michael Bloomberg School of Basket Weaving, or what have you. Only by the time the school opened, the Niceness principal was replaced with a Leadership Academy principal, and the basket-weaving principal would be replaced by someone who couldn’t tell a basket from a bucket.

New York City’s neediest kids, like the ESL students I serve, failed to disappear as planned and continued to pull down test scores, apparently the only thing Mayor Bloomberg cared about. No matter how many schools he closed, kids who didn’t speak English persisted in answering questions incorrectly. Being a lowly teacher, incapable of thinking out of the box, my instinct would have been to teach them English. But Mayor Bloomberg deemed it more productive to close more of their schools. As he closed schools in their neighborhoods, high-needs kids moved to nearby schools, which would soon close as well.

But Mayor Bloomberg (after getting Christine Quinn to help revoke a term-limit regulation twice affirmed by voters) had good news while purchasing term three. Miraculously, state scores had gone up! Diane Ravitch examined NY State’s NAEP scores and said it was too good to be true. And after she endured much criticism from Bloomberg and his minions, it turned out she was right.

Sadly, after having elected Mayor Bloomberg for yet another term, his much-vaunted accomplishments melted right before our eyes. Yet he was determined to stay the course, and went right on closing schools. I attended hearings at Jamaica High School where virtually the entire community got out and no one was in favor of its closing. UFT chapter leader James Eterno made a very persuasive case that the closing was based on false statistics. Yet Eterno, and indeed Jamaica’s entire community were ignored as the PEP rubber-stamped its closing (as it does for every closing).

More recently, Mayor Bloomberg tried one of President Obama’s initiatives, the turnaround model, for some schools. This, apparently, would draw funding and give kids who don’t speak English a chance to pass tests (or something). However, he was displeased when the UFT failed to agree with how to use junk science to evaluate teachers, and thus planned to close dozens of schools instead.

When the UFT finally agreed on a junk science framework, Bloomberg was horrified that 13% of poorly rated teachers could get impartial hearings, and decided to close the so-called turnarounds anyway. An arbitrator ruled against that. Though the mayor decided that the arbitration he’d agreed to was unfair, having not gone his way, he was shut down in court.

Even now, Mayor Bloomberg is still not satisfied the new junk science plan will realize his long-cherished wish of firing teachers arbitrarily and capriciously. That’s why he shot down the plan his DOE agreed upon on the last day it could’ve save $250 million, or 1% of NYC’s education budget. (Not much coverage was given to the fact that Mayor Bloomberg had already cut 14% of the budget, all by himself, since 2007.)

I have been teaching in a trailer for most of the time Mayor Bloomberg has been in office. Mayor Bloomberg promised to get rid of them by 2012. In 2007, there were about 400 trailers. Now, there are about 400 trailers.

That’s symbolic of Mayor Bloomberg’s educational progress. A less visible symbol is the disappearing neighborhood school. To me, a school anchors a neighborhood much better than, say, a department store, or even a Moskowitz charter school. Francis Lewis High School, for my money the best neighborhood high school still standing, is one of the few large high schools Bloomberg has spared. Our neighborhood, our students, and our staff are better off for that. Nonetheless, we survive despite how the mayor treats us, not because of it.

And since Mayor Bloomberg does not believe in satisfactory or unsatisfactory ratings, I’ve devised a new one just for him—completely ineffective. I’m quite sure history will vindicate that rating, if only Michael Bloomberg is not paying the salary of whoever writes the history book.

You earlier read the press release from the National School Boards Association here, reasserting the importance of federalism, a concept unknown to the U.S. Department of Education these days.

Here is a great summary and a link to the NSBA’s proposed legislation, which tells the federal government to abide by its federal role–not as the boss of the nation’s schools, but as a support.

I think the Garfield High teachers are a model for teachers across the nation.

They show that collective action works. If one person speaks up, he or she gets fired.

When an entire faculty resists, together their voice is heard around the world.

Not everyone agrees, of course. Mike Petrilli of the conservative Thomas B. Fordham Institute (where I was a trustee for many years but am no longer) strongly condemns the Garfield teachers. He thinks they are shirking their duty. He thinks they are trying to avoid being held accountable. He thinks they should not compare themselves to Martin Luther King Jr.

I disagree with Mike.

Martin Luther King taught the nation–and the Garfield teachers–about the power of collective action against injustice. He showed them that the powerless, acting in concert, have power even if they don’t have money.

Teachers know better than think tanks that testing has become obsessive and pointless. President Obama has frequently inveighed against teaching to the test. The teachers are exercising their conscience, are manifesting professional responsibility, and are supporting what they believe is right for their students.

Dr. King taught them the power of the boycott. He taught them to stand firm against what they know is wrong. He taught them to have courage regardless of the odds against them.

And lest we forget, Dr. King did not fighting for privatization of public services; he did not demand high-stakes testing for children. He demanded equality of education opportunity, not a regular application of the bell curve. Dr. King demanded an end to poverty and war. He died helping the sanitation workers of Memphis organize a union.

This comment from a Puget Sound parent hits the nail on the head about both the strategy and goal of corporate reform. First, create dissatisfaction, then turn us into shoppers, choosing a school while destroying our attachment to our community schools. In time, we discover that it is the school that chooses, not the shopper.

 

One of the objectives of the privatizers is to reinforce the “Mall Mentality” that so many of us just act on, unconsciously. The entire goal is to get us to see education as a “product” to “choose”—like we would with a new pair of sandals at a giant retailer.

What’s MY “return on investment” for MY kid? How come I’m paying for YOU, “teacher”, and I can’t just “can you, like my boss can can ME, anytime, for any reason?”. What am I getting for MY money?”

And the reason that the privatizers are trying to drill this into us with words like “choice” and “investment” and “accountability” is that they realize that community, cooperation and mutual support are CRITICAL if a public school is to survive, let alone thrive.

Privatizers WANT people to be suspicious of the people running their schools and ultra-competitive with each other. They want people looking for advantage and focused exclusively on self-interest, resulting in an obsession with “MY KID!”—and implicitly “NOT YOUR KID!”

Privatizers live for the image of parents bickering, breaking into factions, and running for the exits after they maliciously pay someone to yell “FIRE!” in the equivalent of a very crowded theatre.

Like the crowd during the bank run in “It’s A Wonderful Life”, will we panic and sell out to Potter, “for at least HALF of MY MONEY” or will we stick together, realizing that our strength comes from standing WITH one another, united for ALL of “OUR KIDS”?

John Thompson examined the studies comparing the relative cost and benefits of older and younger teachers, and he reads the findings differently from the Education Week reporter.

Here are my thoughts on your question.

These studies had different purposes so, if used properly, they would have different effects on policy discussions. For instance, the North Carolina study investigates, “different responses to pension incentives.” It develops “a conceptual model of teacher retirement behavior and employ(s) a unique data set to estimate the causal effect of pensions on teachers’ exit decisions.” It explains, “Teachers in my sample are in their fifth or higher year of teaching … .”

In other words, it offers no support for reformers seeking to replace veteran teachers with TFAers or other inexperienced teachers in the hope that student performance will increase.

Also, in North Carolina “the most- and least-effective teachers in North Carolina are the first to leave, a new study finds. By six years out, however, more-effective teachers are much more likely to retire than less-effective ones.” So, if we conclude that inexperienced teachers are as effective and cheaper as experienced ones, and keep the buy-outs in perpetuity, what would happen after the least-effective veterans are gone? That question should give pause to “reformers,” who in my experience are committed to driving Baby Boomers out in order to keep young teachers away from our professional judgments, as well as save money.

Secondly, the Los Angeles study found an increase in student performance after retirements and it focused on peer effects and the decision to retire. So, it could be an anomaly (due to that unique retirement law and its effects on one district) or, it could have been the most important study for policy purposes. After all, West Ed had discovered that for every $1,000 cut from per-student spending, teachers in the state were 4 percent more likely to retire. That suggests that conditions inside schools can have a big effect on who takes early retirement, and that has a big effect on whether those early retirees are a valid sample for discussing the effectiveness of teachers.

The LA study found “that the retirement of an additional teacher in the previous year at the same school increases a teacher’s own likelihood of retirement by 1.5-2 percentage points.” It conducted “robustness checks indicate that teachers’ responses to colleagues’ retirements in the previous year are not driven by coordinated retirements of spouses, a subsequent increase in workload or a distaste for working with less experienced teachers.”

But, it did not check for the factors that teachers would cite as likely explanations of variance in who retires and why. After all, we are more likely to throw in the towel after being worn down by the challenges of high-poverty schools and/or mismanagement. So, the chances are that the sample of early retirees was not representative but that the economists did not ask teachers to help design a better methodology for comparing teaching effectiveness.

Thirdly, the Illinois study found that the poorest and lowest-performing schools saw the biggest test-score gains after early retirement. Those results may say a lot about the nature of those schools, but thus say very little about the teaching profession as a whole. The sad truth is that the top talent in the toughest schools tend to be worn down and move to schools that are less maddening. Moreover, low performers tend to be channeled towards low-performing schools.

The question is how these serious problems should be addressed. Some “reformers” want to move teachers around like chess pieces, and they will claim that these articles give support to their top down policies.

I suspect that many relevant findings reflect early retirement packages (especially when they use data back to 1992) being used as a substitute for a lot of missing policies. Yes, low performing teachers were more likely to take the offer, suggesting that they were used in lieu of the dismissing ineffective teachers. The solution to that issue is fair and efficient methods of removing ineffective teachers, as opposed to today’s “teacher quality” gimmicks.

High-performing teachers were also more likely to retire early and that reflects a lack of a career ladder. So, the studies document the need to better capitalize on the strengths of the best teachers. To take a military metaphor, if the best lieutenants kept getting pay raises, but they could not be promoted, they would get better at leading their own platoon, but their wisdom would not affect more than those few soldiers. A better system would be for systems to institutionalize ways of drawing on the experience of top teachers – experience that they are paying for – for setting effective policies.

We should not be like the “reformers” and deny truths such as the reality that “many teachers may feel ‘pulled to stick it out a few more years’ in order to receive their full pension benefits, even if they are no longer interested in teaching.” As one local union leader explained to me, the best tool for removing older, ineffective teachers would be the passage of universal health care. His efforts to counsel out such teachers were undermined by the reality that older persons with health problems are locked into their jobs by the lack of health care options. Similarly, Toledo’s Dal Lawrence describes his decision to fire a friend. His fellow teacher later said that the job’s stress had gotten to him and the union’s dismissal of him through peer review saved his life.

The following may sound like special pleading, and I have less confidence in it, so I would not showcase the following speculation. But, in regard to the Illinois study, in the early 1990s the crack and the murder epidemic were peaking. Their replacements in the mid-1990s entered a profession where NAEP scores were increasing. The same could also be true of the L.A. study which covers the peak of the Clinton economic boom 1998 to 2001. So, the veteran teachers might have seen additional increases in their test score growth if they’d remained during the up years.

My district did early retirements in the “jobless recovery” of the mid-90s. It thus got the budget problems behind it in the least disruptive way. Soon afterwards, test scores increased as Oklahoma City finally got out of our two-decade Great Recession. And, that influences my views on how the studies should be read.

During the 2007 Great Recession, my district rejected the buy-out option. Oklahoma embraced the Colorado teacher evaluation law and Oklahoma City used the SIG and other “reforms” to “exit” veteran teachers who it thus labeled as “culture killers.” In the most notorious example, a Transformation school “exited” 80% of its teachers. Now, 5% of that school’s juniors are on track to graduate. The elementary school that feeds my old school brought in so many young teachers that it made the newspaper because of the rampant fights and chaos that resulted, so that they even had to close the school to get reorganized.

The first step in analyzing the economic studies should be to consider “Rational Expectations.” Why would a talented young person commit to a profession, start a family, and buy a house when he or she would become expendable after their effectiveness peaked? We should also ask what would be more cost effective – periodic buy-outs that we all acknowledge aren’t an optimal approach or the churn of today.

Reformers condemn buy-outs and other practical but unlovely policies as “the status quo.” But, they should honestly face all of the facts and ask whether their policies have been worse than the imperfect ones of the “status quo.” They should not cherry pick economists’ findings. They should do a cost benefit analysis of their theories.

As I argued this week, neither we should not be afraid of admitting hard truths.

http://www.huffingtonpost.com/john-thompson/the-challenge-of-overcomi_b_2521436.html?utm_source=Alert-blogger&utm_medium=email&utm_campaign=Email%2BNotifications

We should be transparent when discussing the difficulty in creating learning environments where equally good teachers in rich and poor schools can get equally good results. Especially in the inner city during an age of “accountability,” teachers get burned out. After all, in the inner city the biggest beneficiaries of such policies would not be teachers, as much as the students who are also burned out by our deplorable conditions.

If the evidence shows that teacher effectiveness increases steeply in the first few years and then levels off, why should we feel threatened by that? Isn’t it likely that the same is true of most jobs? Would we get better doctors or better UPS drivers if we started to harass them out of jobs after their first decade or so?

Even President Obama, last week, returned to the position that we can’t balance our budget by reneging on Social Security and Medicare. It is only the contemporary school “reform” movement that argues that teaching is the only profession that would attract more talent if contacts signed in good faith could be torn up at the whim of non-teachers.

And, finally, while pure research may yield information on high- and low-performing teachers, policy should focus on the vast majority in the middle. The ultimate pyrrhic victory is using abusive teacher evaluations the way we are doing now – undermining the entire profession to get rid of low performers.

Anyone who attended public schools knows there was plenty that was wrong with them.

I grew up in Texas and attended segregated schools. That was wrong then, and it is wrong now, even though it is no longer mandated by law.

I had some great teachers and some awful teachers.

Over the years, in my studies of American education, I have documented the rise and fall of reform movements. Some were more successful than others, but one thing is certain: Public schools must constantly get better, and they should today.

In this article, Marion Brady explains what he thinks was better about the era before today’s test-driven, data-driven, privatization-friendly reforms. He thinks the drive for standardization is a big mistake.

What do you think?

This is a disturbing interview with Nevada’s State Superintendent of Instruction James Guthrie.

Nevada is 18th in the nation in teachers’ salaries but Guthrie seems to think they are overpaid.
He is certain there are large numbers of bad teachers in the state.

He has the governor’s ear. In his State of the State address, Governor Sandoval made clear that he wants more of those TFA to come to Nevada and raise scores and close the achievement gap.

In his State of the State, the governor said,

“”One of the most successful programs in the country today is Teach for
America – a unique corps of brilliant young leaders from America’s top
universities, who give their time and talent as teachers in schools
that need them most.

“These teachers help spur innovation and creativity in instruction that
makes the entire system better.

“Teach for America has helped make a difference in the lives of
hundreds of Nevada’s students.

“But we can do more.

I am proposing a new investment in Teach for America to help recruit,
train, develop, and place top teacher and leadership talent in
Nevada.”

So instead of investing in career educators who plan to stay with their schools for the long run, the governor plans to invest in 22-year-old college graduates who have 5 weeks of training and commit to stay for only two years.

Dumb thinking. Poor planning.