Archives for category: Testing

When teachers stand together and refuse to be bullied by the powerful, they deserve our commendation.

The teachers in the Hamburg Central School District in New York voted overwhelmingly to reject a bad deal on teacher evaluation. In the plan at issue, the school superintendent would have been the sole arbiter on any appeals of a teacher’s rating. The teachers held out for an independent arbiter. They voted 217-82 not to accept the deal.

They will be hammered and told that they are costing the district $450,000 in Race to the Top funds, but they know not a penny of that money may be spent to reduce class size or hire social workers or guidance counselors or librarians or anything else that would meet the needs of students.

They also know that New York State has an untried evaluation system designed by AIR, whose researchers warned that value-added methods are not ready for high-stakes uses, such as determining the fate of teachers.

Someday in the future, people will look back on this era of teacher-bashing, this insatiable thirst for metrics, and wonder if our society succumbed to collective madness.

Thank you for your courage, teachers of Central Hamburg.

Stay strong.

Your colleagues support you.

Maureen Reedy sends congratulations, praise, hugs, and high-fives to the teachers at Garfield and Ballard High Schools in Seattle. May their message resonate in schools across America.

Dear Ballard and Garfield High School Teachers in Seattle,

Your proclamations ring true as patriots of public education!

Your proclamations proclaim our right as educational experts to independently stand up, and let our voices ring loud and clear for integrity, authenticity and educational expertise in our teaching practice.

Your proclamations are just what our country needs to build the precursor to a new Declaration of Independence for Public Education!

Most importantly, your proclamations show our students that we will stand up for them and be strong role models in fighting for what we know is best in creating quality educational experiences and lessons for our kids.

Quite simply, when something is wrong, we do everything in our power to “make it right.”

That’s what we teach our students, that’s how we practice our profession and that is how we live our lives.

Thank you for standing up for our children, thank you for standing up for our profession, thank you for standing up for public education.

Thank you all for your courage and conviction.

Teachers across America stand with all of you!

Maureen Reedy
Parent & 29-year public school teacher
Columbus, Ohio

The teachers of Seattle ask that you sign this petition to support them.

Please be careful when you go to change.org and do NOT sign any other petition as you may be duped into becoming a member of StudentsFirst.

Last week, Wendy Lecker wrote an article in the Stamford Advocate saying that she was in search of one superintendent in the state of Connecticut who was doing the right thing for kids, teachers, and the community. Wendy had read here about the courage of Joshua Starr of Montgomery County, Maryland, and Heath Morrison of Charlotte-Mecklenburg, two superintendents who bravely have spoken the truth about the corrosive effects of the misuse of testing.

Was there one such stand-up superintendent in Connecticut?

I posted her plea and that very same day, I was able to identify Tom Scarice, superintendent of Madison, Connecticut, as the one. He brought together his community, parents, and teachers, examined research, and reached agreement on the best path forward for Madison.

I named Superintendent Scarice to the honor roll as a champion of public education.

Wendy Lecker investigated, and she agreed: Tom is the real deal!

She writes here about his leadership, which involved collaboration, not dictatorship or coercion:

“The district sought volunteer educators and administrators to develop a teacher evaluation plan that adhered to the core principles of the recent state legislation. But one component of the state’s proposed teacher evaluation plan is Value Added Measurement (VAM), a highly controversial system that uses student test scores in part to rate teachers’ effectiveness. The 45-member advisory council studied three areas: the efficacy of VAM, the impact of VAM on teachers and students and the impact of VAM on the quality of education. The overarching guiding principle was the goal of preparing Madison’s students to succeed in our complex world.

“After reviewing extensive research, the council concluded that VAM is unstable, unreliable and of questionable validity. To the council, “[s]tudent learning is too central to our beliefs to rely on unreliable data when making decisions.” This conclusion is consistent with the vast body of research on VAM. Just last month, the American Institute of Research joined the growing chorus of educational experts in advising against using VAM in any high-stakes situation precisely because of its many flaws.

“The council found that VAM has a destructive effect on both students and teachers. The narrow focus on standardized test scores heightens anxiety and leads to children who are less creative, expressive and excited to learn. VAM also negatively impacts two essential components of effective instruction: teacher collaboration, and the ability to meet individual students’ needs. Furthermore, the council determined from the research that VAM’s focus on test scores is detrimental to a quality education because it narrows the curriculum and marginalizes the development of the skills Madison decided were vital to successful life outcomes, such as critical thinking, problem solving and ethical decision-making.”

Read more: http://www.stamfordadvocate.com/news/article/Wendy-Lecker-A-town-doing-it-the-right-way-4187399.php#ixzz2HiaxSJz7

A comment came in last night from a KIPP teacher in DC. She provides interesting insight about how charter schools can manufacture high test scores. She asks for advice about the TerraNova tests. Can you help her?

I teach Kindergarten at a “no-excuses” charter school in Washington, D.C. The accounts of cheating on which you report are certainly appalling and unsurprising, but – as you’ve mentioned – they are only the tip of the iceberg. Even if scores were left unaltered, and even if these tests measured knowledge that we as a society deem important, we mustn’t forget that these assessments are so poorly designed that they lack validity or reliability. One telling example: my school has adopted the TerraNova as our indicator of choice. Our status as a DC charter, our funding, our esteem in the reform community and our enrollment all hinge on the TerraNova scores that we report out. Since the start of the school year, administration has drilled staff on the importance of this one test. Teachers are pressured to study copies of last year’s test (legal? ethical?), instructional coaches design unit tests to mirror exactly the questions that appeared on last year’s TerraNova, students are prepped extensively on the importance of filling in only one bubble, and all dialogue about student learning has been framed around what they “need to know for the TerraNova.” Of course none of this is uncommon in schools such as mine. However, today I was informed that this year’s test will be *identical* to last year’s. Apparently the test makers only revise the test every few years. So we are quite literally training our students to answer this one set of questions correctly. And schools across the country do the same thing, resulting in higher and higher scores, despite lower and lower levels of actual knowledge. What sort of game our we playing? It’s like we’re stranded in the desert, racing toward a well of water that turns out to be nothing but a mirage. We as a country need, first of all, to have a national conversation about the purpose of public education; perhaps then we will come to realize that putting all our energy toward scoring well on a meaningless test is doing our children nothing but harm.

On another, related note… Part of the conversation about the meaning and purpose of public education is the status of teachers and the teaching profession. TCRecord recently published a commentary I wrote regarding the failure of teacher preparation programs, the danger of alternative certification, and the need for a respected, professional knowledge base among educators. I hope you’ll check it out: http://www.tcrecord.org/Opinion.asp

Lastly, I haven’t been able to find any information about the TerraNova, its creators, or its reputation. Are you familiar with the test? Do have any data about it?

By unanimous vote, the entire faculty at Garfield High School in Seattle voted not to administer the MAP test of reading and mathematics.

This is the first time, to my knowledge, that the faculty of an entire school refused to give mandated tests.

The action of the Garfield High School faculty could have national ramifications because it shows other teachers that there is strength in unity and that they do not have to endure unethical demands with passivity and resignation.

For their courage, their integrity, and their intelligence, I add the faculty of Garfield High School to the honor roll as champions of public education.

The teachers agreed that the tests are a waste of time and money. Students don’t take them seriously because they don’t count toward their grades. But teachers will be evaluated based on the results of these tests that students don’t take seriously. Even the organization that created the tests say they should not be used for teacher evaluation, but the district requires them anyway.

I hope that the example set by Garfield High School will resonate in school districts across the United States and around the world. High-stakes testing is bad for students, bad for teachers, and bad for education.

This is the statement by the teachers of Garfield High School:

SEATTLE – In perhaps the first instance anywhere in the nation, teachers at Seattle’s Garfield High School will announce this afternoon their refusal to administer a standardized test that students in other high schools across the district are scheduled to take in the first part of January.  Known as the MAP test, it purports to evaluate student progress and skill in reading and math. The teachers contend that it wastes time, money, and precious school resources.

            “Our teachers have come together and agree that the MAP test is not good for our students, nor is it an appropriate or useful tool in measuring progress,” says Kris McBride, who serves as Academic Dean and Testing Coordinator at Garfield.  “Additionally, students don’t take it seriously.  It produces specious results, and wreaks havoc on limited school resources during the weeks and weeks the test is administered.”

            McBride explained that the MAP test, which stands for Measure of Academic Progress, is administered two to three times each year to 9th grade students as well as those receiving extra support services.  The students are told the test will have no impact on their grades or class standing, and, because of this, students tend to give it little thought to the test and hurry through it.  In addition, there seems to be little overlap between what teachers are expected to teach (state and district standards) and what is measured on the test. 

            Despite this flaw, McBride states, results of the MAP tests will be used by district officials to help evaluate the effectiveness of instructors who give the test. “Our teachers feel strongly that this type of evaluative tool is unfair based on the abundance of problems with the exam, the content, and the statistical insignificance of the students’ scores,” she says.

            Refusing to administer a district-mandated test is not a decision the school’s teachers made casually, or without serious internal discussion.

            “Those of us who give this test have talked about it for several years,” explained Mallory Clarke, Garfield’s Reading Specialist. “When we heard that district representatives themselves reported that the margin of error for this test is greater than an individual student’s expected score increase, we were appalled!” 

            After the affected faculty decided unanimously to make a stand against the MAP test, they told the rest of Garfield’s faculty of their decision. In a December 19 vote, the rest of the school’s teachers voted overwhelmingly to support their colleagues’ refusal to administer the test. Not a single teacher voted against the action. Four abstained from voting. the rest voted to support it.

            “We really think our teachers are making the right decision,” said student body president Obadiah Stephens-Terry.“I know when I took the test, it didn’t seem relevant to what we were studying in class– and we have great classes here at Garfield. I know students who just go through the motions when taking the test, did it as quickly as possible so that they could do something more useful with their time.”  History teacher Jesse Hagopian said, “What frustrates me about the MAP test is that the computer labs are monopolized for weeks by the MAP test, making research projects very difficult to assign.” Hagopian added “This especially hurts students who don’t have a computer at home.”

            The $4 million MAP test was purchased by Seattle Public Schools during the tenure of former Superintendent Maria Goodloe-Johnson, who left her position in 2011 and sadly passed away in 2012. Goodloe-Johnson sat on the board of directors of Northwest Evaluation Association (NWEA), the company that markets the MAP test. At the time, some pointed out this potential conflict of interest for Goodloe-Johnson, but the district went ahead with the purchase nonetheless.  NWEA itself warns that districts should not use the map test to evaluate teachers.  We teachers of Garfield High School believe that the NWEA is right—this test should not be used to evaluate teachers.  For secondary teachers the test cannot provide useful information about students’ skills and progress.  Still worse, this test should not rob students of precious class time away from instruction. “We believe the negative aspects of the MAP test so outweigh the positive ones that we are willing to take this step,” said Language Arts teacher Adam Gish.

#     #     #

The final MET study supposedly show that value-added modeling really does work and that test scores really do show who the best teachers are.

But Bruce Baker says the study is full of holes and circular reasoning.

When Bill Gates and the top executives at Microsoft put their own children in schools that use test scores as the measure of good teaching, then we will know that they believe in what they advocate.

This is the kind of school that the connoisseurs prefer. True, the school is in Silicon Valley, not Seattle, but I expect the education at the Waldorf School of the Peninsula looks a lot like the Lakeside School (where Bill Gates went) or Maumee Valley Country Day School (where Michelle Rhee went).

The Daily Howler is a tough marker.

He reports on how the media reports on events.

He was not happy with the PBS show about Rhee.

He thought it was dated and failed to ask important questions.

By the way, if you haven’t seen The Daily Howler reports on how the media fumbled the latest international test scores, you should. See here. And here. And here.

There is a connection. Rhee loves to carry on about how horrible American schools are, how dreadful our teachers are, how far down we are in international tests. But if you read the links above, you will learn that our scores on international tests are not so bad. StudentsFirst will have to rewrite a lot of its documents, maybe even retire that insulting video where SF showed a US athlete in the Olympics who pranced around and stumbled pathetically, a man doing a female-only sport. When I recall that awful commercial (shown on national television), it makes my blood boil. What is it with this woman? Why does she want to humiliate the U.S. in the eyes of the world? Why does she have such contempt for our teachers, our schools, and our students?

 

Mary Levy is a veteran civil rights lawyer and budget analyst in Washington, D.C., who has reviewed developments in the D.C. Public schools for more than 30 years. She wrote the following description of the D.C. cheating scandal, which was revealed by USA Today in March 2011 but never subject to a full and independent investigation:

Re: the U.S. Department of Education Inspector General’s “investigation” of cheating in the DC Public Schools on D.C. standardized tests

It is always interesting to watch power and ideology corrupting people’s judgment, in this case the belief that Michelle Rhee’s approach to education reform must be shown to be effective. There have been no meaningful investigations of the evidence of widespread cheating on DC’s state tests between 2008 and 2010. The ED IG’s statement implies that he relied on the DC IG, who only investigated one school. How could either know about the 102 other DCPS schools flagged for possible cheating? And why is the Department of Education so casual about test integrity? Why did Arne Duncan not ask his IG for a broader investigation?

I’ve studied DCPS data, policies, budget, and history for over 30 years. People with personal knowledge of what occurred during the testing aren’t talking to me any more than to anyone else, but my own data analysis supports the need for a real investigation. Among the top 10 DCPS erasure schools (over one-third of their classrooms flagged over a three year period), scores plummeted at all but one by 2010. At four-fifths of the top 20 erasure schools, scores fell by ten percentage points or more. These are schools with one quarter or more of their classrooms flagged. The bottom dropped out by chance at all those schools?

Contrary to Michelle Rhee’s assertion of “dozens and dozens of schools [with] “very steady gains” or even “some dramatic gains that were maintained,” DC CAS test scores rose significantly after 2008 at only a small number of schools (I counted). Ironically, several of those have been closed or are on the current closing list. Security was only tightened gradually, and is still vulnerable to exploitation, so we’re not at the end of the possibilities even now.

Over the months of preparing the Frontline documentary broadcast on Tuesday, January 7, John Merrow tried very hard to break through on investigating the evidence of cheating. He asked me and my colleagues for contacts and data often, and he actively and persistently sought out witnesses. But witnesses aren’t talking. They’re afraid. People in authority tend to dislike and distrust not only whistleblowers, but critics, even the friendly ones. Principals in DCPS serve at will, and the IMPACT evaluation system makes it easy to terminate teachers who displease their superiors. And after all, since cheating is so unimportant to the Department of Education and the leadership in DC, those who could bear witness can expect no result but retaliation.

Mary Levy
January 9, 2013

A reader in Florida saw the description of the Rocketship charters, where students get no art or music. She was not surprised because her child’s school has neither art nor music, just testing:

“My children attend a Title I school in Florida called Triangle Elementary in Mount Dora. They have no art class, no music class, and no recess (my children are 6 and 8). Florida puts all its emphasis on high-stakes testing, and this is the norm unfortunately, unless you can afford private school.”

Florida was one of the two highest rated states on Michelle Rhee’s report card. Providing the arts and a full curriculum does not qualify as education reform in her ranking system. Only testing and pro privatization policies.