Bob Schaeffer of FairTest says that the system of high-stakes testing enshrined in federal law encourages cheating. The Atlanta scandal is not unique. Cheating has been reported in dozens of states and districts. What is different in Atlanta was the scope of the investigation and the unusual criminal treatment of the educators.
ATLANTA TEST CHEATING: LESSSONS NOT YET LEARNED
By Robert A. Schaeffer, Public Education Director
National Center for Fair & Open Testing (FairTest)
The sad story of educators caught manipulating standardized exam scores has focused attention on one type of “fallout” from the testing explosion that has swept across the nation’s classrooms in the past decade. Federal and state lawmakers are scrambling to incorporate lessons from Atlanta as they work to overhaul testing policies in the face of an increasingly powerful assessment reform movement.
So far, however, policymakers have grasped only the most basic message from the Atlanta scandal: sharp score gains may not be what they first appear to be. Most state departments of education have hired “data forensics” firms to examine test answer sheets. Using computers, they now search for unusual numbers of erasures or odd patterns of score gains. Many have become more willing to pursue reports by whistleblowers citing improper exam administration practices.
The ensuing investigations confirmed cases of cheating in 40 states, the District of Columbia, and schools run by the U.S. Department of Defense. Adults manipulated test scores in more than 60 ways from shouting out correct answers to barring likely low-scores from enrolling. The Atlanta scandal is just the tip of a test cheating “iceberg.”
In the wake of Atlanta, many jurisdictions stepped up test security. However, tougher exam administration policing has not made test cheating disappear. In just the past few months, new examples have surfaced in Pennsylvania, New Mexico, Ohio, Louisiana and several other states.
Understanding the widespread “gaming” of standardized exam results requires addressing its root cause.
Nearly four decades ago, acclaimed social scientist Donald Campbell forecast today’s scandals. He wrote, “[W]hen test scores become the goal of the teaching process, they both lose their value as indicators of educational status and distort the educational process in undesirable ways.” The horror stories in Atlanta and many other communities are case studies of what is now called Campbell’s Law.
Many policymakers still ignore the most important lesson to be learned from Atlanta. Cheating is an inevitable consequence of the overuse and misuse of standardized exams. Federal, state and local testing policies put intense pressure on teachers, principals and other administrators. They create a climate in which educators believe scores must soar “by whatever means necessary,” as the Georgia Bureau of Investigation concluded.
It is hardly surprising that more school professionals cross the ethical line.
Across the nation, strategies that boost scores without improving learning are spreading rapidly. These include changing answers, narrow teaching to the test and pushing out low-performing students. These practices are immoral, unethical and, in many cases illegal. But they are completely understandable.
The damage done by a heavy focus on standardized exams is twofold. The test score fixation takes time away from broader and deeper learning, leaving students inadequately prepared for college or careers. Simultaneously, it inflates test results by making it appear as if there is real academic growth when there may be none. These are the two kinds of corruption described in Campbell’s Law.
To eliminate cheating, reliance on standardized exam results for high-stakes educational decisions must end.
Put simply, test-driven schooling cheats students out of a high-quality education. At the same time, it cheats the public out of accurate information about public school quality.
Until assessment policies are overhauled, Atlanta will stand out as the ugliest example of a continuing national epidemic.
You don’t even have to cheat. In New York State only five Regents Exams have to be passed for graduation. So if only one Regents final has to be passed in science or math, the kids aren’t required to take the exam in more “accelerated” courses. Why wouldn’t the teachers encourage the ones who they know will pass the exam to give it a try and be honest with those who are going to fail (those kids don’t want to take the exam anyway). Often the ones who don’t put any effort into the course during the year, don’t show up anyway for the Earth Science or Geometry Regents if they passed Biology and Algebra. I also know smart kids who refused to take the Physics, Trigonometry, or Chemistry Regents because they didn’t want to ruin their average.
Is this really cheating? Especially if the students are making the decisions?
Ellen #SeenItAll
HS Regents courses have become year-long test prep sessions. It is rare for any Regents teacher to diverge from anything but “tested” material. A veteran Regents teacher has had the advantage of viewing and grading many incantations of their test.
Written by NY teachers, the Regents exams become very, very predictable. Old tests remain on-line for review and the months of May and June become test review sessions in the majority of Regents classes. AP classes work in a very similar manner. Though not technically cheating, this results in classes that run far off the authentic learning track.
What about the new Common Core Regents given in January for Algebra? How can you teach to a test which asks questions from the curriculum of a different course (Basic 9th grade algebra vs 11th grade Advanced Algebra)?
NY Teacher – even if you had or could predict the exact questions on the exam, there are some kids who just can’t pass it. I used to tutor students who had taken the same test numerous times and I could tell they were destined to fail them again.
Ellen #NotFromTheLackOfTrying
Too bad DC’s investigation into DCPS was a joke. However, Jay Matthew’s wife and colleagues did a yeoman’s job with what they had.
http://usatoday30.usatoday.com/news/education/2011-03-28-1Aschooltesting28_CV_N.htm
Predating Donald Campbell:
“When a measure becomes a target, it ceases to be a good measure.” [Charles Goodhart]
😎
P.S. This is the first time I saw Campbell’s Law [by Campbell himself] cited as directly applying to test scores.
Turns out, according to my Google searches, he literally applied his own observation re quantitative social indicators to test scores.
Bazinga!
On a less upbeat note…
A sad day, indeed, for all the Raj Chetty fangirls and fanboys out there waiting for their superhero to collect his Nobel prize. Turns out his “Campbell’s Conjecture”* was nothing more than rheephorm vapors clouding his mind—although his bank account didn’t suffer in the least…
¿? Ah, $tudent $ucce$$. Now that makes a lot of ₵ent¢.
*See his testimony in the Vergara trial.*
And when a bad measure (i.e. Pearson/PARCC/SBAC test) is the target, the target is not worth aiming for.
And so, in the words of Arthur Costa, Emeritus Professor at California State University,
“So now we measure how well we taught what isn’t worth learning.”
–
My version of Campbell’s Law (which I wrote and blogged before I had ever even heard of Campbell’s Law):
“Any educational process or notion that has at its heart the notion that it is the data that needs to be treated, and not the students, is fundamentally flawed.”
If what this man says is true, cheating is widespread on tests. Should the solution to this epidemic be jail time. Ridiculous when you think of it. Just another way to punish teachers et al for trying to save their jobs. Racism is an aspect of this Atlanta story and many of the proposed prosecutions will be of black educators. No, it’s not because they are the only ones who cheat, other educators might use more sophisticated methods of cheating. De formers don’t care, more testing brings in more money. Bottom line
And also Paula…Merrow never did follow up on pushing for Rhee to be indicted for all the cheating she knew about, and perhaps encouraged, during her reign in DC.
It has already begun, schools are pushing I UT low scoring students so that their school’s scores are higher. Eva Moskovits has stated in the New York post last week that her schools stopped accepting new students
In january. She does not want those students tested in the mix with students who have been in her schools since September or earlier. She will not be responsible for their scores. It must be nice , to say you are a public school and then away new incoming students bdca uh se it’s too close to the high stakes testing.
More proof that high stakes testing is linked to cheating. This evidence was found in China.
2,440 Chinese students caught cheating in latest high-tech scam
http://www.independent.co.uk/news/world/asia/2440-chinese-students-caught-cheating-in-latest-hightech-scam-9823188.html
Bob Schaeffer. Your work at FairTest is great. Standardized tests are not measuring learning. They are occasions to pontificate about test integrity and to catch cheaters–hence the booming business of “test forensics” with unparalleled surveillance of students, teachers and not limited to tests.
So how is it that Michelle Rhee walked from her cheating scandal?
The anti-Garth Brooks strategy. She has friends in High Places.
I personally feel that changing the cut scores after the test is given to achieve a preconceived passing rate in order to mete out punishments is more than cheating, it is institutional corruption.
As is voting into law a measure which guarantees the lowest five percent of schools will be rated failing regardless of what the final assessments indicate.
If you get twenty years for erasures, I say a life sentence for individuals who purposely set policies which harm students and faculty of public schools.
Ellen #PleasePutMeOnTheJury
Of course, ETS has been doing this for the College Board for years.
I urge every viewer of this blog that is for a “better education for all” to google (and download) the article by Donald T. Campbell from which Bob Schaeffer got his quote.
Both the general formulation of “Campbell’s Law” and the specific reference to how it applies to test scores can be found in his paper of December 1976 entitled “Assessing the Impact of Planned Social Change.”
Yes, it’s a bit technical in spots, but it is well worth the time and effort to read in its entirety.
Or skip around if you like. But a must read.
😎
So, follow the money of taxpayers from kids and teachers in classrooms
1. To buy the tests
2. To get “ready” for the tests, we give publishers of test prep books money
3. To buy technology to give the tests, we give computer companies money
4. To assure no cheating, we give security companies money
5. To get better test scores, the DOE gives TFA and charters money
Before high stakes tests, these entities didn’t make so much $$$$. Are we surprised that there’s no money for public schools?
I used the New Yorker article on the Atlanta test scandal in two remedial writing classes in a community college last fall. I was appalled by the number of students who said casually, “Oh, yes, I’ve had help” or “I’ve seen students helped” on standardized tests, or “Oh, yes, teachers put the answers up on the wall.” In a high-level class to train tutors, one students said, “Oh, yes, on the trig Regents, my teacher walked up behind me, pointed to a question, and said, ‘You might want to rethink that one.'” When I brought this up in another class this semester, in discussing the Atlanta verdict, again many students nodded “oh, yes, of course there’s cheating.”
What kind of example are we setting?
Near the end of my my thirty-year teaching career (I left in August 2005), a new, young English teacher, who had been teaching less than a month, was fired during his prep period for teaching his students how to cheat like he said he cheated on tests in college.
A few of his students went to their counselors to report what he was doing, and the administration investigated and then fired him on the spot. The same day the newbie was let go, I was called in my classroom to pick up one of his 10th grade English classes during my prep period right after lunch, because their were no substitutes available.
The district ended up replacing the long gone, cheating teacher with veterans who gave up their prep periods to teach his five classes. I was one of those five teachers.
That happened during the early years of NCLB. I wonder if administration would do the same thing today with the stakes so much higher and punitive with Race to the Top and the Bill Gates and Walton family support of the CCCSS rank, fire, fail and close agenda.