Christopher Cotton is an English teacher at Shaker Heights High School in Ohio. He wrote this essay, which appears on his union’s Facebook page.
CRUNCHED BY THE NUMBERS
There are three kinds of lies: lies, damn lies, and data.
— Mark Twain (actually, Twain said “statistics,” not “data,” but it’s close enough)
The Ohio Department of Education has given us an F in “Gap Closing” (which is pretty much what my wife gave me after I attempted to insulate the house before a particularly cold and drafty winter). The sweaty toilers of the ODE engine room shoveled our numbers into the great cruncher. The digits tumbled into the spinning teeth of its mighty algorithms. It chewed, it cogitated, it spat out a judgment. Shaker: F.
First of all, I’d like to point out that 86 percent of Ohio’s 608 school districts flunked this category. If we teachers gave a test that 86 percent of our students failed, we would assume there was something wrong with the test. But this percentage is a political, not educational decision.
In any case, the data makes us look bad. Or does it? It all depends on how you chew it. For example, our African-American and Economically Disadvantaged (ED) kids, the ones on the lower tier of our gap, scored better than the white kids in Cleveland and in several other Ohio districts. Where’s your gap now, ODE? Our ED kids performed vastly better than the same demographic groups—regardless of race—around the state and around the country. Might that be a sign of something we’re doing right?
The problem is that no matter how well the lower tier of our gap performs, it’s being compared to a group whose numbers are severely distorted by our very top-performing kids. The district rightly boasts about our graduates who are Presidential Scholars, National Merit Semi-Finalists, Ivy Leaguers, etc. etc. But the exceptional number of these exceptional students is proof not that we’re great educators, but that we have a freakish concentration of freakishly smart kids. According to “Measuring What Matters,” we are the 17th most educated community in the nation. That puts us squarely in freak territory: the top tenth of the top one percent of the 40,000 American cities and towns. We have many kids who come from families in which not only both parents have advanced degrees, but all four grandparents went to college. Most of these kids are going to be good students. Many will be superstars. And when you throw high income into the mix, the superstars are issued capes and wrist web-shooters and bullet-deflecting bracelets.
We do a tremendous disservice to our students—in any disaggregated group—when we compare them to these outliers. If we want to construe any meaningful lessons from the data, we ought to toss out these off-the-chart scores before we do any calculations.
We often hear something like this: “We can close the achievement gap, because we are Shaker.” I would put it the other way around: We can’t close the achievement gap, because we are Shaker—a community with extreme inequalities in income and family educational background. Certainly we should work on narrowing the gap. Certainly we must bust our butts every day to narrow the gap. But if we think we can erase it, we’re chasing unicorns.
The gap was not caused by schools; schools can’t make it go away. For one thing, the kids arrive—whether first grade, kindergarten or pre-school—with an achievement gap already firmly in place, already gaping wide. We can create programs for the disadvantaged kids, we can work relentlessly on pulling them upward, but the gap may not budge. This is because the advantages don’t stop pouring in for the advantaged kids: nightly book readings, educational toys, museum memberships, tutors, psychologists, painting lessons, pottery classes, iPads, cameras, chemistry sets, horses, hockey teams, telescopes, cello camps, complete sets of Harry Potter. The parents not only understand the homework, they have the time to help with it—and also with the dioramas, book-binding, mousetrap-powered cars, baking soda volcanoes. As they get older, the disadvantaged kids get more and more opportunities in Shaker. I’m proud of all the programs that our district sponsors to help these kids. The energy and money we put into these problems are exemplary. But advantaged kids also get wonderful opportunities in school. And on the weekend they go to Shakespeare plays; when there’s a day off they shadow their parents at the Cleveland Clinic; for spring break they go scuba diving in Costa Rica; over the summer they tour the museums of Europe.
Our achievement gap not only doesn’t close over the 12 years of schooling, it grows slightly wider. And here we make another serious mistake when we interpret the data. We assume that, if we were a truly equitable district, the data would show it by having a gap that decreased, or at worst, held steady. But this assumes that learning is a straight, upward-slanting line, a steady accumulation of knowledge and skills. This is a fundamental misunderstanding of how the brain educates itself: not by inputting information, but by loading software. Growth is exponential. The more you learn, the better you get at learning. You learn faster; you retain more; your brain makes new connections and quantum leaps. Our achievement gap widens only slightly over the school years in Shaker, and this is a genuine achievement.
It appears that our district has begun to supplant the term “achievement gap” with “opportunity gap.” I haven’t heard the rationale for this decision, but it seems to me that we are reaching for whips with which to flagellate ourselves. “Opportunity gap” implies that the fault lies squarely with us: for surely we control what opportunities we give our students. But it is our society that has an opportunity gap. And this colossal injustice manifests itself in schools as an achievement gap.
What the data shows us is that, in our little community, we’re doing a damn good job at battling an epic problem—a problem as wide as the nation and as deep as the most hidden and poorly understood mechanisms of the human mind. A problem as old as the Nina, the Pinta and the Santa Maria. Before that, the data is kinda murky.
I am certainly not advocating complacency. I’m not saying we should stop trying to close the gap. We should strive with every fiber of our teaching souls to reach and engage and inspire the kids on the lower tier of our gap. The obstacles in front of them are a monstrous injustice.
But when we hold ourselves to the impossible benchmarks of the ODE, when we hold up illusions as our standards, we not only set ourselves up for failure and recriminations, but we do a real disservice to the kids we want to help. For some of these kids are truly brilliant, some of them are pushing themselves to the limit, day in and day out, some of them are walking miracles. And are we telling them that no matter how hard they work, no matter how high they achieve, it’s not enough?
The failing state report card has led to a lot of hand-wringing in the district, and some urgent communication to parents. But—can I tell you a secret? This is one hell of a good school system. We know it; most of the community knows it. Personally, I’m proud to be a Shaker teacher. I’m humbled by the work of my colleagues. The only message we need to send regarding the news from Columbus is to the ODE itself: take your report card and shove it where the data don’t shine.
There. I feel better already. And now I need to get back to work.
Chris Cotton,
SHHS English Teacher
SHTA Member

Many great points. This should be sent to newspapers.
LikeLike
Oh my god! Where to start? So much mental masturbation over completely invalid nonsense.
First, quit playing their data language game Chris! You’ll lose every time! (Yes, yes, I know it’s supposedly the “coin of the realm” but that coin is not even made of pyrite.)
“Certainly we should work on narrowing the gap. Certainly we must bust our butts every day to narrow the gap. But if we think we can erase it, we’re chasing unicorns.”
Okay so you’ve identified that supposed “gap” as being a fantastical creature (although I would call it a dragon and I’m not talking about Puff the Magical.) Why the hell would you “chase” it? Isn’t that a definition of insanity? Don’t chase it, slay it.
While I know your heart is in the right place, Chris, your acceptance of their data game belies it. The data and gap monster can be slain. Refuse to participate. Teach how you know how to without playing and promoting the standards and testing malpractice regime. Do you have the guts to do so?
LikeLike
Many great points as well.
LikeLike
Refuse to participate? Really? He will be written up and may be fired if he doesn’t have tenure. You could have a little more empathy for his or the other teachers’ plight.
LikeLike
Yep, refuse to participate. And yep he may be fired. It won’t be the end of the world. And no I cannot have empathy when teachers implement malpractices that are discriminatory and that harm children. Personal expediency should never trump justice for when it does atrocities such as the malpractices he rails against occur.
“Should we therefore forgo our self-interest? Of course not. But it [self-interest] must be subordinate to justice, not the other way around. . . . To take advantage of a child’s naivete. . . in order to extract from them something [test scores, personal information] that is contrary to their interests, or intentions, without their knowledge [or consent of parents] or through coercion [state mandated testing], is always and everywhere unjust even if in some places and under certain circumstances it is not illegal. . . . Justice is superior to and more valuable than well-being or efficiency; it cannot be sacrificed to them, not even for the happiness of the greatest number [quoting Rawls]. To what could justice legitimately be sacrificed, since without justice there would be no legitimacy or illegitimacy? And in the name of what, since without justice even humanity, happiness and love could have no absolute value?. . . Without justice, values would be nothing more than (self) interests or motives; they would cease to be values or would become values without worth.”—Comte-Sponville [my additions]
LikeLike
Come on, Duane. Rewrite the essay in your terms. The state is using an instrument on which students from more affluent and well resourced backgrounds score better. The gap is not an assessment of achievement on anything but the ability to perform well on this/these assessment(s) at some point in time. Given the information that children from enriched backgrounds do much better than those from impoverished or less well resourced backgrounds on these instruments, what hypotheses do we generate? The state chooses to demonize schools that are not able to decrease this gap. Somehow schools are supposed to provide all the possible missing ingredients to one group (while holding static the other?). Chris chooses to say they are not really seeing their students or the dynamics of learning. Any teacher worth their salt comes to that conclusion sooner or later. You assert that the only correct response is to refuse to participate in the state’s mandated game. I say that a teacher can convey to their students that the “measure” of their worth will never be contained in a data table of test scores and that judging themselves by their ability to take tests will never give them a true “measure” of themselves. Chris would do his students no service by losing his job; I suspect he is the kind of teacher we need.
LikeLike
Mr. Cotton and his school are victims of voodoo math applied to education for the purpose of rating and ranking. Statisticians should not be determining the effectiveness of a school any more than they should determining the “value add” of teachers. I am no expert in statistics, but I know they make false assumptions about students, schools and teachers. As Mr. Cotton points out, students are not static widgets, and learning is not a linear progression. That is how a very effective school can be deemed “failing.” Something is “rotten in Denmark,” if 86% of the schools in the state are “failing.” It seems like the state has concocted a formula to allow them to privatize en masse. Parents of the school should complain to the state and protest the low ranking of such an effective school. In the next four years, I fear, more communities are going to have defend and assert their children’s right to a free public education.
LikeLike
The myth that the gap can be closed needs to be killed.
It endures as a political and philanthropic legacy designed to distract attention from the early and lasting influence of poverty on what happens in schools.
The idea that teachers are the “most important ” in-school factor in student achievement, is an artifact of statistical thinking. It has been used as if a weapon against teachers, fueling today’s rhetorical claims that great public schools such as those in Shaker Heights are “failing.”
Thanks for recycling this. Chis Cotton: See if some folk at the Cleveland Clinic will accept this cockamamie system–outcomes only and “gaps” must be closed.
LikeLiked by 1 person
I worked in a diverse district that worked very hard to “eliminate the gap.” We made a dent; we narrowed the gap. Even if you get a few students on grade level in a given year, overall the gap is still there. Also, as poor students go up in the grades, it becomes more difficult to reduce the gap as the cognitive and linguistic demands increase. We would brag about our elementary students’ performance. However, when the students hit middle school, we saw a slump. The slump was not caused by “failing” teachers; it was caused by students’ lack of exposure to books, language and experiences that provide the basis for understanding in a more complex curriculum.
LikeLiked by 1 person
France’s schools used to shrink the achievement gap between K and 12, whereas ours have always widened the gap. Then France switched to an American-style skills-centric curriculum and the achievement gap there drastically widened. A knowledge-centric curriculum is thus proven as good medicine for the achievement gap. Laura is right that it cannot ever be eliminated because of home factors.
LikeLike
YES; if we actually moved our attention from a poorly monitored “achievement” gap to a very real poverty gap, we might see some notable changes in the long-term social success/inclusion of all children.
LikeLike
Political decisions that emanate from Columbus, are bought.
LikeLike
Reblogged this on David R. Taylor-Thoughts on Education.
LikeLike
Chris, you wrote one the best explanations of the gap that I’ve read. It starts early with differences in parents’ education, income and life experiences. Schools can’t solve that. It’s not even clear what “solve” means. It’s certainly not scores on a test. The scores measure disparities already in place—disparities which affect “college and career readiness” far more than the standards in place for math and English.
I salute you for the job you do and wish there were many more committed teachers who judge success one student at a time, often by very small victories: a beam of a excitement in a student’s eyes, or a dash of new-found self-confidence. That stuff never shows up on a spreadsheet. But all good teachers know it makes a profound difference in closing the achievement gap.
LikeLike
That achievement gap is 100% Pure Grade AA Bovine Excrement of Pseudo-Intellectual Origin.
LikeLike
I am compelled to repeat repeatedly what a January 2013 Stanford Study discovered about that achievement gap.
“There is an achievement gap between more and less disadvantages students in EVERY COUNTRY; surprisingly, that gap is SMALLER in the United States than in similar post-industrial countries, and not much larger than in the very highest scoring countries.
“Achievement of U.S. disadvantaged students has been rising rapidly over time, while achievement of disadvantaged students in countries to which the United States is frequently unfavorably compared … has been falling rapidly.”
http://news.stanford.edu/news/2013/january/test-scores-ranking-011513.html
LikeLike
I heard that stat quote attributed to Disraeli.
LikeLike
Chris Cotton is an extraordinarily talented English teacher and he sews up torn backpacks for his students while he teaches.
LikeLike
Wiouldnt it be wonderful if the economic gap was held to such scrutiny and the wealthy were penalized for not working to close the “economic” gap?
LikeLike
Like!!!
LikeLike
It hurts when the State of Ohio grades your school an F. It hurts everyone associated with the school: supt., principals, teachers, students, parents and community. It is a very deep game ALEC bought politicians are playing now. They started with the most vulnerable schools, those serving the poor, black/brown communities, and ELL newcomers who need the services that Ohio has cut or never provided. Now that the sham of VAM has reached the heretofore labeled successful/A schools with the unreasonable, unattainable, invalid test data results, it is clear that test & punish is about eliminating public schools in Ohio – not about the achievement gap. If it were solely about the achievement gap, there would be an effort to meet the underperforming students’ needs for nutrition, medical, mental health, housing. Instead, it is all about spending $$ on unneeded teacher improvements: PD, coaching, outside advisors, expensive programs, blended learning, and insane mandates while ignoring the needs of the child.
LikeLike