Peter Greene, like Steven Singer, is unimpressed by Sarah Cohodes’ claim that no-excuses charter schools have solved the problem of low scoring students. Discipline! SLANT! No excuses! Look at the teacher! Walk in a straight line! Thats what the black and brown kids need.
“Cohodes opens with a quick recap of charter history, then lays out the problem with measuring charter effects– selection bias because charter students have chosen the charter. But good news– the selection bias problem is completely solved by charter school lotteries. Except (she acknowledges) not everybody chooses to enter the lottery. And the lottery only applies when schools are over-subscribed. But maybe we can find comparable groups of non-charter students to compare charter students to. Which is hard. Cohodes seems to conclude this kind of research is really hard to design well. So she used some lottery studies and some observational studies in her research. And, having scanned the research, she drops this right in this intro section:
“The best estimates find that attending a charter school has no impact compared to attending a traditional public school….
”Let’s go to the headline material. Essentially, she finds that No Excuses charters set up in neighborhood served by very struggling public schools show a big gain in test scores. But here I will get into specifics, because she cites in particular the KIPP schools and the charters of Boston. Yet Boston charters have been found to come up very short in sending students on to complete college.
“The No Excuses practices that Cohodes zeros in on are ” intensive teacher observation and training, data-driven instruction, increased instructional time, intensive tutoring, and a culture of high expectations.” Not being able to narrow the list down is a problem– if I tell you that my athletic program gets great results by having athletes exercise for two hours daily, drink high protein shakes, breathe air regularly, and sacrifice toads under a full moon, it will be easy to follow my “research” to some unwarranted conclusions. Cohodes’ list is likewise a hugely mixed bag.
“Longer school day and school year is obvious. More time in school = getting more schooling done. A culture of high expectations is meaningless argle bargle. And the teacher training and “data-driven” instruction boils down to the same old news– if you spend a lot of time on test prep, your test results get better.
“Cohodes also notes that the worse the “fallback” school results, the greater the charter “improvement.” In other words, the lower you set the baseline, the more your results will surpass it.
“She doubles back to look at how charters relate to the surrounding public schools, again kicking the tires on the research to test reliability.
“She notes that there are two ways for lottery charters to cream the best students from the community. One is to manipulate the lottery, which she doesn’t think happens (for what it’s worth, neither do I, mostly because it’s not necessary). The second is to push out the students the school doesn’t want. But she is missing two more– make the lottery system prohibitively challenging, so that only the most motivated families can navigate it. And advertising allows charters to send a clear message about which students are welcome at their school. And nobody works those creaming tricks like No Excuses schools, with their highly regimented and oppressive treatment of students….
”And the criticism that I found myself leveling at very page finally surfaces here:
Given that the overall distribution of charter school effects is very similar to that of traditional public schools, expanding charter schools without regard to their effectiveness at increasing test scores would do little to narrow achievement gaps in the United States. But expanding successful, urban, high-quality charter schools—or using some of their practices in traditional schools—may be a way to do so.
Emphasis mine. If you think that closing the achievement gap is nothing but raising test scores, you are wasting my time. It’s almost two decades into this reform swamp, and still I don’t believe there’s a person anywhere sayin, “I was able to escape poverty because I got a high PARCC score.” Using the Big Standardized Test score as a proxy for student achievement is still an unproven slice of baloney, the policy equivalent of the drunk who looks for his car keys under the lights, not because he lost them there, but because it’s easier to look there.
It’s really not that hard to raise test scores– just devote every moment of the day to intensive test preparation. What’s hard is to raise test scores while pretending that you’re really doing something else.
Let’s consider a thought experiment in which further expansion focuses on high-quality charters. What would happen to the achievement gap in the United States if all of those new charter schools were opened in urban areas serving low-income children, had no excuses policies, and had large impacts on test scores like Boston, New York, Denver, and KIPP charters?
Yes, I want to say, and let’s consider a thought experiment in which pigs fly out of my butt. However, she continues
Expanding charters in this way certainly could transform the educational trajectories of the students who attend. But if we consider the US achievement gap as a whole, it would have a negligible effect.
What she wants to see is an expansion of charter practices expanded to public schools, and she sees ESSA as a policy tool to do it. But what practices? Expanded school time? That would take too much money for policy makers to support. Relentless test prep at the expense of broader education? No thanks. High expectations in the form of heavy regimentation, speak-only-when-spoken-to, treatment? Pretend that student socio-economic background and the opportunity gap are not really factors? That seems just foolishly wrong. Besides the questionable morality of such an approach, a vast number of parents simply wouldn’t stand for it. And how would we replace the mission of public education– to educate all students– with the mission of No Excuse charters– to educate only those students who are a “good fit.”

Yes, imagine if real public schools were run like no-excuses charter schools. But wait, lawsuits have prohibited that from happening.
On a different note, Tulsa and Oklahoma in general don’t get examined much within the education “reform” conversation, but I wanted to include a link from yesterday’s Tulsa World. It looks like the city schools are starting their own Teach for America program, but without having to pay TFA. They’ll “train” people with a college degree in a five-week summer program and stick them into the classroom. The guy heading this program is a Broad “Academy” graduate and the superintendent is the infamous Deborah Gist, who approved laying off all the teachers in Central Falls, Rhode Island, under the harsh turnaround options of Race to the Top and NCLB. Philanthropist George Kaiser funds this stuff.
Here’s the article:
http://www.tulsaworld.com/news/education/new-tulsa-public-schools-program-will-train-certify-aspiring-teachers/article_00f8c50e-5137-51f2-8a66-0829c5b0ec83.html
LikeLiked by 1 person
Leigh,
I just finished writing a post about Tulsa.
LikeLike
Thanks!
LikeLike
A very telling statement which should be getting everyone’s attention: “…imagine if real public schools were run like no-excuses charter schools. But wait, lawsuits have prohibited that from happening.”
LikeLike
I posted Peter’s Article at https://www.opednews.com/Quicklink/CURMUDGUCATION-Another-Fl-in-Best_Web_OpEds-Charter-School-Failure_Education_Peter-Greene_Public-Schools-180208-616.html#comment688932
and added yoru commentary as a comment.
LikeLike
Thank you, Peter Greene, for recognizing the Emperor has no clothes!
Here is the report in a nutshell:
Charter schools as a whole have NO effect on achievement.
EXCEPT: The small subset of charters that do show higher achievement by students who enroll are those that use the “no excuses” curriculum that operate in urban areas whose students are mainly poor and low-income.
(By the way, if this subset of no excuses charters does better, and yet the “average” of all charters shows no improvement, that means that charters that are not “no-excuses” are doing a far worse job of educating students than public schools. Which is somehow not mentioned.)
Sarah Cohodes seems like a researcher who is interested in addressing all issues, so perhaps she will respond to questions on here.
To wit, I noticed that Cohodes used as one of her sources (footnote 14) this: “14. Rebecca Unterman, An Early Look at the Effects of Success Academy Charter Schools (New York: MDRC, August 2017).”
In fact, I suspect Cohodes didn’t read that study very carefully because if she had she might have noticed this:
“To examine enrollment rates for students who won Success Academy lotteries, MDRC looked at participation in various Success Academy preenrollment activities that students (and their parents/guardians) who were offered a seat were told to attend. Specifically, after winning the lottery and before the school year started, students and their families were informed of a welcome meeting, student registration, a uniform fitting, and a dress rehearsal. In addition,before enrollment (as is common among many charter networks), parents/guardians signed a contract highlighting the education-related activities offered throughout the year and outlining the various ways the Success Academy staff communicates with families.
Of the lottery winners in the sample (both kindergarten and first-grade entrants), about 82 percent attended a welcome meeting. Approximately 61 percent of lottery winners attended student registration, 54 percent attended a uniform fitting, and 50 percent attended a dress rehearsal. With few exceptions, lottery winners who did not attend an activity did not attend subsequent activities. Ultimately, about 50 percent of lottery winners enrolled in Success Academy schools in the 2010-2011 school year.”
Half the lottery winners chose NOT to attend — the majority of those who chose not to attend did so after one of these enrollment meetings.
And, we know from the NY Times (11/3/08, “The Education Crusader” slide show) that THIS happens: “Ms. Moskowitz asks a lot of participation from parents, as a condition of admitting their children. She told one group, “If you know you cannot commit to all that we ask of you this year, this is not the place for you.”
So what Sarah Cohodes should have discovered is that “no excuses” charters specialize in discouraging less motivated parents (from a group of already motivated parents!) who won the lottery from even enrolling their children.
In addition, it is a fact that while charters go to great lengths to keep their longitudinal attrition rates hidden, there was one WNYC study that showed that Success Academy — with the highest student “achievement” by far — just happens to have one of the very highest attrition rates of any charter network. And this is AFTER half the lottery winners — most likely the least motivated to work hard and do all that is asked of them — give up their spot before enrolling!
Red flag anyone? Apparently not to Cohodes. Not even all the lawsuits by families whose students were drummed out convinces her. Not even the NAACP testimony of the dad explaining how his child was identified the first week (along with other students) and all were targeted for removal.
Here is the formula that Cohodes just discovered is true:
x = achievement of students in all charters.
y = achievement of students in public schools.
x = y
But if we use Cohodes paper and separate x (all charter students) into 2 parts:
x = a + b
a = achievement of students in urban no-excuses charters known for exclusionary practices
b = achievement of students in charters that are NOT “no-excuses” (all other charters)
y = achievement of students in public schools
Cohodes’ paper tells us that a > y AND a > b (which also suggests the unmentionable conclusion that y > b, in other words, public schools are better than every other charter except the no-excuses kind)
But it turns out the formula that Sarah Cohodes is actually using is this:
a = includes students who win the lottery for an urban no-excuses lottery MINUS those students who the no-excuses lottery discourages from enrolling and if they do enroll, drums them out if they are low performing.
b = students who win the lottery for other charters where far fewer lottery winners are discouraged from taking their spot and which are committed to educating all students regardless of they are struggling to learn.
So Cohodes study basically find that the students who are allowed to enroll in an urban no-excuses charter due to their parents’ strong motivation to do exactly what is asked of them MAY have higher achievement than students who are allowed to enroll in other urban charters that don’t exclude students with parents who aren’t as motivated. And they MAY have higher achievement than students who enroll in public schools.
But that is ONLY based on studies that exclude every child whose parent originally wanted him to attend a no excuses charter and disappeared from the no-excuses charter cohort. Since the results of this unknown number of students who had intended to enroll, who attended a pre-enrollment meeting, who spent a few days in Kindergarten but were identified as unwanted and left, or who were in the charter for a year or two but never made it to 3rd grade testing, are all excluded from these studies, Sarah Cohodes has concluded that they are not important.
All I can say is it is a good thing that scientists testing the effect of new medications don’t push new drugs as miracle cures based on this shoddiest of research methods.
The very first thing that scientists look at when examining a new drug is whether the results are being manipulated by excluding patients whose results don’t look good.
Is it any coincidence that charters known for their exclusionary practices — “no excuses” — would have students who perform better than charters who don’t?
What often happens when I post this question is that faux researchers say “but we are comparing all lottery winners, whether they attended a charter school or not.” Or they say “we are comparing all students who enter a charter lottery, whether they win or not.”
And yet no one has ever explained how the results of the lottery winners who are discouraged from enrolling or spend a week in the school before they are identified for removal can be included in these studies. Are they included as students educated in charters despite never being in charters or spending most of their time in public schools? Or are they included as students no educated in charters if they were discouraged from enrolling or identified as unwanted the first week? No one has ever explained how the results of a student who wins a lottery but is discouraged from enrolling or enrolls in a charter for a year or two but isn’t there for 3rd grade testing are included.
By the way, if Sarah Cohodes was a truly outstanding researcher, she would have noticed what the MDRC study she cited in footnote 14 carefully left out.
It is virtually impossible to learn what percentage of students who enrolled at Success Academy for Kindergarten and first grade actually remained at the school long enough to be part of the testing cohort being studied in 3rd and 4th grade. We know how many “lottery winners” remain but we also know that half of the winners never enrolled at the charter after attending those ‘pre-enrollment’ meetings where so many unexplainably changed their minds and never enrolled.
But what is clear again is that students whose scores are included as part of the “attended charter school and made it to testing year” cohort are missing all scores of students the charter chooses to exclude so that they don’t get to the testing year.
The charters that are not “no excuses” which Sarah Cohodes claims do such an extraordinarily bad job of teaching poor students in urban areas when compared to the charters that are “no excuses” very likely exclude far fewer students.
So Cohodes’ real “revelation” is that in urban areas, charters that exclude low-performers do better than charters that don’t. And charters that most ruthless exclude low-performers do better than charters that exclude low-performers but not as ruthlessly. And charters that make a concerted effort to teach every student who wins a seat do the worst of all — so poorly that their results are not as good as those of public schools.
LikeLike
I will not defend no-excuses charters –they have made their gains under false pretenses. However I do believe they have made one important contribution: they challenge the education school orthodoxy that punishment is taboo. There is a theological abhorrence of punishment for students throughout the education world, and to some extent, in the broader culture. This is harming education, and harming kids. Punishment, applied judiciously, works to stop anti-social behaviors and improve school climate. We’re now suffering the effects of our insane allergy to punishment.
LikeLike
Can’t agree with your analysis, ponderosa. Both the schools and districts in which I taught had pretty tight discipline policies. Was there corporal punishment? No, no need to if one consistently applies class rules and respects the students.
LikeLike
I am with you on this one, Duane. Students may on occasion view consequences as punishment but if the rules are clearly defined and the consequences are a natural result of ignoring those rules, then any “punishment” is self imposed. I am thinking of a student I had who was being very disruptive during a discussion. I told him he was welcome to stay if he could contribute to the class otherwise he was free to leave. He chose to leave. The next day when he returned, he tried to accuse me of throwing him out. The other students shut him down really fast reminding him that he had chosen to leave. I can’t say he turned into a model student, but he never “chose” to leave again.
LikeLiked by 1 person
For years now, the Amarillo (TX) public schools have fully bought into Damien Lopez’s “No Excuses” program for those district “clusters” located in low-income, high minority enrollment schools.
These schools are draped in college/university/military school banners, and have shout-outs for each classroom’s college. They use the SLANT system, with yellow and red laminated cards to place on a student’s desk to warn them that he/she will be subject to disciplinary action because they are not “SLANT-ing”. Hallways have tape running down the center to keep students in line. To keep their mouths shut, elementary school children are often told “to make a bubble” in their mouths, keeping hands held by their sides, or grasped behind their backs when walking down halls.
In middle school lunch rooms, students must raise their hands and use hand signs to indicate they need something.
Amarillo Area Foundation offers ACE scholarships to Amarillo College and West Texas A&M to students who manage in these “No Excuses” schools to make As and Bs, and mind their ps and qs, from elementary school through high school graduation. A “No Excuses” program is also in effect at Amarillo College.
Every six weeks the Foundation’s ACE program sponsors an assembly in each school to award certificates, freebies, and even field trips to those ACE students who have met “high expectations.” Those who haven’t either sit through these special assemblies, or, when there’s a field trip, often to visit AC or WT, either stay in the classroom or marched to an assembly in which teachers give them “pep talks” about how they can do a better job at making the grade.
As an old sub who’s been hearing-impaired since late adolescence, I’ve told some classes that I’ve been “SLANTING” all my life–watching the speaker, teacher or minister, and nodding, tracking him/her with my eyes, etc., but, in fact, not hearing a blessed thing they’re saying. Still do this, if accommodations aren’t available for my disability…
This is my very first comment on a blog I’ve been following every single day!
Sincerely,
Edith Ann
Warnecke
LikeLike
Thank you, Edith Ann.
I suspect you realize that these methods are the new colonialism, designed specifically for children of color to teach them to shut up and behave as they are told, without question or qualification.
LikeLike
Diane, from my conversations with teachers, kids’ talking over the teacher is an almost universal problem. Downright teacher abuse is a problem in many classrooms. What is your solution? You once wrote that your partner managed a challenging public school as principal by gaining respect. Is that your answer: gain students’ respect? This suggests that you think these mistreated teachers don’t try to gain respect, or they act in ways that don’t deserve respect. Do you think that the teachers who are being routinely disrespected or psychologically abused somehow deserve their treatment? Do you believe the cliche that if an adult gives respect, he’ll get respect? I don’t. Experience disproves this. I had several very decent high school teachers who were run over by kids day after day.
LikeLike