I am reposting this because the original omitted the link to the article. I went to the car repair shop and the computer repair shop today, and wrote this post while paising in a coffee shop between repairs. Carol Burris’s article links to the original study, which has the ironic title “In Pursuit of the Common Good: The Spillover Effects of Charter Schools on Public School Studenys of New York City.” Ironic, since charter schools have nothing to do with the common good.
Recently, a study was released that made the absurd claim that public schools make academic gains when a charter opens close to them or is co-located in their building. To those of us who have seen co-located charters take away rooms previously used for the arts, dance, science, or resource rooms for students with disabilities, the finding seemed bizarre, as did the contention that draining away the best students from neighborhood public schools was a good thing for the losing school.
The rightwing DeVos-funded media eagerly reported this “finding,” without digging deeper. Why should they? It propagated a myth they wanted to believe.
The author of this highly politicized study is Sarah Cordes of Temple University.
Carol Burris, executive director of the Network for Public Education and a former principal, is a highly skilled researcher. She reviewed Cordes’ findings and determined they were vastly overstated. Her review of Cordes’ study was peer-reviewed by some of the nation’s most distinguished researchers.
“Cordes attempted to measure the effects of competition from a charter school on the achievement, attendance and grade retention of students in nearby New York City public schools. In addition, she sought to identify the cause of any effects she might find.”
She did not take into account the high levels of mobility among New York City public school students, especially the most disadvantaged.
But worse, her findings are statistically small as compared to other interventions:
“Upon completing her analysis, Cordes concludes that “the introduction of charter schools within one mile of a TPS increases the performance of TPS students on the order of 0.02 standard deviations (sds) in both math and English Language Arts (ELA).”
“To put that effect size in perspective, if you lower class size, you find the effect on achievement to be ten times greater (.20) than being enrolled in a school within one mile of charter school. Reading programs that focus on processing strategies have an effect size of nearly .60. And direct math instruction (effect size .61) with strong teacher feedback (effect size .75) has strong benefits for math achievement[2]. With a .02 effect size, the effect of being enrolled in a school located near a charter school is akin to increasing your height by standing on a few sheets of paper.”
Burris noted that what really mattered was money:
“Although it appears that Cordes found very small achievement gains in a public school if a charter is located within a half mile, that correlation does not tell us why those gains occurred. To answer that question, Cordes looked at an array of factors — demographics, school spending, and parent and teacher survey data about school culture and climate.
There was only ONE standout out factor that rose to the commonly accepted level of statistical significance — money.”
Burris concludes that journalists need to check other sources before believing “studies” and “reports” that make counter-intuitive claims:
“The bottom line is that Sarah Cordes found what every researcher before her found — “competition” from charters has little to no effect on student achievement in traditional public schools. It also found that when it comes to learning, money matters as evidenced by increased spending, especially in co-located schools.
“Most reporters generally lack advanced skills in research methods and statistics. They depend on abstracts and press releases, not having the expertise to look with a critical eye themselves. But it does not take a lot of expertise to see the problems with this particular study.”
Sarah Cordes’ “study” will serve the purposes of Trump and DeVos and others who are trying to destroy the common good. Surely, that was not her intention. Perhaps her dissertation advisors st New York University could have helped her develop a sounder statistical analysis. It seems obvious that the public schools that have been closed to make way for charters received no benefit at all–and they are not included in the study.

Good job by Carol to debunk Cordes’ paean to charter schools.
And as usual the main assessment device (and a piss poor one at that, totally bogus and invalid) is the standardized test score which supposedly assesses “student achievement, whatever the hell that is, ““competition” from charters has little to no effect on student achievement in traditional public schools.”
Comparing invalid nonsense such are standardized test scores to supposedly assess a non-defined concept of “student achievement” can only result in invalidities and utter nonsensical claptrap. Complete horse manure in, with bovine excrement coming out the other end.
Insane is the only proper descriptor for that “student achievement” absurdity. As a teacher I never gave a damn about “student achievement” only gave a damn if a student was learning Spanish to the best of his/her abilities and desire.
LikeLike
Yes, indeed, where were those dissertation advisors? .02 standard deviations, really? Could it be that a negative outcome would not allow her to get a degree? Or, was she the graduate student of the Department Chair?
How on Earth can .02 standard deviations be called significant, in any way? Why would the Committee allow such a number to be included in a thesis? To allow a ‘positive correlation’ statement to be included simply points out the failure of committee members to understand or take any interest in this work. The members should be ashamed of themselves.
Assuming the study was done with adequate controls to isolate the ‘nearness’ variable, however, a more surprising result is that there was no significant harm done to the nearby public school (based solely upon test scores, of course). Then, again, I suspect that a Committee that can’t even determine that .02 standard deviations is so insignificant that it shouldn’t be reported is equally incapable of pointing out experimental design flaws that fail to isolate the variable being tested.
LikeLike
I know. I know! It makes me crazy when this overblown minutiae is branded as a rational for making policy decisions.
Reformers consistently complaining about grade inflation should turn the finger towards themselves.
Does the committee know that correlation does not mean causation?
And who even approved that research question? There’s little theory previous research or logic that I’m aware of to justify it.
LikeLike
I thought good reporters were schooled on being good at research? Isn’t that taught in journalism school anymore? Maybe Cordes was just writing an oped piece for the DeVos/Trump agenda and she will certainly get schooled by a lot of angry parents.
LikeLike
Temple University, my alma mater, used to have one of the better schools of education. Since 2015 Temple has become a training ground for TFA for both Philly and New York. I don’t know if this association has anything to do with the 0.02 standard deviations in the findings that “reformers” will add to their propaganda buffet. It is just like “reform” to make mountain out of a molehill when results conveniently feed their political narrative.http://thenotebook.org/articles/2015/01/06/tfa-closes-new-york-training-site-sending-trainees-to-philly
LikeLike
Good work!
I’m not a researcher but it isn’t “correlation is not causation” one of the laws of this stuff?
It’s like how they “found” that vouchers improved public schools in Ohio. This may be shocking to ed reformers but public schools try a lot of things to improve. It could have been vouchers or it could have been something public schools did.
I know, right? Impossible to believe public schools did anything without the express permission of the “choice” movement, but they do in fact sometimes improve! All by themselves!
It’s telling to me how public schools are always treated as some kind of “control” in these “choice” promotions- as if they are static and unchanging and completely passive- as if the only thing that affects public schools is what charters and private schools do.
It’s a clear bias. Why wouldn’t you look first to see what the public school changed?
LikeLiked by 1 person
Correlation does not mean causation unless you’re a corporate reformer interested in dumbing down the next generation of children.
Did you know there is a .96 positive correlation between the number of people who died by becoming tangled in their bed sheets with the total revenue generated by skiing facilities? By reformy logic we should recommend killing more people with bed sheets.
http://twentytwowords.com/funny-graphs-show-correlation-between-completely-unrelated-stats-9-pictures/
LikeLike
They’re promoting that stat on college completion in a really misleading way, too. I saw a headline that read “charter school graduates finish college at X times the rate of public school graduates”
That just isn’t true across the board, yet millions of parents will believe it’s true.
It happens so often it has to be deliberate. It’s an obvious, glaring mistake to equate a couple of charter school networks with “charter schools” but they do this stuff constantly.
LikeLike
This is The 74:
Why are #CharterSchool stus graduating college at 3-5X the national average?
Well, I don’t know. Because they chose the best charter schools in the country for that study and excluded the vast majority of them? Just a guess.
Deliberately deceptive. These people are marketing and poli sci professionals. They know darn well how people will read that – as it it measures some national cross-section of charter schools.
LikeLike
The 74 speaks for DeVos
LikeLike
I hope Carol will provide a link to this study. Cordes’has been enlisted twice to serve as a co-peer reviewer for the National Education Policy Center (NEPC) both of those studies about charter schools in Illinois.
Thank you Carol, for not taking the leap from reporting on standard deviations to reinventing those deviations as “hours of learning.”
LikeLike
Does Cordes receive grants? If so, from whom?
LikeLike
I don’t know.
LikeLike
Reposted for you, Laura
LikeLike
Cordes is garden variety . She gets her salary from a state-related university that receives financial appropriations from the taxpayers of Pennsylvania. Then, she uses her public-subsidized perch to extol privatization of schools. Cordes ought to look in the mirror- she wants privatization… she should go work in the private sector like Michelle Rhee did when she joined the board of a right-wing owned corporation.
LikeLike
And away it goes…into the ether….https://www.chalkbeat.org/posts/ny/2017/07/28/do-charter-schools-hurt-their-neighboring-schools-a-new-study-of-new-york-city-schools-says-no-they-help/
LikeLike
And here’s another….http://www.nydailynews.com/opinion/charter-schools-raising-educational-bar-article-1.3372403
LikeLike
And here’s another: https://www.theatlantic.com/education/archive/2017/08/why-charter-schools-are-good-neighbors/535638/… but this one had some embedded good news for those of us who think that more spending and smaller class sizes are important: it seems that spending in co-located public schools was 9% higher and class sizes were smaller. Wouldn’t it be great to see how a 9% increase in spending and a reduction in class sizes would play out in the “traditional” public school system. http://wp.me/p25b7q-1V9
LikeLike
Hechinger Report (Gates-funded) highly praised, a free-standing charter school in Baltimore. The writer failed to identify that the contractor school was getting $9,137 per student while the public school received $5,300. The contractor school went back to court to get even more. Since politicians are bought, I assume, Maryland is like Ohio, the industry got what it wanted.
LikeLike
Maryland has a Republican governor, who stacked the state board with other Republicans. MD is a blue state and the legislature fights the governor. But the governor, Larry Hogan, controls education policy the board
LikeLike
“Burris concludes that journalists need to check other sources before believing “studies” and “reports” that make counter-intuitive claims: ”
“Most reporters generally lack advanced skills in research methods and statistics. They depend on abstracts and press releases, not having the expertise to look with a critical eye themselves. ”
add to that Group think and editorial bias and we have the true nature of “fake news”
It’s not the pizza-gates that should concern us . It is the shrinking press rooms and the diminished number of competing publications, coupled with a 24 hr news cycle that pits mostly light weight cable hosts against paid spokesman.
LikeLike
There are four times as many people employed in PR as there are in journalism. And, on average, the PR people earn substantially more.
LikeLike