Jay Greene, chairman of the Department of Educational Reform at the University of Arkansas, reaches a startling conclusion: Higher test do not necessarily translate into higher graduation rates or other life outcomes that matter.

This post pretty much blows away the rationale for corporate reform. How many times did we hear from Michelle Rhee, Joel Klein, Wendy Kopp, Arne Duncan, Bill Gates, and other “reform” leaders that charter schools get higher test scores than public schools? How many times have we heard from the Friedman Foundation and other cheerleaders for vouchers that vouchers are the key to higher test scores? But what if the higher test scores do not translate into better outcomes for students? What if Jay Greene is right? Perhaps the goal of schooling should be to teach a well-rounded education, character, and citizenship? Test scores don’t measure that.

This is one of the most important posts I have read in a very long time. I encourage you to read it.

Greene writes:

I’ve written several times recently about how short term gains in test scores are not associated with improved later life outcomes for students. Schools and programs that increase test score quite often do not yield higher high school graduation or college attendance rates. Conversely, schools and programs that fail to produce greater gains in test scores sometimes produce impressive improvements in high school graduation and college attendance rates, college completion rates, and even higher employment and earnings. I’ve described at least 8 studies that show a disconnect between raising test scores and stronger later life outcomes.

Well, now we have a 9th. Earlier this month MDRC quietly released a long-term randomized experiment of the effects of the SEED boarding charter school in Washington, DC. Because SEED is a boarding school, there was a lot of hope among reformers that it might be able to make a more profound difference for very disadvantaged students by having significantly more time to influence students and structure their lives. Of course, boarding schools also cost significantly more — in this case roughly twice as much as traditional non-residential schools.

While the initial test score results are very encouraging, the later life outcomes are disappointing. After two years students admitted to SEED by lottery outperformed those denied admission by lottery by 33% of a standard deviation in math and 23% in reading. If we judged the quality of schools entirely based on short term changes in test scores, as many reformers would like to do, we’d say this school was doing a great job.

In fact, SEED may be doing a great job in a variety of ways, but when we look at longer term outcomes for students on a variety of measures the evidence demonstrating SEED’s success disappears or even turns negative. Of the students accepted by lottery to SEED 69.3% graduate from high school after four years compared to 74.1% for the control group, a difference that is not statistically significant. And when asked about their likelihood of attending college, there was no significant difference between the two groups. SEED students also score significantly higher on a measure of engaging in risky behavior and lower on the grit scale….

If we think we can know which schools of choice are good and ought to be expanded and which are bad and ought to be closed based primarily on annual test score gains, we are sadly mistaken. Various portfolio management and “accountability” regimes depend almost entirely on this false belief that test scores reveal which are the good and bad schools. The evidence is growing quite strong that these strategies cannot properly distinguish good from bad schools and may be inflicting great harm on students. Given the disconnect between test scores and later life outcomes we need significantly greater humility about knowing which schools are succeeding.

The last time I checked (when reviewing “Waiting for ‘Superman'” in 2010, the cost of a SEED education was $35,000 per child; it is probably more now.

Be sure to open the link to read the full post, which is very informative.