Archives for category: National Education Policy Center

A careful review of the Brookings study of New York City’s privately-funded voucher program finds that the program had no significant effects.

The authors of the voucher study, Paul Peterson of Harvard and Matthew Chingos of Brookings, wrote an article in the Wall Street Journal claiming that their study proved “the success” of vouchers. The study was widely cited by news media and voucher advocates as “proof” that vouchers improve college-admission rates for minority students.

Sara Goldrick-Rabb of the University of Wisconsin says that the study does not confirm the authors’ inflated claims. The National Education Policy Center, which published Goldrick-Rabb’s review, writes:

In her review of the Brookings report, Goldrick-Rab observes that the study identifies no overall impacts of the voucher offer, but that the authors “report and emphasize large positive impacts for African American students, including increases in college attendance, full-time enrollment, and attendance at private, selective institutions of higher education.”

This strong focus on positive impacts for a single subgroup of students is not warranted. Goldrick-Rab notes four problems:

· There are no statistically significant differences in the estimated impact for African Americans as compared to other students;
· There is important but unmentioned measurement error in the dependent variables (college attendance outcomes) affecting the precision of those estimates and likely moving at least some of them out of the realm of statistical significance;
· The authors fail to demonstrate any estimated negative effects that could help explain the average null results; and
· There are previously existing differences between the African American treatment and control groups on factors known to matter for college attendance (e.g., parental education).

“Contrary to the report’s claim, the evidence presented suggests that in this New York City program, school vouchers did not improve college enrollment rates among all students or even among a selected subgroup of students,” Goldrick-Rab writes.

http://nepc.colorado.edu/newsletter/2012/13/vouchers-college

The National Education Policy Center in Boulder, Colorado, released a report today about the performance of the for-profit online corporation K12. This is the biggest of the online operators, which has been criticized repeatedly for poor academic performance yet continues to expand. Just recently, Ohio and Pennsylvania added more for-profit virtual charters, as North Carolina rejected them and New Jersey deferred making a decision.

The new NEPC report found that students who enroll in these virtual schools do worse in academics than those who attend a brick-and-mortar school.

The authors of the report urged states to slow down in their headlong rush to open more such “schools.”

Here are the major findings, as reported in the press release:

New Report Shows Students Who Attend K12 Inc. Cyber Schools Falling Behind

Students at K12 Inc., Nation’s Largest Virtual School Company,
Are Lagging in Reading, Math and Graduation Rates; Researchers Say Evidence of Success Needed BEFORE Further Expansion

Few Dollars Dedicated to Instructional Salaries and Special Ed, Despite Lower Overhead Costs

WASHINGTON — A new report released today by the National Education Policy Center (NEPC) at the University of Colorado shows that students at K12 Inc., the nation’s largest virtual school company, are falling further behind in reading and math scores than students in brick-and- mortar schools. These virtual schools students are also less likely to remain at their schools for the full year, and the schools have low graduation rates. “Our in-depth look into K12 Inc. raises enormous red flags,” said NEPC Director Kevin Welner.

The report’s findings will be presented in Washington today to a national meeting of the American Association of School Administrators (AASA), where the report’s lead author, Dr. Gary Miron, is scheduled to debate Dr. Susan Patrick, president and CEO of the International Association for K–12 Online Learning. The report is titled, Understanding and Improving Full- Time Virtual Schools.

“Our findings are clear,” said Miron, an NEPC fellow, “Children who enroll in a K12 Inc. cyberschool, who receive full-time instruction in front of a computer instead of in a classroom with a live teacher and other students, are more likely to fall behind in reading and math. These children are also more likely to move between schools or leave school altogether – and the cyberschool is less likely to meet federal education standards.”

K12 Inc. schools generally operate on less public revenue, but they have considerable cost savings, says Miron. They devote minimal or no resources to facilities, operations, and transportation. These schools also have more students per teacher and pay less for teacher salaries and benefits than brick-and-mortar schools.

“Computer-assisted learning has tremendous potential,” said Miron. “But at present, our research shows that virtual schools such as those operated by K12 Inc. are not working effectively. States should not grow full-time virtual schools until they have evidence of success. Most immediately, we need to better understand why the performance of these schools suffers and how it can be improved.”

Earliier this week, New Jersey education officials postponed granting approval to a K12 Inc. full- time virtual schools for one year. In many states, however, policy is headed in exactly the opposite direction. In Michigan, for example, legislators decided earlier this year to lift the cap on full-time virtual schools, even though the state was in the second year of a pilot study to see whether these schools work and what could be done to ensure they work better. That pilot study had provided no findings to support such a scale-up.

Student performance results from the current study are clearly in line with the existing body of evidence, which includes state evaluations and audits of virtual schools in five states as well as a more rigorous study of student learning in Pennsylvania virtual charter schools conducted by the Center for Research on Education Outcomes (CREDO) at Stanford University. CREDO’s study found virtual-school students ended up with learning gains that were “significantly worse” than students in traditional charters and public schools.

New Report Shows K12 Inc. Cyber School Students Falling Behind/ 3

Miron and co-author Jessica L. Urschel, a doctoral student at Western Michigan University, analyzed federal and state data sets for revenue, expenditures, and student performance. In terms of student demographics and school performance data, the researchers studied all of K12’s 48 full-time virtual schools. In terms of revenues and expenditures, they used a federal data set that includes seven K12 Inc. schools from five different states (Arizona, Arkansas, Idaho, Ohio and Pennsylvania), although these seven schools accounted for almost 60 percent of all of K12 Inc.’s enrollment from 2008-09, which is the most recent year of available finance data.

In terms of the number of students enrolled, K12 Inc. is the largest private education management organization (EMO) and the largest private operator of virtual schools in the United States. It had contracts to operate 48 full-time virtual schools in 2011-12. In addition to these contracts, K12 Inc. provides services and support to dozens of other schools that have more limited online offerings.

Key findings include:

  •   Math scores for K12 Inc.’s students are 14 to 36 percent lower than scores for other students in the states in which the company operates schools. Across grades 3- 11, the scores were between 2 and 11 percentage points below the state average in reading.
  •   The on-time graduation rate for students the K12 Inc. schools is 49.1 percent, compared with a rate of 79.4 percent for the states in which the company operates schools.
  •   Only 27.7 percent of K12 Inc.’s schools reported meeting Adequate Yearly Progress (AYP) standards in 2010-11, compared to 52% for brick-and-mortar schools in the nation as a whole.
  •   Student attrition is exceptionally high in K12 Inc. and other virtual schools. Many families appear to approach the virtual schools as a temporary service: Data in K12 Inc.’s own school performance report indicate that 31% of parents intend to keep their students enrolled for a year or less, and more than half intend to keep their students enrolled for two years or less. K12 Inc. also noted in this report that 23% of its current students were enrolled for less than a year and 67% had been enrolled for fewer than two years.

• K12 Inc.’s schools spend more on overall instructional costs than comparison schools – including the cost of computer hardware and software, but noticeably less on teachers’ salaries and benefits.

New Report Shows K12 Inc. Cyber School Students Falling Behind/ 4

  • K12 Inc. spends little or nothing on facilities and maintenance, transportation, and food service.
  • K12 Inc. enrolls students with disabilities at rates moderately below public school averages, although this enrollment has been increasing, but the company spends half as much per pupil as charter schools overall spend on special education instruction and a third of what districts spend on special education instruction.Among the take-aways from all this is that K12 Inc.’s cyberschools reduce costs by having more students per teacher and by reducing overall spending on teachers’ salaries and benefits, particularly for special education instruction. “Part of K12’s problem seems to be that it skimps on special education spending and employs few instructors, despite having lower overhead than brick-and-mortar schools,” said the NEPC’s Welner, who is a professor of education policy at the University of Colorado. 

Just days ago, the National Education Policy Center at the University of Colorado announced the winners of its annual Bunkum Awards.

These are awards given to the worst educational research of the previous year. Being mundane or trivial is not enough to win these awards. They go only to “prime exemplars of incompetent science.”

The Grand Prize for Bunkum, or “Cancer is Under-rated” award,” went to the Progressive Policy Institute, for its report “Going Exponential: Growing the Charter School Sector’s Best.” It achieved distinction for its “weak analysis, agenda-driven recommendations, and the most bizarre analogy we have seen in a long time.” The report compared the growth of charter schools to the growth of cancer and viruses. The citation read: “Beyond the analogy, the report suffers from an almost complete lack of acceptable scientific evidence or original research supporting the policy suggestions. It presents nine “lessons” or suggestions that are essentially common and vague aphorisms from the business world. Yet it fails to make the case that the suggestions or references are relevant to school improvement.

The First Runner-Up –the “Mirror Image (What You Read Is Reversed) “Award was the Bill & Melinda Gates Foundation. It won for its Measures of Teaching analysis, which reached  a conclusion that was the exact opposite of what the evidence suggested.

The “If Bernie Madoff Worked in School Finance” Award went to the advocacy group ConnCAN for proposing a financial reform package that would be a reverse Robin Hood: Steal from the poor and give to the rich.

The “If Political Propaganda Counted as Research” award went to the Center for American Progress for its report “Charting New Territory: Tapping Charter Schools to Turn Around the Nation’s Dropout Factories.” This report is a sham. Its “citations to “research” literature about school turnarounds, for instance, consisted of four references: a blog, a consultant’s template, a non-peer reviewed case study, and an article from the Hoover Institution journal Education Next. The report also focused on the ostensibly inspiring improvements of one school that, after concentrated, intensive and skillful charter management, catapulted English Language Arts proficiency rates to 14.9% and math proficiency rates all the way to 7%.”

The “Discovering the Obvious While Obscuring the Important” award went to the Third Way for its report on middle class schools. The report determined that middle class schools do better than schools at the bottom, but not as well as schools in affluent districts. What is the point of the study? “What, then, is basis of the conversation Third Way is attempting to ignite? We’re not sure. That’s because in a normal conversation, one can understand what the other person is saying. Yet this report mixes and matches data sources and units of analysis to such an extent that it’s almost impossible for readers to figure out which analyses go with which data. Even more troubling, since the report defines “middle class” as having between 25% and 75% of students qualifying for free and reduced lunch, its analyses of district-level data include the urban schools districts in Detroit, Philadelphia, Houston and Memphis. The Third Way appears to have found a new way to address urban poverty: define it out of existence.

The NEPC “Get a Life(time) Achievement Award” went to Matthew Ladner, advisor to former Florida Governor Jeb Bush’s Foundation for Education Excellence. As the award says, “Dr. Ladner’s body of Bunk-work is focused on his shameless hawking of what he and the Governor call the “Florida Formula” for educational success.  As our reviews have explained, they’d be less deceptive if they were selling prime Florida swampland. One cannot, however, deny Dr. Ladner’s salesmanship: gullible lawmakers throughout the nation have been pulling out their wallets and buying into his evidence-less pitch for flunking of low-scoring third graders and other policies likely to harm many more students than they help.”

To learn what put Ladner did to put him over the top in the estimation of the contests’ judges, read the full report.

Diane