Archives for category: Failure

Chalkbeat Tennessee has an excellent report on Tennessee’s testing fiasco. State officials knew that the testing company was in deep trouble before the testing began, yet they plunged ahead, wasting millions of dollars.

Grace Tatter describes Tennessee’s “worst case scenario”:

Tennessee education officials allowed students and teachers to go ahead with a new online testing system that had failed repeatedly in classrooms across the state, according to emails obtained by Chalkbeat.

After local districts spent millions of dollars on new computers, iPads, and upgraded internet service, teachers and students practiced for months taking the tests using MIST, an online testing system run by North Carolina-based test maker Measurement Inc.
They encountered myriad problems: Sometimes, the test questions took three minutes each to load, or wouldn’t load at all. At other times, the test wouldn’t work on iPads. And in some cases, the system even saved the wrong answers.

When students in McMinnville, a town southeast of Nashville, logged on to take their practice tests, they found some questions already filled in — incorrectly — and that they couldn’t change the answers. The unsettling implication: Even if students could take the exam, the scores would not reflect their skills.

“That is a HUGE issue to me,” Warren County High School assistant principal Penny Shockley wrote to Measurement Inc.

Tennessee Education Commissioner Candice McQueen speaks with reporters in February about technical problems with the state’s new online assessment.

Tennessee Education Commissioner Candice McQueen speaks with reporters in February about technical problems with the state’s new online assessment.

The emails contain numerous alarming reports about practice tests gone awry. They also show that miscommunication between officials with the Tennessee Department of Education and Measurement Inc. made it difficult to fix problems in time for launch.

And they suggest that even as problems continued to emerge as the test date neared, state officials either failed to understand or downplayed the widespread nature of the problems to schools. As a result, district leaders who could have chosen to have students take the test on paper instead moved forward with the online system.

The messages span from October until Feb. 10, two days after the online test’s debut and cancellation hours later. Together, they offer a peek into how Tennessee wound up with a worst-case scenario: countless hours wasted by teachers and students preparing for tests that could not be taken.

In Oakland, California, a grand jury impaneled to investigate the oversight of charter schools reported that the schools were performing poorly and needed better management and more supervision. Despite results like this, the California State Board of Education, the legislature, and Governor Jerry Brown acquiesce to every demand of the California Charter Schools Association. CCSA has a rich PAC which they use to eliminate candidates who don’t support continued expansion of their private sector. They want more and more charter schools, no matter how pathetic their performance. At what point does evidence matter?


Although charter schools were intended to be an educational antidote to the city’s struggling traditional public schools, many of the city’s charter schools aren’t outperforming their district-run counterparts, and on average, performed worse last year in statewide results, according to an Alameda County grand jury report released this week.

The grand jury, which looked into Oakland Unified School District’s oversight of the city’s 37 charter schools, found that 19 scored below district averages for both charter and traditional schools in mathematics in statewide test results. And 17 charter schools scored below the district average in English. The panel reported that 15 charters scored below the district averages in both categories.

Measured against the state, the results are more troubling: 62 percent, or 23 of the city’s charter schools, scored below state averages in math, and 65 percent, 24 schools, scored below the state averages in English, according to results from the 2015 California Assessment of Student Performance and Progress, which replaced the API scores of previous years. Many of the schools performed similarly on past API tests, the report stated.

For that reason and a host of others, the panel recommended that Oakland Unified adopt a more rigorous oversight and approval process when authorizing and reauthorizing charter schools in the city. It also urged the district to increase its staffing at the Office of Charter Schools and to increase the number of on-site visits to charter schools and their board meetings to ensure stronger accountability, including fiscal and governance oversight, since they are funded on the taxpayer’s dime.

Here is a link to the Grand Jury report:

Click to access final2015-2016.pdf

Here are highlights:

The Oakland Unified School District (OUSD) is comprised of 95 K-12 schools with an enrollment of approximately 48,000 students. Of the public schools within the city of Oakland, thirty-seven (37) are charter schools with a total enrollment of approximately 12,000 students. This represents nearly 25% of the total enrollment of the district.

However, the autonomy and independence granted to charter schools come at a cost. Charters operate without the same scrutiny as their district counterparts by the tax paying public. For example, a charter may change curricula, teaching methods, and budget allocation without approval from the authorizing district superintendent or the elected school board. They are also able to determine their own achievement standards, accountability, and systems of discipline or transfers between schools.

Using the California Assessment of Student Performance and Progress Test Results for English Language Arts/Literacy and Mathematics for 2015, the Grand Jury determined that of the 37 Oakland charter schools that participated, 17 scored below the blended average of all Oakland unified public schools and 24 scored below the statewide average in English. Nineteen scored below OUSD averages and 23 scored below the statewide average in mathematics. Within these results, there were 15 Oakland charter schools that scored below OUSD averages in both categories. Many of these charter schools have been in Oakland for years and scored similarly on the previous API tests that are no longer in use.

The Grand Jury acknowledges that test scores are not the only measure of success, as many other factors such as school culture and non-academic support personnel, must be taken into consideration. Nevertheless, it is a concern that some charters are not achieving expected results and yet may still be re-authorized.

Current legislation requires the authorizer to “monitor fiscal condition” of charters, but beyond an annual financial audit, there is no oversight of charter school’s long term financial planning or budgeting.

This growth in charter schools has altered the original intention of the charter movement from “experimental laboratories” to one that attempts to address the sub-par results in district schools.

Funding for special education services in each region is provided by the state on a per student basis. In 2010, the state allowed charter schools to withdraw from their SELPA district, and join any other such district they chose. Twenty-five of Oakland’s 37 charter schools withdrew from the Oakland SELPA reducing the funds available.

Because a SELPA district is intended to form collaborations and share special needs education resources across many schools, the departure from its SELPA of so many charter schools resulted in fewer funds for OUSD that still must serve the same broad range of special needs students including those with the most severe needs. The Grand Jury heard testimony that individual charter schools have fewer severely disabled students. The Grand Jury views this as creating an inequity for special needs students in Oakland’s district schools.

The OUSD Office of Charter Schools is understaffed and underfunded. Although they are managing to successfully comply with the current laws, it will be increasingly difficult to ensure the future success of the charter school program in the city of Oakland.

The state provides a formula for authorizer staffing levels that would require 13 full time employees to support Oakland’s charter schools. Current staffing was recently raised from five to six people.

There is no reporting or tracking to monitor potential wrongful expulsion or dismissal of “less desirable” students by charter schools.

The Grand Jury heard testimony that some charter schools may counsel a student to leave that school for a variety of reasons including recurrent misbehavior or lack of achievement. Witnesses testified that this procedure would be unknown were it not for “whistleblowers.”
A charter school is governed by a board of directors that is not publicly elected. Members of such a board may have no expertise in education or have any particular qualifications for that role.

There is no requirement that the superintendent of the school district, or any member of the elected school board, attend charter school board meetings. The only oversight is through the current authorization and renewal process that requires some site visits throughout the school year.

There is no plan in place in OUSD to manage the proliferation of charter schools and no policy in place to manage or regulate growth. Such a plan would include facilities management, safety standards, and expected student outcomes.

There is no plan in place in OUSD to manage the proliferation of charter schools and no policy in place to manage or regulate growth. Such a plan would include facilities management, safety standards, and expected student outcomes.

EduShyster provides insight and detail on the story of the Boston turnaround school that didn’t get turned around.

Take a low-performing school in an impoverished neighborhood.

Give it to a company that never ran a school before.

Run through five principals in two years.

What could possibly go wrong?

Will anyone be held accountable? Why not Mitchell Chester, the state commissioner who created this fiasco?

Patrick Michels of the Texas Observer cites all the ways that ETS messed up the STAAR tests in Texas. It is not a pretty picture. Texans almost missed Pearson after encountering the incompetence of ETS. Almost.

Questions with no right answers.

Test booklets sent to the wrong schools.

Students’ answers deleted.

No answers from ETS on testing day.

Boxes of completed tests lost in the mail.

Short answer essays with improbably low scores.

Long waits for test scores, some never delivered.

The upshot?

Somebody should be held accountable!

The Texas Association of School Administrators has asked [State Commissioner Mike] Morath not to use this year’s test scores to rate schools. In an open letter to Morath published in the Houston Chronicle, Ben Becker — part of the parents’ group that sued TEA claiming this year’s test is too long — said that Morath owes “the people of Texas a transparent accounting” of this year’s problems, otherwise, “you must throw out all the scores, order them expunged from student records, and assure they are not used for any decision-making. Anywhere. Period.”

Morath responded to Becker, telling him that while the spring test scores will be late, he believes they’ll still be accurate. Morath’s staff apparently drafted an apology letter to parents in April, according to the emails obtained by the Observer, but is waiting to send it once all of the spring test results are out — which now won’t happen until early July.

State Senator Kel Seliger, who has praised Morath for his leadership so far, has told the Amarillo Globe-News that Texas simply shouldn’t pay ETS for its work on this year’s STAAR. Whatever action Morath takes to hold ETS accountable after this year, lawmakers are certain to have their own ideas for reforming STAAR when they reconvene in January.

Don’t mess with Texas.

The charter industry is split by an internal quarrel between the brick-and-mortar charters and the virtual charters.

Report after report has concluded that the virtual charters do not live up to their claims. The latest–from CREDO at Stanford–found that students in virtual charters lost a year of math instruction for every year in the virtual charter, and nearly half a year of reading. What do you call a school where no one learns anything? A failure.

Peter Greene writes here about the charter vs. charter dust-up.

Here is a news story about the battle between the traditional charters that have buildings and their Ponzi cousins.

Since elected officials are unwilling to clean up the mess in the charter industry, will self-regulation work? I wouldn’t bet on it.

Michael R. Ford, a professor of public administration at the University of Wisconsin-Oshkosh, reports that 41% of private schools that received vouchers have closed their doors since the inception of the voucher program. Milwaukee has the nation’s oldest voucher program, and anyone looking for the miracle of school choice should look elsewhere. On the National Assessment of Educational Progress, Milwaukee continues to be one of the nation’s lowest performing urban districts. Milwaukee has had charters and vouchers for 25 years–two generations of students. If charters and vouchers were the answer to the problems of students and schools in urban districts, Milwaukee should be a shining star of student success. It is not.

Ford writes:

Forty-one percent of all private schools that participated in the Milwaukee Parental Choice Program (MPCP) between 1991 and 2015 failed. I do not mean failed as in they did not deliver academically, I mean failed as in they no longer exist. These 102 schools either closed after having their voucher revenue cut off by the Department of Public Instruction, or simply shut their doors. The failure rate for entrepreneurial start-up schools is even worse: 67.8 percent.

Fredrik Andersson and I discuss these data in a new article just published online in Policy Studies Journal entitled “Determinants of Organizational Failure in the Milwaukee School Voucher Program.” We frame the article in the context of public and educational entrepreneurship “with the goal of explaining the factors that put voucher schools specifically, and public entrepreneurial public polices in general, at greater failure risk.” The Milwaukee voucher case is particularly fertile ground for this line of inquiry due its long history, organizational churn, and relevance as the birthplace of the modern school voucher movement.

We test several hypotheses using a survival model and find:

Start-up voucher schools have a much higher failure rate. It takes almost ten years for a new voucher school to lower its failure risk to that of previously existing schools;

When new MPCP schools fail they tend to fail quickly, on average just 4.3 years into program participation;

Schools without a religious affiliation are more likely to fail;

Stricter program regulations led to more failure; and

Schools can reduce their failure risk by gaining market-share.

Read his research article for the full findings.

Last week, the Houston Independent School Board deadlocked in a 3-3 tie vote on whether to renew its contract with the vendor supplying the teacher evaluation program.

Audrey Amrein-Beardsley explains their decision here.

At least three board members realized that five years of this program had not moved the needle by an inch. If performance matters, then EVAAS was a failure.

Beardsley is one of the nation’s leading researchers in the study of teacher evaluation.

She writes:

Seven teachers in the Houston Independent School District (HISD), with the support of the Houston Federation of Teachers (HFT), are taking HISD to federal court over how their value-added scores, derived via the Education Value-Added Assessment System (EVAAS), are being used, and allegedly abused, while this district that has tied more high-stakes consequences to value-added output than any other district/state in the nation. The case, Houston Federation of Teachers, et al. v. Houston ISD, is ongoing.

But just announced is that the HISD school board, in a 3:3 split vote late last Thursday night, elected to no longer pay an annual $680K to SAS Institute Inc. to calculate the district’s EVAAS value-added estimates. As per an HFT press release (below), HISD “will not be renewing the district’s seriously flawed teacher evaluation system, [which is] good news for students, teachers and the community, [although] the school board and incoming superintendent must work with educators and others to choose a more effective system.”

Open the link, read the full article, and read her links. This is excellent news.

The bad part of her post is the news that the federal government is still giving out grants that require districts to continue using this flawed methodology, despite the fact that it hasn’t worked anywhere.

Apparently, HISD was holding onto the EVAAS, despite the research surrounding the EVAAS in general and in Houston, in that they have received (and are still set to receive) over $4 million in federal grant funds that has required them to have value-added estimates as a component of their evaluation and accountability system(s).

So Houston will have to find a new vendor of a failed methodology.

As the new vendor of testing for Texas, ETS is off to a rocky start. It lost all the grades 3-8 test scores for Eanes, Texas. Think of all the weeks wasted on test prep: for nothing!

 

“The state’s new testing vendor reportedly lost all tests taken by elementary and middle school students in central Texas district of Eanes, according to a report from The Texas Tribune.

 

“The site reports that Educational Testing Services told officials at that district that it lost tests taken by students in third through eighth grade, potentially impacting up to 4,000 students.

 

“This is yet another problem in an ever-growing list of concerns for New Jersey-based ETS in its first year of administering the STAAR test. Problems have ranged from the tests missing a correct answer to scoring problems to security concerns.

 

“The problems started getting reported in March with computer glitches that gave students the wrong version of tests, locked up or even erased answers. About 14,220 students across the state were impacted.

 

“In the Burkburnett school district, for example, some students had to rewrite their essays as many as three times after the system repeatedly kicked them back to earlier questions in the test English I end-of-course test.

 

“One student, after redoing her essay several times, finally typed ‘whatever’ in her essay out of frustration,” superintendent Tylor Chaplin wrote in a letter to the Texas Education Agency in April as he expressed his growing frustration.”

 

If a teacher or a school did this, they would be in deep trouble.

 

Mistakes were made!

 

Who will be held accountable?

Here are letters to the editor printed in the Los Angeles Times in reaction to its editorial criticizing the Gates Foundation and other wealthy philanthropists for trying to control the nation’s education agenda.

http://www.latimes.com/opinion/readersreact/la-le-bill-gates-education-reform-20160603-snap-story.html#nt=blogroll

The theme of the letters is: why don’t people listen to teachers? If Gates had, he would have spent his $3 billion wisely and well. But instead, he squandered it on his own faulty ideas.

Our friend and regular commenter Laura Chapman, retired educator, reflects on Bill Gayes’ failure in Hillsborough. Accepting his pledge of $100 million drew the district onto a teacher evaluation plan that nearly exhausted the district’s reserve fund, led to the firing of the district superintendent MaryEllen Elia, and was ultimately canceled by Gates and the district after no results.

She wrote a comment about the serial failures of the Gates Foundation:

“This discussion has taken me down memory lane to the public schools I attended. One of these, Hillsborough High School in Tampa Florida, has been rehabbed several times, but it remains a landmark in school architecture from an era when attending and completing “high” school was a major achievement. The website has a curated collection of documents showing the history of the school’s founding and various locations before the current building was built, with magnificent Gothic architecture, refelecting some high aspirations for the experience of going to school. The school has been rehabbed several times, with “moderate”but important attention to preservation. The International Baccalaureate program is thriving, but that seems to have created a school within a school and conflicts among the students and the faculty.

http://www.tampapix.com/HHS.htm

“Then there is the story of what Bill Gates did to the Hillsborough County Schools and the demoralization that his money has created–his demand for pay-for-performance, worship of metrics especially test scores, the wholesale destruction of morale, and now a budget that is busted. Bill Gates did serous damage to a decent school system. For him, there was not an ounce of value to this particular high school. It could have been a big box store.”

http://www.tampabay.com/news/education/k12/hillsborough-schools-shouldering-millions-more-than-expected-in/2246528