Archives for category: Standardized Testing

I first learned about Roland Fryer, Jr., a Harvard economist, when he devised an experiment to pay students for raising test scores in several cities, which failed. Subsequently, he seemed to be involved in other such experiments where the methodology always involved incentives for teachers or students to get higher scores. Here is an outside review of the merit pay plan he designed for New York City. Another of his less-than-successful incentive plans was called “loss aversion.” It works like this: the district gives teachers a $4,000 bonus at the start of the school year; if scores go up, they keep it. If scores don’t go up, they give the money back.

That gave me an idea: how about “loss aversion” for economists? If their predictions are wrong, their computer is confiscated. Or their pay is cut. Or they lose a digit on one finger.

Mercedes Schneider decided to learn more about Fryer after learning that Charlie Baker, the Republican governor, had appointed Fryer to the State Board of Education. The state is on the verge of deciding whether to stick with its MCAS state tests or switch to PARCC. The State Commissioner of Education for Massachusetts, Mitchell Chester, is chair of the PARCC Governing Board. Gosh, I wonder which test they will choose?

Schneider wondered, who is Roland Fryer, Jr.

She writes that Fryer was “promoted from assistant professor to full professor after a single year on the Harvard University faculty (and skipping right over associate professor, to boot).

“Fryer is also the faculty director of Harvard University-based EdLabs, which describes itself as just a helpful group of individuals with no agenda:”

Here is their agenda:

We are an eclectic collection of scientists, educators, and implementers with diverse backgrounds and vast experience, generating ideas and implementing experiments that have the potential to transform education.

Edlabs has no political affiliation or agenda to promote. We squeeze truths from data. People may not always like what we discover, but we will disseminate our results no matter what we find.

Sounds good, yes?

But then she checked out EdLab’s associates and funding, and almost every notable reformer group was there.

Among his advisors: Joel Klein, Condoleeza Rice, and Eli Broad.

Among his funders: the usual suspects. You can guess, or read the post.

Schneider reports on one of Fryer’s ideas to close the achievement gap: don’t test the affluent districts (like the one he lives in), because it would leave less time for reading Shakespeare; but test the poor kids daily.

As I have said on more than one occasion, tests are a measure, not an educational intervention. They measure gaps, they don’t close them. If you have a fever, you can find out how high it is with a thermometer, but taking your temperature again and again will not lower your fever.

Angry parents and educators bombarded Senator Legg, chair of the Senate Education Committee in Florida, with 45,000 letters, complaining about the state’s standardized tests. Kathleen Oporeza of Fund Education Now spurred the protests by pointing out that the tests had so many problems that the results were invalid and should not be used to grade schools or teachers.

She wrote:

“There isn’t a Florida student, parent, teacher, superintendent, board member or administrator who doesn’t see through this charade. Superintendents from Leon to Miami-Dade have expressed their deep concerns. The study’s own numbers point out that just 65 percent of the test items match the Florida Standards. It concludes that it would be wrong to retain students or deny diplomas based on the 2015 FSA, yet Commissioner Stewart plans to use these same flawed test results to set pass/fail cut scores, grade schools and evaluate teachers. It’s fundamentally unfair to punish teachers and grade schools based on scores where 35 percent of the test items were never taught to Florida students.

“Put another way, if a student answered every question based on the Florida standards correctly, he would receive a 65 or a D letter grade. It’s hard to reconcile this poor finding with Commissioner Stewart’s glowing reaction to the study. Who or what is she trying to protect?”

Senator Legg responded to protestors, claiming it was too late and there was nothing he could do. Apparently in Florida, the Legislature can pile on tests, but it can’t reduce them or prevent their misuse.

Jessica Bakeman of Politico wrote:

“TALLAHASSEE — A key state senator said Thursday it’s time to stop harping on the problems that arose during state standardized testing earlier this year because there’s little the Legislature can do to fix it now anyway.

“Sen. John Legg, who chairs the chamber’s pre-kindergarten to 12th grade education committee, said it’s not worth entertaining district leaders’ push for education officials to withhold school grades after cyber attacks and technical glitches disrupted state testing for thousands of students.

“Legg, a Republican from Lutz, believes results from the state’s controversial new exams are valid for use in evaluating schools’ performance. But even if they weren’t, he said, lawmakers wouldn’t be able to stop the Department of Education from assigning school grades.”

Florida may be the testing Capitol of the nation. But no one can stop this train wreck.

Oporeza wrote:

“After decades of micro-managing public education, Legg claims “there’s nothing the legislature can do.” He goes on to assert that they are “unable to stop” Commissioner Pam Stewart and the Department of Education from setting pass/fail cut scores, issuing school grades or using the flawed scores to evaluate teachers. Legg’s comment lacks credibility. He knows Stewart is an unelected political appointee with an ardent penchant for rule following. The FSA testing mess was wholly created by the Florida Legislature. Period.

“During the Senate hearing, politicians were dogmatic about preserving the political agenda of “ed reform.” Even though the EdCount/Alpine study team will not deem the FSA 100% “valid,” committee members said any discussion of alternatives is useless. Looking for a better way, such as using limited standardized tests only as transparent diagnostic tools would destroy Florida’s A-F Accountability scheme. Reformers know that without high stakes there would be no classroom fear or chaos. There would be no leverage to use against us.”

The Hudson Valley Alliance for Public Education issued a statement pledging to increase the number if opt outs next spring, in response to the Board of Regents’ decision to endorse a punitive, test-based teacher evaluation system. In the new system, test scores will count for 50% of a teacher’s evaluation, despite the American Statistical Association’s warning that a teacher accounts for 1-14% of variation in test scores.

Supporters of VAM think that the teachers’ union is pulling the strings and persuading parents to express such views. They think parents are dupes and fools. They are wrong.

Parents understand that when test scores matter so much, teachers will spend more time on test prep and less time on untested subjects. This is educationally unsound, and it hurts their children.

The parents support opt out to protect their children.

Here is the statement of the Hudson Valley Alliance:

“Parents across the Hudson Valley are dismayed by yesterday’s vote by the Board of Regents to adopt teacher evaluation regulations that will double down on high stakes testing and the harmful effects of test-prep driven education. While we applaud the courage of those Regents who voted no, Hudson Valley parents are disappointed with Regent Finn’s failure to protect public school children in our area.

“Under Chancellor Tisch’s leadership, the Regents majority have failed to challenge flawed legislation that harms public school children” said Carol Newman Sharkey, Orange County public school parent. “It is clear that Chancellor Tisch must be removed from her position when her term is up this year.”

“The Regents failed to rise up against the Governor’s tyrannical demands and instead have allowed bad education policies to displace whole child and sound pedagogical practices. They have stood idly by while Cuomo makes a mockery out of public schools putting cronies, political ambition, and charter schools above children” said Tory Lowe, co-founder of Kingston Action for Education and Ulster County public school parent.

“This vote ensures that the opt out movement will continue to grow. Parents seeking to protect their children will not back down or be appeased by false promises of better tests. At the end of the day, you cannot measure teaching and learning with a test score. Until there is real change, parents will continue to reject a corrupt system that destroys authentic teaching and learning” said, Bianca Tanis, New Paltz public school parent.

Since the adoption of the Common Core-aligned assessments, the Regents have voted to limit the number of students entitled to extra support in the form of Academic Intervention Services while simultaneously labeling teachers and students as failures.

“Once again, NYSED seems to talk out of both sides of its mouth. The message that SED continues to spread is that almost 70% of the students in grades 3-8 aren’t “proficient”, but yet schools don’t have to provide AIS (i.e. – “flexibility”) if their level of failure isn’t low enough. Either our children who are scoring ‘1s and 2s’ on the state tests are struggling and they deserve to get the academic support to help them meet the standards, or the standards themselves are inappropriate. They cannot have it both ways” said Tim Farley, Columbia County public school parent.

Stacey Kahn, Ulster County public school parent said “We suggest that Chancellor Tisch and Commissioner stop insulting the intelligence of the public. We will refuse the tests until the Regents majority starts making decisions that put children before politics and corporate sponsors.”

“What took place at the Regents meeting only underscores what parents and educators have known for quite some time – Chancellor Tisch must go. It is critical that parents, educators, and concerned community members turn their eyes towards our state legislators who have the power to amend destructive education law and remove Chancellor Tisch and some of her colleagues as they seek reappointment in the new year. New York students deserve responsible and informed leadership that will ensure an equitable, community-driven, and child-centered education. We will accept nothing less” said Anna Shah, Dutchess County public school parent.

“The 10 NYS Board of Regents members who lacked the courage to vote against Governor Cuomo’s public school privatization agenda have now emboldened parents towards increased activism. Through the use of social media, traditional media and speakers forums parents will continue to inform and educate. They will forge ahead against these harmful policies using their best weapons…involvement in the political process (our eyes will on our legislators) and of course the 500,000 test refusals for Spring 2016,” said Lauren Isaacs Schimko, public school parent, Rockland County educator & Administrator of “Pencils DOWN Rockland County” on Facebook.

HV Alliance for Public education, is a grassroots organization dedicated to advocating for the rights of parents and public school children against harmful testing practices in the Hudson Valley. To join the Alliance or to learn more, please visit us here:

https://www.facebook.com/groups/485430588295878/

This teacher teaches children with severe disabilities. She is a BAT. She is conscientious and devoted to her work. She was rated “developing,” which is one step above “ineffective.”

She writes:

“In my career (and this is every year), I am potty training, teaching self hygiene, teaching self regulation, executive functioning, how to SPEAK, for God’s sake.

“I teach children how to hold a pencil, write their name, the fundamentals that they need and more. On top of that, I teach a ridiculous curriculum, mandated by NYS, to a self-contained class of what has been Kindergarten through 3rd graders, sometimes all in one class. I have taught class sizes from 12 to 17, when there were only supposed to be 12. This past year, my class was a mix of children with autism, children who are emotionally disturbed and unmedicated, children with speech and language impairments, and children who are learning disabled. In the time they were with me, these children made progress beyond your wildest dreams and that is because of me and my team, not some ridiculous curriculum.

“According to my rating, my teaching was effective and the same went for my state measures. Where I apparently “fail” as a teacher is on my local measure. My children, as described above, were asked to take a writing exam in which they listened to and took notes on an informational text. From there they took their notes and were expected to write a paragraph or more relating to the topic. My children did as they were asked, to the best of their ability, when most came to me in the beginning unable to accurately write their name.

“I am not sharing this to garner sympathy or cry “poor me,” but rather to expose what this profession has become and how discombobulated this system is. I also want others to know that they are not alone when it comes to these ridiculous score adjustments.”

Jeff Bryant reports that the Seattle teachers’ strike is nearing an end. The teachers are very pleased with the gains they made on behalf of their students.

Was a pay increase part of the settlement? Yes. Seattle teachers live in one of the most expensive cities in the nation and have gone for years without a cost of living increase.

But what mattered most to teachers and what precipitated the strike were their concerns about conditions for their students.

Jesse Hagopian, a spokesman for teachers, said: “For the first time, our union was able to make social justice the center of the debate. We took a huge step forward.”

Also in the settlement terms, according to a local television news outlet, were student-centered demands including requests for guaranteed 30 minutes of recess for all elementary students, additional staff such as school counselors and therapists, a reduction in the over-testing of students, and the creation of new teams in 30 schools to ensure equitable learning opportunities and treatment of students regardless of race.

While recess may seem to be an unworthy demand to the reform-minded editors of the [Seattle] Times, classroom teachers understand it to be something critical to the health, development, and academic success of their students, as numerous research reports have found.

Having access to school counselors, therapists, and other specialists is critical to many students, but in inadequately funded school districts, such as Seattle, these are the positions that are routinely the first to be cut.

The demand for less testing is also, ultimately a student-centered demand. As Hagopian explains, this time to Erin Middlewood for The Progressive magazine, “’We oppose these tests because there are too many of them and they’re narrowing the curriculum and they’re making our kids feel bad, but they’re also part of maintaining institutional racism,’ says Hagopian, who serves as an adviser to Garfield’s Black Student Union.”

Hagopian sees the increasingly popular campaign to opt out of standardized tests as being connected to the Black Lives Matter movement because money that should be used to support and educate children and youth of color is being directed to punitive measures such as testing and incarceration.

Mike Klonsky does his usual round up of Chicago news.

70% of students in Illlinois “failed” the PARCC test. Arne Duncan was not troubled at all.

“Arne Duncan agrees…

“It actually doesn’t concern me at all. What Illinois and many other states are doing is finally telling the truth.” (EdWeek)”

Did he forget that President Obama named him as Secretaryof Education because of the alleged leap in test scores in Chicago? We’re they not telling the truth in 2008?

The news: the Dyett hunger strike is in day 32. See the interview with Jitu Brown.

Illinois released the results of Common Core test results, and the proportion of students who met PARCC’s wildly unrealistic expectations declined from previous years.

“In a troubling picture of performance, the vast majority of Illinois students failed to reach the high academic bar on the new state PARCC exams, meaning they weren’t on track academically for the next grade level, let alone for college or careers.

“Preliminary statewide results from last spring’s testing, released for the first time Wednesday, reveal the extent to which students fell short of the key goal of the Common Core movement, to ultimately prepare students for higher education and the world of work.

“Between 26 and 36 percent of third-through-eighth-grade students “met expectations” or “exceeded expectations” on the PARCC math exams. In English language arts/literacy, the figure was 33 to 38 percent for third-through-eighth-graders.

“In high schools the picture was even more dismal, with 17 percent of students meeting or exceeding expectations in math while 31 percent did so in English language arts/literacy. In high school, districts had the choice to give the exams in various grades, depending on the level of courses students were taking in math and English. For example, districts could give ninth-graders the Algebra 1 PARCC exam.

“The Illinois State Board of Education’s data is not complete but includes students who took the exams online, which represents more than 75 percent of test takers. Results of students taking the exams with paper and pencil will be melded into final results later.

“The scores on the new exams are lower than any statewide test results since 2001, data shows, when the state launched the Prairie State Achievement Examination for high school juniors. The Illinois Standards Achievement Test for grade school students had debuted in 1999. The percentage of students meeting and exceeding expectations on those exams since 2001 never dipped below 50 percent statewide, even after the state made it tougher to pass the grade school tests.”

These are the dismal results that the test developers of PARCC and Smarter Balanced planned for and predicted.

Some educators recognized the tests for what they are: madness .

“For educators following the debate over testing and the new exams, the results were expected.

“We’ve been writing and meeting with ISBE officials for over two years to stop this madness. We’ve told them that our technology isn’t ready, our Common Core curriculum isn’t ready and the test will be hurting kids,” said Argo Community High School District 217 Superintendent Kevin O’Mara, who also is president of the Illinois High School District Organization.

“They didn’t listen then; I hope with a new ISBE chairman and a new ISBE state superintendent, they’ll finally rethink PARCC and get back to helping students learn.”

With a rabidly pro-charter Governor Rauner, students and educators can’t expect much relief. These are results that discredit public education and can be used by the privatizers to push their agenda.

As Mercedes Schneider has repeatedly declared, there is zero evidence that these tests are an accurate gauge of college or career readiness.

Mercedes writes:

“Chin up, Illinois. These lousy scores are only a half-full glass. Besides, there will be other PARCC states releasing terrible scores, and we can make it a senseless contest to see which of the few PARCC states is the worst.

“Of course, there is no evidence that PARCC and its Common Core host have any empirically-established, practical connection to any useful outcome. But practicality is beside the test-obsessed point. These scores must be useful because they’re just too awful to not accurately capture the marketed message about American public education.”

You probably know who Peter Greene is: a prolific high school teacher in Pennsylvania who specializes in skewering fools.

But do you know who Mike Barber is? He is actually Sir Michael Barber of Pearson. He wrote a book called Deliverology, which provides the theoretical construct for corporate reform. It argues for setting targets (test scores) and incentivizing people to reach them.

In this post, Peter Greene reviews Mike Barber’s latest book , which he wrote with two co-authors. The goal of the book is to explain why ordinary people have failed to do reform right. The problem is implementation.

Peter writes:

“Their new book has the more-than-a-mouthful title Deliverology in Practice: How Education Leaders Are Improving Student Outcomes, and it sets out to answer the Big Question:

“Why, with all the policy changes in education over the past five years, has progress in raising student achievement and reducing inequalities been so slow?

“In other words– since we’ve had full-on reformsterism running for five years, why can’t they yet point to any clear successes? They said this stuff was going to make the world of education awesome. Why isn’t it happening?

“Now, you or I might think the answer to that question could be “Because the reformy ideas are actually bad ideas” or “The premises of the reforms are flawed” or “The people who said this stuff would work turn out to be just plain wrong.” But no– that’s not where Barber et al are headed at all. Instead, they turn back to what has long been a popular excuse explanation for the authors of failed education reforms.

“Implementation.

“Well, my idea is genius. You’re just doing it wrong!” is the cry of many a failed geniuses in many fields of human endeavor, and education reformsters have been no exception.”

Yes, Communism was a great idea but it was badly implemented. Mao’s Great Leap Forward was a great idea, badly implemented. All those millions of people who died? Collateral damage.

Peter writes:

“The implementation fallacy has created all sorts of complicated messes, but the fallacy itself is simply expressed:

“There is no good way to implement a bad idea.

“Barber, described in this article as “a monkish former teacher,” has been a champion of bad ideas. He has a fetish for data that is positively Newtonian. If we just learn all the data and plug it into the right equations, we will know everything, which makes Michael Barber a visionary for the nineteenth century. Unfortunately for Barber, in this century, we’re well past the work of Einstein and the chaoticians and the folks who have poked around in quantum mechanics, and from those folks we learn things like what really is or isn’t a solid immutable quality of the universe and how complex systems (like those involving humans) experience wide shifts based on small variables and how it’s impossible to collect data without changing the activity from which the data is being collected.

“Barber’s belief in standardization and data collection are in direct conflict with the nature of human beings and the physical universe as we currently understand it. Other than that, they’re just as great as they were 200 years ago. But Barber is a True Believer, which is how he can say things like this:

“Those who don’t want a given target will argue that it will have perverse or unintended consequences,” Sir Michael says, “most of which will never occur.”

“Yup. Barber fully understands how the world works, and if programs don’t perform properly, it’s because people are failing to implement correctly.”

You have to read it all. It is Peter Greene at his best.

Ohio has withdrawn from the federally funded PARCC test, but the results came in from last spring’s tests. A little more than one-third “met expectations.” Put another way, nearly two-thirds “failed.”

Under the old state tests, 75-80% were proficient. Ohio softened the blow of high failure rate by creating a new category called “Approached Expectations.” This reduced the proportion of “failures.”

“That will have, for example, students that “Met Expectations” on PARCC rated as “Accelerated” by Ohio. And students will be labeled as “Proficient” by Ohio, even if they still just “Approached Expectations” of the 12 PARCC states.

“That means that many more kids will labeled as “Proficient” than the PARCC states would consider as meeting expectations.

“Jim Wright, ODE’s director of assessment, told the board this morning that shouldn’t be a concern.

“Educators across the country have warned that scores and ratings would drop with the new tests. The proposed ratings will bring a drop, just not the “cliff” that people warned about, Wright said.”

The test scores for most charter schools, like most public schools, declined sharply on the new Smarter Balanced tests of the Common Core.

Rocketship charters, in particular, did poorly.

The typical response of charter leaders was not to complain that the tests are biased and unreliable (which they are), but to say, showing grit, “We will have to up our game.” I suppose that means they weren’t trying hard enough until they got the scores.

Will the sobering news burst the charter bubble? Of course not. Too much money riding on their proliferation.