Archives for category: Testing

The National Grange, which represents rural communities across America, released this resolution. The Grange moves deliberately and thoughtfully before it takes a position. Its resolutions are initiated locally, then reviewed at the state and national levels before adoption.

The resolution says:


WHEREAS, our nation’s future well-being relies on a high-quality public education system that prepares all students for college, careers, citizenship and lifelong learning, and strengthens the nation’s social and economic well-being; and

WHEREAS, our nation’s school systems have been spending growing amounts of time, money and energy on high-stakes standardized testing, in which student performance on standardized tests is used to make major decisions affecting individual students, educators and schools; and

WHEREAS, the over-reliance on high-stakes standardized testing in state and federal accountability systems is undermining educational quality and equity in U.S. public schools by hampering educators’ efforts to focus on the broad range of learning experiences that promote the innovation, creativity, problem solving, collaboration, communication, critical thinking and deep subject-matter knowledge that will allow students to thrive in democracy and an increasingly global society and economy; and

WHEREAS, it is widely recognized that standardized testing is an inadequate and often unreliable measure of both student learning and educator effectiveness; and

WHEREAS, the over-emphasis on standardized testing has caused considerable collateral damage in too many schools, including narrowing the curriculum, teaching to the test, reducing love of learning, pushing students out of school, driving excellent teachers out of the profession and undermining school climate; and

WHEREAS, high-stakes standardized testing has negative effects for students from all backgrounds, and especially for low-income students, English language learners, children of color, and those with disabilities; and

WHEREAS, the culture and structure of the systems in which students learn must change in order to foster engaging school experiences that promote joy in learning, depth of thought and breadth of knowledge for students; therefore be it

RESOLVED, that the National Grange lobby the U.S. Congress and administration to overhaul the Elementary and Secondary Education Act (currently known as the “Every Child Succeeds Act”), reduce the testing mandates, promote multiple forms of evidence of student learning and school quality in accountability, and not mandate any fixed role for the use of student test scores in evaluating educators.

Sara Stevenson, a middle school librarian in Austin (and a hero of this blog for her tireless advocacy) Reviews Daniel Koretz’s “The Testing Charade: Pretending to Make Schools Better” in Trib Talk, part of the Texas Tribune..

https://www.tribtalk.org/2017/12/20/the-education-testing-charade/

Here is no better place to puncture the myth of standardized testing’s beneficent powers than in Texas, which spawned the punitive and failed No Child Left Behind and foisted it on the nation.

Good work, Sara! Keep fighting!

This review of books by Daniel Koretz and Jack Schneider is important because it shows that a larger public is awakening to the false narrative about “the crisis in public schools.”
http://www.chicagotribune.com/lifestyles/books/ct-books-biblioracle-1224-story.html

This public questioning of the Destroy Public Education critique is crucial to our ability to blunt the attacks of the billionaires, privatizers, and extremists.

We have struggled to break out of our own world and reach a broader public. This review suggests we are succeeding.

I reviewed Daniel Koretz’s book, “The Testing Charade” in the current issue of The New Republic.

The review is behind a paywall, but you can get a free 30-day pass or a one-year digital subscription for $10 for the year. When it comes out from the paywall in a couple of weeks, I will post it in full.

The review starts like this:

“In 1979, the psychologist Donald Campbell proposed an axiom. “The more any quantitative social indicator is used for social decision-making,” he wrote, “the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor.” He also wrote: “Achievement tests may well be valuable indicators of general school achievement under conditions of normal teaching aimed at general competence. But when test scores become the goal of the teaching process, they both lose their value as indicators of educational status and distort the educational process in undesirable ways.”

“Put simply, when the measure becomes the goal, and when people are punished or rewarded for meeting or not meeting the goal, the measure is corrupted. As Richard Rothstein has shown in his superb monograph, “Holding Accountability to Account,” tying high stakes to measurable goals affects behavior in negative ways in every field, not just education. Judge heart surgeons by the mortality rate of their patients, and they will turn away risky patients. The classic (and probably apocryphal) illustrations of Campbell’s law come from the Soviet Union. When workers were told that they must produce as many nails as possible, they produced vast quantities of tiny and useless nails. When told they would be evaluated by the weight of the nails, they produced enormous and useless nails. The lesson of Campbell’s law: Do not attach high stakes to evaluations, or both the measure and the outcome will become fraudulent.

“For the last 16 years, American education has been trapped, stifled, strangled by standardized testing. Or, to be more precise, by federal and state legislators’ obsession with standardized testing. The pressure to raise test scores has produced predictable corruption: Test scores were inflated by test preparation focused on what was likely to be on the test. Some administrators gamed the system by excluding low-scoring students from the tested population; some teachers and administrators cheated; some schools dropped other subjects so that more time could be devoted to the tested subjects.

“In his new book, Daniel Koretz, an eminent testing expert at Harvard University, has skillfully dissected the multiple negative consequences of the education reforms of the 2000s, most of them unintended. His title, The Testing Charade: Pretending to Make Schools Better, sums up his conclusion that the reform movement failed badly because of its devotion to high-stakes testing as the infallible measure of educational quality.

“Koretz says the results of the testing inflated scores and were not valid. But reformers did not withdraw their support for testing even when the harm it inflicted on children and public schools became evident. Some were ignorant of the evidence of failure; others believed tests provided valuable information, despite the corruption of the data by high stakes. Since federal law required states to label schools with low scores as failing, and since those schools were often turned into charter schools, a whole industry benefited from this system—even though the same measures labeled many charters as failing, too. The Every Student Succeeds Act (ESSA), passed in 2015, still requires that every child be tested every year—a practice unknown in any high-performing nation.

“Legislators’ and policymakers’ obsession with testing has been locked into place since January 8, 2002, when President George W. Bush signed into law his signature domestic legislation, the No Child Left Behind Act. Before NCLB, every state had its own tests and its own accountability measures, but none was as harsh, punitive, and unrealistic as NCLB. None required every school to reach 100 percent proficiency or face mass firings or closure or both.”

You will enjoy reading this interview with parent activist Kemala Karmen. She grew up in Louisiana in a family of activists, experienced racial discrimination, and now lives in New York City, where she is active in the Opt Out movement and works with film maker Michael Elliott.

How do we start a revolution and change education for the better for every student?

Start by learning from Kemala.

Kevin Welner of the National Education Policy Center has written a thoughtful (and optimistic) commentary on the Gates Foundation’s latest big bet on reforming education. The new one will invest $1.7 billion in networks of schools in big cities, in the hopes that they can work together to solve common problems.

Welner, K. (2017). Might the New Gates Education Initiative Close Opportunity Gaps? Boulder, CO: National Education Policy Center. Retrieved [date] from http://nepc.colorado.edu/publication/bmgf.

Welner notes that the previous big initiatives of the Gates Foundation failed, although he believes that Gates was too quick to pull the plug on the small schools initiative in 2008, into which he had poured $2 billion. Gates bet another $2 billion on the Common Core, and that was sunk by backlash from right and left and in any case, has made no notable difference. Gates poured untold millions into his plan for teacher evaluation (MET), but it failed because it relied too much on test scores.

Welner says that Bill Gates and the foundation he owns suffer from certain blind spots: First, he believes in free markets and choice, and he ends up pouring hundreds of millions into charters with little to show for it; second, he believes in data, and that belief has been costly without producing better schools; third, he believes in the transformative power of technology, forgetting that technology is only a tool, whose value is determined by how wisely it is used.

Last, Welner worries that Gates does not pay enough attention to the out of school factors that have a far greater impact on student learning that teachers and schools, including poverty and racism. These are the factors that mediate opportunity to learn. Without addressing those factors, none of the others will make much difference.

Welner is cautiously optimistic that the new initiative might pay more attention to opportunity to learn issues than any of Gates’ other investments.

But he notes with concern that Gates continues to fund charters, data, technology, and testing. He continues to believe that somewhere over the rainbow is a magical key to innovation. He continues to believe in standardization.

It seems to me that Kevin Welner bends over backwards to give Gates the benefit of the doubt. With his well-established track record of failure, it is hard to believe he has learned anything. But let’s keep hoping for the best.

Gary Rubinstein knows Michael Johnston from his days in Teach for America. He wishes Mike would stop telling tall tales about the school he briefly ran.

Mike said that the school he ran had a 100% graduation rate and college acceptance rate. Gary points out that 44 seniors graduated and got accepted to college, but there were 73 students in tenth grade two years earlier. That’s a 60% graduation rate, not 100%.

Now Mike Johnston is running for Governor of Colorado. He has built a reputation in the state as an education “reformer.” After graduating from Yale, he taught in Mississippi as a member of Teach for America, earned a degree at the Harvard Graduate School of Education, then a law degree, then was principal of a small school in Colorado where he claimed the school had a graduation rate of 100% and all were accepted into college. Based on this record, he ran for and was elected to the State Senate at the age of 35.

I met Mike Johnston in 2010, when I visited Denver to talk about my then-new book “The Death and Life of the Great American School System: How Testing and Choice Are Undermining Education.” I was scheduled to debate Johnston at a luncheon before about 100 of Denver’s civic leaders. At the very moment I was in Denver, the Legislature was debating Johnston’s legislation to evaluate teachers and principals by the test scores of their students. Johnston called his law, SB 10-191, the “Great Teachers, Great Principals Act.” It required that test scores would count for 50% of every teacher and principal’s evaluation.

On the day we were to debate, Johnston was late. I spoke. Minutes later, Johnston arrived, not having heard anything I said about choice and testing. He spoke with great excitement about how his new legislation would weed out all the bad and ineffective teachers in the state and would lead to a new era of great teachers, great principals, and great schools.

Johnston, as Gary Rubinstein points out, is very much an Obama Democrat. Arne Duncan, whose Race to the Top squandered $5 Billion, has endorsed Johnston’s candidacy for governor.

Seven years later, even Colorado reformers acknowledge that Mike Johnston’s grandiose promises fell flat. In an article in Education Week, Colorado reformer Van Schoales admitted that the punitive SB 10-191 didn’t have much, if any effect.

He wrote:

“Implementation did not live up to the promises.

“Colorado Department of Education data released in February show that the distribution of teacher effectiveness in the state looks much as it did before passage of the bill. Eighty-eight percent of Colorado teachers were rated effective or highly effective, 4 percent were partially effective, 7.8 percent of teachers were not rated, and less than 1 percent were deemed ineffective. In other words, we leveraged everything we could and not only didn’t advance teacher effectiveness, we created a massive bureaucracy and alienated many in the field.

“What happened?

“It was wrong to force everyone in a state to have one ‘best’ evaluation system.”

“First, the data. We built a policy on growth data that only partially existed. The majority of teachers teach in states’ untested subject areas. This meant processes for measuring student growth outside of literacy or math were often thoughtlessly slapped together to meet the new evaluation law. For example, some elementary school art-teacher evaluations were linked to student performance on multiple-choice district art tests, while Spanish-teacher evaluations were tied to how the school did on the state’s math and literacy tests. Even for those who teach the grades and subjects with state tests, some debate remains on how much growth should be weighted for high-stakes decisions on teacher ratings. And we knew that few teachers accepted having their evaluations heavily weighted on student growth.

“Second, there has been little embrace of the state’s new teacher-evaluation system even from administrators frustrated with the former system. There were exceptions, namely the districts of Denver and Harrison, which had far fewer highly effective teachers than elsewhere in the state. Both districts invested time and resources in the development of a system that more accurately reflects a teacher’s impact on student learning. Yet most Colorado districts were forced to create new evaluation systems in alignment with the new law or adopt the state system, and most did the latter. This meant that these districts focused on compliance (and checking off evaluation boxes), rather than using the law to support teacher improvement.

“Third, we continue to have a leadership problem. Research shows that teacher evaluators are still not likely to give direct and honest feedback to teachers. A Brown University study on teacher evaluators in these new systems shows that the evaluators are three times more likely to rate teachers higher than they should be rated. This is a problem of school and district culture, not a fault with the evaluation rubric.

“Fourth, all of Colorado’s 238 charter schools waived out of the system.

“We wanted a new system to help professionalize teaching and address the real disparities in teacher quality. Instead, we got an 18-page state rubric and 345-page user guide for teacher evaluation.

“We didn’t understand how most school systems would respond to these teacher-evaluation laws. We failed to track implementation and didn’t check our assumptions along the way.”

Unfortunately, when the time came to change the law, Sen. Mike Johnston joined with five Republicans on the State Senate Education Committee to defeat a proposal to fix his failed law.

The rejected proposal, “originally introduced with bipartisan sponsorship, would have allowed school districts to drop the use of student academic growth data in teacher evaluations. It also would have eliminated the annual evaluation requirement for effective and highly effective teachers.”

But Johnston preferred to keep his law in place, despite its failure. It remains today as the most regressive teacher evaluation law in the nation. And it has had seven years to demonstrate its ineffectiveness.

Gary Rubinstein calls on Mike Johnston to stop making the false claim in his campaign literature that his high school’s graduation rate was 100%.

I call on him to renounce and denounce SB 10-191.

Make a clean break of it, Mike. Set things right. Show you are man enough to admit you were wrong.

A few days ago, I wrote a post speculating about whether Common Core had caused the decline in forth grade reading scores on the latest international test.

David C. Berliner, one of our nation’s most distinguished social scientists, wrote to say that Common Core is not the culprit; demographics is.

I stand corrected.

He writes:

It may be, as you posit, that the introduction of the Common Core State Standards (CCSS) had its effects on our PIRLS scores. But before you or any others of us worry about our latest PIRLS scores, and the critics start the usual attacks on our public schools, remember this: Standardized Achievement Tests are quite responsive to demographics, and not very sensitive at all to what teachers and schools accomplish.

With that in mind, let’s ask first what the average score for the USA was in comparison to a few other nations that we often think of as high performing nations. On the paper and pencil version of PIRLS 2016 the USA achieved a score 549. (There was also an e-version of the test reported separately, but nothing in that analysis contradicts anything I say below) Singapore, however, scored 576, Hong Kong scored 569, and Finland scored 566. Clearly these other nations exhibited considerably higher scores than did the USA. Our public schools would seem to be doing something wrong. Perhaps it is related to the introduction of the CCSS. But since demographics are powerful influences on Standardized Achievement Test scores, let’s break down the US PIRLS scores by some of the demographic information that we have available to us.

First, we can note that Asian Americans scored 591. That is, our Asians beat the hell out of Asian Asians! Since the vast majority of Asian Americans go to public school it would appear that there isn’t much of anything wrong with the public schools they go to, nor can the curriculum in use in those schools be bad, even if it is the CCSS. And from Asian American achievement in literacy, we must acknowledge that the skills of their reading teachers appear to be more than adequate.

White kids in the USA, taken as a group, are generally wealthier than non-whites. How did white kids do on PIRLS? They scored 571, close to Singapore, and better than Hong Kong and Finland. Since white kids make up something like 50% of the public school population of the USA, we can say that about half of our school kids, about 25 million or so, are, on average, high performing students in the area of reading—whatever the method chosen to teach them.

How do kids in schools where there is little poverty do on PIRLS? The data tell us that in schools where there are fewer than 10 percent of the students on free and reduced lunch, students had a score of 587—handily beating Singapore, Hong Kong, and Finland. In fact, even higher average scores were found in in schools that cater to upper middle-class kids, schools where the poverty rate is between 10 and 24 percent. That very large group of American public school kids scored 592, handily exceeding the schools that serve even wealthier families, and easily beating the two Asian nations and Finland. Furthermore, there was also a group of kids from schools where 25 to 50 percent of the kids were considered to be in poverty because they were eligible for free and reduced lunch. These were schools that clearly do not cater to the very wealthy. Yet they scored 566, the same as Finland, a nation we always look up to and one with childhood poverty rates of about 4%.

So why did the USA, overall, look mediocre in score and rank on this test? I think it is for the same reason that we always look mediocre in score and rank on PISA! It’s our social and economic systems, not our schools, that cause lower scores than is desired by our nation.

Poor kids in general, but often Black and Hispanic kids in particular, do not grow up in the same kinds of stable families and secure neighborhoods that are more likely to nurture higher levels of school achievement. It’s not America’s schools that are a problem: its America’s social, economic, and housing policies that are our educational problem. While Singapore and Hong Kong both have disturbingly high poverty rates, compared to Finland, both are so small that poor and rich live in proximity to each other. Thus, there is a lot more mixing of children from different social classes and ethnicities than is true in the USA, where income determines housing and housing determines schooling. Here, schools that predominantly serve poor and minority kids, and schools that predominantly serve wealthier kids, are the rule, not that exception. It seems clear to me that those demographic realities are the predominant determinants of scores on Standardized Achievement Tests—be they domestic (NAEP, ACT, SATs) or international (PISA, PIRLS).

So, if we want better scores on such tests, we need to get off the backs of teachers and schools. Our teachers and schools are presently educating a high percentage of our kids to very high levels of literacy. But that is not true for another high percentage of our kids. What we need to help those kids is to exert a lot more influence on our nations politicians to give us the equitable society that will promote higher achievement for all our citizens.

David C. Berliner
Regents’ Professor Emeritus,
Mary Lou Fulton Teachers College,
Arizona State University,
Tempe, AZ 85287

Astrophysicist and author Ethan Siegel writes in Forbes magazine about the way that federal policies have disrespected and demoralized passionate teachers. No Child Left Behind, Race to the Top, and the Every Student Succeeds Act have been disasters for teaching and learning.

Every sentence in this short article is priceless, and I hate to abridge it. You will have to open the link and read it yourself in its entirety.

He writes:

The ultimate dream of public education is incredibly simple. Students, ideally, would go to a classroom, receive top-notch instruction from a passionate, well-informed teacher, would work hard in their class, and would come away with a new set of skills, talents, interests, and capabilities. Over the past few decades in the United States, a number of education reforms have been enacted, designed to measure and improve student learning outcomes, holding teachers accountable for their students’ performances. Despite these well-intentioned programs, including No Child Left Behind, Race To The Top, and the Every Student Succeeds Act, public education is more broken than ever. The reason, as much as we hate to admit it, is that we’ve disobeyed the cardinal rule of success in any industry: treating your workers like professionals.

Everyone who’s been through school has had experiences with a wide variety of teachers, ranging from the colossally bad to the spectacularly good. There are a few qualities universally ascribed to the best teachers, and the lists almost always include the following traits:

*a passion for their chosen subject,
*a deep, expert-level knowledge of the subject matter they’re teaching,
*a willingness to cater to a variety of learning styles and to employ a variety of educational techniques,
*and a vision for what a class of properly educated students would be able to know and demonstrate at the end of the academic year.

Yet despite knowing what a spectacular teacher looks like, the educational models we have in place actively discourage every one of these.

The first and largest problem is that every educational program we’ve had in place since 2002 — the first year that No Child Left Behind took effect — prioritizes student performance on standardized tests above all else. Test performance is now tied to both school funding, and the evaluation of teachers and administrators. In many cases, there exists no empirical evidence to back up the validity of this approach, yet it’s universally accepted as the way things ought to be…

If your goal was to achieve the greatest learning outcome possible for each of your students, what would you need to be successful? You’d need the freedom to decide what to teach, how to teach it, how to evaluate and assess your students, and how to structure your classroom and curriculum. You’d need the freedom to make individualized plans or separate plans for students who were achieving at different levels. You’d need the resources — financial, time, and support resources — to maximize the return on your efforts. In short, you’d need the same thing that any employee in any role needs: the freedom and flexibility to assess your own situation, and make empowered decisions…

Like any job involving an interaction with other people, teaching is as much of an art as it is a science. By taking away the freedom to innovate, we aren’t improving the outcomes of the worst teachers or even average teachers; we’re simply telling the good ones that their skills and talents aren’t needed here. By refusing to treat teachers like professionals — by failing to empower them to teach students in the best way that they see fit — we demonstrate the simple fact that we don’t trust them to do a good job, or even to understand what doing a good job looks like. Until we abandon the failed education model we’ve adopted since the start of the 21st century, public education will continue to be broken. As long as we insist on telling teachers what to teach and how to teach it, we’ll continue to fail our children.

Every time that international test scores are released, there is a predictable clamor to “do something.”

President Obama said that our ranking on an international test was “a Sputnik moment” and reason to push harder for the “remedies” in Race to the Top. We now know that Race to the Top was a failure that had no positive results. Schools were closed, teachers were fired, many new charter schools opened, and performance on the NAEP in 2015–five years after the launch of Race to the Top–went flat.

Now we have the results of the latest international test, the Progress in International Literacy Study (PIRLS), and the news for fourth graders in the U.S. was not good.

The United States tumbled in international rankings released Tuesday of reading skills among fourth-graders, raising warning flags about students’ ability to compete with international peers.

The decline was especially precipitous for the lowest-performing students, a finding that suggests widening disparities in the U.S. education system.

The United States has traditionally performed well on the Progress in International Reading Literacy Study, an assessment given to fourth-graders in schools around the world every five years. In 2016, however, the average score in the United States dropped to 549 out of 1,000, compared to 556 in 2011. The country’s ranking fell from fifth in the world in 2011 to 13th, with 12 education systems outscoring the United States by statistically significant margins. Three other countries roughly tied with the United States; they scored higher, but the differences were not ­notable.

What happened?

The Common Core (aka Common Core State Standards) was introduced across the nation in 2010-2011. The students now in fourth grade were the first cohort to get Common Core, starting in kindergarten.

Their reading scores went down, and it appears that the children who were likeliest to see declines were the lowest performing students.

The Common Core standards were written hurriedly, funded entirely by one man (Bill Gates), and rushed into implementation without any field testing whatsoever. Gates not only paid the hundreds of millions of dollars to fund the writing of Common Core, but he spent many more millions (some have estimated as much as $2 billion) to persuade advocacy groups and education organizations to support the adoption and implementation of the standards.

Would the FDA approve a drug for national use without field testing?

Of course not.

Our children were guinea pigs, and the experiment failed.

Almost every state in the nation has adopted Common Core. Some have rebranded it, but it is still Common Core.

What will states do now?

One of the most prominent advocates for Common Core was Jeb Bush, who is close to Betsy DeVos. They loved Common Core, because they expected it would cause widespread failure and hasten support for the privatization of public schools.

DeVos reacted to the declining scores on PIRLS by advocating for more school choice, more charters and vouchers.

In 2012, Joel Klein and Condoleezza Rice wrote a report claiming that public schools were so awful that they endangered national security. Their recommendations: more charters, more vouchers, and Common Core.

Friends, we can’t let these nihilists destroy our democratic system of public education.

Schools improve when they have adequate funding, not competition. Schools improve when students live stable lives, with access to food, medicine, and decent living conditions. Schools improve when they are staffed with professional teachers, not temporary, untrained teachers.

Common Core has failed our nation and our students. So have the privatizers.

Since the passage and signing of No Child Left Behind on January 8, 2002, the U.S. has been on the wrong track.

Can the “reformers” please admit their errors and change their ways? Or are they determined to keep pushing the same failed strategies without regard to evidence?