Archives for category: Testing

As readers know, the Los Angeles a Times published a scathing indictment of Bill Gates and his ill-fated forays into education policymaking. The Times noted Gates’ serial failures, one of which was his naive belief that teachers should be evaluated by the test scores of their students. This idea appealed to his technocratic, data-driven mindset.

Some cheered the Times’ about-face, but Anthony Cody did not. He argues that Los Angeles Times was complicit in some of Gates’ worst ideas, despite the absence of evidence for their likely success. It gave full-throated support to John Deasey when he ran the city’s public schools with a heavy hand and spent profligately on ed technology. While wiser heads were skeptical about Gates’plan to evaluate teachers by test scores, the Times decided to create its own test-based rating system and published the results.

Cody calls for accountability. The line between advocacy and reporting is thin, and he believes the Times’ reporters crossed it. They should have investigated the Gates’ theory, but instead they acted on it, assuming its validity.

Cody writes:


“I have a question related to journalistic integrity. How can the LA Times chastise the Gates Foundation – and their disciple John Deasy, without acknowledging their own embrace of Gatesian reforms? The LA Times did not just report on the issue – they created their very own VAM system, and criticized Los Angeles Unified for not using such a system to weed out “bad teachers” and reward those identified as “effective.” They were active advocates, instrumental in the war on teachers that has been so devastating to morale over the past decade.”

Larry Cuban writes on his blog about the most important inventions that have raised our nation’s standard of living. He poses the question that is the title of this post. He supposes that most people would respond “the smartphone,” but they would be wrong. His post is an intriguing review of a book by economic historian Robert Gordon, who contends that the century from 1870-1970 experienced greater growth and innovation than the past half century.

Cuban summarizes Gordon’s central argument:

Thus, an unheralded, stunning century of innovation and economic growth produced the telegraph, phone, television, house lighting, automobile, airplane travel, and, yes, indoor plumbing. These inventions networked the home and workplace in ways that raised living standards and increased workplace productivity considerably. It was in that same century that medical advances reduced infant mortality and lengthened life of Americans dramatically.

The half-century since 1970 has surely seen innovations that have enhanced these earlier inventions but the template for economic growth was laid down for that fruitful hundred-year period. In past decades, new technologies have clearly expanded communication and entertainment, making life far more instantaneous, convenient and pleasurable. But social media, immediate communication, and constant access to photos, video clips, and films have not increased the standard of living as had the decades between 1870-1970.

Cuban then segues to a discussion of the current reform movement in education, which traces its roots to the 1983 report “A Nation at Risk.” That report was “driven by an economic rationale–the human capital argument–for improving U.S. schools” and embraced by policymakers, business leaders, and foundations. If we didn’t improve education dramatically, we would lose our competitive edge in the world economy. And thus was born the “reform movement,” in which governors and “reformers” sought to raise curriculum and performance standards for both students and teachers, increase testing, and create accountability frameworks that included rewards and penalties in subsequent decades….

The current reforms in education and the pressure to raise test scores on international tests have not increased economic growth, stimulated productivity, or reduced inequality, writes Cuban.

In other words, reforms aimed at getting U.S. students to perform better on international tests for the past three decades–think No Child Left Behind, expanded parental choice in schools, more computers in schools, and Common Core state standards–was of little influence on growing a strong economy, raising median income, or lessening inequality, according to Gordon. These reforms, while aiding low-income minorities in many instances, overall, contributed little to improving productivity or raising standards of living

Gordon’s book concludes, writes Cuban, with a list of ten interventions that could raise the standard of living, like raising the minimum wage. Of his ten interventions three have to do with education. They are:

“…investing in preschools, state and federal school financing rather than local taxes, and reducing student indebtedness in higher education. Not a word about the dominant school reforms in 2016–Common Core standards, standardized testing, technologies in schools, charter schools, accountability.

In questioning the dominant beliefs in current school reform as essential to economic growth, Gordon’s argument and evidence are useful to those politically active decision-makers, teachers, parents, and researchers who know that a democracy needs schools that do more than prepare children and youth for the workplace.

The paradox, as Cuban suggests, is that the more we focus on test scores and workplace readiness, the more we sacrifice civic values that may be of greater importance in a democracy.

A reader writes:

“In the non-public special education field, we generally feel the residual effects of educational policies and changes. Right now we’re feeling the effects of Common core and PARCC and not in such a positive way. Common Core Standards “do not define the intervention methods or materials necessary to support students who are well below or well above grade-level expectations,” but our students with disabilities must participate at the same level and with the same rigor as their “non-disabled” peers in PARCC assessments.

 Our IEP’s must be standards-based, aligned to their grade level and our teaching must be aligned to the Maryland CCR Standards at the students grade level. The problem, however, is that the majority of our students are functioning 3 to 4 grade levels below their non-disabled peers and our teachers are struggling to help them acquire and demonstrate a few skills successfully. 

How then do we prepare our students effectively for an assessment that will test them on the very standards they fail to understand? Our students with ED, anxiety, depression, ADHD, and autism have already been formally tested by teachers and related services providers multiple times before even reaching PARCC season. When is enough enough? There has to be a better way to assess their learning.

This is a remarkable editorial that appears in the Los Angeles Times, of all places. The headline tells a story we did not expect to read on this newspaper’s editorial page:

Gates Foundation failures show philanthropists shouldn’t be setting America’s public school agenda

Read that again. Slowly.

The editorial recaps the serial failures of the Gates Foundation in education: Small high schools (abandoned); evaluating teachers by test scores (not yet abandoned but clearly a failure, as witnessed by the disasterous, costly experience in Hillsborough County, Florida); Common Core (not abandoned, but facing a massive public rejection).

But it’s not all bad, says the editorial:

It was a remarkable admission for a foundation that had often acted as though it did have all the answers. Today, the Gates Foundation is clearly rethinking its bust-the-walls-down strategy on education — as it should. And so should the politicians and policymakers, from the federal level to the local, who have given the educational wishes of Bill and Melinda Gates and other well-meaning philanthropists and foundations too much sway in recent years over how schools are run.

That’s not to say wealthy reformers have nothing to offer public schools. They’ve funded some outstanding charter schools for low-income students. They’ve helped bring healthcare to schools. They’ve funded arts programs.

This is not the whole story, of course. They have funded a movement to privatize public education, which drains resources and the students the charters want from public schools, leaving them in worse shape for the vast majority of students. And they have insisted on high-stakes testing, thus leading schools to eliminate or curtail their arts programs. As for healthcare in the schools, there should be more of it, but it should not depend on philanthropic largesse. Two children in the Philadelphia public schools died because the school nurses were cut back to only two days a week, and there were no philanthropists filling the gap.

Knowing how destructive the venture philanthropists have been–not only Gates, but also Eli Broad and the Walton Family, and a dozen or two other big philanthropies–one could wish that they would fund healthcare and arts programs, and perhaps experimental schools that demonstrated what public schools with ample resources could accomplish.

Still we must be grateful when the Los Angeles Times writes words like these:

Philanthropists are not generally education experts, and even if they hire scholars and experts, public officials shouldn’t be allowing them to set the policy agenda for the nation’s public schools. The Gates experience teaches once again that educational silver bullets are in short supply and that some educational trends live only a little longer than mayflies.

Allowing Bill Gates or Eli Broad or the Walton Family to set the nation’s education is not only unwise, it is undemocratic. The schools belong to the public, not to the 1%.

Since the editorial mentioned Bill Gates’ devout belief that teachers could be evaluated by the test scores of their students, it is appropriate to recall that the Los Angeles Times was the first newspaper in the nation to publish ratings for teachers based on test scores; it even had hopes of winning a Pulitzer Prize for this ugly intervention by non-educators who thought that teaching could be reduced to a number and splashed in headlines. Let us never forget Rigoberto Ruelas, a fifth-grade teacher who committed suicide shortly after the evaluations were published by the Los Angeles Times, and he was declared by the Times to be among the “least effective” teachers. There followed a heated debate about the methodology used by the Times to rate teachers. That was before the American Statistical Association warned against using test scores to evaluate individual teachers. But the Los Angeles Times was taking Gates’ lead and running with it. It was not worth the life of this good man.

After days of withering criticism for a policy of holding back third graders who opt out of the state test, after failing to get any support from the State Education Department, the school officials of Manatee County, Florida, backed down and agreed that third grade students could use alternative methods to be promoted to fourth grade.

Peter Greene updated his post here.

Massachusetts is the latest battlefield over the question of how to evaluate teachers. At the center of the conflict is the favorite idea of Arne Duncan and Bill Gates: evaluating teachers by the test scores of their students (or if not their students, someone else’s students). The new Every Student Succeeds Act relieved states of the obligation to tie teacher evaluations to students scores. Oklahoma and Hawaii recently dropped the measure, which many researchers consider invalid and unreliable.

The state plans to impose its evaluation system on all teachers, including teachers of the arts and physical education. How the state will measure the students’ growth in music or art or sports is not clear.

Researchers at the University of Massachusetts-Amherst studied the plan and criticized it:

A 2014 report by the Center for Educational Assessment at the University of Massachusetts Amherst, which examined student growth percentiles, found the “amount of random error was substantial.”

“You might as well flip a coin,” Stephen Sireci, one of the report’s authors and a UMass professor at the Center for Educational Assessment, said in an interview. “Our research indicates that student growth percentiles are unreliable and should not be used in teacher evaluations. We see a lot of students being misclassified at the classroom level.”

The Massachusetts Teachers Association, the largest teachers’ union in the state, has come out in opposition to the plan, as has the Massachusetts Association of School Committees, representing the state’s elected school board.

But state officials, led by state Commissioner Mitchell Chester, insist that they won’t back down. Boston’s superintendent, Tommy Chang, a graduate of the unaccredited Broad Superintendents Academy, is acting to implement the evaluations.


A centerpiece of Massachusetts’ effort to evaluate the performance of educators is facing mounting opposition from the state’s teacher unions as well as a growing number of school committees and superintendents.

At issue is the state’s edict to measure — based largely on test scores — how much students have learned in a given year.

The opposition is flaring as districts have fallen behind a state deadline to create a “student impact rating,” which would assign a numeric value to test score growth by classroom and school. The rating is intended to determine whether teachers or administrators are effectively boosting student achievement. The requirement — still being implemented — would apply to all educators, including music, art, and gym teachers.

“In theory it sounded like a good idea, but in practice it turned out to be insurmountable task,” said Glenn Koocher, executive director of the Massachusetts Association of School Committees. “How do you measure a music teacher’s impact on a student’s proficiency in music? How do you measure a guidance counselor’s impact on student achievement?”

Critics question whether the data can be affected by other factors, including highly engaged parents or classrooms with disproportionate numbers of students with disabilities or other learning barriers. The requirement has also created problems in developing assessments for subjects where standardized tests are not given, such as in art and gym.

Resistance has escalated in recent weeks. On Thursday, the state’s largest teachers union, the Massachusetts Teachers Association, as well as others successfully lobbied the Senate to approve an amendment to the state budget that would no longer require student impact ratings in job evaluations. A week earlier, the Massachusetts Association of School Committees passed a policy statement urging the state to scrap the student impact ratings.

But some educators see value in the student impact ratings. Mitchell Chester, state commissioner for elementary and secondary education, defended the requirement, which has been more than five years in the making.

Commissioner Chester is deeply involved with the Common Core and the tests for Common Core. Until recently, he was chair of the PARCC Governing Board.

The educational turmoil in Massachusetts is baffling. It is the nation’s highest-scoring state on standardized tests, yet school leaders like Mitchell Chester can’t stop messing with success. Although they like to say they are “trying to close the achievement gap” or they are imposing tougher measures “to help minority students,” these are the children who fall even farther behind because of the new tests, which are harder than past tests, and are developmentally inappropriate, according to teachers who have seen them.

What is happening in Massachusetts is the epitome of “reform” arrogance. Why doesn’t Commissioner Chester support the fine teachers he has and fight for better funding and smaller classes in hard-pressed urban districts like Boston?

Peter Greene reports that the Florida Department of Education made an ambiguous statement when pressed on the Manatee County’s determination to hold back third-grade students who opt out, even if they have excellent reports cards and can read very well.

The spokesperson for the state said that the law is clear: students have to take the test. But the law does not say that students must be held back.

Peter reads this to mean that the state is blaming the district.

So, Superintendents Diane Greene and Lori White– the ball’s in your court. In fact, you’re kind of in your court all alone now. The state has sent a clear message of “Don’t lay this foolishness on us!” My suggestion? make a reasonable, humane, decent decision here– the kind of decision that one would expect from a professional educator who actually cares about the welfare of children. Take the opening the state has given you, and pass those children.

Myra Blackmon is a columnist for he Athens Banner-Herald, where this column appeared.

 

 

She writes:
It happened last year. They said problems were corrected. It happened again this year.

 

Once again, administration of the Georgia Milestones – those hideous tests that purport to measure student achievement and teacher effectiveness – was plagued with computer problems.

 

 

Only someone who has been asleep for the last three years should be surprised at this. Computer servers couldn’t handle the traffic, systems crashed, teachers wrung their hands, students wept in frustration.

 
As a result, test scores will not be used for retention or promotion decisions for students in grades 3, 5 and 8.

 

This isn’t accountability, friends – this is abuse. The Georgia Milestones abuse the money Georgia taxpayers spend on education.

 

Let’s put this waste and abuse into perspective. According to the state Department of Education, there are about 401,000 students in third-, fifth- and eighth-grade classes in Georgia public schools. Let’s assume their teachers spend 10 hours of test preparation, practicing and reviewing with each of these students. That’s four million hours of time that could have been spent building projects, reading books for fun, doing science experiments – in other words, actually learning.

 
Yep, four million hours of wasted time, all before the testing begins. And that’s in just three grades.

 

In those same three grades, there are about 15,000 classrooms across the state, (assuming an overall average class size of about 26) spending millions of student hours on unproductive, speculative practices. It isn’t the schools deciding to waste all this time and money, it’s the state legislature and the U.S. Department of Education.

 

When you translate that into teacher pay for that wasted time, we are quickly pushing $1 billion annually. If that money was being spent to pay teachers to do what they do best, instead of what federal and state mandates insist they do, we could be making huge gains in education. But we are so driven by the mandated metrics and extraneous requirements that we completely lose sight of what real learning looks like.

 

What are we thinking, allowing this nonsense in our schools?…

 

Georgia Milestones provide zero diagnostic data. There are no reports that Johnny does well with long division, but needs to work on reading comprehension, while Tamekia is really strong in earth science, but still needs to work on her understanding of the three branches of government. No, all we get is aggregate data – and it’s not available until several months into the next school year, far too late to do anything about problems in any given class.

 

The Georgia Milestones have become the Georgia Millstones, huge weights that break the backs of our children and their teachers. We must stop it. And we must stop it soon, lest we lose another generation to corporate profits and political junk science.

 

 


Peter Greene reliably reads all the studies, think tank reports, foundation proclamations, and other stuff that pours forth from the Think About Education Industry.

 

In this post, he is thinking about something else, something very important: his 18-month-old grandson.

 

This is a young man with a long list of studies, reports, and policy briefs. Well, diapers, not so much briefs.

 

As Peter writes:

 

He is, at 18 months, a Man of Adventure. He knows many exciting activities, such as Putting One Thing Inside of Another Thing, or Stomping Vigorously Upon the Ground. He knows the word “dog” and is involved extensive survey of just how many dogs there are in the world, which also involves working out which survey items are dogs, and which are not. In the photo above, you can gauge his mastery of Spoon Technique as applied to Ice Cream. This is part of his extensive study on What Can Be Safely and Enjoyably Eaten.

 

 While outdoors he devotes his time to Running Studies, by which I don’t mean the management of studies, but the study of actual running. A popular game– Walking Up The Top of the Hill, followed by the sequel, Running to the Bottom of the Hill (“Hill” here defined as “Stretch of mildly tilted ground”). This dovetails with another one of his spirited experiments on the question of When Is It a Good Time To Applaud and Cheer? (The complete answer has not yet been compiled, but it clearly includes “after you have made it to the top of the hill” and “after you have run down.”)

 

Peter knows that somewhere there are people with Very Important Titles trying to figure out ways to determine whether this child is improving. What test should be devised? How should he be measured? Will he ever amount to anything if he doesn’t have a battery of tests to rate him, rank him, and enable comparison to children of the same age in other states and nations?

A group of parents in Texas has filed suit against the state education agency to stop the use of this year’s scores to punish students and schools.

 

The legislature passed a law requiring the tests to be shortened, but the state education agency did not comply.

 

Its failure to abide by the law invalidates the tests, the parents believe.

 

Commissioner Mike Morath does not agree and intends to use the test results for accountability purposes, continuing the test obsession in Texas.