Leonie Haimson, parent activist, worked with a group of other concerned critics to review the explosion of computer-massessment, in particular, the scoring of writing.
“On April 5, 2016, the Parent Coalition for Student Privacy, Parents Across America, Network for Public Education, FairTest and many state and local parent groups sent a letter to the Education Commissioners in the states using the federally funded Common Core tests known as PARCC and SBAC, asking about the scoring of these exams.
“We asked them the following questions:
“What percentage of the ELA exams in our state are being scored by machines this year, and how many of these exams will then be re-scored by a human being?
“What happens if the machine score varies significantly from the score given by the human being?
“Will parents have the opportunity to learn whether their children’s ELA exam was scored by a human being or a machine?
“Will you provide the “proof of concept” or efficacy studies promised months ago by Pearson in the case of PARCC, and AIR in the case of SBAC, and cited in the contracts as attesting to the validity and reliability of the machine-scoring method being used?
“Will you provide any independent research that provides evidence of the reliability of this method, and preferably studies published in peer-reviewed journals?
“Our concerns had been prompted by seeing the standard contracts that Pearson and AIR had signed with states. The standard PARCC contract indicates that this year, Pearson would score two-thirds of the students’ writing responses by computers, with only 10 percent of these rechecked by a human being. In 2017, the contract said, all of PARCC writing samples were to be scored by machine with only 10 percent rechecked by hand.”
Haimson refers to research that demonstrates that computers can’t recognize meaning or narrative, although they admire sentence complexity and grammar.
This,she writes, means that computers will give high scores to incoherent but windy prose.
“The inability of machine scoring to distinguish between nonsense and coherence may lead to a debasement of instruction, with teachers and test prep companies engaged in training students on how to game the system by writing verbose and pretentious prose that will receive high scores from the machines. In sum, machine scoring will encourage students to become poor writers and communicators.”
Only five state commissioners responded after a month. They learned that the state commissioner of Rhode Island, Ken Wagner, testified that machine scoring was more valid and reliable than trained and expert humans.
Haimson concludes, quoting Pearson’s literature:
“Essentially, the point of this grandiose project imposed upon our nation’s schools is to eliminate the human element in education as much as possible.”
Read this well-documented article. It is up to parents to stop this headlong rush to the dehumanizing of education.

This is is worth reading. Love, Nancy
Nancy Weant
Date: Sun, 8 May 2016 14:00:46 +0000 To: wnancyk@hotmail.com
LikeLike
It’s Mother’s day, but as a 40 year veteran teacher of writing, from second grade to seventh grade and beyond, all I want to say is AGGGGGGH!
As the NYS Council of English Teacher’s (NYSEC) EDUCATOR OF EXCELLENCE in 1998, I had created a PORTFOLIO system in my seventh grade, that showed what a student was writing when entering my class, and HOW that same student was writing when leaving seventh grade.
Then, they were third in the state, on the citywide writing exam (the only standardized tests back then) when 3/4 of NYC students failed
So, a computer is going to do what I did?
I think not.
LikeLike
You can’t. And Utah has been using machine scoring for essays for nearly 10 years. My school uses a computer-based writing program for the kids to practice on. Most of us read the essays as well. I read essays that have gotten pretty good scores on the program that make no sense. The program also doesn’t check for plagiarism, and I’ve found some pretty blatant plagiarism over the years. I’ve gone back to having the kids hand write their essays.
LikeLike
Of course, for years philosophers have warned that the threat is not just that computers will take on the work of humans. But that humans will become more and more computer-like, behaving like machines.
Consider how teachers are now made to act like automatons when grading. God forbid we actually grade our own students’ Regents exams here in New York State. We might actually know something about the meaning those individuals bring to their essays.
Years ago I went to a conference where a young state ed dept. apparatchik harangued us about the overabundance of just barely passing grades on the Regents…there were tons of 66s and 67s etc… Why weren’t more of those kids getting 64% and failing the oh-so-sacred exams? Cheaters all of you, he seemed to imply.
No, it’s called human compassion and the knowledge that most tests inevitably have some flaws. Essay grading is subjective. I guess you could compare the tendency to try to help a kid with a 64% to the idea of a “grace period”….though, of course, machines know nothing about grace nor soul.
And, by the way, Ken Wagner (mentioned above) was one of the so-called “leaders” responsible for the debacle otherwise known as the Common Core roll-out here in New York State. These were the folks who famously built (and then crashed) the plane while flying it. Just like his boss, John B. King, Wagner got his reward, a promotion to head honcho in Rhode Island.
Lesson for the 21st century: if you can behave like a machine and treat other human beings like machines you, too, will be rewarded…by the machine. How tragic.
LikeLiked by 1 person
Kinda misses the whole point of writing … which is communication between human beings … in case some people have forgot …
LikeLike
“Pearsonal Test-taking Assistant”
When robots take the test
Our problems will be gone
Cuz robots are the best
And never ever wrong
LikeLike
“Computer Messessment”
Computer based messessment
Is really quite a blessing
A Pearsonal investment
That pays for quite a messing
LikeLike
And then there are the tests used in other states, with embedded constructed response items…
LikeLike
The whole point of computer evaluated writing is to assist the relentless assault on public schools by business. Ultimately, the goal is to remove teachers from teaching. Despite the obvious flaws in the capabilities of computers, the movement continues to plow ahead because it is backed by Pearson and Gates, and both have much to gain from this. Teachers need to do what they have always done. Teach students to reason and feel; engage the head and the heart, and get it all down on paper, and not worry about making anything more “efficient” for Gates and Pearson.
LikeLike
“Pearsonalized Education”
Take the teachers from the teaching
Lop the students from the learning
Replacing all with Pearson leeching
Battling bots with circuits burning
LikeLike
Down with Gates, Pearson, and all the rest of those yahoos who think computers can actually replace teachers. This “BLENDED” learning is just another term for BAD stuff from the deformers to make even more $$$$$ off the backs of kids and at the same time DISS teachers. It’s SIC.
LikeLike
Reblogged this on Politicians Are Poody Heads and commented:
Computerized scoring. Sure, that’s the ticket. Not.
It’s one thing for computers to score “fill in the bubble” multiple choice tests. But essays?
I think not. The program’s seem to be “counting words” and scoring high for excess verbiage.
Somehow, I’m betting that Ernest Hemingway would not have done well on one of these computer-scored tests.
LikeLike
I think the most important question is NOT how reliably computers assess writing. Rather we need to ponder what changes when our students know the audience for their writing is not a human being, who might be impressed by the quality of their ideas and the beauty of their language, but by a machine. Now they need to figure out what the algorithm values.
LikeLiked by 1 person
Very useful article. When I posted the article on Facebook’s BAT groups (it got more than 100 shares), I was informed that Perelman already made his basic observations 4 years ago.
“Shockingly” it didn’t change anything.
Under heavy criticism, they may say, ok, teachers will have to grade the standardized tests.
LikeLike
I don’t trust people to “grade” writing, much less computers.
LikeLike