Lorrie A. Shepard is one of the nation’s most eminent assessment experts. In this article in Education Week, she explains that it would be a mistake to resume testing this spring. She is University Distinguished Professor in the research and evaluation methodology program of the school of education at the University of Colorado Boulder.
Shepard writes:
This past spring, the U.S. Department of Education gave states permission to cancel federally mandated state testing and accountability reporting because of pandemic-induced lockdowns. As the new testing season approaches, many advocacy groupsare urging the department to reinstate testing requirements.
As an assessment researcher who has studied both high-stakes statewide tests and very different classroom-assessment processes, I am alarmed when testing advocates claim that test data will automatically serve equity goals. Advocates do not acknowledge any potential harm from testing for the very students in communities of color most traumatized by COVID-19. If the downsides were factored in, I believe most, even all, state tests would be canceled for 2021.
Even under normal circumstances, high-stakes testing has negative consequences. State assessment programs co-opt valuable instructional time, both for weeklong test administration and for test preparation. Accountability pressures often distort curriculum, emphasizing testlike worksheets and focusing only on tested subjects.
Recent studies of data-driven decisionmaking warn us that test-score interpretations can lead to deficit narratives—blaming children and their families—instead of prompting instructional improvements. High-stakes tests can also lead to stigmatizing labels and ineffective remedial interventions, as documented by decades of research.
Most significantly, teachers report that they and their students experience high degrees of anxiety, even shame, when test scores are publicly reported. These stressors would undoubtedly be heightened when many students will not yet have had the opportunity to learn all of what is covered on state tests. A high proportion of teachers are already feeling burnt-out.
Some advocates, alert to the potential for harm, have argued in favor of testing but without accountability consequences. Clearly it would be unfair to hold schools and teachers accountable for outcomes when students’ learning opportunities have varied because of computer and internet access, home learning circumstances, and absences related to sickness or family disruption.
Others are insisting on accountability for spring 2021, saying that schools and districts had plenty of time this school year to prepare for COVID circumstances. In a recent letter, 10 civil rights, social-justice, disability-rights, and education advocacy organizations urged the Education Department to maintain federally mandated testing requirements so as “to hold districts and states to account.”
That impulse looks very close to blaming educators, who have given so much during the pandemic. It is counterproductive because it potentially demoralizes students and teachers without addressing the grave problems advocates have in mind.
One of the main arguments for testing this spring is to document the extent of learning loss, especially disproportionate losses affecting poor children and communities of color. We are told those data would then be used to allocate additional resources to support students who have fallen the furthest behind...
We already have enough evidence of COVID impacts to warrant federal investments. At the state level, there may not be new monies to allocate because of budget cuts.
Testing advocates should also consider the technical difficulties of testing during a pandemic. Remote testing requires security protocols that would violate privacy laws in some states, and even with such protocols, remote and in-person test results could not be aggregated or compared as if they were equivalent. Bringing all students into schools for testing when some are still learning remotely is unfair.
Consider, too, that the many students who are now absent from remote learning would likely be absent from testing, skewing results compared with previous years. Given the likely inaccuracies in 2021 state test scores, other data sources might be just as good depending on the intended purpose for testing...
Bear in mind that state tests do little to guide instruction for individual students. Knowing which students are below proficient does not tell teachers what skills they have already mastered nor what understandings students still need. Assessments embedded in high-quality curriculum or key assignments are the best way for teachers to gain substantive insights about children’s thinking, plan instruction, and share information with parents.
Reblogged this on David R. Taylor-Thoughts on Education.
Hoping by January 21st the word has come down from the new Sec. Ed. that spring test are cancelled.
optimistic, perhaps
“Others are insisting on accountability for spring 2021, saying that schools and districts had plenty of time this school year to prepare for COVID circumstances.”
Just amazing. None of the powerful people in government who COMPLETELY dropped the ball on assisting public schools in a pandemic will EVER be held accountable, but those same powerful people want to punish teachers and principals.
So nice that we have public schools to blame for every national disaster.
“…..it would be a mistake to resume testing this spring.”
it would be a mistake to resume testing ever.
That is a better idea.
Yes
Absitively.
AMEN, Roy!
That’s an approximation of the comment I wrote in when I signed the (Un)Fair Test petition. “NO MORE TESTING. EVER.”
& wrote all the Duane reasons (well, not exactly the Wilson Rant, but close) why not.
I would love to read this blog one day & see NO posts on “standardized” testing…because the Sec. of Education had Congress write (& Congress passed) a bill that ended the means to no ends
($$$$$ to the ed. publishing monopoly).
And the President signed it.
Wonderful!!! Yes, yes, yes!
Even if these state tests actually validly tested what they purport to test, they would be instructionally useless because the results aren’t broken down and aren’t available within reasonable timeframes. In general, summative tests are much less useful than are diagnostic and formative ones.
Oh, and btw, the First Noel was to certain poor Shepherds.
So were relatives of yours at the first Christmas? Bob the shepherd? 🙂
The Shepherds of Bethlehem were a better lot, generally, than were those of Bedlam. I won’t get into that. However, it has been often remarked that Bedlam Boys Are Bonny.
Right about now, I am having trouble deciding which branch you are from! I missed the segue.
lol
“Recent studies of data-driven decision making warn us that test-score interpretations can lead to deficit narratives—blaming children and their families—instead of prompting instructional improvements.”
Particularly when high stakes are attached to standardized test scores, students, teachers and schools understand that data are used to blame and punish. All blame and punishment stem from a deficit view of the results. It is not a benefit to students when a competent teacher is fired over low test scores. Nor is it a benefit to students when a community school is closed, and a charter school school is opened in its place. There is no evidence to show that this is a valid way to address inequity. If politicians seek equity, they should fairly fund the schools most poor students attend.
Unfortunately, the issue of equity and testing emerged from justifying expenditure for Title 1. I have even heard some educators say that if we don’t test the ELLs and the classified students, they will be “forgotten.” This was never my experience teaching ELLs in NYS. Both classified students and ELLs received support from certified reading, ESL or special education teachers to address their needs. These students were never ignored or forgotten. In fact, these students lost too much instructional time due to unnecessary over testing.
Readers who agree with Lorrie Shepard’s excellent opinion column should join FairTest, the Network for Public Education, Badass Teachers, and other leading assessment reform groups in signing on to the “National Call to Suspend High-Stakes Testing in Spring 2021” — https://actionnetwork.org/petitions/suspend-high-stakes-student-testing — Please share widely
Thank you, FairTest, for all the work you do to expose the assessment scams!
Time to end the federal standardized testing mandate!
It’s is absurd, after the disjointed year students endured, that Texas is still insisting that its students still take the STAAR Test.
There is no “fair test” when it comes to the standardized and testing malpractice regime. Fairtest just serves to give a sheen of “objectivity and fairness” that is not warranted at all.
Come on Bob, read and comprehend Noel Wilson’s and my work to understand all of the onto-epistemological errors and falsehoods involved in the standards and testing malpractice regime that render using any of the results of said tests to be completely invalid, or as Wilson succinctly puts it “vain and illusory”.
Fairtest is part of the problem.
As is the author of the article.
Fairtest, Duane, is a WONDERFUL organization that investigates and reports on scams in the testing industry and problems with the tests. Check out their website. It’s great.
Bad to be in a circular firing squad with your allies.
LOL. Well said, Diane!
https://www.fairtest.org/
Okay, I’m going to be quite crude with this comment. And it’s crudeness will not be anywhere near as “crude” as the standards and testing malpractice regime that has bastardized the teaching and learning process for this century causing irreparable harm to the students. So don’t read further if you don’t like crude, and I ain’t talkin about J. Clampett’s oil.
Didn’t even have to read the article, although I did, to realize it was going to be another exercise in mental masturbation by a supporter of the unjust and unethical standards and testing malpractice regime. Same ol crap as usual in these kinds of “pass the smelling salts so I don’t faint” articles that feign concern for students. Hell, if the author, and those here applauding her fainting act REALLY cared for the students and the teaching and learning process they’d literally be up in arms against the powers that be that mandate such disgustingly harmful practices that harm all students and that destroy the teaching and learning practice as the standards and testing malpractice regime is doing.
“But, but, you need to play nice. How are you going to convince others of the righteousness of what you say”? Well, those that mandate these things, those administrators and teachers that implement such malpractices don’t listen to begin with–“Do as I say!” “Yes, dear master, I’m a GAGA Good German worker who believes in efficiency (sic) and objectivity (sic) in indoctrinating the students.”
Really?
“Yeh! We can accommodate all viewpoints and welcome them in the ‘big education tent'”
Well, you all are wrong in that type of thinking. Education malpractices that harm all students should be immediately ceased. Nothing else can mitigate those harms other than to stop doing them. “Gee whiz I stick my hand in the fire and it burns, I think I’ll do it again.” The author and you all here loudly clapping in approval are tolerating/condoning/supporting the destruction of a child’s true learning opportunities that are the results of the standards and testing malpractice regime.
“Oh, but we can make it kinder and gentler.”
Horse manure!
The standards and testing malpractice regime cannot be made into anything more palatable than the s#!t sandwich it is. Those who think it can be done I say: “Enjoy your meal of the dead brains of the children.”
For you—but I may have already sent this. Please send me dates for our work. d
From: Diane Ravitch’s blog Date: Friday, December 18, 2020 at 8:02 AM To: David Berliner Subject: [New post] Lorrie A. Shepard: Testing Students This Spring Would Be a Mistake dianeravitch posted: ” Lorrie A. Shepard is one of the nation’s most eminent assessment experts. In this article in Education Week, she explains that it would be a mistake to resume testing this spring. She is University Distinguished Professor in the research and evaluation “
This says it all…”Recent studies of data-driven decision making warn us that test-score interpretations can lead to deficit narratives—blaming children and their families—instead of prompting instructional improvements. High-stakes tests can also lead to stigmatizing labels and ineffective remedial interventions, as documented by decades of research.” As an assistant principal some 15 years ago, I had a conversation with an 8th grader where she said,”You know I’m not going to pass that test Mr. Bonner.” This conversation has haunted me since as I have observed too many students come to the same conclusion through their experience. Testing has simply calcified a sense of failure in too many students because these assessments communicate to them an inability to achieve. This self concept follows them through school and into adulthood.
I was a middle school sped. teacher (L.D. Resource) from 1989-2010 (L.D., part of the definition of which is “having average or above average intelligence,” &, I would say, the vast majority of our students had WAY above average intelligence), & I loved, loved, LOVED the kids who:
-Fell asleep during the test.
-Took their highlighting pens (for the consumable test booklet) &
colored in the Scantron bubbles. “Look, Mrs. Retired, isn’t my test
pretty?” (A lovely, sassy 6th grader who’d made me {but not some of
her tight-a** gen. ed teachers–laugh MANY times!}) The principal &
A.P. also got a good chuckle out of it. (Yes, some of them had a sense
of humor & were NOT “adminimals.”)
-Tried to “trick” me into giving them the “right” answer. I said, “There
IS no one right answer.”–Pear$on-manufactured test, so…often true!
Were ADHD, but not on meds, so filled in anything, saying, “I’m
finished!” after 5 minutes or <. Then, when I asked them to check
their answers, looked at the Scantron for 1-2 minutes, then said,
“Yep! All done!”
Hid under the desk & refused to take the test The. Entire. Fifty.
Minute. Period. (Actually, more, because they had “extended time.”)
Had so many hard erasures (in addition to “flop sweat”) on the
Scantron that I’m quite sure the answers were
unreadable/indistinguishable.
Wrote on the “essay” portion of the test, “This test is DUMB!” or
“I DON’T KNOW.” Or wrote both!
Manufactured a “tantrum” in order to go to the school social worker
rather than take the test.
Connected all the bubbles w/a pencil, but didn’t fill any of them in.
&–a favorite– one who filled in the bubbles so they spelled “S**T”!!
& most of the other sped. middle school teachers had same or similar stories. Wish we could have been able to copy these…
🙂
It was powerfully compelling to read an article like this in Ed Week.
Completely agree. Many thanks to Dr. Shepard!
All of the above!!!
Getting rid of all testing is as obvious as the need to remove cyanide from school lunches.
In their incessant greed to make money, the political powers behind the test and punish privatize-and-profitize movement do not care about the dehumanization of our children and the emotional anguish that the pandemic has caused.
I live with my 7 year old autistic grandson so I see the reality every day. I am also a former reading specialist in Philadelphia who used assessment properly in a diagnostic-prescriptive manner. The tests which have been imposed on our children are the worst I have ever seen in my now 40 year career as a teacher and advocate for children.
My grandson can do many things that you and I could never do including script whole scenes from movies and YouTube videos. Yet he would never do well on any standardized test. The autistic mind is utterly amazing.
Glad he has a grampa who can appreciate his gifts.