Archives for category: Testing

 

To my knowledge, the United States is the only nation in the world that requires students to take standardized tests every year from grades 3-8. I believe that it is surely the only advanced nation that requires annual testing in these grades. The tests are required by federal law, a hangover from George W. Bush’s No Child Left Behind, and the requirement was re-enacted in the Every Student Succeeds Act of 2015.

This testing regime has been in place since 2002, when the law was signed by President Bush the first. The consequences attached to the tests have been harsh in many states, which use them to stigmatize students, teachers, and schools. Teachers have been fired, and schools have been closed based on test scores. That is called test-based accountability, and there is growing evidence that TBA is ineffective. NAEP scores have been flat since 2013. The number of people entering teaching has declined sharply. Schools have cut back on the arts, physical education, and other subjects that are not “counted” in the test score calculus. It is difficult to find any real benefits to our national investment in high-stakes testing.

Why do our policymakers at the federal, state, and local levels continue to require and enforce annual testing, despite the non-existent benefits? I believe that testing survives for two reasons: One is that there is a lobby that loves testing, composed of testing corporations and groups like Democrats for Education Reform, the hedge fund managers organization. The other is that our policymakers are still inhaling the stale fumes of NCLB and the non-existent “Texas Miracle.” It is hard to break away from a practice, even a bad practice, that has become ingrained. Annual testing began with NCLB, became more punitive with Race to the Top, and survived in ESSA. Bad habits are hard to change.

Testing authorities have a general rule. Tests should not be used for any purpose other than the one for which they are intended. Tests are supposed to be diagnostic; they are supposed to provide teachers with information to help them improve instruction. They never do, because the results are reported long after the student has left the teacher who administered the test and they never provide enough detail about the strengths and weaknesses of individual children to be useful.

Standardized tests should not be used for high school graduation or for firing teachers or closing schools. Yet they are. Obviously, they are misused on a regular basis.

So, I have a modest proposal.

I am not aware of any legal requirement that the annual tests required by Congress must be offered in the spring.

Why not give the tests in the first week of school and use only a test whose results may be returned within a month? Let machines score the standardized questions, and let teachers score the constructed responses. The testing vendor would know that they would be chosen only if they could report the results in a month, in a format that informs teachers what students do and do not know. That way, the teacher can find out where students are as they begin the year and tailor instruction to address the needs of the students.

That way, tests would no longer be high-stakes. They would be expressly designed for diagnostic purposes, to help teachers help students. The results would come too early to misuse the tests to stigmatize students, punish teachers, and close schools. There would be no punishments attached to the tests, but plenty of valuable information to help teachers.

How would we know how schools are doing?

We could rely on the National Assessment of Progress, which reports on states and many districts and is disaggregated by race, gender, disability, and other categories. It reports on achievement gaps as well.

With this fairly simple but drastic change, we could put testing in its proper place. We could stop terrorizing students and teachers.

We could let teachers gain at least a month, maybe two, for instruction instead of test prep.

Tell me what you think.

Some of you, I know, will tell me why all testing is a waste of time.

But so long as the requirement for annual testing is in the law, there must be a good faith effort to comply.

Why not comply in a way that is not harmful to students, teachers, or schools, but that might actually provide useful information?

 

Steven Singer reviews the decision by the Colorado Democratic party to tell the “Democrats for Education Reform” to stop calling themselves “Democrats.” DFER, he writes, is neither “Democrat” nor is it advocating for “education reform.” It is a group of wealthy hedge fund managers who pour large amounts of money into election to promote standardization, profitization, and privatization. They are clueless about the value of public schools and about the needs of students and teachers. They don’t care. They have money and they do what they want, without regard to collateral damage.

He writes:

Henceforth, “Education Reform” shall be Education Sabotage – because that’s really what it is.

It is about deliberately obstructing goods and services that otherwise would help kids learn and repurposing them for corporate benefit.

Likewise, I propose we stop using the term “School choice.” Instead, call it what it is – School Privatization.

Anyone who uses the older terms is either misguided or an enemy of authentic education.

Perhaps this seems petty.

They’re only words, after all. What does it matter?

It matters a lot.

As Ludwig Wittgenstein wrote:

“The limits of my language mean the limits of my world.”

We cannot effectively fight the forces of segregation, standardization and privatization if we have to constantly define our terms.

Professor Maurice Cunningham of the University of Massachusetts, who specializes in the deployment of Dark Money to promote school privatization, has suggested the term “Financial Privatization Cabal.” Great term, too many syllables.

We could just call them the “Privatizers,” because that is the word that represents the common goal of DFER and Betsy DeVos, Donald Trump, Scott Walker, Rick Scott, and the other thieves of language and the common good.

 

“A Nation at Risk” was published in 1983. It launched the false narrative that American public schools were failing. The nation was in recession, and the authors of the report blamed the schools. When the economy improved, no one said, “Oops, we were wrong about the schools.”

In this article, James Harvey and David Berliner reflect on what the report said, and what needs to change to create real reform.

Although there is powerful evidence of significant improvement in American schools since 1971, as Arne Duncan, President Barack Obama’s first secretary of education, recently noted, “A Nation at Risk” itself ignored that evidence in favor of launching what turned into a “shock and awe” campaign that promoted a consistent narrative of school failure.

Part of the shock and awe campaign used the National Assessment of Educational Progress (NAEP).  With the encouragement of Secretary Bennett and his allies, this excellent assessment was diverted from its original purpose of measuring what students at various grade levels actually know to a new goal: judging what students at various grade levels should know.

Adding to the confusion, NAEP’s governing body, the National Assessment Governing Board, adopted three vague terms to define performance benchmarks: Basic, Proficient, and Advanced. Almost nobody understands what these terms mean. Analysts, journalists, and state officials use the term “proficient” as the barometer of success despite the fact that the government has consistently maintained that what most people would consider to be proficient performance would not meet NAEP’s definition of proficiency.

So we are told every few years that only about a third of our students are “proficient” in reading or mathematics under NAEP’s benchmarks as though that were information of great value. Yet it is clear from recent research published by the National Superintendents Roundtable and the Horace Mann League (“How High the Bar?”) that the vast majority of students in most nations cannot clear the NAEP bar of “proficiency.”

Indeed, government officials acknowledge that to understand how many students in the United States are performing at grade level, the appropriate benchmark to examine is “basic,” not “proficient.“

What to Do?

Nobody should think for a minute that there aren’t very real problems with learning in America.  There’s a lot to be done.  But we’re not going to solve our school problems by exaggerating them or by misleading the public about school quality.

It is simply not true that American schools are failing 60 percent or more of their students, as NAEP’s proficient benchmark suggests. NAEP’s data indicate that nearly 70 percent of fourth graders are performing on grade level in reading, with 80 percent performing on grade level in mathematics. For 8th graders, the rates are 76 and 70 percent, respectively. While it would be gratifying to see higher numbers, these results are a much better guide to action than the deceptive picture of failure painted by the misleading term “proficient.”

“How High the Bar?” recommends that NAEP adopt benchmarks used by international education assessments, such as low, intermediate, high, and advanced. These terms provide a much more neutral and accurate take on student achievement.

It’s time also that we put an end to educational policy-making grounded in testing and tax cuts. As the recent wave of statewide protests across the nation indicates, educators are tired of standing by, their dignity under assault while their incomes stagnate and books and buildings fall apart.

Of course we should build more flexibility into the system, along with more variety and greater responsiveness to student and parent preferences.

Finally, we should go back to some of the advice the excellence commission received during its hearings but tossed aside in developing its report.  Oddly, President George H.W. Bush adopted some of these ideas in his “America 2000” program. Make sure all infants have a decent start in life so that they’re “ready” when school begins.  Worry about the 80 percent of their waking hours that students spend outside the school walls.  Provide adequate health care for children and a living wage for working parents, along with affordable day-care.

We can’t afford these things? Nonsense!  The United States is the wealthiest nation in the history of the world. It can certainly provide its citizens with the basics that other nations provide to theirs.

 

Jack Hassard, professor of science education, assesses creeping authoritarianism and the growing resistance to it among educators.

“The authoritarianism of standardization has spread harm and inflicted damage to America’s public schools during the last two decades. The profits from standardized tests and teaching materials associated with the Common Core have overwhelmed the nature of learning in public school classrooms that one wonders if this goliath, which has trampled on the very heart of education in a democratic society, can be brought down.

“The conservative world-view is at the root of standardization, not only in the United States, but in most countries around the world. This world-view has set in motion the reform of education based on a common set of standards, high-stakes tests, and accountability metrics that demoralize not only students and their families, but the educators who families regard as significant and positive others in the lives of their children.

“I think of standards-based education reform as a kind of “spray” analogous to how we used DDT as an agricultural insecticide. We sprayed it everywhere to stamp out disease carrying bugs. For example, from 1940 – 1972, more than 1.3 billion pounds of DDT were released into U.S. communities indiscriminately. This indiscriminate and relentless spray would eventually be shown to be harmful and a serious threat to the basics of ecosystems.”

Hassard describes the fight to block authoritarianism in education, which is closely aligned with the resistance to authoritarianism in the public arena.

He writes about a vanguard of resistors, some of whom are gentle and others not so gentle (he uses the word “gentile” but I think that is an error or auto-correct gone amok, as I am neither gentile nor gentle).

”So, what is this vanguard voicing opposition to? All are questioning the lack of wisdom, profound ignorance, and inexcusable ineptness of an educational reform movement that is rooted in a very narrow purpose of schooling: teaching to the test. According to Sahlberg, the movement can be summarized in four words: Global Education Reform Movement GERM).”

Are you part of GERM or part of the resistance. Chances are, if you are reading this post, you are part of the Resistance.

 

 

From FairTest:

In addition to lots of other testing news, several states that contract with Questar, a for-profit subsidiary of the Educational Testing Service, recently experienced significant disruptions of their computerized standardized exams. In three — New York, Ohio and Tennessee — the entire assessment system crashed. The latest failures add to the evidence that corporate and ideological forces rushed these technologies into the marketplace before they were ready for prime time. See FairTest’s chronology of computer testing problems at:
http://fairtest.org/computerized-testing-problems-chronology

Florida State Seeks to Delay Stricter Grad Test Rules
http://www.orlandosentinel.com/features/education/school-zone/os-florida-graduation-test-scores-20180416-story.html

Georgia District Tells Opt-Out Parents to Keep Kids Home for Two Weeks
http://www.13wmaz.com/article/news/local/what-to-do-if-you-opt-your-child-out-of-milestones-testing-dont-go-to-school/85-542620645
Georgia Top State Court Refuses to Hear Educators Test Cheating Appeal
https://www.myajc.com/news/local-education/highest-georgia-court-won-hear-aps-educators-appeals/zmXkAVaS38EYWLg02FJlZK/

Maryland Computer Testing Is Another Challenge for Low-Income Students
http://www.baltimoresun.com/news/maryland/education/k-12/bs-md-online-parcc-test-20180402-story.html

Massachusetts Student and Her Mother Blog About Problems with State Testing
https://lesstestingmorelearning.tumblr.com/post/173095664989/stories-12-and-13-from-a-daughter-and-her

Michigan Standardized Tests Dull Learning
https://www.detroitnews.com/story/opinion/2018/04/17/standardized-tests-dull/33935993/

Minnesota Legislature’s Test-Driven School Ranking System Needs Overhaul
http://www.startribune.com/proposed-system-for-ranking-minnesota-schools-needs-work/480423733/

Mississippi Technical Problems Interrupt State Computerized Test
http://www.heraldcourier.com/news/technical-problem-briefly-interrupts-mississippi-state-tests/article_2066e3fd-859e-52fb-b636-387279e56309.html
Mississippi State Renews $10 Million Testing Contract Despite Recent Exam Administration Disruption
https://www.clarionledger.com/story/news/2018/04/20/mississippi-renews-questar-testing-contract-more-than-10-m/536735002/
Mississippi What’s a Test For?
https://www.charlotteobserver.com/news/politics-government/national-politics/article209485029.html

New Jersey PARCC’s Long Goodbye
http://nj1015.com/parccs-long-goodbye-wont-end-standardized-tests-in-new-jersey/

New Mexico Legislators Push Back Against Governor’s Test-Based Retention Plan
http://www.santafenewmexican.com/news/education/secretary-s-school-retention-plan-riles-new-mexico-lawmakers/article_b042ef13-990b-5846-bf30-aec990e296df.html

New York After Epic Fail of State Testing, Parents Seek Removal of Education Commissioner
https://nycpublicschoolparents.blogspot.com/2018/04/epic-fail-of-last-weeks-state-testing.html

North Dakota New Education Dashboard Goes Beyond Test Scores, Includes Student Engagement
http://www.valleynewslive.com/content/news/New-tool-launched-to-Provide-More-Transparency-in-School-Performance—480534231.html

Ohio Statewide Computer Testing System Crashes
https://www.daytondailynews.com/news/online-state-testing-system-down-some-schools-cancel-tests-for-day/3aV1Z4YyJdEp9SdhxJrsON/
Ohio School Grades Are Not Understandable
http://www.norwalkreflector.com/Education/2018/04/20/School-supers-want-simplified-fair-state-report-cards.html

Oregon Latino Students, Standardized Testing and Opting Out
https://www.eugeneweekly.com/2018/04/19/latino-students-what-matters/

Pennsylvania Opt-Out Numbers Growing
https://lancasteronline.com/news/local/nearly-lancaster-county-students-have-opted-out-of-pssas-this/article_2ec60700-44da-11e8-8e1b-3b18d5e8c81f.html
Pennsylvania Teacher Writes Anti-Test Poetry While Proctoring Exams
http://www.philly.com/philly/education/i-had-test-itis-while-kids-are-taking-pssas-this-teacher-might-be-writing-subversive-poetry-20180418.html
Pennsylvania “Kiss My Assessment,” More High-Stakes Poetry
https://gadflyonthewallblog.wordpress.com/2018/04/18/kiss-my-assessment-a-high-stakes-testing-poem/

Tennessee Statewide Computerized Testing System Fails for Third Year in a Row
https://www.commercialappeal.com/story/opinion/editorials/2018/04/20/tnready-testing-testing-testing-and-failing/529442002/
Tennessee Parents Pull Children Out of Testing
https://www.wbir.com/article/news/local/parents-pull-children-from-tnready-testing/51-542961098
Tennessee Legislators Drop Consequences From This Year’s Flawed Tests
https://chalkbeat.org/posts/tn/2018/04/19/breaking-tennessee-lawmakers-take-matters-into-their-own-hands-on-tnready-testing-problems/

Texas High Time for State Testing Burnout
https://www.dallasnews.com/opinion/commentary/2018/04/18/high-time-staar-test-burn
Texas Why Do They Test?
https://www.mystatesman.com/news/opinion/commentary-let-test-then-you-and/1VVhNP556rJE6RjHiwDpDK/

Washington New System for Evaluating Schools Is Being Implemented
http://www.spokesman.com/stories/2018/apr/18/washington-implementing-new-system-for-judging-sch/#/0
Washington Time to Opt Out
http://saveseattleschools.blogspot.com/2018/04/its-testing-time-opting-out.html

University Admissions SAT Documentary “The Test and the Art of Thinking” Opens Across the U.S.
https://www.thetestdoc.org/

International Why British Parents Will Boycott School Tests
https://www.theguardian.com/education/2018/apr/22/parents-boycott-sats-tests

Worth Reading Why Can’t We Assess Like We Were Assessed?
https://www.educationdive.com/news/we-cant-assess-like-we-were-assessed/521257/
Worth Reading I Lied to My Students Today
http://www.lovewhatmatters.com/i-lied-to-my-students-today/

Bob Schaeffer, Public Education Director
FairTest: National Center for Fair & Open Testing
office- (239) 395-6773 fax- (239) 395-6779
mobile- (239) 699-0468
web- http://www.fairtest.org

 

A statement from the New York State Parent Teachers Association. 

The PTA is worried about the breakdown of the online assessments as well as the excessive time required by the “shortened,” two-day exams.

“We are extremely concerned about technological failures by Questar Assessments, Inc., the vendor who was awarded the NYS testing contract. We are glad that the State Education Department has announced that they will be holding Questar Assessments, Inc. fully accountable for this error.  Reports indicate more than 30,000 students had work lost, or had total system failures when trying to take the assessments on computers. Further, we are aware that bandwidth and other technical issues plagued some school districts who were trying to administer computer based assessments.

“It was also disappointing that the state budget was passed without addressing the backlog of Smart Schools Bond Act Plans that have yet to be reviewed or approved.

“Students who were unable to finish should not have to re-take these assessments.

“Further, we are alarmed at the many reports that some students were testing for multiple hours, some into and past lunch periods.

“For ALL children, the duration must be short, and content must be appropriate for these mandated tests,” offered President Gracemarie Rozea. “While we appreciate the reduction of tests from the previous three days to two days, we must ensure that the remaining testing days are short, and that students are not sitting for multiple hours in testing conditions – especially our earliest learners.”

“As a parent of  a 3rd grader, I fully understand the concern families have on this issue – and know that we will continue to advocate that standardized assessments be limited in quantity, in duration, and developmentally appropriate,” added Executive Director Kyle Belokopitsky.

“We will continue to communicate our concerns and possible solutions with the Education Department and other stakeholders, and will be asking for a review of the length of tests, and of the content again to ensure tests are developmentally appropriate for all children.”

 

 

Fred Smith is a testing expert who worked as an analyst for the New York City Board of Education for many years. In this study, he flips the question: Not, how did the students perform, but how did the tests perform?

He grades the tests and finds a remarkable increase in the number and percent of students who scored a zero, perhaps because they didn’t understand the question or provided a confused or incoherent response.

The increase in zeroes was particularly high for students with disabilities and English language learners. They were higher still for black and Hispanic students.

Smith writes:

”The data show that there has been an increase in the percentage of zero scores since the administration of exams aligned with the Common Core. We anticipate that officials will claim this outcome to be the consequence of tougher standards reflected by more rigorous exams.

“We argue that those assertions are insufficient explanations for what we found. Recall that a zero score indicates an unintelligible or incoherent answer. Certainly, some zeroes are to be expected. But the percentage of zero scores, particularly for students in grades 3 and 4, is unreasonable in our view. With so many answers deemed “incomprehensible, incoherent, or irrelevant,” we must ask whether such a program yielded any valuable information at all about our youngest students, as the testing was purported to do. The failure here is much more likely in the questions themselves and in the belief that it was acceptable to ask eight- and nine-year-olds to sit and take long exams over several days. That the data also indicate a widening achievement gaps cannot be ignored…

“Further evidence of flawed testing can be noted in the decline of zeros in 2016 — when the SED removed time limits — from the surge in 2013, for most grades. After three years of CC-aligned testing, the SED acknowledged that the time constraints imposed by the tests were an issue. This, in itself, is an after-the-fact admission that the tests were poorly developed, as test administration procedures, including timing, should be resolved as part of the test-development process before tests become operational.

“In taking stock of the testing program we must return to the fears and doubts that were expressed by a small number of people early on. Were New York State’s CC-aligned tests appropriate measures? Would they have a negative impact on students, especially the most vulnerable?

“The analyses and findings in this report vindicate these early concerns and give empirical grounding to the opt-out movement that grew to an astounding 20 percent of the test population between 2013 and 2015. Specifically, our findings raise questions about the efficacy of this kind of testing, particularly for our youngest students. They also open a needed discussion about the quality of Pearson’s work, the worth of its product, and SED’s judgment in managing the program.”

The unasked question is why we insist on testing every student in grades 3-8 every year. No other nation does it.

My guess: Congress is still inhaling the toxic fumes of NCLB, which was based on the nonexistent “Texas miracle.”

 

 

If you have nothing better to do today or tonight, you might enjoy watching my presentation to a lively audience at the Lensic Center in Santa  Fe, where I spoke about the negative result of eight years of “reform” based on the Florida model.

Since I will soon turn 80 and am ending my lecture career to turn to writing a new book (my last, I assume), I didn’t hold back. The warmth of the audience unleashed me to say what was in my mind and in my heart about the fraud that is now called “reform” (but is really privatization).

New Mexico has the highest rate of child poverty (under the age of 5) in the nation at 36.2%,  five points higher than Mississippi, which is in second place. It also has one of the nation’s highest rates of adult poverty. But the education leaders in New Mexico thought they could cure poverty with testing and teacher evaluation. All of it failed. New Mexico, with all its beauty and splendor, has made no education progress during these past eight years of “reform.”

Jesse Hagopian, teacher and author at Garfield High School in Seattle, who led a strike against mandated standardized testing at that school, introduced me and joined in conversation after I spoke.

 

This would be funny if it were not also unethical and outrageous.

Pearson embedded messages in certain tests to test “social-psychological”premises. Would encouraging messages raise test scores? Would “growth mindset” messages improve scores?

The answer: no.

“Education and publishing giant Pearson is drawing criticism after using its software to experiment on over 9,000 math and computer science students across the country. In a paper presented Wednesday at the American Association of Educational Research, Pearson researchers revealed that they tested the effects of encouraging messages on students that used the MyLab Programming educational software during 2017’s spring semester.

“Titled “Embedding Research-Inspired Innovations in EdTech: An RCT of Social-Psychological Interventions, at Scale,” the study placed 9,000 students using MyLab Programming into three groups, each receiving different messages from the software as they attempted to solve questions. Some students received “growth-mindset messages,” while others received “anchoring of effect” messages. (A third control group received no messaging at all.) The intent was to see if such messages encouraged students to solve more problems. Neither the students nor the professors were ever informed of the experiment, raising concerns of consent.

“The “growth mindset messages” emphasized that learning a skill is a lengthy process, cautioning students offering wrong answers not to expect immediate success. One example: “No one is born a great programmer. Success takes hours and hours of practice.” “Anchoring of effect” messages told students how much effort is required to solve problems, such as: “Some students tried this question 26 times! Don’t worry if it takes you a few tries to get it right.”

“As Education Week reports, the interventions offered seemingly no benefit to the students. Students who received no special messages attempted to solve more problems (212) than students in either the growth-mindset (174) or anchoring groups (156). The researchers emphasized this could have been due any of a variety of factors, as the software is used differently in different schools. However, educators who spoke to Education Week were understandably more alarmed by Pearson placing thousands of unwitting minors in A/B testing for its products.

“It’s concerning that forms of low-level psychological experimentation to trigger certain behaviors appears to be happening in the ed-tech sector, and students might not know those experiments are taking place,” Ben Williamson, a professor at the University of Stirling, told the publication.”

The students who received no “encouraging messages”performed much better than those who did. Maybe the messages triggered anxiety. Maybe they were distracting. Maybe this was a dumb and unethical experiment on human subjects.

 

Our very own blog poet has written a wonderful new poem.

“Jabbertalky” (after Jabberwocky, by Lewis Carroll, of course)

“Twas brillig, and the billionaires
Did lie and dissemble in the press
All flimsy were Deformer wares
And the charter rats did nest

“Beware the Jabbertalk my son!
The Cores that bite, the tests that catch!
Beware the Coleman bird, and shun
Felonius charters, natch!”

“He took his opt-out sword in hand:
Long time Deformer foe he sought —
So rested he by the Knowledge tree,
And stood awhile in thought.

”And, as in peaceful thought he stood,
The Jabbertalk, with eyes of flame,
Came bumbling through the teaching wood,
And burbled as it came!

“One, two! One, two! And through and through
The opt-out blade went snicker-snack!
He left test dead, and with its head
He went galumphing back.

“And, has thou slain the Jabbertalk?
Come to my arms, my beamish boy!
O frabjous day! Callooh! Callay!’
He chortled in his joy.

“Twas brillig, and the billionaires
Did lie and dissemble in the press
All flimsy were Deformer wares
And the charter rats did nest”