Archives for category: Testing

FairTest says that the new Common Core tests do not live up
to the claims by proponents about a new era of tests that measure
higher-order thinking and really show what students know and can
do. FairTest
National Center for Fair & Open Testing for further
information: Dr. Monty Neill (617)
477-9792
Bob Schaeffer (239)
395-6773

DISSECTING
COMMON CORE ASSESSMENT MYTHS AND REALITIES;

DESPITE HYPE, PLANS CALL FOR MORE
HIGH-STAKES TESTS, COST AND STRESS;

MORATORIUM ON NEW EXAMS
NEEDED

A new fact sheet shows
that the Common Core Assessments, which are being rolled out for
widespread implementation in the 2014-2015 school year, are not
significantly different from the standardized exams currently
administered in many states. At the same time, plans call for more
high-stakes tests with even greater costs. “Despite proponents’
claims that the Common Core would lead to a new breed of
assessments that focus on higher-order, critical thinking skills,
the planned tests are predominantly the same-old multiple-choice
questions,” explained Dr. Monty Neill, Executive Director of the
National Center for Fair & Open Testing (FairTest). Dr.
Neill continued, “Rather than ending ‘No Child Left Behind’ testing
overkill, the Common Core will flood classrooms with even more
standardized exams. Their scores will continue to be misused to
make high-stakes educational decisions, including high school
graduation. They will also end up costing taxpayers millions more
for new tests and the computer systems required to deliver them.”
The FairTest fact sheet also challenges the notion that harder
tests are automatically better. It states, “If a child struggles to
clear the high bar at five feet, she will not become a ‘world
class’ jumper because someone raised the bar to six feet and yelled
‘jump higher,’ or if her ‘poor’ performance is used to punish her
coach.” Scores recently plummeted in New York State and Kentucky
where Common Core tests were initially administered. Based on its
analysis, FairTest is calling for an indefinite moratorium on the
Common Core tests. “As the prestigious Gordon Commission of
educational experts recently concluded, these exams are not the
better assessments our schools need,” Dr. Neill concluded.
“Instead, a system of classroom- based performance assessments,
evaluations of student work portfolios, and school quality reviews
will help improve learning and teaching.”

–
– 3 0 – –

The fact sheet is online at: http://fairtest.org/common-core-assessments-factsheet

This is a book you should read if you want to understand
how assessments are now being misused. It sets a valuable political
and historical context for understanding the mess that is now
federal education policy. The Mismeasure of Education by Jim Horn and Denise Wilburn should be on your shelf. The publisher just dropped the price to $27.50.

 

 

With new student assessments and teacher evaluation
schemes in the planning or early implementation phases, this book
takes a step back to examine the ideological and historical
grounding, potential benefits, scholarly evidence, and ethical
basis for the new generation of test based accountability measures.
After providing the political and cultural contexts for the rise of
the testing accountability movement in the 1960s that culminated
almost forty years later in No Child Left Behind and Race to the
Top, this book then moves on to provide a policy history and social
policy analysis of value-added testing in Tennessee that is framed
around questions of power relations, winners, and
losers.
In examining the issues and exercise
of power that are sustained in the long-standing policy of
standardized testing in schools, this work provides a big picture
perspective on assessment practices over time in the U. S.; by
examining the rise of value-added assessment in Tennessee, a
fine-grained and contemporary case is provided within that larger
context. The last half of the book provides a detailed survey of
the research based critiques of value-added methodology, while
detailing an aggressive marketing campaign to make value-added
modeling (VAM) a central component of reform strategies following
NCLB. The last chapter and epilogue place the continuation of
test-based accountability practices within the context of an
emerging pushback against privatization, high stakes testing, and
other education reforms.
This book will be
useful to a wide audience, including teachers, parents, school
leaders, policymakers, researchers, and students of educational
history, policy, and politics.

REVIEWS “When the Obama
Administration decided to spend the billions it got for schools as
part of the stimulus package to launch the Race to the Top program
and the NCLB waivers, forcing many states to adopt teacher
evaluation based on changes in student test scores, leading experts
warned that this “value added” system did not have a reliable
scientific basis and would often lead to false conclusions. This
sobering and important study of the long experience with this
system in Tennessee (where it was invented) shows that it did not
work, was unfair, and took attention away from other more
fundamental issues.” Gary Orfield Distinguished Research Professor,
UCLA, Co-Director, Civil Rights Project/Proyecto Derechos Civiles,
UCLA
“If The Mismeasure of Education offered
only its penetrating new look at Conant and Coleman, it would be
worth the price. But that’s just the beginning. Horn and Wilburn
uncover the obsessive instrumentalist quantification and
apocalyptic rhetoric soapboxed by both liberal and conservative
political elites. Their autopsy of value-added accountability
reveals the pathology of ed reform’s claim about teachers not being
good enough for the global economy.” Susan Ohanian Educator,
Author, Activist
“A well-researched (and
frightening) look at examples of shameful pseudoscience in America,
the latest manifestation of which is value-added assessment for
determining teacher competency… A well-documented and thorough
analysis, inescapably leading to the conclusion that student test
data cannot be used to determine teacher effectiveness. A must read
for policy makers enamored of the idea that value added assessments
will do what is claimed for them. They do not!….An excellent and
scholarly history of how we got to an
educational-testing/industrial complex, now promoting invalid
assessment strategies that are transforming education, but not for
the better. A scary book that should be thoughtfully read by those
who value America’s greatest invention, the public schools.” David
Berliner Regents’ Professor Emeritus, Arizona State
University
“The Mismeasure of Education is a
magnificent work, an elegantly written, brilliantly argued and
erudite exposition on why the “what,” “how” and “why” of effective
teaching cannot be adequately demonstrated by sets of algorithms
spawned in the ideological laboratories of scientific management at
the behest of billionaire investors… This book will serve as a
sword of Damocles, hanging over the head of the nation’s
educational tribunals and their adsentatores, ingratiators and
sycophants in the business community… The Mismeasure of Education
will have a profound resonance with those who are fed up with the
hijacking of our nation’s education system. This is a book that
must be read by everyone interested in the future of our schools.
It is a book that advocates real educational justice, for student,
teachers, administrators and the public; it is informed by
impressive scholarship and compelling argument. It is surely to
become a classic work.” Peter McLarenProfessor, GSEIS, University
of California, Los Angeles, Distinguished Fellow in Critical
Studies, Chapman University

I first learned about the Common Core standards while attending a briefing for Congressional staff at a conference sponsored by the Aspen Institute in 2009. it was held at Wye Plantation, a lovely and isolated conference center in Maryland. Dane Linn of the National Governors
Association described the development work. I was invited to talk about the history of standards in the U.S.

In the discussion following Linn’s presentation, I recommended field
testing. In my experience in working on state standards in California, the standards needed to be vetted by experienced teachers. There needed to be a feedback process in which teachers used the standards and had the chance to tell someone in charge what worked and what didn’t, what was placed in the wrong grade (too hard or too easy), and which expectations were unrealistic.

In 2010, I was invited to the White House to meet with
three top officials–Melody Barnes, director of the Domestic Policy
Council, Rahm Emanuel, the President’s chief of staff, and Roberto
Rodriguez, the President’s education advisor. We talked for an hour
(Emanuel got bored and left early). They asked many questions, like what do you think of merit pay? i told them it had been tried repeatedly and failed every time. they responded that the Obama administration was putting $1 billion into merit pay.

Another of their questions was:
“What do you think of the Common Core standards?” My answer: “They
should have a trial in a few states for a few years before they are
made national standards. You need to find out what needs fixing.
They might be so rigorous that they increase achievement gaps and
hurt the kids who are not doing well now, especially poor kids and
kids of color.” I had a suggestion: “Why don’t you try the
standards out in three to five states, offer grants to those that
want to do it, and see how they work and what consequences they
have?” They were not interested. I left the meeting at the White House feeling that I had just spent an hour talking to people who heard nothing that I said. They told me what they planned to do, but they never engaged in dialogue about whether it was a good idea. Oh, and before Rahm Emanuel abruptly left the meeting to do more important things, his first question was “What can we learn from Catholic schools?”

For four years, I sat on the fence, waiting for evidence one way or the other about the Common Core standards. It really bothered me that no one cared to find out how they worked in real classrooms before imposing them. Then, earlier this year, I wrote a post
explaining that the way the standards were imposed
, with
no trial, no feedback, no way to update them, made it impossible
for me to support them. Critics responded that standards need no evidence, but I don’t believe it. No big corporation would roll out a big product without field testing. Why should an entire nation accept education standards without finding out how they work?

Now we do have evidence. This is what
we know: the Common Core tests cause a huge decline in test scores.
Passing rates fell 30% in Kentucky and about the same in New York.

What is worse is that the achievement gaps grew larger. As
Carol Burris recently wrote
, the test results were
especially devastating for black and Latino children. “The results
expanded the black/white achievement gap. In 2012, there was a
12-point black/white achievement gap between average third grade
English Language Arts scores, and a 14-point gap in eighth grade
ELA scores. This year, the respective gaps grew to 19 and 25
points. In 2012, there was an 8-point gap between black/white
third-grade math scores and a 13-point gap between eighth-grade
math scores. The respective gaps are now 14 and 18 points. The gap
expansion extended to other groups as well. The achievement gap
between White and Latino students in eighth-grade ELA grew from 3
points to 22 points. Students who already believe they are not as
academically successful as their more affluent peers, will further
internalize defeat. “The percentage of black students who scored
“below basic” in third-grade English Language Arts rose from 15.5
percent to 50 percent. In seventh-grade math, black students
labeled “below basic” jumped from 16.5 percent to a staggering 70
percent. Nearly one-third of all New York children scored “below
basic” across the grade level tests. Students often score “below
basic” because they guess or give up. Principals and teachers
cannot get accurate feedback on student learning. Although Ms.
Tisch [chancellor of the New York State Board of Regents] may say
that “this does not mean there’s no learning going on,” what will
parents think? Students will now need to be placed in remediation,
or Academic Intervention Services. Schools that serve a
predominately minority, poor student body will be fiscally
overwhelmed as they try to meet the needs of so many children.
Those who truly need the additional support will find that support
is watered-down.”

Maybe the standards are okay, but the tests are
not.

Who is in charge? By law, the U.S. Department of Education is not
allowed to interfere with curriculum or instruction. Who
can find out what went wrong? Or will we feel okay about imposing
reforms that widen the gaps? In New York, the charter schools did
no better than the public schools. Where are we heading? It won’t
do to keep saying, as Secretary Duncan likes to, that only
extremists oppose the standards. Reasonable people question them as
well. To whom should we turn for a careful, thoughtful analysis of
what is going terribly wrong?

Over the past several months, I have honored several superintendents who have stood up for their students, their staff, and their community schools.

I have identified hero superintendents in Michigan, New York, Oklahoma, Illinois, and elsewhere. We need to find them and thank them.

These are men and women who have upheld their ethical responsibility to their profession and to children.

They have spoken out boldly and fearlessly against the misuse of standardized tests to judge teacher quality and to label schools as “failing.” They have spoken in support of professional standards for teachers and for teacher and principal evaluation. They have withstood the bullying of uninformed politicians and arrogant policymakers. They have refused to bow to misguided conventional wisdom. They have been a source of wisdom and inspiration for their staff and their community.

When the superintendent is a hero, he or she enables the staff to act with dignity and professionalism.

Do you have a hero superintendent in your community?

If so, send me public statements they have made so I may highlight their courage and integrity.

Voters approved Proposition 30 in California to raise taxes to fund schools. Where will the money go?

This teacher thinks she knows:

 

California districts will pay for the gigantic costs associated with Smarter Balanced CCSS testing using the Prop 30 money that the voting public intended should go to actual instruction. Teachers put in countless hours and much energy convincing the public to vote for Prop 30, and the joke is on us. In five years we’ll wonder where all that money went… and the answer will be ‘in Pearson’s coffers’.

Howard Schwach taught for more than 25 years, developed
test items for the state, and worked on curriculum development for
special education students. He
recently reviewed sample items from New York’s Common Core tests
and professed astonishmen
t.

 

He wrote:

 

From the
first moment that I looked at some practice tests for the English
Language Arts tests that were given recently, I knew that the kids
and their teachers were in trouble.
In his long
experience as a teacher and test writer and curriculum developer,
he said, “there was one guiding principal: never test
students on skills or material that you have not taught and
practiced.
To do so not only would have been
unfair to the students, but it would have made the tests unreliable
and downright useless at a measure of student ability and
knowledge.
That is why, when I looked at the
practice test, my first thought was that the questions were in the
deep end of the pool when the kids were just learning how to
swim.
One that stuck in my mind was a passage
from a 1920’s magazine about aspirin.
Because
the source article was written nearly 100 years ago, it contained
some archaic language and syntax that would have been confusing to
today’s adults, nonetheless eleven-year-olds.

So the kids were at a disadvantage right away, trying to
figure out the words they had never seen before, working them out
through context. Then, the question called for skills that have
never been tested before, nor taught by the teacher who showed me
the sample questions. She admitted that she had been “teaching to
the old test” for the past several years, trying to keep her kid’s
all-important test scores up while trying to keep her
job.
“Education has nothing to do with what we
have been doing for the past couple of years,” the teacher admitted
with a nervous laugh. “It has been all about the
numbers.”

 

He found questions that had two right answers.
He found questions that would send the kids into tears. And he
wondered, “What in the world was the state thinking?” Indeed, what
were state officials when they tested students on material they had
not been taught, using unfamiliar vocabulary, having ambiguous
answers, with the certainty that most students would fail? Was it
John King’s inexperience that led him to align the state cut scores
with NAEP’s proficiency levels? Did he not understand that NAEP
proficiency is not a “passing” mark but a measure that connotes
“solid academic performance”?

 

What were they thinking?

The U.S. Department of Education on its official blog asked
for help and advice in evaluating state testing systems aligned
with the Common Core. Forget the fact that the U.S. Department of
Education is barred by law from doing anything to control or direct
curriculum and instruction. How about offering your help?

Here is a suggestion posted as a comment:

“First of all let’s address the
standards you are referring to (Common Core). These standards are
ridiculous in every sense of the word! You want 6 year olds to know
what ziggurats are and a kindergartener to know what molecules are
(look at NY ELA modules)? They are developmentally inappropriate!
They are learning their name and the names of their classmates. Be
realistic. “Secondly, we are testing too much! My kids sit through
hours and hours of useless testing. Assessments are important when
they can inform the teacher on a student’s growth. Tell me how
standardized tests do this? They don’t ….the results come out 5
months after the test. They give a score, but nothing else.
Teachers can’t see the tests, so how can they see what Junior
answered? How was Junior confused? Then, there is the expectation
that a 4 year old can sit in front of a computer to take a test.
This is child abuse! It is child abuse for a 3rd grader to sit
through hours of testing. And it is in poor judgement that a
special needs student be tortured with these as well. “All of this
has resulted in kids hating school. If all they are ever told is
they are a failure, then why would we wonder why they drop out of
school? Kids need choices. Maybe they aren’t cut out to be a rocket
scientist, but would make a great carpenter. Let’s foster that
talent and stop thinking “one size fits all”. “Why do states have
to have testing? To compare with other states? To compare with the
rest of the world? How much does this testing cost? Lots! Why don’t
we take that money, put it into programs that foster economic
growth, like art and music? Offer children after school activities
that are inspiring, like music, dance, art, sports. You know,
things that are fun, but foster student worth. “We are not moving
in the right direction with education “reform”. It is causing more
problems. If you want to improve education so the US compares to
other countries, like Finland, then take a good hard look at how
they do it! We will not get the same results by trying to implement
the opposite ideas! Stop demoralizing teachers and students! You
are getting nowhere on that stationary bike!”

E.D. Hirsch, Jr., the founder of the Core Knowledge curriculum, wrote an article opposing value-added teacher evaluation, especially in reading. Hirsch supports the Common Core but thinks it may be jeopardized by the rush to test it and tie the scores to teacher evaluations. He knows this will encourage teaching to the test and other negative consequences.

Hirsch believes that if teachers teach strong subject matter, their students will do well on the reading tests. But he sees the downside of tying test scores to salary and jobs.

He writes:

“The first thing I’d want to do if I were younger would be to launch an effective court challenge to value-added teacher evaluations on the basis of test scores in reading comprehension. The value-added approach to teacher evaluation in reading is unsound both technically and in its curriculum-narrowing effects. The connection between job ratings and tests in ELA has been a disaster for education.”

He is right. Will the so-called reformers who recently became Hirschians listen?

A reader submits the following comment. He or she might
also have noted the computer failures of testing companies this
past spring, for example, in Indiana and Oklahoma. The reader says:
Pearson has a pattern of poor performance nationwide, stretching
back for more than a decade. For example, A. In 2002, a computer
glitch caused malfunctions in some online math tests and Pearson
incorrectly failed nearly 8,000 Minnesota students on a test that
was required for high school graduation. Pearson agreed to pay up
to $7 million in damages for that problem. B. In 2007, a Minnesota
online statewide math test was shut down after the program
malfunctioned for 25% of the districts that were using it. C. In
2010, the results from online science tests taken by 180,000
students in grades 5 to 8 were delayed due to scoring errors. D. In
2005, in Virginia computerized tests were misgraded. E. In
2009-2010, Wyoming’s new computer testing program failed and the
state demanded that Pearson repay $9.5 million for “complete
default of the contract.” F. In 2011, according to the Tampa Bay
Times, students taking Florida’s new computerized algebra final
exam could not submit finished tests because Pearson’s servers were
down. For more details see
http://www.huffingtonpost.com/alan-singer/enough-is-enough-pearson-_b_3146434.html
These online testing problems are not confined to Pearson. There
has been a concerning pattern across states over a number of years
with several testing companies in addition to Pearson. See
http://www.washingtonpost.com/blogs/answer-sheet/wp/2013/05/04/severe-technical-problems-raise-concerns-over-online-tests/

Mark Naison is one of the founders of BAT, the Badass Teachers Association. He says that what is happening to public education today is nothing less than a coup d’état, a stealthy takeover of public education by elites who know little or nothing about education. Some do it for the power; some for greed; some for ideology. Whatever their reason, it is time to resist.

Naison writes:

“There Has Been an Education Coup D’Etat In the US- Time to Organize Resistance”

“When a country has suffered a Coup D’Etat, as Chile did in the 1970’s, or a foreign invasion, as France did during the start of World War II, it takes a while for the population to figure out how to resist. Some collaborate, some passively conform, some pretend compliance and grimly go about their business, some move into active resistance, even at the risk of their lives

“While it would be foolish to pretend that what has happened to education in the US in the last ten years has had the same life threatening consequences, it does have many of the elements of a Coup D’Etat. A well financed and highly motivated elite with little or no background in teaching or school administration has seized control of Education Policy in the US, excluding teachers and parents voices, and has imposed a grim test regimen on the nation’s public schools that has driven joy and creativity out of our classrooms and made teachers hate their jobs. The Common Core Standards, imposed with lightning speed across the country through bribery and intimidation is but the latest example of how School Reformers borrow the ethos and strategy of dictators to impose their policies. Teachers, parents, and students who have had no chance to discuss the standards, much less see them in operation before deciding whether to support them, are presented with a fate d’accompli and told they are undermining national progress if they dare to ask questions, and if they are teachers or principals, told that opposition can cost them their jobs

“Well, despite the intimidation, a resistance has emerged, composed of parent opt out groups, anti- testing and anti-Common Core Coalitions, and this group, the Badass Teachers Association. With Common Core now part of professional development for teachers in most school districts, it is time to help the resistance spread. Just letting teachers know there is a group like BATS which thinks current policies are crazy is an important step. We now have a one page document in the files that you can print out and distribute to colleagues.

“Please discretely hand this out to your colleagues and friends. Most will probably not want to join, but knowing there is a resistance of this size and militancy will give them courage and make them feel empowered to resist covertly, in their own classrooms. And who knows, over time, they may join us

“But the important thing is to spread the word. Let people know that 26,000 teachers across the country have said “enough is enough” to top down Education Reform and are determined to fight back.

“It’s not only our jobs that are at stake, it is our students and our children’s education, and the future of democracy in this country that are on the line.”

https://www.facebook.com/groups/BadAssTeachers/