Archives for category: Testing

Diane Rehm is one of the best interviewers on national radio (WAMU in DC).

I always enjoy being on her show.

This morning, I was invited to discuss the Chicago teacher strike, and discovered to my chagrin, that the lineup was three against one.

I defended the teachers and discussed their aims and the conditions in the Chicago public schools.

On the other side was Rick Hess of the conservative American Enterprise Institute; Andrew Rotherham of Bellwether Partners; and former Mayor Adrian Fenty of D.C.

The three of them versus me. Mayor Fenty would like to see tenure abolished. He blames the unions for all the ills of the schools. He
loves standardized testing. Andy Rotherham says that unions are too powerful even in right to work states. Hess warned that the CTU would make the union movement as irrelevant as the referendum in Wisconsin. All three are rooting for Mayor Rahm to beat back the CTU.

I hope you find time to listen.

If you add the scores on standardized tests for five years in a row, can you tell who the best and worst teachers are?

No.

But that’s the theory behind value-added assessment.

The idea is that an “effective” teacher raises test scores every year. The computer predicts what the test scores are supposed  to be, and the teacher who meets the target is great, while the one who doesn’t is ineffective and should be shunned or banished.

But study after study shows that value-added assessment is rife with error. As this paper from the National Academy of Education and the American Educational Research Association shows, value-added assessment is unstable, inaccurate and unreliable. Teachers who get high ratings one year may get low ratings the next year. Teachers are misidentified. Data are missing. The scores say more about which students were in the classroom than the teachers’ “quality” and ability to teach well.

Teachers of the gifted are in trouble because the students are so close to the ceiling that it is very difficult to “make” them get higher scores.

Teachers of special education are in trouble because their students have many problems taking a standardized assessment. A teacher wrote me last year to tell me that her students would cry, hide under their desks, and react with rage; one tore up the test and ate the paper.

Teachers of English language learners are in trouble because many of their students don’t know how to read English.

A superintendent in Connecticut wrote me to say that his state department of education is pushing the Gates’ MET approach. I urged him to read Jesse Rothstein’s critique. In fact, the MET study won the National Education Policy Center’s Bunkum award for research that reached a conclusion that was the opposite of its own evidence.

For a fast and accurate summary of what research says about value-added assessment, read this article by Linda Darling-Hammond.

VAM is junk science. Bunk science.

Just another club with which to knock teachers, wielded by those who could never last five minutes in a classroom.

Count on Stephanie Simon of Reuters to get the story that eluded every other reporter.

She is the one that got the inside story on Louisiana, TFA, and for-profit investors.

Now she has the scoop on Chicago.

The strike in Chicago is not about money.

It is a national story.

It’s about the survival of public education.

Read her story.

Opting Out of the ‘Rug Rat Race’

For success in the long run, brain power helps, but what our kids really need to learn is grit

By PAUL TOUGH

We are living through a particularly anxious moment in the history of American parenting. In the nation’s big cities these days, the competition among affluent parents over slots in favored preschools verges on the gladiatorial. A pair of economists from the University of California recently dubbed this contest for early academic achievement the “Rug Rat Race,” and each year, the race seems to be starting earlier and growing more intense.

At the root of this parental anxiety is an idea you might call the cognitive hypothesis. It is the belief, rarely spoken aloud but commonly held nonetheless, that success in the U.S. today depends more than anything else on cognitive skill—the kind of intelligence that gets measured on IQ tests—and that the best way to develop those skills is to practice them as much as possible, beginning as early as possible.

American children, especially those who grow up in relative comfort, are being shielded from failure as never before.

There is something undeniably compelling about the cognitive hypothesis. The world it describes is so reassuringly linear, such a clear case of inputs here leading to outputs there. Fewer books in the home means less reading ability; fewer words spoken by your parents means a smaller vocabulary; more math work sheets for your 3-year-old means better math scores in elementary school. But in the past decade, and especially in the past few years, a disparate group of economists, educators, psychologists and neuroscientists has begun to produce evidence that calls into question many of the assumptions behind the cognitive hypothesis.

What matters most in a child’s development, they say, is not how much information we can stuff into her brain in the first few years of life. What matters, instead, is whether we are able to help her develop a very different set of qualities, a list that includes persistence, self-control, curiosity, conscientiousness, grit and self-confidence. Economists refer to these as noncognitive skills, psychologists call them personality traits, and the rest of us often think of them as character.

If there is one person at the hub of this new interdisciplinary network, it is James Heckman, an economist at the University of Chicago who in 2000 won the Nobel Prize in economics. In recent years, Mr. Heckman has been convening regular invitation-only conferences of economists and psychologists, all engaged in one form or another with the same questions: Which skills and traits lead to success? How do they develop in childhood? And what kind of interventions might help children do better?

The transformation of Mr. Heckman’s career has its roots in a study he undertook in the late 1990s on the General Educational Development program, better known as the GED, which was at the time becoming an increasingly popular way for high-school dropouts to earn the equivalent of high-school diplomas. The GED’s growth was founded on a version of the cognitive hypothesis, on the belief that what schools develop, and what a high-school diploma certifies, is cognitive skill. If a teenager already has the knowledge and the smarts to graduate from high school, according to this logic, he doesn’t need to waste his time actually finishing high school. He can just take a test that measures that knowledge and those skills, and the state will certify that he is, legally, a high-school graduate, as well-prepared as any other high-school graduate to go on to college or other postsecondary pursuits.

Mr. Heckman wanted to examine this idea more closely, so he analyzed a few large national databases of student performance. He found that in many important ways, the premise behind the GED was entirely valid. According to their scores on achievement tests, GED recipients were every bit as smart as high-school graduates. But when Mr. Heckman looked at their path through higher education, he found that GED recipients weren’t anything like high-school graduates. At age 22, Mr. Heckman found, just 3% of GED recipients were either enrolled in a four-year university or had completed some kind of postsecondary degree, compared with 46% of high-school graduates. In fact, Heckman discovered that when you consider all kinds of important future outcomes—annual income, unemployment rate, divorce rate, use of illegal drugs—GED recipients look exactly like high-school dropouts, despite the fact that they have earned this supposedly valuable extra credential, and despite the fact that they are, on average, considerably more intelligent than high-school dropouts.

These results posed, for Mr. Heckman, a confounding intellectual puzzle. Like most economists, he had always believed that cognitive ability was the single most reliable determinant of how a person’s life would turn out. Now he had discovered a group—GED holders—whose good test scores didn’t seem to have any positive effect on their eventual outcomes. What was missing from the equation, Mr. Heckman concluded, were the psychological traits, or noncognitive skills, that had allowed the high-school graduates to make it through school.

So what can parents do to help their children develop skills like motivation and perseverance? The reality is that when it comes to noncognitive skills, the traditional calculus of the cognitive hypothesis—start earlier and work harder—falls apart. Children can’t get better at overcoming disappointment just by working at it for more hours. And they don’t lag behind in curiosity simply because they didn’t start doing curiosity work sheets at an early enough age.

Instead, it seems, the most valuable thing that parents can do to help their children develop noncognitive skills—which is to say, to develop their character—may be to do nothing. To back off a bit. To let our children face some adversity on their own, to fall down and not be helped back up. When you talk today to teachers and administrators at high-achieving high schools, this is their greatest concern: that their students are so overly protected from adversity, in their homes and at school, that they never develop the crucial ability to overcome real setbacks and in the process to develop strength of character.

American children, especially those who grow up in relative comfort, are, more than ever, shielded from failure as they grow up. They certainly work hard; they often experience a great deal of pressure and stress; but in reality, their path through the education system is easier and smoother than it was for any previous generation. Many of them are able to graduate from college without facing any significant challenges. But if this new research is right, their schools, their families, and their culture may all be doing them a disservice by not giving them more opportunities to struggle. Overcoming adversity is what produces character. And character, even more than IQ, is what leads to real and lasting success.

—Adapted from “How Children Succeed: Grit, Curiosity and the Hidden Power of Character” by Paul Tough, which has just been published by Houghton Mifflin Harcourt.A version of this article appeared September 8, 2012, on page C3 in the U.S. edition of The Wall Street Journal, with the headline: Opting Out of the ‘Rug Rat Race’.

The nation’s leading anti-testing organization has issued a call to its supporters to turn out and welcome Secretary Duncan if he visits their communities on his cross-country bus tour.

Tell him why his teach-to-the-test policies are failing. Tell him why high-stakes testing is bad for the quality of education. Tell him that children need time to play and dance and sing, not just take test prep. Tell him that it is wrong to ditch physical education and the arts and recess for more testing.

Greet him warmly. Of course, the tour starts in Silicon Valley, where the edu-entrepreneurs are heavily represented.

Here is the FairTest message.

Give Arne’s “Bus Tour” a Warm Welcome  

Once again, Education Secretary Arne Duncan is running a “back to school” bus tour, starting in California on Sept. 12 and winding east to DC (see http://www.ed.gov/blog/topic/bustour/ for full schedule).  

FairTest encourages assessment reformers to give Duncan the “welcome” his destructive policies deserve.  A handful of people is sufficient to make a big impact. You can leaflet the locations where Duncan and his surrogates stop, challenging their policies while educating the media and the audience. The National Resolution on High-Stakes Testing provides a succinct critique of federal testing policies (see http://www.fairtest.org/national-resolution-highstakes-testing)

The tour starts in the Redwood City/Silicon Valley, California area. Other stops include: Sacramento, California; Reno and Elko, Nevada; Salt Lake City, Utah; Rawlins, Rock Springs, and Cheyenne, Wyoming; Denver and Limon, Colorado; Topeka and Emporia, Kansas; Kansas City and Columbia, Missouri; St. Louis, Missouri ; Mt. Vernon, Illinois; Evansville, Indiana; Lexington, Kentucky; Charleston and McDowell County, West Virginia; Roanoke and Richmond, Virginia.

If Duncan’s bus tour is visiting your region, please help make the public aware of the growing grassroots resistance to high-stakes testing.  Feel free to call on FairTest at any time for assistance in your important work.

A new reader has joined our discussion and is looking for answers to important questions. I assured this reader that we have explored these topics in some depth; that we know that the purpose of reform is to eliminate unions; to get rid of tenure; to cut the budget for schools; and to privatize the greatest extent possible, with profits where possible for smart investors in “reform.”

I invite the new reader to hang out with us and join our discussion.

Any advice for the new member of our discussion group?

Please forgive me if I am pulling this conversation back to farmed-out ground (I’m new); but is it fair to say that the gist of the corporate-backed educational “reform” movements today is generating cheaper teachers?This is how the equation boils down for me (a public school teacher). As I’ve been trained to show my work, my thinking is that the greatest “reform” that privatization and charter school movements bring is the elimination of union contracts. And that the primary consequence of eliminating unions in any field is lower labor costs.If the above argument holds water, is it acceptable to eliminate the obfuscating phrase “educational reform movement ” and replace it with the clearer “reducing educator salary” movement? Or, more simply, the “labor-busting” movement? Or the “cheapness” movement?In a similar vein, I am wondering if Dr. Ravitch and others have exposed the cant behind the argument that problems with tenure stem from unions. There don’t seem to be many general-public sources pointing out that no one from a public teacher’s union awards tenure to teachers. Every single public decision to grant tenure is made by an elected school board, advised by its appointed educational managers. If the nation’s schools are saddled with incompetent tenured teachers, the blame falls on leadership and management, does it not? From all the complaints being voiced about tenure that outsiders — many from the world of corporate management — it seems pretty clear to me that the nations educational managers apparently couldn’t recognize an incompetent teacher if they got hit with a hammer by one of them. What is eliminating tenure going to help this group of apparently bumbling crop of managers transform into brilliant predictors of pedagogy? At least tenure forces educational decision-makers to live with the consequences of their incompetence. Lifting the pressure of having to evaluate their teachers in three years and educational managers will be even less accountable for their bad decisions. In the world of corporate management, weakening the chains of accountability is an insane act — something that you would think the corporate nabobs nattering about our schools would understand. Unless they absolutely do understand what they are saying is absurd but don’t care, since the real goal isn’t improving our schools at all.

One reader says that schools and teachers can lift children out of poverty. He says it is happening.

This reader dissents.

To be clear, and I think the writer of this post would agree, teachers and schools save children’s lives every day. Poor kids can succeed. Poor kids can make it into Harvard, thanks to their grit and the support of family and teachers.

But that is not the norm, and it never will be. Teachers alone, no matter how great they are, can’t overcome poverty. Thinking that it is so doesn’t make it so.  Saying that it is so doesn’t make it so. As this reader says, tests always produce results correlated with income.

The irony of reform today is that it relies on the one measure guaranteed to reflect family income: standardized tests.

No it’s not “happening”, Shaun. I have millions of data points from every administration of NAEP, PISA, TIMSS, ACT, and SAT for many years in history. Kids in poverty ALWAYS score lower on average.

Poverty dictates student achievement more than any factor, and schools and teachers cannot overcome its effects. Nor should we have to.

Politicians and economists MUST fix poverty. But they are too busy ruining the teaching profession to care.

And more now than ever, from study after study, financial mobility is becoming more and more difficult for the poor and even the middle class.

So, just where is this “happening”, and please no miracles allowed? If you want to rely on miracles, for every one miracle student or school (that didn’t cheat) you want to show me, I can show you exponentially more that never make the miraculous feat.

In hopes of raising test scores, elementary schools in Syracuse are eliminating recess.

This discounts mountains of research about the importance of non-cognitive skills, which are often learned on the playground,

And too there is the pesky fact that children need tine to run and play.

A sound mind in a healthy body.

But not in Syracuse.

Arne Duncan reminded us In his speech at the Democratic National Convention that President Obama opposes teaching to tests. Duncan didn’t say whether he agrees. It’s hard to take this sentiment seriously now that so many states are evaluating teachers by student test scores, at Duncan’s urging.

When this practice is one day acknowledged to be bogus, we will remember who imposed it.

Meanwhile Governor Dannel Malloy, who has specifically endorsed teaching to the tests, was made chairman of the National Governors Association’s education and the workforce committee.

As someone once said,, hypocrisy is the homage that vice pays to virtue.

Rick Roach is a school board member in Orange County, Florida. He took the state test, the FCAT, and concluded that it is a very poor measure of student learning and is consuming far too much instructional time.

Rick Roach joins the honor roll of champions of public education. The honor roll consists of people who fight for good education for all children; who oppose privatization and high-stakes testing; and who break ranks and take risks to speak out. They may be state board members, local school board members, superintendents, principals, teachers, parents, and concerned citizens.

A reader sent this story about him.

Last winter, when he took the FCAT, he failed both sections. He said he knew none of the answers to the math questions, but managed to get 62% on the reading section. His story was written up by Marion Brady for Valerie Strauss’s Answer Sheet column in the Washington Post.

Roach said this to Brady:

“A test that can determine a student’s future life chances should surely relate in some practical way to the requirements of life. I can’t see how that could possibly be true of the test I took.”

Then he added, “It makes no sense to me that a test with the potential for shaping a student’s entire future has so little apparent relevance to adult, real-world functioning. Who decided the kind of questions and their level of difficulty? Using what criteria? To whom did they have to defend their decisions? As subject-matter specialists, how qualified were they to make general judgments about the needs of this state’s children in a future they can’t possibly predict? Who set the pass-fail “cut score”? How?”

“I can’t escape the conclusion that decisions about the [state test] in particular and standardized tests in general are being made by individuals who lack perspective and aren’t really accountable.”