Archives for category: NAEP

A few days ago, I posted a letter from Hari Sevugan on this site, in which he defended Michelle Rhee’s agenda of privatization and high-stakes testing. Sevugan was (according to Wikipedia) the former national press secretary for the Democratic National Committee and was the senior spokesman for the Obama campaign in 2008. In June, 2011, he became vice-president of communications for Michelle Rhee’s StudentsFirst.

I invited him to post again. I wrote:

“I hope he will write again to explain why he thinks that Rhee’s support for for-profit charters, for vouchers, and for the agenda of rightwing governors helps our society’s most vulnerable children.”

Rhee has worked closely with Governor Scott Walker, Governor John Kasich, Governor Rick Scott, and other Republicans who want to privatize education, curtail collective bargaining rights, and take away any job protections for teachers.

Many readers of the blog wrote responses to Sevugan. He responded with a letter this morning (I confess I missed it and read it first on the Huffington Post). He did not answer my questions, but he did respond to a letter from a Florida teacher and parent. I am updating this post because I did not see his comment on the blog (unlike Rhee, who has a large staff, I have no staff, not even a secretary; I read all comments myself, and I write all the responses myself, I write all my own tweets, all my own articles, all my own books, no ghostwriters).

In his comments to Huffington Post, Sevugan scoffs at the success of Massachusetts and Maryland because “only 40-50%” of students in those states are proficient on NAEP. I don’t think he knows much about NAEP’s achievement levels. “Proficient” on NAEP is not above average. It represents solid achievement. I spent seven years as a member of the NAEP governing board. Proficient on NAEP is like getting a B+ or an A. Massachusetts can be proud that half its students have such outstanding performance.

Sevugan fawns all over Florida, because Rhee gave Florida and Louisiana her highest grades. (He doesn’t even try to defend Louisiana, one of the nation’s lowest performing states on NAEP.)

But why is he so admiring of Florida? True, it is overrun with charters, both nonprofit and for-profit. But it doesn’t come close to Massachusetts (or Maryland) on NAEP.

Florida (whose education policies are tightly controlled by Jeb Bush) is far behind Massachusetts on NAEP. In fourth grade math, for example, an astonishing 59% of students in Massachusetts rank proficient (which is outstanding), as compared to 37% in Florida (slightly below the national average of 39%).

In eighth grade math, an impressive 51% in Massachusetts are proficient, compared to 28% in Florida (well below the national average of 34% proficient).

In reading, the story is the same. Massachusetts students far outperform those in Florida. In fourth grade, 51% of Massachusetts students are proficient, as compared to 35% in Florida (the national average is 32%).  In eighth grade reading, 46% of students in Massachusetts are proficient, compared to only 29% in  Florida.

Michelle Rhee gave one of her highest grades on her report card to the D.C. schools, despite their low test scores, low graduation rates, and scandalous achievement gaps. Michelle Rhee and her successor have been in charge of the D.C. public schools since 2007, yet the black-white achievement gap and the Hispanic-white achievement gap there are the largest of any city or state in the nation and they are even larger now than when Rhee took over.

If Michelle Rhee knows how to reform schools, why did she fail to do so in D.C.?

Sevugan’s letter is just more of the public school-bashing and teacher-bashing that StudentsFirst has perfected. He thinks our nation and our schools are failing. He is wrong. Our nation is the most powerful, most creative, most innovative in the world, and 90% of Americans were educated in public schools.

Sevugan obviously has never  looked at NAEP scores. If he had, he would know that the scores for black students, white students, Hispanic students, and Asian students in 2011 (the latest NAEP) were at their highest point in history.

Sevugan has a lot to learn about education. I’ll be happy to help him. The first thing he needs to learn is that the doom-and-gloom narrative of the corporate reformers is wrong. It is factually untrue, and I’ll demonstrate how wrong it is in my next book.

We have heard the same doleful complaints since the 1950s, and the peddlers of decline have been wrong every time. They are wrong now too.

Diane

Education Week has an article by Catherine Gewertz saying that defenders of the Common Core are out in full force to quell the uproar about whether CC will mean less fiction.

It is interesting that the two loudest voices defending CC are Jeb Bush’s Foundation for Educational Excellence and the Thomas B. Fordham Institute, both quite conservative groups.

The way the issue is framed unfortunately misses the point, at least the point that I and others have raised.

Why do the CC standards mandate a proportionate split between fiction and non-fiction?

Who thought it was necessary to turn NAEP’s instruction to test developers into a mandate for teachers?

Who will police the implementation of the arbitrary ratios of 50-50 or 70-30?

If the ratios apply to all courses, can’t we assume that students will read “informational text” in math, science, civics, history, and other subjects, leaving teachers of English language arts to assign as much fiction or non-fiction as they want?

In the interests of clarity, here’s what I want: the ratios should be eliminated. They are an overreach. They have no basis in research or experience. There is no justification for imposing them.

I urge this not as a partisan of fiction or non-fiction, but as a partisan of common sense.

Diane

Mitt Romney likes to boast that Massachusetts is number 1 in the nation in academics, and he is right. Massachusetts is the highest scoring state on the National Assessment of Educational Progress in math and reading, in fourth and eighth grades.

Now, as we know, Mitt is very anti-union. His educational platform excoriates the bad teachers’ unions, that allegedly protect bad teachers and drive down educational quality.

But, wait a minute! Massachusetts has a completely unionized teaching force. How can this be?

Did anyone ever tell Romney that the highest scoring states in the nation on NAEP–Massachusetts, Connecticut, and New Jersey–have strong teachers unions and collective bargaining?

Did anyone tell ALEC, which has model legislation to bust teachers unions?

When writing about Richard Rothstein, I scarcely know where to begin.

He has written several major books. Anyone who wants to understand the challenge of poverty in our society must read Rothstein’s seminal work, Class and Schools.

He was responsible for drafting the EPI paper that brought together nearly a dozen scholars to explain why value-added assessment–or judging teachers by student test scores–was riddled with problems.

I got to know Richard many years ago when he wrote a regular column for the New York Times. We used to meet and disagree, but he never lost his cool, and he never stopped trying to explain patiently why I was wrong. Over time, I discovered, he was right on almost everything about which we had disagreed.

He understands the importance of public education. He objects when people defame public education, especially when they have no facts. If you want to get a flavor of his careful, thoughtful, judicious approach to issues, read this response to Bill Gates’ claim that educational achievement has been flat for many years. Richard Rothstein refuted what he said with clear and persuasive evidence.

For his courage, for his intelligence, for his dedication to democratic ideals, Richard Rothstein joins our honor roll as a hero of American public education.

Jonathan Pelto reports on Jeb Bush’s recent visit to Connecticut. While there, he saluted the “reforms” pushed through the legislature by Governor Dannell Malloy, especially his efforts to curb teachers’ tenure and seniority. And he boasted about Florida’s achievement (he didn’t mention the class size reduction initiative, which voters approved and he tried to roll back). And choice, choice, choice!

Funny that no one mentioned that Connecticut is one of the top two or three states in the nation on NAEP, even though it has strong teachers’ unions, seniority and tenure. It is far ahead of Florida. Since when does a state whose students are ABOVE the national average (8th grade math, NAEP) take lessons from one that is well below the national average?

Jersey Jazzman calls out the conservative pundits who, in an effort to embarrass Chicago teachers,try to show how awful student perormance is in that district and paint it in the worst possible light.

If they are casting stones, you kinda wonder why they don’t throw them at Arne Duncan and Mayor Daley, whose policies determined what happened in the schools.

What they do is akin to blaming the war in Iraq on the soldiers, not the policymakers.

Many readers have contacted me to ask why CNN has not posted Randi Kaye’s interview with me, rebutting Michelle Rhee’s assertions.

This reader, Michael Brocoum, made a copy of the interview and posted it on Youtube. Here it is.

As I mentioned in an earlier post, the interview began with a question about the National Assessment of Educational Progress (you will note that it is misspelled by CNN as the National Assessment of Educational Process). I don’t recall the precise wording, but the question went like this:

“You claim that test scores on NAEP are at their highest point in history, but how do you explain that the scale score for fourth grade reading is only 221? That’s 221 out of 500. That’s less than 50%. Isn’t 50% a failing grade?”

I then tried to explain that scale scores don’t work like that, that the question itself was a completely erroneous interpretation of scale scores. NAEP has a vertical scale, and scale scores in the 4th grade are lower than in the 8th grade. They can’t be converted into a grade in the way that Randi Kaye asserted, although they are useful as measures of progress.

Consider this: the average scale score for 4th grade is 221, but students scoring at the 90th percentile–our top students–have a scale score of 264. By Randi Kaye’s fallacious reasoning, they are failing too! In 8th grade reading, the students at the 90th percentile had a scale score of 307 (on a scale of 500). She would convert that to a grade of 61, which is borderline failing.

Wouldn’t you think that the editor or research staff at CNN would have prevented Randi Kaye from making such absurd assertions?

But it was of a piece with all the questions that followed. I felt as if I were being interrogated by someone who worked for StudentsFirst, not by a reporter seeking to ascertain either my views or the basic facts.

Rhee said at the outset of my interview that the answer to what she thinks is the terrible performance of our schools is merit pay. So Randi Kaye drilled in on that with two questions (one of them was dropped from the show before it aired). She ended up with a quote from someone named Lucas who said he wanted merit pay. That wasn’t exactly definitive, since I was able point out that merit pay has been tried again and again and has always failed to make a difference.

So-called reformers say again and again that the U.S. education system is a failure and that academic performance is declining.

What they never tell you is that the test scores of American students are at their highest point in history, as recorded on the only longitudinal measure of performance, the federal test called the National Assessment of Educational Progress (NAEP).

Maybe the reformers don’t know that. You can educate them with facts.

In an earlier post, I reported the reading scores. The gains in reading have been slow, steady, and significant.

In mathematics, the gains have been large.

There are two different versions of NAEP.

One is called the long-term trend trend, and it reports the scores on tests that have been given from 1973 to 2008.

The long-term trend tests hardly ever change, so they provide a consistent yardstick over decades.

The other is called “main NAEP,” and it has been reported periodically since 1990 or 1992 (depending on the subject).

Unlike the long-term trend NAEP, main NAEP gets revised and updated, yet still has a consistent trend for academic performance over the past 20 years.

Main NAEP is now given every other year; the long-term trend NAEP is given every four years.

Here are the long-term trend data for mathematics. Remember, same test given every four years from 1973 to 2008:

White students: Age 9, up 25 points; age 13, 16 points; age 17, up 4 points.

Black students: Age 9, up 34 points; age 13, up 34 points; age 17, up 17 points.

Hispanic students: Age 9, up 32 points; age 13, up 29 points; age 17, up 16 points.

On the main NAEP, from 1990 to 2011, here are the data:

White students: fourth grade, up 49 points; eighth grade: up 23 points.

Black students: fourth grade, up 36 points; eighth grade, up 25 points.

Hispanic students: fourth grade, up 29 points; eighth grade, up 24 points.

Asian students: fourth grade, up 29 points; up 28 points.

Don’t let anyone tell you that American education is failing and declining. It’s not true. 

Share this.

Source: “The Nation’s Report Card Mathematics 2011: National Assessment of Educational Progress,” U.S. Department of Education, Institute of Education Sciences.

“The Nation’s Report Card: NAEP 2008 Trends in Academic Progress, Reading 1971-2008; Mathematics 1973-2008,” U.S. Department of Education

I get so tired of reading about the “decline” and “failure” of American education.

It is not true.

A reader wrote the other day to say that NAEP scores in reading have been flat since 1971. She read it somewhere.

I went to the NAEP reports, the ones produced by the federal government, and here are the facts about NAEP reading.

Sources:” The Nation’s Report Card Reading 2011″; “The Nation’s Report Card Mathematics 2011”; both printed in Washington, D.C., by U.S. Department of Education. Also “The Nation’s Report Card: Trends in Academic Progress, Reading 1971-2008, Mathematics 1973-2008”

Share them:

On the long-term trend NAEP, which goes from 1971-2008:
White students age 17 gained 4 points from 1971-2008
Black students age 17 gained 28 points from 1971-2008
Hispanic students age 17 gained 17 points from 1971-20082008 is last date that long-term NAEP was given.

There is also Main NAEP, which has been given since 1992.

Only given to 4th and 8th grade, not to 17-year olds.
Improvement for all groups in this 20 year period, from 1992-2011.
Whites in 4th grade: % below basic dropped from 29% to 22%
Blacks in 4th grade: % below basic dropped from 68% to 51%
Hispanics: 4th grade: % below basic dropped from 62% to 49%.

Don’t believe everything you read. I am quoting from government documents.

The gains on NAEP reading are incremental but significant.

The gains on NAEP math are dramatic.

Reading changes more slowly than math, because math is taught in school, and reading reflects both home and school.

Yesterday, Secretary of Education Arne Duncan had a story in the Huffington Post extolling his work in building respect for the teaching profession.

He has accomplished this, he says, by insisting that teachers be evaluated based on the test scores of their students.

Exhibit A of his success, he says, is Tennessee. Mr. Duncan relies on a report by Kevin Huffman, the state commissioner of education (former PR director for TFA, now employed by one of the nation’s most conservative governors).

The report says that since Tennessee won Race to the Top funding in 2010, it has seen remarkable results because it is now using test scores as 50% of teachers’ evaluations.

Leave aside for the moment the fact that leading researchers (like Linda Darling-Hammond of Stanford University and the National Academy of Education and the American Educational Research Association) say that these value-added measures are inaccurate, unreliable, and unstable.

It is simply bizarre to boast about a one-year change in state test scores. It has long been obvious that state test scores are less reliable than NAEP and that any real change requires more than one year of data as evidence of anything.

According to NAEP, the scores for Tennessee in both reading and math were flat from 2009-2011. Perhaps Secretary Duncan should wait for the release of the 2013 NAEP  before boasting about the dramatic gains in Tennessee.

In the meanwhile, I urge Secretary Duncan and his staff, and Commissioner Huffman, to read the joint statement of the National Academy of Education and the American Educational Research Association on value-added testing and its misuse in evaluating teachers. It is called “Getting Teacher Evaluation Right.” I am sure that the Secretary agrees that policy should be informed by research.

Here is the executive summary:

Consensus that current teacher evaluation systems often do little to help teachers improve or to support personnel decision making has led to a range of new approaches to teacher evaluation. This brief looks at the available research about teacher evaluation strategies and their impacts on teaching and learning.

Prominent among these new approaches are value-added models (VAM) for examining changes in student test scores over time. These models control for prior scores and some student characteristics known to be related to achievement when looking at score gains. When linked to individual teachers, they are sometimes promoted as measuring teacher ―effectiveness.‖

Drawing this conclusion, however, assumes that student learning is measured well by a given test, is influenced by the teacher alone, and is independent of other aspects of the classroom context. Because these assumptions are problematic, researchers have documented problems with value-added models as measures of teachers‘ effectiveness. These include the facts that:

1. Value-Added Models of Teacher Effectiveness Are Highly Unstable: Teachers‘ ratings differ substantially from class to class and from year to year, as well as from one test to the next.

2. Teachers’ Value-Added Ratings Are Significantly Affected by Differences in the Students Who Are Assigned to Them: Even when models try to control for prior achievement and student demographic variables, teachers are advantaged or disadvantaged based on the students they teach. In particular, teachers with large numbers of new English learners and others with special needs have been found to show lower gains than the same teachers when they are teaching other students.

3. Value-Added Ratings Cannot Disentangle the Many Influences on Student Progress: Many other home, school, and student factors influence student learning gains, and these matter more than the individual teacher in explaining changes in scores.

Other tools have been found to be more stable. Some have been found both to predict teacher effectiveness and to help improve teachers’ practice. These include:

  • Performance assessments for licensure and advanced certification that are based on professional teaching standards, such as National Board Certification and beginning teacher performance assessments in states like California and Connecticut.
  • On-the-job evaluation tools that include structured observations, classroom artifacts, analysis of student learning, and frequent feedback based on professional standards.

    In addition to the use of well-grounded instruments, research has found benefits of systems that recognize teacher collaboration, which supports greater student learning.

    Finally, systems are found to be more effective when they ensure that evaluators are well-trained, evaluation and feedback are frequent, mentoring and coaching are available, and processes, such as Peer Assistance and Review systems, are in place to support due process and timely decision making by an appropriate body. 

    And here is a short summary of the report by Linda Darling-Hammond.