Archives for category: Texas

First the good news. School boards in Texas continue to pass a resolution opposing high-stakes testing. As of this date, 610 school boards representing more than 3.6 million students have passed the Texas resolution. That 59% of all school boards in the state, representing 74% of all students in Texas public schools.

Texas, as we know from its role in originating No Child Left Behind, is a state that is test-obsessed and test-centric. Its leaders assumed that testing would solve all problems, raise everyone’s performance, close the gaps between races and income levels, and maybe do the dishes as well. No one figured out that a standardized test by design is normed, meaning that half are above and half below average; no one realized that standardized tests accurately reflect poverty and affluence. Tests do not teach. Tests instead displace instruction and control and direct instruction into the path ordained by the tests.

Texas, be it noted, is paying $100 million a year to Pearson to design tests. Texas officials should be asking Pearson why New York pays only $32 million annually. Are the Pearson tests for Texas three times as good as Pearson’s tests for New York? Are the Texas officials being treated as dumb rubes who will buy just anything sold by someone with a British accent? As a Texan, I’d like to know why my state got sold something for triple the price of what they were selling to NY.

Now for the bad news.

Disappointed with the results of three decades of testing, disappointed with the poorly prepared students who enter college, Texas officials have just given a contract to the College Board to develop a new test! This would be a placement exam for all students entering any college or university in Texas.

Meanwhile, the cuts to public education are something like $4 billion in the past few years. Teachers, librarians, other have been laid off. Class sizes have gone up.

But there is always enough money for new tests.

 

 

There is a hugely important development in Texas.

Tom Pauken, the former head of the state Republican party and a current state workforce commissioner representing employers told a meeting of business leaders that testing had gotten out of control in the state and was actually hurting the workforce of the future. “I’m really concerned we’re choking off the pipeline of skilled workers that our employers need,” he said. “We’re spending too much time and effort teaching to the test instead of focusing on real learning.”

Teachers have been saying that for a decade and no one has been listening. Now that the business leaders hear it from one of their own, maybe they will listen.

I wonder if the anti-high stakes testing revolt by the school boards of Texas is making a difference. I wonder if the arguments the school boards make are so powerful, that they can’t be ignored.

We are making headway. Do not lose hope. This mighty vessel will turn, and lots of empty suits will be left behind when it does.

A recent post noted a story in the New York Times that described a design flaw in the Texas tests created by Pearson (at $100 million per year). It reported that the state tests did not reflect the improvements observed in connection with an outside intervention because the tests are designed to show improvement only in relationship to previous and future versions of the test.

I am not a statistician or a psychometrician and do not feel competent to say that this is a Eureka! moment. I leave that to others more competent than I. My reaction is that this finding bears further investigation. Otherwise the only way to improve on the tests is to prepare for the tests and to learn the subject in no other way.

Someone commented negatively in response to this post and questioned the claims and “provenance” of the study.

The central figure in the news story, Professor Walter Stroup of the University of Texas, responds:

It’s hard to know what to make of someone who would find the provenance of a PhD thesis “suspicious” because, in its standard use, the word provenance simply refers to “the chronology of the ownership or location of a historical object.” Anyone who has read a thesis would have to know that in conformity with long-established practices such issues are typically addressed in the first few pages. Given this, one can only assume that “provenance” and “suspicion” are invoked in proximity to one another in the previous post for reasons having more to do with an effort to discredit the particular work being discussed. The implication is that somehow the artifact, in this case a PhD thesis by my former advisee Vinh Pham, is not what it purports to be, and thus is worth less than it might be if its provenance was secure.While one might admire the elegance and subtlety of this form of malice and character assignation directed at both myself and, more importantly, my former student, I would suggest that in general: (1) PhD theses, especially those that emerge from top-rated graduate programs, are routinely cited in nearly any realm of formal inquiry as credible sources of scholarship and (2) that the best way to evaluate the quality and significance of that scholarship is to actually read it.

You might also note the NYT article does in fact refer to myself “and two other researchers” in the second of two introductory paragraphs. Both names — Drs. Vinh Pham and Guadalupe Carmona were given to the reporter, Morgan Smith. My guess, and I should stress it is only a guess, is that she left them out only for reasons having to do with style.

Having now addressed your concerns about provenance, I would close by simply expressing our sincere hope that you might now settle into actually reading the work you seem so committed to disparaging. A place to start might be Dr. Pham’s Thesis:

http://generative.edb.utexas.edu/presentations/2009PMENA/pham/VinhHuyPham09Dissertation.pdf

 

The Texas testing system is a pot of gold for Pearson–a five year contract worth $500 million.

Pearson has a problem. More than half the school boards in Texas have passed a resolution against high-stakes testing.

The parents and citizens have watched the stakes go up and  up for the past 20 years and they don’t see how it helps their children or their state.

They didn’t see any miracle in Texas.

Now an influential conservative blogger has spoken up and called for a halt. Enough is enough. Put the money into the classroom.

Is there a real possibility that common sense may be breaking out in the great state of Texas?

As a native Texan, I sure hope so.

Texans may talk funny (to non-Texans), but we are not stupid.

All of U.S. education policy is now firmly hitched to standardized test scores.

Although the President said in his last State of the Union address that teachers should not teach to the test, he surely knows that federal policy demands teaching to the test.

Test scores determine teacher evaluation, teacher salary, teacher tenure, teacher bonuses. Test scores determine whether teachers and principals are fired. Test scores determine whether schools get closed or commended.

Test scores determine whether students are promoted or held back.

Today, the New York Times reported that a professor at the University of Texas has concluded that the standardized tests are not reliable or valid. He says they predict how students will do in the future in relation to how well they have done on the same standardized tests in the past. They do not show what students have learned.

The story begins:

“In 2006, a math pilot program for middle school students in a Dallas-area district returned surprising results.

“The students’ improved grasp of mathematical concepts stunned Walter Stroup, the University of Texas at Austin professor behind the program. But at the end of the year, students’ scores had increased only marginally on state standardized TAKS tests, unlike what Mr. Stroup had seen in the classroom.

“A similar dynamic showed up in a comparison of the students’ scores on midyear benchmark tests and what they received on their end-of-year exams. Standardized test scores the previous year were better predictors of their scores the next year than the benchmark test they had taken a few months earlier.

“Now, in studies that threaten to shake the foundation of high-stakes test-based accountability, Mr. Stroup and two other researchers said they believe they have found the reason: a glitch embedded in the DNA of the state exams that, as a result of a statistical method used to assemble them, suggests they are virtually useless at measuring the effects of classroom instruction.”

Read the whole story and re-read that last line: the tests are “virtually useless at measururing the effects of classroom instruction.”

Think of it: we have a multi-billion dollar industry that sucks resources out of the classroom, whose tests are best at predicting how students will perform on next year’s tests. The test measure each other. They are designed to do that. They demand teaching to the test.

I don’t know whether the professor’s concerns are right. Others with technical expertise will weigh in . But what was obvious before he spoke out is that these tests are not good enough to carry the weight of determining our social structure, let alone the lives of students and teachers and principals and the fate of their schools.

Let’s hear from the testing experts about this.

Jason Stanford wrote a blistering critique of the misuse of testing in Texas and Sandy Kress responded. Sandy Kress was the architect of No Child Left Behind, which imposed a testing regime on the entire nation. Kress is now a lobbyist for testing giant Pearson.

Stanford summarized his original column, called “Let Them Eat Tests,” as follows:

  1. Texas taxpayers are paying Pearson $470 million for the STAAR test.
  2. Sandy Kress, the father of No Child Left Behind, lobbies for Pearson in Texas.
  3. The school taxes I pay fund a system that corrupts the classroom experience for my two sons who attend an elementary school in Austin by requiring them to learn test-taking skills to pass Sandy Kress’ tests.
  4. Sandy Kress, enriched in very small part by my tax dollars, chooses to send his children to private schools where they don’t have to take his standardized tests.

Kress took this as a personal attack, as well as an attack on the concept on the value of testing and accountability. Read his response. In fact, read the whole exchange. It is a very thorough airing of important issues that concern every state and every citizen these days.

In recent years, the governor and legislature in Texas have cut billions of dollars from the budget for public education.

They have shown their priorities. By keeping taxes low, they can grow new jobs, or so they say.

But at the same time, they are destroying the public schools that prepare the next generation for citizenship and work and innovation.

A Texas colleague sent me an article to show what the cuts are doing to one small district. The Hutto school district must cut more than $1 million from its $37 million budget. A local tax increase was turned down last November. The district will go back to the voters to ask again.

The district is imposing a fee of $200 a year for students to ride the bus to school, with no break for poor kids. The district is selling advertising on the buses and licensing the right to use its mascot symbol. In April, the district laid off arts teachers, counselors, and nurses. It increased the fee for participating in extracurricular activities to $100.

Faced with endless cuts, districts are moving back to a time in our history–now seen only in very poor nations–where access to education was limited by what families can pay.

If only education reformers were as passionate about paying for education as they are about privatizing it.

Where is “Superman” when you really need him?

Diane

A parent in Texas wrote to say that she couldn’t understand why the state was paying Pearson $100 million a year while laying off teachers. She’s right. This is crazy. She pointed out that in addition to the direct cost of the state testing, schools and districts now had to pay people whose sole job is the care and feeding of the testing monster. One district is hiring a testing coordinator for each of its five high schools, More money diverted from the classroom. At the same time the cost of testing grows, the budget for public education shrinks.

She sent me this article from an Austin newspaper: http://www.kxan.com/dpp/news/local/austin/educators-parents-fight-testing-system. Sandy Kress, who was the architect of NCLB and is now a lobbyist for Pearson, strongly defended the testing system, saying that young people would be closed out of good jobs if they didn’t take all those tests.

Now, be it noted that this claim is utterly false. Students in independent schools (such as the one that Kress’ own children attend) do not take all those tests and they presumably will not be shut out of the good jobs in the future. http://jasonstanford.org/2012/05/the-lone-staar-rebellion/

Furthermore, there is no reason to assert that taking state tests prepares anyone for good jobs in the future. Where is the logical connection? How does testing prepare you to get a better job? The testing regime now in force penalizes students who exhibit imagination or divergent thinking. Entire generations of Americans have gotten good jobs without being subjected to test prep and annual high-stakes testing.

According to the Bureau of Labor Statistics (http://www.bls.gov/opub/mlr/2009/11/art5full.pdf, p. 88), most new jobs will not require a college degree.

And where is the evidence that taking all those state tests is the best way to prepare for college? Again, none of the children who attend elite independent schools take those tests and they seem to have a high rate of success in gaining admission to selective colleges and universities.

Really, the test salespeople and lobbyists for the testing industry have sold the American people a bill of goods. Either we buy their product, and more of it, and pay them for prep materials, and pay them for test security, and pay test coordinators, or no one will get a good job in the future.

Don’t believe it.

Diane

It turns about that Houston has been awarding test-based bonuses for years. It turns about that tying test scores to scores has not been good for teachers or students. It turns out that the ratings jump around from year to year. They are inaccurate, unreliable, and unstable. Value-added assessment, as everyone recognizes, creates massive pressure to raise scores on standardized tests of questionable value. The more pressure, the less reliable the scores. The more pressure, the more teaching to the test and the more cheating.  (http://nepc.colorado.edu/blog/houston-you-have-problem)

Value-added assessment is inherently incapable of producing better education because it does not measure better education. It only measures test scores. Higher test scores are a byproduct of better education. If you aim for the scores, you miss the target. The target is deeper understanding, greater knowledge, more thoughtful writing, more careful observation, a greater love of learning. The very act of measuring destroys the target instead of bringing it closer.