Archives for category: Testing

A great post here by Carolyn Heinrich of the University of Texas.

She explains that Texas spends more than any other state in the nation on testing, but is seeing no returns on its heavy investment.

The cost is not just in dollars, but in the amount of time that students spend preparing for tests and taking tests, not to mention the distortion of the purpose and content of education.

This is a great analysis of how a well-meaning state can make disastrous decisions that hurt the quality of education.

Tom McMorran was named Connecticut’s principal of the year in 2012. Here he offers a lesson to our nation’s politicians about the Common Core standards and high-stakes testing. Send this to your state legislators and your member of Congress and the Senate.

 

Tom sent the following comment:

 

It is time to school our politicians about CCSS and High-Stakes testing.
Here is a day in course level 101.

Tom McMorran
2012 High School Principal of the Year NASSP

Philosophy 101:

In order for an argument to carry weight and cause one not only (1) to believe it, but also (2) to take action based on that belief, the argument must have warrant. There is nothing subtle here. The weakest form of argument is some version of “I am in power and I say so…” Or, in any teen’s mother’s words: “Because I am the parent!”

When the person presenting the argument relies on some authority to shore up his/her argument, then we have a duty to test the reliability of the authority. In philosophy or rhetoric or simply argumentation this is known as an appeal to authority.

Last week Gina, Mary Ann, and I attended another workshop at the Connecticut Association of Schools (CAS). This is the body that is, in theory, an institution that is independent from the State Department of Education. The presentation was made by Dr. Diane Ulman, who is the Chief Talent Officer at the DOE. She was appointed by Commissioner Pryor.

As part of her presentation, Dr. Ulman reminded us that the Governor’s Council, The Gates Foundation, a range of other foundations and 46 states have signed on to CCSS. In other words, she offered an appeal to authority. Now, for an appeal to authority to work, credentials must be established. And any group that has a personal, financial interest in public policy must make their bias known. So, let’s ask a very basic question: Where’s the money? For Pearson, Houghton Mifflin, and other publishing companies the prospects are enormous. Smarter Balance, the private, for-profit company received half a billion federal dollars to develop the next generation of assessments, which will replace the CMT and CAPT and be administered in about 26 states. You may recall the President’s State of the Union Address; he all but bragged about the 4.3 billion for Race to the Top (RTTT) funding, and how it was amazingly inexpensive for the Federal government to get these 46 cash-strapped states to sign on.

So, when you hear the proponents of the Common Core State Standards and High-Stakes Testing appeal to authority, you have a duty to weigh the degree to which the authority has sufficient warrant to be believed. Here, let me try it: Elvis is still alive. Evidence? 50 million Elvis fans cannot be wrong.

Statistics 101:

Before meaningful inferences can be drawn from any data set, the researcher has a duty to ensure that the social phenomenon under consideration has not been conflated with other factors. In other words, if you want to give a test that measures the contributions of a teacher to a student’s growth, you must account for and guard against any other factor that might conflate with the primary inquiry. It works like this:

1. We want to know if the teacher’s skill as a reading teacher leads to observable reading skills in her/his students.
2. Therefore, if we give all students the same reading assessment, we should be able to conduct a comparison between teacher A’s students and teacher B’s students.
3. From that comparison we can tell if one teacher is better than another at teaching reading.

So, what’s wrong with that?
A. If the assessment was designed to measure student performance, it can only be used for teacher evaluation by an act of hopeful extension. If the assessment had been designed to measure teacher performance, then it could only be used to measure student performance indirectly.
B. In order for teacher A to be compared with teacher B, the context for all potentially confounding factors for the experiment must be the same. In other words, the only factor that can be measured is, in this case, reading.

But wait, Tienken, Lynch, Turnanian, and Tramaglini have something to say about this in “Use of Community Wealth Demographics to Predict Statewide Test Results in Grades 6 & 7.”

Here’s the very short version: If you tell these researchers three out-of-school demographic variables, then they can tell you a New Jersey school system’s 6th Language Arts scores on the New Jersey Assessment of Knowledge for grade 6 (NJASK6). Tell them (a) the percentage of lone parent households in the community, (b) the percentage of people with advance degrees, and (c) the percentage of people without a high school diploma, and they can plug those data points into a formula that will predict the scores within an acceptable range.

If confounding factors such as a town’s wealth are predictors of performance, then how can we use a reading assessment designed to measure a student’s performance in order to decide whether or not a teacher has effectively taught the skills or knowledge measured by the test?

Here is another wee complication: In New York the APPR rating system that is a year ahead of Connecticut’s uses a growth over time model, which sounds great. But, if you are the unlucky teacher who earned the highest rating in your first year and then for some reason you “slipped” to proficient in your second year, you have not shown growth over time, have you?

Economics 101:

The foundation of the CCSS argument has been negative comparisons between international assessments of 15 year olds in which Americans appear to come out near the middle of the testing range. The argument runs like this: The future economy needs 21st Century Skills. Other countries are out-scoring us, therefore the strength of our economy is threatened over the next few decades.

But, if we recall our faculty reading of Yong Zhao’s Catching Up, or Leading the Way, we recall that there is an inverse relationship between performance on a standardized international assessment and productivity over time. Yes, that’s right. The same group of 14 yr olds who came in dead last in the First International Math Study (TIMS) is now a group of the 60-somethings who control the American economy, which is still rated among the top three most productive economies according to the World Economic Forum.

So, to make the international comparisons look bad, the proponents of this argument have to place the USA into a comparison with the 58 countries for which there is competitive data. Yikes, it looks like the mid-21st century will be dominated by Bulgaria; didn’t see that coming, but that’s what the tests show. If, on the other hand, one compares the US to the G-20 or G-7 Economies, the negative comparisons cease to be statistically valid.

Also, let’s just pause for a minute here and consider the PISA study of 15 year olds. You have to be 15 to take the test. So, if an American kid averages 170 days of school attendance a year, and among those days are mid-years, finals, and field trips, then let’s say there is a good chance for 140 days of instruction. But Asian countries regularly offer up to 240 days of school, so let’s knock off twenty and call it 220. Should an American student be able to compete with his/her counterparts in math? Well, actually, even on the much-vaunted PISA fully one out of four students performing at level five, the highest level, is an American.

So, if we follow the scores-to-economics argument, we would be likely to engage in behaviors that promote success on a test, but this will lead to lower creativity and productivity in the adult world!

Sociology 101:

Campbell’s Law: 1975 “The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social process it was intended to monitor.”

Here is what Nichols and Berliner have to say at the end of a comprehensive examination of NCLB and high-stakes testing: “We are going to do something unheard of in the history of academic research. In this concluding chapter, we are not going to call for more research. There is absolutely no need for new research on high-stakes testing! Sufficient evidence to declare that high-stakes testing does not work already exists.” (2006, Collateral Damage, p. 175).

CONCLUSION:

1. I am NOT saying that we should have no standards. I am not saying that a standards-based curriculum is a bad thing; in fact, I am in favor of it.
2. I am NOT saying that we shouldn’t desire excellence for all students. I am not saying that all students should be able to have meaningful adult lives.
3. I am NOT saying that teachers shouldn’t link their performance to student achievement. I am not saying that we should avoid standardized assessments.

I AM SAYING that the worn out application of so-called hard-nosed business practices (which I do not believe business men or women apply to their own concerns) have any place in a school. I AM SAYING that there is a better way, and it is for all of us educators to embrace our responsibilities as professionals and act from Informed Professional Judgment. I AM SAYING that we can either define ourselves or accept the so-called reform that is happening to us.

It might be that we have to acknowledge and optimistically embrace the following proposition: The High School Structure that has served us so well is not broken; it is obsolete, and it is time for us to transform it!

Tom

GreatSchools.org ranks and rates the nation’s public, charter and private schools. It aims to be a consumer’s guide for parents who are shopping for a school.

I know some of those involved, and I know they mean well. But this sort of rating service, based on data and reviews, not only raises a basic question—how can you judge an establishment you have never visited or seen with your own eyes–but contributes to the marketplace mentality that is now dissolving any sense of community or support for public schools.

The rating system reinforces the data-driven perspective that keeps everyone obsessed with testing and ranking and rating. And in doing so, it promotes consumerism as parents search desperately for better rated alternatives, not knowing that the alternatives may be no better. The end result is destruction of community and loss of the commons.

This may not be the intention of those involved in the organization. But in life, intentions matter less than outcomes.

This letter came from a teacher in Texas:

Dear Dr. Ravitch:

I am not sure if you have dealt with these morons before, but I am infuriated and am writing to you to see if you can use this in your blog to educate parents nationwide.

I recently learned from my parents, that an editorial came out in our local newspaper, the Laredo Morning Times, where our local school districts both received rankings of 3 and 4 respectively, from an “Independent Organization” called “Great Schools” on a 10 point scale. Basically, the editorial cited that both districts have the worst state test results in decades as of the recent administration of the now called STARR test, previously TAKS, previously TAAS, etc, etc, ad nauseoum.

From a cursory browsing of the Great Schools Web Site, if you look at the list of supporters and funders, you see the all too familiar names of the Bill and Melinda Gates Foundation, the Walton Group, etc. And their officers and board members? All of them seem to be a parade for private school alumni and hedge fund managers.

I am taking advantage of our Thanksgiving holiday week, to send a letter exposing these jerks, and defending our public education system, at least at the local level, to our town newspaper. These jokers have just smeared the faculty members of mine and many other campuses by saying our districts are failing our students. On the website, you can see many ads for charter schools, K12, and many other pictures that scream privatization and school choice.

Their misleading slogan of “Involved Parents, Succesful Kids” leads site visitors to believe that they are all pro-students, when in reality, they are advertising a painful truth in our districts( Poverty and Family Violence, among many other issues that create null parent involvement) and using it as a way to convince the uneducated parents that privatization, school choice and online charters are better.

If you can offer any insight on how to draft my letter to the newspaper, your wisdom would be immensely appreciated. I am not going to let this attack on the profession I love so much go unanswered.

Yours in Education,

The Virginia Legislature passed legislation proposed by the governor that opens the door to privatizing any school in the Commonwealth that is found to be “failing.”

Rachel Levy has the details here

Governor McDonnell’s “Opportunity Education Institution” is an ALEC-inspired dream.

It creates a governor appointed commission that will take over schools with low test scores.

Levy writes:

“The Institution will be run by a board of gubernatorial appointees, which includes the executive director. There is no guarantee that the board would include any people who know anything about education. The board would contract with non-profits, corporations, or education organizations to operate the schools. Funding for the new bureaucracy would be provided by federal, state, and local taxpayers. The “failing” schools’ local governing bodies would be represented on the board in some way, but they would lose decision-making power and would not be able to vote or, from what I can tell, have much meaningful input, besides providing the same share of local funding and being responsible for maintenance of the school building. As for staffing, current faculty at the schools being taken over could apply for a position as a new employee with the OEI or apply for a transfer.”

And more:

“…teachers at the OEI schools would not have to be licensed, so the students who need the most experienced teachers would be getting the least experienced. Nor would those OEI teachers be entitled to the benefits, pay, or job protections that other Virginia teachers are, even if they were employed by the school being taken over prior to takeover. Who will want to work at such schools, or schools that look likely to be taken over? Interestingly enough, the members of the new OEI bureaucracy would be eligible for VRS (Virginia Retirement System) and other benefits that the teachers would lose.”

Levy points out that the tests are supposed to get harder and more schools will fall into the hands of the OEI. The basic idea is to use New Orleans as a model for Virginia, ignoring the fact that most charters in New Orleans have been rated a D or F by the state, and even the reformy Cowen Institute at Tulane said recently that two-thirds of the NOLA charters are academically unacceptable.

And then there is this consideration:

“Finally, eliminating democratic institution and processes in a democratic society is not a cure for dysfunction or low test scores. Certainly, mass failure on the SOL tests signals a problem, but before the state blames and disenfranchises school communities, it really needs to figure out what that problem is and then target its resources accordingly. While many majority poor schools do just fine on standardized tests, I think we all know that the schools with low standardized test scores are often majority poor. Last I checked, being poor isn’t a reason to disenfranchise communities and hand their schools over to outsiders.”

Levy urges you to act now. If you live in Virginia, speak up. Join with your friends and neighbors to stop this raid on the public’s schools.

“So, I urge you to contact Governor McDonnell (804-786-2211) and your state legislators ASAP to state your opposition to the Opportunity Education Institution and to tell them to vote against SB1324S and amendment 12. This bill is likely unconstitutional and it’s bad for Virginia–bad for public education and bad for democracy.”

This NPR program contrasts the different paths of Finland and South Korea. Too bad it relies only on results of PISA tests. US students did much better on the latest TIMSS.

Frankly, I’m getting tired of the same old talk about international test scores.

We live in the world’s most economically successful nation, with the most advanced this, that, and the other. Why are we always looking for another nation to copy?

We do lead the world–that is, the most industrialized nations–in child poverty. Why not aim to be #1 in children’s health and well being?

Fred Smith, a testing specialist and consultant, was an administrative analyst for the New York City public schools. He’s a member of Change the Stakes, an advocacy group of parents and educators concerned about the impact of testing in schools. In the following tale, “Tweed” is shorthand in NYC for the NYC Department of Education. Guess who the Pharoah is? There is more than one.

~~~~~~~~~~~~~~~

An Anti-Passover Story: The 10 Plagues of Testing

There doesn’t seem to be any relief from high-stakes testing which has become the cruelest of taskmasters in public school systems throughout the land. It has become a form of enslavement whose lash is felt by students, parents, teachers and principals.

The Pharaoh enthroned in this Haggadah of misery rules from the gleaming palaces of Albany and Tweed, controlling the upper and lower empire, raining oppression upon his suffering populace. The masses await a modern day Moses to save them from the 10 Plagues of testing that keep them in chains:

The stream of learning that nourishes the minds of the youth and flows between teachers and students is bloodied by this heartless king who has decreed that testing shall be what is taught. And so, day in and day out are spent preparing for exams, fouling the wellsprings of knowledge and bringing a drought to those thirsting to learn.

For the Pharaoh is mighty. He instills fear in the people for failure to obey. Dread sweeps over the land as if caused by deafening screeches made by armies of frogs. It is visited on everyone should anyone question the wisdom of the exams. Especially harsh consequences are threatened if even one bold parent asks what the benefit to the children is. This brings forth thunderous wrath. Children will be punished, teachers exiled and schools closed for the welfare of the realm.

But the people have grown angry over the years because the schools have left them with little hope. A spirit of rebellion is starting to stir. The Ruler knows he needs to do something. High priests are summoned to give counsel. Then his vizier whispered their scheme to quell any thoughts of revolt.

Bring in the nobles and men who have made their fortunes elsewhere to run the schools and academies. It would cost the royal treasury dearly, but with Pharaoh’s iron fist behind the promise of better schools, incessant testing would continue and compliance would follow.

The rich and privileged are eager to preserve the school system. Nowadays, we know them as successful businessmen, corporate types, investors and consultants. They see in their call to service an opportunity to keep the good order and to mine the gold in the vaults of education. All of this good work will be done for the glory of Pharaoh!

And so they swiftly descend on classrooms like lice, feeding on the blood of innocent children. Some attack like wild animals—greedy lions and wolves, damaging schools and classrooms, leaving room for the noble profiteers to take them over or replace the ones they have destroyed.

In the wake of the insect infestation and beastly assaults, more testing takes place than ever before, wasting too much of the school day, draining time and resources from teaching and learning. Biblical scholars describe this as a time of pestilence when generations were deprived of opportunities to acquire knowledge and experience the joy of learning.

Children become anxious about the exams and what failing them can mean. For many they are an affliction that makes their flesh crawl. Yet Pharaoh’s wise men tell him the tests have been too easy and useless for years. At once he orders difficult ones to appear. The students and teachers are not prepared. Children are told the tests will be harder, but this will make them stronger.

Parents in the land begin to grumble again. Some say they will not let their children go take these new tests. Enraged, Pharaoh hails down stinging edicts on parents throughout the empire proclaiming all children under his dominion must take them. If not, they and their parents will be dealt with severely for defying his supreme law. There is no other choice.

Now the Ruler commands his scribes to prepare the harsh tests. And they write the many very difficult items that will appear on the examinations brought forth like locusts to devour new crops.

Still not convinced that the large hailstones falling from sickly green clouds will keep the masses in line, Pharaoh asks his gods to turn the skies black—leaving the people in a greater state of shock, uncertainty and fear. And soon blinding darkness covers the land with confusion and panic, and no one knows where to turn. Testing prevails.

Few children pass. And with that, the hopes and dreams of so many are defeated and the spark needed to grow in knowledge, happiness and wisdom is extinguished before it can ever set their minds on fire. And Pharaoh and the elite prosper.

Recently, the Providence Student Union persuaded 50 accomplished professionals to take a math test made up of items released from the test required for high school graduation.

I think that anyone who demands more tests or that all students should take the same tests should take the same tests and release their scores.

This reader has a suggestion:

“I believe that anyone who is contemplating running for U.S. Senator or Representative should have to pass their state’s standardized test in the four core areas in order to qualify for that position. Those students who are on a college track should be tested. Unfortunately, many of the students with disabilities and those who desire a trades occupation are discouraged by school because of these tests…they need to be tracked in a way different from those who aspire to go to college.”

Here’s more about the Tennessee proposal to cut the welfare benefits of families if their children don’t make progress on state tests.

155,000 families will be affected if the bill passes.

Is this value-added right-to-eat?

The main sponsor of the bill has no children.

I knew it was Ebenezer Scrooge.

Here are the names and contact number for the committee in the Tennessee legislature that will decide whether to cut the welfare benefits of families whose children get low test scores.

Please contact them, in the name of decency.

Just when you think that things couldn’t get any worse, some legislator comes up with the meanest, cruelest, dumbest idea yet.

Tennessee is considering legislation to cut the welfare benefits to families if their children get low test scores.

Some exceptions are carved out, but the basic idea is that the kids need a carrot and stick approach. Or more likely, a whip. The kids need to be afraid that their family won’t eat.

That’ll fix education.

Who are these people?

Do they have an ounce of charity in their hearts?

Do they have any religion? Any sense of humanity?

Will they sleep well at night knowing that someone went to bed hungry because of a law they passed?