Here is a puzzlement (as the king said in “The King and I”).
Is there a right way to do something that is inherently wrong?
I think that it is wrong to judge “teacher quality” by student test scores.
Doing so undermines the quality of education.
It narrows the curriculum only to what is tested.
It encourages districts and states to attempt to test subjects that cannot be assessed by standardized tests.
It encourages teaching to the tests.
It incentivizes schools, districts, and states to game the system, and many have developed clever ways to inflate their scores.
No existing test was designed for this purpose, and test publishers always caution that tests should be used only for the purpose for which they were designed.
Some desperate or unscrupulous educators will cheat to get rewards or avoid sanctions.
Campbell’s Law holds true: “The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor.”
Thus, the more we use high-stakes testing, the more we corrupt what is measured. Every teacher, every administrator focuses on the scores to the exclusion of more important issues, such as the engagement of students in the arts, the health and well-being of children, and the soundness of the curriculum. They do this because their job depends on doing it.
I am not opposed to testing, if the tests are used diagnostically, to help students and teachers. I am opposed to testing that has high stakes attached to it, that rewards and punishes teachers, principals, and schools based on test scores. What we now call “accountability” is a synonym for “punishment.” I think that is wrong. Such “accountability” warps education, and I oppose it.
As I read discussions about school improvement strategies, I am struck by the obsession with data, the imposition of rubrics and targets, etc. that has taken the place of conversations about students and curriculum, about the joy of learning and love of the subject for its own sake, not for a test score.
And yet intelligent people continue to slice and dice the methods for using data to judge teacher quality.
They think there is a right way to do it. I don’t.
I think that the truly great teachers awaken a love of learning in their students. The truly great teachers reach into their students hearts and souls and change their lives. Truly great teachers don’t think about test scores. They think about making a difference in the lives of children.
I don’t think there will ever be a test or a method that measures what matters most.
I believe that the current era of test obsession will eventually collapse. It will collapse because it demoralizes teachers and has other pernicious effects. Students know it. Teachers know it. many administrators know it but are afraid to say so (I honor those who do say so and defend principle). Parents are beginning to see it. Sooner or later, those who sit in legislative halls in states and nations will understand that they are squandering money, but even worse, they are harming students and ruining American education.
That day will come. It is inevitable. And when it does, we will have the large task of reconstructing American education in ways that make sense, that restore honor to the profession of teaching, and that are truly educative for all children.

Diane
You have so eloquently stated the Truth. about Testing Mania.
Thank you
LikeLike
Well, stated.
LikeLike
Well stated (weithout the comma).
LikeLike
Here’s another puzzlement: If we argue that TEACHERS can’t be judged based on tests, can we judge STUDENTS based on tests? If tests are primarily diagnostic, a case can be made that tests should not be used to “grade” students but rather to help teachers determine whether a student has mastered the material presented. Campbell’s Law applies to students as well…
LikeLike
That’s why it is so important to know your students well. Tests are a rough way of measuring what students have learned. Typically as (older) students get to know how a teacher tests, they adjust the way they study to suit that teacher and scores trend upward. As a special education teacher, I had to pay attention to the design of my tests in order to let my students show what they had learned. On occasion, I modified general education teachers’ tests for special education students. The students had to demonstrate the same knowledge, but the test format was adjusted to their needs.
Summing up one of my students in a single grade was torture. So much important information was left out of that single letter grade. We had extensive classroom discussions about grading.
LikeLike
wgerson,
I ain’t religious, but AMEN BROTHER on the “grading” of students.
It is an abhorrent practice and has no place in public education. I wish someone would point out where in our constitutionally mandated charge that we are to sort and separate students out based on a “grading” system. Well, no one can because no state constitutional charge compels that practice. Two questions I ask of people and hardly ever get a correct answer are: What document authorizes public education? and What, then, is the purpose of public education as authorized in that document?
I challenge all here to answer those questions! Looking forward to responses.
LikeLike
Diane, well stated as usual!
All this data gathering falls into the category, “garbage in, garbage out .”
I only hope the pendulum swings the the other way before it is too late.
LikeLike
Diane,
It is so important that you have qualified your statements thus:
” I am not opposed to testing, if the tests are used diagnostically, to help students and teachers. I am opposed to testing that has high stakes attached to it, that rewards and punishes teachers, principals, and schools based on test scores.”
So many people come out against standardized testing with such a fury that they just bash the entire concept of assessment itself, which of course is ludicrous. Your take is balanced and sensible.
As I have written before and will continue to write again: “Popular myth and the standardized-test culture of American public education would have one think that education is about the massive and rapid accumulation of content, the purpose of which is to succeed on a state test; the error of this thinking is that it relegates the education process itself to a secondary status, making the test score the “prize” of education. Nothing could be more removed from the truth. We have become a nation of pure data, of test scores and dropout rates, ciphers which are at best simplified abstractions of critically important ideas – but raw numbers do not tell the whole story. Any educational process or notion that has at its heart the notion that it is the data that needs to be treated, and not the students, is fundamentally flawed.”
We now revolve completely around test scores, and it’s just sad: http://askingquestionsblog.blogspot.com/2013/05/could-you-take-my-picture-cuz-i-wont.html
LikeLike
“So many people come out against standardized testing with such a fury that they just bash the entire concept of assessment itself, which of course is ludicrous.”
You might want to look up the definition of “assessment”. You’ll note it is not equal to standardized testing. It is possible to be against standardized testing without being against assessment.
LikeLike
That’s my point. Read me again. You are in such a rush to be contrary to me that you don’t read me well. if I was unclear, I can clarify. if you ask nicely 🙂
LikeLike
I think that the reason many object to all standardized exams is that they object to tests that are high stakes for students, not just exams that are high stakes for teachers.
I think standardized exams also allow students a teacher independent way to demonstrate.academic achievement even if they are not used for diagnostic purposes. There is some evidence that this is particularly important for boys.
LikeLike
Andrew,
“So many people come out against standardized testing with such a fury that they just bash the entire concept of assessment itself, which of course is ludicrous.”
Yes, I come out both barrels blazing in attacking standardized testing because that is what is needed to fight the insanities that are educational standards, standardized testing and the “grading” of students. These are illogical and abhorrent educational malpractices that cause harm, damage students, deprive many students of the “spoils” that are given to those at “the top”. Why should only a few get the spoils?? Insanity squared!!
But, when I am in my class teaching I am constantly assessing what is going on, how the students are reacting to the lesson, are they “getting it”, are they putting in the effort, what can I do to get them to put in more effort, etc. . . . Even my own teacher made tests are just a tiny fraction of my assessment process.
LikeLike
Accept the premises of your opponent, and you have lost the debate.
LikeLike
And one of those premises is the we, public school teachers, should sort and separate out the students through “grading” them as if they were sides of beef hanging in the slaughterhouse.
That premise is wrong, dead wrong and causes much harm to many students. Foucault writes of subjetivication, the process whereby people internalize what the authorities say about them and “become” that label/type of person (think being told you are bi-polar, or that as a student you are a “D” student). Students definitely internalize all this grading malpractice so much so that it is said (and I don’t have the research at hand) that by third grade one can predict quite accurately the future of the student by looking at his/her grades.
I don’t accept the “grading” premise and it goes against my constitutional mandate as a public school teacher.
LikeLike
Unfortunately, what the teacher produces IS grades, and she doesn’t get her paycheck unless she turns them in on time. Some places won’t give you your last paycheck in June until you have turned in your grades. Whatever else a teacher may do for the child, the grade is the one essential.
LikeLike
There is no right way to do something wrong.
LikeLike
AMEN!
LikeLike
The standardized tests are being misused in teacher evaluation systems across the nation. These tests were designed to assess the K-12 system, not individual teachers, not individual students, not single classrooms. Jerry Waxman is correct; there is no right way to do something wrong.
LikeLike
Since the tests were not designed to evaluate teachers, schools and districts it is UNETHICAL to do so. This year I am going to be evaluated by some sort of student test scores. Don’t know what (I anxiously await the beginning of the year meetings and even then they probably won’t tell us exactly what is going to be done). I’ve already told my administration that I cannot be a part of a process that is UNETHICAL and to expect me to bring a black permanent marker so that I may cross out that section of my evaluation. I refuse to be a part of an UNETHICAL process.
LikeLike
As someone who was just judged by test scores, I can tell you just how ludicrous it is. In my state, each had to give four pre and post tests. I would love to set down the details of the poor tests, the ridiculous process of choosing targets, the inconsistencies, the crazy math that could be manipulated in many different ways should teachers choose to do it, but suffice to say I missed one of my four “exeeds target” goals by 1.7 %, and I went from “highly effective” to just “effective”. Not that it really matters this year except to my ego. And this doesn’t even touch what this kind of over-testing does to the kids.
LikeLike
The administration tried to get us to do the whole pre, post, formative and summative test crap this year. I refused. Fortunately my AP is moving on to a principal position and doesn’t have the time to address the issue. Sometimes we get lucky. But it will be back with a fury this year.
It’s all excrement in excrement out!
LikeLike
“And this doesn’t even touch what this kind of over-testing does to the kids.”
And that is why I refuse to participate in this UNETHICAL nonsense-the harmful effects of this educational malpractice that are educational standards, standardized testing and the “grading” of the students (although there are “grades” in my class I let the students know just how bogus they are and that if they do the work as assigned and learn as much as they can their “grade” will be fine)
LikeLike
“The last temptation is the greatest treason, to do the right thing for the wrong reason” – TS Eliot.
LikeLike
This is why you are great and valuable and important. You have the wisdom to not even go there with all of the idiocy. It is so hard to stay above it, but you are right we must just say no. There is no right way to do a wrong thing. That was our problem from the beginning. The very first high stakes test that came across my path probably about 1997, I said this is ridiculous, we should not change anything we are doing to suit this test and when they give it again we should all stay home. Well I received my first bad evaluation after saying that in a meeting and was moved from my spot in 3rd grade which was a testing grade down to 1st (which ended up being a blessing) and have watched for 15 yrs while that school and almost every school in the country has been destroyed.
LikeLike
I think that the current testing system lacks integrity and I don’t even understand it completely. But any time you have a testing system that induces or tempts stakeholders to not be totally honest, you have a problem.
Putting that in light of what Jesus teaches, we pray “lead us not into temptation” and also in the Sermon on the Mount he teaches his disciples to “Let what you say be simply ‘Yes’ or ‘No’; anything more comes from evil. I bring the later up to bring to light the issue of integrity,
but it also ties back to the first of being tempted. These were of course being taught to his disciples, but I believe these hold water outside the faith tradition in which they were being taught.
More importantly though the ones being hurt the most are the students, because it opens the door for not only the integrity of test; the teacher; the administers it ultimately calls into questions the integrity of the education they are receiving.
My position is this: that both student and teacher would be better served if accountability were left in the hands of the community where they are located.
That may seem a bit naive…maybe we should all think about these things a little more.
LikeLike
“I think that the current testing system lacks integrity. . . ”
All testing systems (yes, even teacher made) lack validity which to use your term perhaps lack integrity. That which is invalid by definition lacks integrity.
But I’m not sure that using integrity is quite the correct word, but then again. . . . I prefer invalidity.
Integrity:
Noun
-The quality of being honest and having strong moral principles; moral uprightness.
-The state of being whole and undivided: “territorial integrity”.
Synonyms
honesty – probity – entirety – rectitude – wholeness
invalidity:
Noun
-The fact of not being valid.
-The condition of being an invalid.
Synonyms
nullity – infirmity – disablement – disability
Going with the definition of invalidity as something not valid (I disregard the term in relation to physical/mental/emotional states of being) I believe is the better course of action than using integrity although that may be a “better” term to use in “framing” the discussion for those not so well versed in what many see as the arcana of testing/educational discourse. Torn between the two and may have to start using integrity more. Thanks for bringing the term into the discussion.
LikeLike
How do education statisticians define “validity” of a test? How can we know a test is in-valid, unless we know what a valid test is? There seems to be an internal contradiction here.
Duane, do you have an independent income so that you can defy the administration without worrying about the consequences?
LikeLike
WOWZER, Diane. Thank you. We have dufuses in office.
LikeLike
I’ve been thinking about testing too. A lot. I teach first grade. My students arrive at the tender age of 5 or 6 and exit at 6 or 7. I give my students 6 benchmark tests a year, 3 in literacy and 3 in math. This past year, 4 more tests were added to the roster – this time on computer. That adds up to 10 – yes 10 -multiple choice tests every year for children who still cry for their moms, pee on the carpet, fall asleep spread eagle on the floor, and poke, prod, tease, and growl at each other. Oh –did I say that the children can’t read, at least for the first third of the year –the first 3 or 4 tests?
I am told the tests are to help inform my instruction. But I know the truth. The tests are there in first grade to get the kids ready for the tests in second grade –the tests that really matter – the tests that will count on the schools’ API and AYP reports. (California tests 2nd grade).
As a pragmatist, I’m efficient, organized, hold traditional values, and like rules and order. I know how to do what is expected of me and how to show results. So I reasoned I could use these structural strengths to get the tests over with, show the expected results, meet the smart goals, so that I could move on to the creative part of teaching –the part that cannot be quantified– the part of teaching where I get to interact with the children I am charged with developing academically, I get to know their passions, fears, ideas, the part of teaching that educates children – where there are no borders between painting and reading and playing basketball and building towers and writing , the part of teaching that is magical, that combines knowledge of standards, expertise, and passion on the part of the teacher with excitement, willingness, surprise, and vision from children.
But that is not what happened. Every breathing space I created for myself and my students by my efficiency got filled up with another expectation. More students – 18 one year, 20 the next, 24 for a few years, then 26; a new policy of all-day, full inclusion of special needs children in the general education classroom; a neighborhood impacted by the housing market decline and its resultant mobile population – causing more to move in and out of my classroom during the year; a school in program improvement – in effect designated as failing, and the resultant punishments – more administrative scrutiny, narrowing of curriculum to math and reading, canceling of arts programs during the school day; flight of families to school with better scores; and noisy classrooms in buildings without connecting walls.
So I got tired. I got beaten down. I got discouraged. And if you think I had it bad, think of the kids. Imagine a teacher for them who is always cross, always serious, harps about the test, never takes the time to ask them how they are doing, is too busy to tie a shoe lace or rub a boo-boo. That is me. I cringe as I write this.
Standardized tests don’t just stop my students from thinking, they teach them not to think. Imagine a 5 year old child who doesn’t read, and may not even speak English. They look at an 8 by 11 inch white paper devoid of all but one or two sketches. They listen as I read the question to them. Then I read the 3 or 4 choices. They pick the choice and fill in the bubble. Imagine the time I spend teaching them how to find the question, scroll with their eyes through the 4 choices, all while listening to me drone on and repeat the question and the choices until all 26 of them have bubbled something in. Imagine that this one test has 8 pages of questions – 15 or 20 questions in all. No wonder I’m cross. No wonder their eyes are glazed and they are growling.
But it gets worse. I am complicit in this next part. Standardized tests actually make students stupid. Yes, stupid. Not only are the kids not thinking, they are losing the ability to think. In my zeal to get administrative scrutiny off me and my students, I mistakenly thought that if I give them the test results they want, then I could do what I know was best for my students. To that end I trained my students to do well in these tests. I taught them to look for loopholes; to eliminate and guess; to find key words; to look for clues; in short, to exchange the process of thinking for the process of manipulation. I capitalized on my knowledge of young children, and the fact that they want to please adults and like to get the answer “right”. I justified my actions by saying that I had no choice, that the consequences of low test scores at my school were too dire to contemplate, and I wasn’t willing to put myself in professional or financial jeopardy. Clearly, testing made me stupid too.
I can’t speak for all my fellow teachers at my school, but I suspect many of them would, at the very least, recognize similar behaviors in their test-teaching practices. So, when despite our best collective efforts at raising test scores failed and my school entered 2nd year program improvement, I surrendered my stupidity and started speaking up, and eventually speaking out. I read research, blogs, government publications, and journals. I read widely from educational, historical, economic, pediatric, and psychological literature. I challenged administrative authority at my school to do the same – read, think, debate, discuss, and much to my surprise, did not get rebuffed. Astonishingly, I got ignored.
At about the same time I woke up out of my testing-induced nightmare , I started to notice the monster I had helped create. My students were only happy when they got the answer right. For many years my collegues and I had noticed a trend in young children – a trend toward passivity in learning. We had theories – all the kids had TV’s in the bedrooms, they had far too much screen time – computer, games, cells, TV’s in cars, lack of adult supervision and interaction, lack of conversational models at home, lack of social models at home, the list went on. But what wasn’t on the list was what I was culpable for – I had become about the right answer. They wanted to please me. They knew that if they waited long enough I would help them find the right answer. And I did.
One day, during small group math rotation, I put up privacy boards during the practice part of a lesson on math reasoning. The story problem went like this: There are 10 buttons on my coat. 6 are red and the rest are blue. How many are blue? We have worked on these kind of problems frequently, and the children has seen in test format. Using connecting cubes as buttons, the children had to make a model of the problem. Three kids cried that day. The stress of thinking for and by themselves got to them. You see, many of the children had become expert at copying – watching what other children did in the group to get an answer and then providing “their” answer a nanosecond later. The children did not trust themselves enough to even attempt an answer. Their discomfort was palpable, and I was appalled.
Crying notwithstanding, I continued to use privacy boards. I also started to coach the kids about my belief in their abilities. I found that as they worked out a math problem using manipulatives to represent objects, I could lean in and coach them, one to one. Then, when they all had their answers, we pushed down the privacy boards to explore what we had all done. Ever so slowly, over many weeks, they started to regain their confidence.
You might wonder why I had not been doing this kind of teaching all along. I had, 11 years ago, pre-NCLB. Testing, along with the breadth of the standards and the resulting mountain of material to cover, much of it developmentally inappropriate, slowly eroded my professional judgement. Pressure to produce results through collaboration and mind-numbing analysis sapped my energy. A constant barrage of media stories about the ineffectiveness of teachers, some of it supported by leaders at my own school, drowned my spirit. Then I heard you, Diane, speak as a guest of my district and union. I started to read your work and have never looked back.
So thank you from the bottom of my heart. You are truly brave. You inspire me to speak up and speak out. You remind me that knowledge is power –I had forgotten. Now I get my ducks in a row, collect my facts, back up my intuition and experience with research, and speak up without fear or rancor. And in the process of speaking up for myself, I speak up for my students. And ever so slowly I start to rebuild my confidence too.
LikeLike
What and amazing, horrifying, and finally triumphal story. Some football coach had as one of a number of mantras for his players, “Always do the right thing.” Your story proves it.
LikeLike
The Rheeformers and men like Broad, Gates, Bloomberg on and on also believe they are doing the right thing. Do they see their plans as a wrong against others? Probably not. Because they are so entrenched in their own thinking and arrogance of wealth and power (along with the like headedness of the yes people around them) that they believe it to be the right way, their way, the only way. They are truly the epitome of doing something for their own belief that theirs is the right reason, but I believe, with an ultimate wrong against society. I wonder if they can see past themselves and their comfort zone to the horrible disruption and destruction, hurt and injury they are perpetrating on others? Are they so isolated in their own towers separated by talking on computers and only interacting with themselves that they have forgotten to respect nature and all of the gifts of differences no matter the level of functioning and that not everything should be or can be measured? Is measurement their god? I hope not because right now they are not measuring up, even if they think they are.
The silence of our “leaders” is deafening on issues of privacy, education, finance, for the exception of the courageous few. They must be those that are not deep in the pockets of such global manipulators. We, you and I are funding the Utah spy center and future
control of us, or should I say our innocent children, for their future. Our approval is not needed, only our tax dollars, because it is not about us, but it is about the children. The cities will be the safe fortress for the elite and the rest will be boots on the ground.
A brave new world! A docile existence! Is there time to change this?
LikeLike
This was so great to read. I feel some of the very same things; and I teach preschool! It’s hard to imagine some of this stress and anxiety trickling down to 3 and 4 year olds, but it does. Very inspiring to read and rethink what is really important in education; teaching ALL our children, not just content, but what to do with it. Think, reason and analyze.
LikeLike
I believe I have posted this before on this blog. It is worth revisiting.
The proliferation of educational assessments, evaluations and canned programs belongs in the category of what systems theorist Russ Ackoff describes as “doing the wrong thing righter. The righter we do the wrong thing,” he explains, “the wronger we become. When we make a mistake doing the wrong thing and correct it, we become wronger. When we make a mistake doing the right thing and correct it, we become righter. Therefore, it is better to do the right thing wrong than the wrong thing right.”
Our current neglect of instructional issues are the result of assessment policies that waste resources to do the wrong things, e.g., canned curriculum and standardized testing, right. Instructional central planning and student control doesn’t – can’t – work. But, that never stops people trying.
The result is that each effort to control the uncontrollable does further damage, provoking more efforts to get things in order. So the function of management/administration becomes control rather than creation of resources. When Peter Drucker lamented that so much of management consists in making it difficult for people to work, he meant it literally. Inherent in obsessive command and control is the assumption that human beings can’t be trusted on their own to do what’s needed. Hierarchy and tight supervision are required to tell them what to do. So, fear-driven, hierarchical organizations turn people into untrustworthy opportunists. Doing the right thing instructionally requires less centralized assessment, less emphasis on evaluation and less fussy interference, not more. The way to improve controls is to eliminate most and reduce all.
Former Green Beret Master Sergeant Donald Duncan did when he noted in Sir! No Sir! that: “I was doing it right but I wasn’t doing right.”
And from one of America’s premier writers:
“The mass of men [and women] serves the state [education powers that be] thus, not as men mainly, but as machines, with their bodies. They are the standing army, and the militia, jailors, constables, posse comitatus, [administrators and teachers], etc. In most cases there is no free exercise whatever of the judgment or of the moral sense; but they put themselves on a level with wood and earth and stones; and wooden men can perhaps be manufactured that will serve the purpose as well. Such command no more respect than men of straw or a lump of dirt.”- Henry David Thoreau [1817-1862], American author and philosopher
LikeLike
Thank you . . .
LikeLike