This is a book you should read if you want to understand
how assessments are now being misused. It sets a valuable political
and historical context for understanding the mess that is now
federal education policy. The Mismeasure of Education by Jim Horn and Denise Wilburn should be on your shelf. The publisher just dropped the price to $27.50.
With new student assessments and teacher evaluation
schemes in the planning or early implementation phases, this book
takes a step back to examine the ideological and historical
grounding, potential benefits, scholarly evidence, and ethical
basis for the new generation of test based accountability measures.
After providing the political and cultural contexts for the rise of
the testing accountability movement in the 1960s that culminated
almost forty years later in No Child Left Behind and Race to the
Top, this book then moves on to provide a policy history and social
policy analysis of value-added testing in Tennessee that is framed
around questions of power relations, winners, and
losers. In examining the issues and exercise
of power that are sustained in the long-standing policy of
standardized testing in schools, this work provides a big picture
perspective on assessment practices over time in the U. S.; by
examining the rise of value-added assessment in Tennessee, a
fine-grained and contemporary case is provided within that larger
context. The last half of the book provides a detailed survey of
the research based critiques of value-added methodology, while
detailing an aggressive marketing campaign to make value-added
modeling (VAM) a central component of reform strategies following
NCLB. The last chapter and epilogue place the continuation of
test-based accountability practices within the context of an
emerging pushback against privatization, high stakes testing, and
other education reforms. This book will be
useful to a wide audience, including teachers, parents, school
leaders, policymakers, researchers, and students of educational
history, policy, and politics.
REVIEWS “When the Obama
Administration decided to spend the billions it got for schools as
part of the stimulus package to launch the Race to the Top program
and the NCLB waivers, forcing many states to adopt teacher
evaluation based on changes in student test scores, leading experts
warned that this “value added” system did not have a reliable
scientific basis and would often lead to false conclusions. This
sobering and important study of the long experience with this
system in Tennessee (where it was invented) shows that it did not
work, was unfair, and took attention away from other more
fundamental issues.” Gary Orfield Distinguished Research Professor,
UCLA, Co-Director, Civil Rights Project/Proyecto Derechos Civiles,
UCLA “If The Mismeasure of Education offered
only its penetrating new look at Conant and Coleman, it would be
worth the price. But that’s just the beginning. Horn and Wilburn
uncover the obsessive instrumentalist quantification and
apocalyptic rhetoric soapboxed by both liberal and conservative
political elites. Their autopsy of value-added accountability
reveals the pathology of ed reform’s claim about teachers not being
good enough for the global economy.” Susan Ohanian Educator,
Author, Activist “A well-researched (and
frightening) look at examples of shameful pseudoscience in America,
the latest manifestation of which is value-added assessment for
determining teacher competency… A well-documented and thorough
analysis, inescapably leading to the conclusion that student test
data cannot be used to determine teacher effectiveness. A must read
for policy makers enamored of the idea that value added assessments
will do what is claimed for them. They do not!….An excellent and
scholarly history of how we got to an
educational-testing/industrial complex, now promoting invalid
assessment strategies that are transforming education, but not for
the better. A scary book that should be thoughtfully read by those
who value America’s greatest invention, the public schools.” David
Berliner Regents’ Professor Emeritus, Arizona State
University “The Mismeasure of Education is a
magnificent work, an elegantly written, brilliantly argued and
erudite exposition on why the “what,” “how” and “why” of effective
teaching cannot be adequately demonstrated by sets of algorithms
spawned in the ideological laboratories of scientific management at
the behest of billionaire investors… This book will serve as a
sword of Damocles, hanging over the head of the nation’s
educational tribunals and their adsentatores, ingratiators and
sycophants in the business community… The Mismeasure of Education
will have a profound resonance with those who are fed up with the
hijacking of our nation’s education system. This is a book that
must be read by everyone interested in the future of our schools.
It is a book that advocates real educational justice, for student,
teachers, administrators and the public; it is informed by
impressive scholarship and compelling argument. It is surely to
become a classic work.” Peter McLarenProfessor, GSEIS, University
of California, Los Angeles, Distinguished Fellow in Critical
Studies, Chapman University

HELP everyone! Arne DuncAn Is on the Diane Rehm show. Call andnletmhim know what you think!,
1-800-433-8850
LikeLike
Just bought it. Should have it in hand within the week. Will give an opinion after I read it.
Please excuse the extra space I am taking up.
Just finished reading Stephen Jay Gould’s THE MISMEASURE OF MAN (1996 updated edition). The title of the new book, THE MISMEASURE OF EDUCATION, is no accident but a conscious tribute to a book that is still highly relevant in the ed debates today.
And I am just finishing a rereading of Banesh Hoffman’s THE TYRANNY OF TESTING (1964, originally published in 1962). In highly accessible prose he bests the high-stakes standardized testing industry and its worshipful adherents at their own game, on their own ground, using their eduproducts and rationales. And it gives plenty of food for thought on the VAManiacal reliance on ill-considered numerical measurements of teacher effectiveness and student learning.
Consider just these two quotes from p. 143 that address what we now would call the “mathematical intimidation” employed by the devotees of high-stakes standardized testing:
1), “A person who uses statistics does not thereby automatically become a scientist, any more than a person who uses a stethoscope automatically becomes a doctor. Nor is an activity necessarily scientific just because statistics are used in it.”
Quite so. And the following paragraph:
2), “The most important thing to understand about reliance on statistics in a field such as testing is that such reliance warps perspective. The person that holds that subjective judgment and opinion are suspect and decides that only statistics can provide the objectivity and relative certainty that he seeks, begins by unconsciously ignoring, and ends by consciously deriding, whatever cannot be given a numerical measure or label. His sense of values becomes distorted. He comes to believe that whatever is non-numerical is inconsequential. He can not serve two masters. If he worships statistics he will simplify, fractionalize, distort, and cheapen in order to force things into a numerical mold.”
With all due respect to some fine commenters on this blog—Duane Swacker, whatcha think?
🙂
P.S. Both books [paperbacks] I mention are inexpensive, though Hoffman’s is slim and small and and Gould’s is, let us say, small but not thin.
Thank you all for your patience.
LikeLike
Love, love, love the Mismeasure of Man. I had the pleasure of hearing Dr Gould speak on several occasions. Wow, just wow.
I heartily second your recommendation.
“If the misery of our poor be caused not by the laws of nature, but by our institutions, great is our sin.”
C. Darwin
LikeLike
Ang: Stephen Jay Gould’s THE MISMEASURE OF MAN (1996) is even more relevant today than when it was published.
For those that haven’t read it: the quote that Ang includes from Darwin is the epigraph Gould chose for his book.
You had a rare privilege, hearing him speak. I know where he would be in today’s ed debates: on this blog, pulling the rug out from under the feet of every edufraudulent argument that the leading charteriters/privatizers put forward.
I again urge people to consider buying Hoffman’s THE TYRANNY OF TESTING. How relevant could a 51-year old book be today?
The first lines of the Acknowledgments, p. 5: “With tests of aptitude and achievement exerting every greater influence on our lives, people are becoming increasingly uneasy. But their skepticism is held in check by their awe of the professionalism of the testers. The purpose of this book is to dispel that awe by subjecting the testers to public examination.”
In fact, it is of utmost importance that Hoffman’s work appeared so many decades ago because it shows, in practice, that despite the constant promises by those producing and profiting off of increasingly high-stakes tests that they just needed a little more time to tweak them and work out any problems—
They have never delivered on their promises. And they won’t because they can’t.
In fact, one of the few constants out of the standardized testing ‘industry’ is the steady stream of excuses.
Just my dos centavitos worth…
🙂
LikeLike
Darwin was gentle, compassionate, altogether beautiful man. Wonderful to read this.
LikeLike
Well, KTA, since you asked-ha ha!
I have not read either of the two books you have referenced although I think I have read another Gould book. I’d have to go back through my books (scattered as they are throughout the house) to check. I do want to read both of them eventually and I suspect that I will find much to be in agreement with both Hoffman and Gould. They are not the only ones who in prior times have questioned standardized testing (other than the oft referenced Wilson).
One of the great scientists of the 20th century, Nobel Prize winning physicist Richard Feynman (a truly deserving recipient not like the current occupant of the Oval Office) in a compilation of lectures compiled into the book “The Meaning of It All” spoke out against standardized testing. Don’t have his quote with me, I’ll have to look it up.
Also Gerry Spence (attorney who is best known for his lead work in the Karen Silkwood case) in “Give Me Liberty” speaks of the LSAT as “A Test That Excludes the Poor and Minorities”: “Computers, not people, are selecting the lawters of this country. When we engage a lawyer today, we know he has been kissed on both cheeks [he didn’t say which set of cheeks] by a computer: first the LSAT, a computer driven test, and second, the Multistate Bar Examination, with is also a computer-driven test imposed on the profession by the ABA. As frightening as it may be, when we look into most lawyers’ eyes it is likely that no human being looked into them at the time he was chosen for the profession.”
I tend to look at things from a Critical Enquiry perspective developed by Drs. James Walther and Charles Fazzaro (my doctoral advisors at UMSL) in the late 90s/early 00s:
What is Critical Enquiry?
The capital “C” in Critical emphasizes social criticism at the most fundamental level of what ought to constitute an ideal just social structure. Enquiry emphasizes the self-conscious use of all forms of analysis and interpretation of actions and discourses that create, maintain, and justify social structures. To this end:
• Critical Enquiry is suspicious of al “isms” offered as The ideal social structure because like all “isms” they purport to transcend human subjectivity, that they are constituted in nature, outside the boundaries of human consciousness.
• Critical Enquiry fully recognizes the political nature of social structures, and seeks to reveal the power embedded in all forms of historically contextualized discourses to condition popular thought to accept a particular ideology, an “ism,” as natural and inevitable. Of particular concern are those “isms” that attempt to justify socioeconomic power differentials as inevitable, as normal.
• Critical Enquiry works dialectically in an unremitting search for contradictions between existing social arrangements and the Enlightenment ideals of natural rights, such as those embodied in the Founding Documents of the United States.
• Critical Enquiry is particularly concerned with those contradictions which systematically exclude individuals and groups from sociopolitical power or from the free access to information that is used to both condition and justify the status quo.
• Critical Enquiry is based on the belief that emancipation comes only to individuals that increase their understanding and self-reflective analysis of their social conditions. Such an analysis depends on the free and open exchange of knowledge and information uncontaminated by authoritative privilege and sanctions. Only after meeting these conditions regarding knowledge can citizens in a democratic society be sufficiently prepared to make ethical and moral judgments. (emphasis in original)
LikeLike
By the way, I consider Noel Wilson’s “Educational Standards and the Problem of Error” to be an excellent example of “Critical Enquiry”.
LikeLike
Duane Swacker: pardon the impertinence, but I am interested in your particular opinion of Hoffman’s THE TYRANNY OF TESTING (1964, originally published 1962) and Stephen Jay Gould’s THE MISMEASURE OF MAN (1996 updated edition).
I don’t mean this as a burden. You are not required to read or comment on them or come up with some unexpected insight. But perhaps with your particular interests and background you will see something the rest of us missed…
And why do I think you might have some fresh perspective on them? Because I am betting—98% sure of a ‘satisfactory’ rating of your imagination, a 13th percentile get you a 90th—that you understand what Mr. Numbers himself meant when he said:
“Any man who can drive safely while kissing a pretty girl is simply not giving the kiss the attention it deserves.” [Albert Einstein]
I am sure you will give this matter your full attention.
🙂
LikeLike
Love this interplay between two of my most respected bloggers. Thanks Duane for bringing up Critical Enquiry. Great info for us all.
I am curious how many grad schools of ed are using this material any more???
Coming from a public policy perspective, I see the last quote on emancipation and social conditions as key. We have enough stats on how poverty is affecting learning, and on the huge number of students in America who live in poverty.
Why does the government and the public not get it? Why do they waste billions of dollars of tax dollars on CC and iPads, when they need to create schools that are a safe and productive learning environment for all children, and that includes feeding them healthy foods, not Coca Cola because Coke gives them perks, and not using ketchup as a food source based on Luddite info, and have teachers, books, nurses, and librarians available at every school rather than iPads?
What was the topic of your dissertation? Is it online?
PS…in the late 70s I had the privilege and fun on knowing Feynmann at Cal Tech. He was a character and a good tennis player.
LikeLike
Ellen,
The E in enquiry is meant to distiguish this mode of thought from the philosophical school of thought from the 20th century that was called “critical inquiry”. It is not quite the same with more of an emphasis on social justice that critical inquiry.
I’m not sure how many grad schools (or even undergrad where CE should be introduced) come from this perspective. I’m not sure how many have much in the line of educational philosophy type courses and how one’s philosophy of teaching and learning has to do with how a teacher teaches. Many consider philosophical thought to be useless or extemporaneous to the “nuts and bolts” of the teaching and learning process. Unfortunately they are quite misquided in that thinking. I know I’ve run across it way too many times.
I share your frustration with policy makers who can’t see the trees from the forest or the forest for the trees. (it works both ways in my mind)
My dissertation was going to use Wilson’s error approach and applying it to the MAP (MO Assessment Program at the time) and relating that to the fundamental purpose of public education as outlined in the MO Constitution. The university pulled my funding after a year of work-SOBs! Long story, I should have gotten an attorney involved. Since my wife at the time was in law school that took priority. However, I did continue with the group without getting credit until they all finished up.
LikeLike
Great info..thanks. Bought Mismeasure and your two suggestions. Always read your posts carefully and learn. You are so NOT krazy.
I am compiling a list of books to recommend in handouts when I talk with community on the issues of testing, Parent Revolution, privatization. I would appreciate any suggested reading material you all may have. Please contact me with suggestions at
JoiningForces4Ed@aol.com
LikeLike
Thanks for the link Diane – I just bought my copy.
KrazyTA, I also have the Tyranny of Test (based on a suggestion from a comment on this blog) and now I want to check out the Mismeasure of Man. It is important to learn more and I appreciate everyone taking the time to make reading suggestions.
LikeLike
concernedmom: I know that people are very busy and time and effort are precious, but I think that if you read THE TYRANNY OF TESTING you will be pleasantly surprised to find that this ‘old’ book is so timely, accessible and relevant.
Of course, I am guessing. You may have a different opinion of it. If you do, I want to hear [not dispute] it. It is good to know if it has wider or narrower appeal.
And speaking of books: it does not go without saying that everyone should buy copies of REIGN OF ERROR for themselves and others when it becomes generally available.
“A person who won’t read has no advantage over one who can’t read.” [Mark Twain]
Please excuse this [perhaps] burdensome suggestion, but I would suggest you obtain Daniel Koretz’s MEASURING UP: WHAT EDUCATIONAL TESTING REALLY TELLS US (2009 paperback edition) for an excellent description of how standardized tests are designed, made, evaluated, and scored—by someone who both supports their use and strongly opposes their misuses.
IMHO, it is a balanced look from inside the psychometric field at what standardized tests can and can’t do.
Good luck. When I first started reading up on this stuff, it was almost painful [modified Angoff vs. bookmark methods for picking test items, standard deviations, norm-referenced and criterion-referenced tests, distractors/misleads/decoys, sampling, statistical & practical significance, etc., capped off with relearning the meaning of seemingly obvious terms like “reliability”].
Ok, sometimes painful. But it is worth it.
Good luck!
🙂
LikeLike
The Mismeasure of Education is one of the books of the new school year, and give what else is coming (“Reign of Error” and at least one expose on Rahm) that’s saying something. I’ve been laboring for three days, off and on, on my lengthy review, which will be up in a day (or two at the most) at substancenews.net. The reason for the length is that the book is a treasure of history and analysis, and each of the four main chapters has to be discussed for readers who won’t get to the book for some time.
Other good news today is that the publisher has dropped the price of the book. In one of the drafts for my review, I had noted that the “college textbook” price of The Mismeasure of Education” might prove an almost fatal drawback. At least some of us are planning to use the book as part of our CORE “Book Clubs”, but I hesitated because of the price. Now it’s coming within range. (The CORE “Book Clubs” are regional study groups across Chicago where we read and discuss books that help us get the background of the struggles we are facing here, both from a historical and other perspectives; I assume within a month or two we will have added the latest from Horn and Wilburn, on the one hand, and Ravitch, on the other…).
When Jim first mentioned the title for the book, my worry was it would be too much for any study to bear. After all, any book that echos Stephen Jay Gould’s “The Mismeausure of Man” has set a very very high goal. Now in my second reading of “The Mismeasure of Education,” I’m certain that Horn and Wilburn have reached that goal.
One of the things the reader should note is that what we are facing in our debates with the corporate ed reformers is theology — not science. The firmly held beliefs of the bishops and archbishops of the Church of Ed Reform are as immune to logical rational argument as the beliefs of any other group of zealots, organized and evangelistic. It’s taken me nearly 15 years of study and struggle to realize that some of my earlier training (including the study of philosophy and theology, which included a reading of the Summa Theologica) in religion was a better preparation for these battles than some more rational training. Reading Horn and Wilburn made me realize why Arne Duncan got that silly look on his face when he was repeating some of his more ridiculous line: he was in a rapture more akin to religious fundamentalism than to anything that we could refute with facts, history, logic, or a concern for human children in our real worlds.
That means we need to refute the arguments they make, but that only defeating their crazy power will end their reign. Once they are relegated to the lunatic sect that they have always been, we can study them. But for now, we have to understand their insanity and defeat it.
LikeLike
George, please send me our review and I will post it.
LikeLike
“. . . we are facing in our debates with the corporate ed reformers is theology — not science.”
No, not theology as their is no need for a “god” in this very human of activities, but IDEOLOGY: From Wikipedia, An ideology is a set of conscious and unconscious ideas that constitute one’s goals, expectations, and actions. An ideology is a comprehensive vision, a way of looking at things (compare worldview) as in several philosophical tendencies (see political ideologies), or a set of ideas proposed by the dominant class of a society to all members of this society (a “received consciousness” or product of socialization).
Ideologies are systems of abstract thought applied to public matters and thus make this concept central to politics. Implicitly every political or economic tendency entails an ideology whether or not it is propounded as an explicit system of thought.
LikeLike
George, will you post a link to your review?
Just ordered this book and anxiously awaiting Diane’s.
LikeLike
I think “theology” a good description. And I think of Wallace Stevens’s wonderful line, “Theology before breakfast sticks to the eye.”
And then you can’t see anything for the rest of the day.
LikeLike
“Reading Horn and Wilburn made me realize why Arne Duncan got that silly look on his face when he was repeating some of his more ridiculous line: he was in a rapture more akin to religious fundamentalism…
I agree. Arnie really does have the look of a religious zealot. It explains why no logic can pierce his hide.
LikeLike
Arne is a just the wind-up toy that mouths what it is supposed to when its string is pulled. He brings NO experience to his job and no discernment. Those are actually qualifications for the role assigned to him. He’s not an educator, but he plays one on TV.
He has his current job because he knew the right people and mouthed the right phrases. He brings to the job no qualifications whatsoever except the low cunning of the apparatchik. Well, he DID play basketball. And he worked for a while for his Mom. Then his pal made him CEO of the Chicago Schools. (He couldn’t be Superintendent because he didn’t have the qualifications.) And on the basis of his questionable tenure there, he was made Secretary of Education by his buddy Barry, which made for lots of photo ops of the two of them shooting hoops. He has about as much understanding of education as I do of quantum chromodynamics.
LikeLike
He has no notion how much damage he is doing.
LikeLike
I guess I should ask if there are any quality books that are pro-testing and give sound arguments for the level and stakes attached to these tests.
LikeLike
Point well-made, concerned! It goes without saying–one cannot be found, because a factual one cannot be written! Perhaps someone in the realm of Diane’s readership can write such a book–fiction, of course! (Duane? KrazyTA?) And–who knows?–the SyFy channel might option a TV movie–it could rate right up there with Sharknado! (Then you guys could make some $$$, buy out Pear$on, & put them out of business!)
LikeLike
Hasn’t that sci-fi movie already been written-“Waiting for Superman”?
LikeLike
This sounds very much like a book I wish I had had the time and resources to write. I can’t wait to read it. There is a great deal of utter nonsense about standardized testing being spouted by the reform crowd that one can recognize as nonsense only by actually learning something about how this stuff works.
I very much wish I had the time and resources to do one that subjects the CCSS in ELA to critical analysis. Such a book is sorely needed, for these new standards [sic] are a mess, and the reasons why they are–the reasons why they will have detrimental effects–are specific and technical. I notice that most of the talk about education reform takes place at a very high level of abstraction. It’s easy enough to look from a distance and generalize. Things look simple from the rarefied perches from which these ed deformers speak.
One of the greatest book titles ever was Robert Graves’s “Difficult Questions, Easy Answers.” I think of that title often when I read the nonsense from the test-kids-until-the-scream crowd.
LikeLike
A couple more interesting reads, oldies but goodies:
LikeLike
These books will give some needed background on recurrent reform initiatives from the metritocracy and some of the ways in which these can go terribly wrong.
LikeLike
Another book that I highly recommend that has profound implications for testing, though it might not seem so at first:
LikeLike
Here is the latest from California and LAUSD…how will 3rd graders be able to use their iPads without keyboards to take these tests, and without knowing how to type? Will their standings be posted for all to see, and to embarrass all the testees at all grade levels, or will they be kept totally private for only educators to use to improve this whole testing situation?
My guess, if they follow along with this mess, is that it will be similar to NYC results.
Anyone who thinks Brown and Perez, and their cohorts in Sacramento, are not leading the charge with CC, are not paying attention.
_______________________________________
New post on LA School Report
Testing Bill Taking Shape, Would Suspend API For Two Years
by Hillel Aron
52175279A bill moving through the California State Assembly would suspend nearly all of the old standardized tests to free up money and student energy to “field test” the new computer-based Common Core assessments.
But testing data from those field tests won’t be used for accountability purposes – they’ll simply be used as practice for students and school districts. That means that school districts would go through a year — this year — without testing data that is often used to judge how well schools and even teachers are doing — LA Unified’s new teacher evaluation system uses testing data, in part, to evaluate teachers. And schools would be without Academic Performance Index scores for the next two years.
“We’re essentially pressing reset on our current system,” says LAUSD lobbyist Edgar Zazueta.
Only students in grades 3 through 8 and 11 would take the new Common Core tests – also known as the “Smarter Balanced test,” so named for the consortium developing assessments that align with Common Core. The tests are designed to deemphasize memorization while pressing students for a deeper understanding of the material. For some, that’s simply not enough testing.
“There will be only one assessment in high school,” says Arun Ramanathan, Executive Director of Education Trust West, bemoaning the lack of testing for 9th and 10th graders. “You’re going to wait until 11th grade until you know if your child isn’t doing well in English language arts or mathematics.”
Read more of this post
Hillel Aron | Septembe
LikeLike
ellen Lubic: let me give my advice by [painfully] putting a few books into first, second and third groups. These are based solely on those that have been the most helpful for me because they were well-written and meant for a broad audience, generally jargon-free, shorter and smaller, and [not the least important consideration] cheaper. Other folks may have other picks or rankings.
First group. Someone is just starting out. High-stakes standardized testing and the charterite-privatizer complex built on it seem so, you know, scientific and objective and all. Well, gag me with a spoon why don’t you! If someone reads MAKING THE GRADES: MY MISADVENTURES IN THE STANDARDIZED TESTING INDUSTRY by Todd Farley (2009, paperback) s/he now realizes that the puny man behind the curtain is the real Wizard of Obfuscation, er, Oz. Lively, entertaining, uplifting, heart-breaking. But what about the numbers?!?!? Darrell Huff, HOW TO LIE WITH STATISTICS (paperback, original 1954, reprinted many times, I have the 1993 Norton paperback version). Big help in beginning to demystify stats/numbers and in inoculating one against mathematical intimidation. If you’ve made it through the first two, then on to Banesh Hoffman THE TYRANNY OF TESTING (1964, original 1962, Dover edition 2003). Straightforward explanations of the fundamental problems with high-stakes standardized testing. Relevant to today’s ed debates. And to put a little historical perspective on all this, MANY CHILDREN LEFT BEHIND: HOW THE NO CHILD LEFT BEHIND ACT IS DAMAGING OUR CHILDREN AND OUR SCHOOLS (2004, paperback, includes Deborah Meier, Stan Karp, Monty Neill, Alfie Kohn, Linda Darling-Hammond, and Theodore R. Sizer). The train wreck was anticipated long before it happened.
All paperbacks, all cheap, all written for the non-specialist.
Second group. You now want to get your hands dirty with some of the technical, er, “stuff.” THE MYTHS OF STANDARDIZED TESTS: WHY THEY DON’T TELL YOU WHAT YOU THINK THEY DO by Phillip Harris, Bruce M. Smith, and Joan Harris (hardcover, 2011). I can’t praise this enough; difficult questions and answers made accessible. Now you will really start to understand what Todd Farley and Banesh Hoffman were getting at. Follow that up with Daniel Koretz’s MEASURING UP:WHAT EDUCATIONAL TESTING REALLY TELLS US (2009, paperback) and you can start confounding friend and foe alike with such gems as “differential item functioning” and “reliability is consistency of measurement” and why a percentile is, er, a percentile on a norm-referenced test and what the heck a percentile is in the first place. Koretz is an expert and experienced psychometrician but pretty much blows holes in every major charterite/privatizer claim about high-stakes standardized testing. To continue to fortify yourself in the testing arena, COLLATERAL DAMAGE: HOW HIGH-STAKES TESTING CORRUPTS AMERICA’S SCHOOLS by Sharon L. Nichols and David C. Berliner (2007, paperback). Again, the damage to public education, people young and old, and democracy is laid out in painful detail. And then to further strengthen us non-math majors in the defensive arts when it comes to warding off the evil magic of mathematical intimidation, there’s Daniel Best’s 2012 updated version of DAMNED LIES AND STATISTICS: UNTANGLING NUMBERS FROM THE MEDIA, POLITICIANS, AND ACTIVISTS (hardcover). As a famous [infamous?] Supreme Court Justice might say, ‘Whoop De Damn Do!”
Third group. In a sense I’ve saved the best for the last. If you’ve read the first two sets of books you are in for a real treat. Two paperbacks by the late Gerald Bracey; he died in 2009. Perhaps of him it could be said, “we will not see the like again” or “when they made him they broke the mold.” An absolutely indomitable figure in the ed debates, a fierce defender of public education who I firmly think would have approved heartily of the subtitle of this blog: “A site to discuss better education for all.” Want to know how to lay waste to the morally and intellectually bankrupt arguments of the leading charterites/privatizers? EDUCATION HELL: RHETORIC VS. REALITY (Transforming the Fire Consuming America’s Schools) of 2009, paperback, and READING EDUCATIONAL RESEARCH: HOW TO AVOID GETTING STATISTICALLY SNOOKERED, 2006 paperback. The 2006 book is especially helpful because it embodies a principal well-articulated by one of those old dead white guys “NO problem can withstand the assault of sustained thinking” [Voltaire].
Where would I put Diane’s THE DEATH AND LIFE OF THE GREAT AMERICAN SCHOOL SYSTEM and the soon-to-be-here REIGN OF ERROR? Wherever you like—beginning, middle or end. Perhaps it depends if people are reading them in solitary fashion or as part of a study group.
This list is not exhaustive, even of the books I’ve read. But I think in this case brevity is the soul of, er, usefulness.
I hope this helps.
Thank you for your postings.
🙂
LikeLike
Dear TA…thank you so very much for this excellent list and for creating categories so that I can be realistic when recommending them to the widely diverse groups. You have mentioned some that I have read, and many that I have not and will now read.
I did use Diane’s fact-filled 2010 book Death and Life of the Great Am. School System two terms ago when I taught a public policy directed course on the Dumbing Down of American Public Schools. It was well received by those with open minds, but as is often the case, there were those others who followed the ‘rotten teachers, rotten schools’ syndrome.
But this tired and sometimes jaded old educator still has hope that knowledge can grow exponentially. So, you are wonderful to have taken the time to do this important favor for me.
Ellen
LikeLike
ellen Lubic: it is I who should thank you for all your efforts and troubles.
🙂
The advantage with commencing with Todd Farley’s MAKING THE GRADES is not just that it is an engaging book or that it is relatively short. It is that with self-deprecating humor and insight the author strips away the protective teflon armor of awe and invincibility with which the standardized test makers cover themselves from head to toe.
Sometimes the best way to proceed is to begin with the unspoken, felt assumptions rather than the self-conscious grandiose rationales. By reducing the testers and their “science” to manageable human proportions you render them vulnerable to questioning and critiques.
“…the mind is not a vessel that needs filling, but wood that needs igniting—no more—and then it motivates one towards originality and instills the desire for truth. Suppose someone were to go and ask his neighbors for fire and find a substantial blaze there, and just stay there continually warming himself: that is no different from someone who goes to someone else to get some of his rationality, and fails to realize that he ought to ignite his innate flame, his own intellect…” [Plutarch]
Link: http://quoteinvestigator.com/2013/03/28/mind-fire/
Thank you for being a fire starter!
🙂
LikeLike
Ah so..dear TA..you lead me to Voltaire, Plutarch, and Yeats among so many others. It whets my appetite and makes me want to slothfully sit on my patio and read for the next month.
But please do not use the F word….most of Yosemite is in ashes, our giant redwoods and the John Muir trail, and that fire is still not contained and seems to win the prize for being the worst fire in our long history. So being a fire starter gives me pause. But I do thank you for your compliments, kindness, and interest in my efforts in California.
LikeLike
ellen Lubic: I meant well but the timing was awful.
Please forgive the inadvertent wound.
“Observe due measure, for right timing is in all things the most important factor.” [Hesiod]
A small gift in apology, handed down to us by another one of those old dead Greek guys.
🙂
LikeLike
so, if the tests are so unreliable, and unfair—shouldn’t we also fight to get rid of the data backpack of the SBAC and PARCC that will have the same impact on our children and their futures??? I hear a lot about protecting the teachers, but when is it ever about my kid?
LikeLike