Valerie Strauss posted this article that I wrote on her Washington Post site “The Answer Sheet.” The tests now required by federal law are worthless. The results are reported too late to matter. The reports to teachers do not tell them what students do or do not know. The tests tell students whether they did well or poorly on a test they took six months ago. They do not measure “learning loss.”
Diane Ravitch is a former assistant secretary of education and historian. For more than a decade, she has been a leading advocate for America’s public education system and a critic of the modern “accountability” movement that has based school improvement measures in large part on high-stakes standardized tests.
In her influential 2010 book, “The Death and Life of the Great American School System,” Ravitch explained why she dropped her support for No Child Left Behind, the chief education initiative of President George W. Bush, and for standardized test-based school “reform.”
Ravitch worked from 1991 to 1993 as assistant secretary in charge of research and improvement in the Education Department of President George H.W. Bush, and she served as counselor to then-Education Secretary Lamar Alexander, who had just left the Senate where he had served as chairman of the Senate Education Committee. She was at the White House as part of a select group when George W. Bush first outlined No Child Left Behind (NCLB), a moment that at the time she said made her “excited and optimistic” about the future of public education.
But her opinion changed as NCLB was implemented and she researched its effects on teaching and learning. She found that the NCLB mandate for schools to give high-stakes annual standardized tests in math and English language arts led to reduced time — or outright elimination — of classes in science, social studies, the arts and other subjects.
She was a critic of President Barack Obama’s policies and his chief education initiative, Race to the Top, a multibillion-dollar competition in which states (and later districts) could win federal funds by promising to adopt controversial overhauls, including the Common Core State Standards, charter schools and accountability that evaluated teachers by student test scores.
In 2013, she co-founded an advocacy group called the Network for Public Education, a coalition of organizations that oppose privatizing public education and high-stakes standardized testing. She has since then written several other best-selling books and a popular blog focused primarily on education.
She was also appointed by President Bill Clinton to the National Assessment Governing Board, which oversees the federal National Assessment of Educational Progress, and served for seven years.
In the following post, she provides a historical overview of standardized testing — and takes issue with supporters who say that these exams provide data that helps teachers and students. Instead, she says, they are have no value in the classroom.
The subject has resonance at the moment because the Biden administration must decide soon whether to give states a waiver from the federal annual testing mandate. The Trump administration did so last year after schools abruptly closed when the coronavirus pandemic took hold in the United States, but said it wouldn’t do it again if President Donald Trump won reelection. Trump lost, and now Biden’s Education Department is under increasing pressure to give states permission not to administer the 2021 tests.
By Diane Ravitch
I have been writing about standardized tests for more than 20 years. My 2000 book, “Left Back: A Century of Battles Over School Reform,” included a history of I.Q. testing, which evolved into the standardized tests used in schools and into the Scholastic Aptitude Test, known now simply as the SAT. The psychologists who designed these tests in the early 20th century believed, incorrectly, that you inherited “intelligence” from your family and nothing you might do would change it. The chief virtue of these tests was that they were “standardized,” meaning that everyone took the same ones. The I.Q. test was applied to the screening of recruits for World War I, used to separate the men of high intellect — officer material — and from those of low intellect, who were sent to the front lines. When the psychologists reviewed the test results, they concluded that white males of northern European origin had the highest I.Q., while non-English-speaking people and Black people had the lowest I.Q. They neglected the fact that northern Black people had higher I.Q. scores than Appalachian White people on the Army’s mental tests. Based on these tests, the psychologists believed, incorrectly, that race and I.Q. were bound together.
One of the psychologists who helped create the wartime I.Q. tests was Carl C. Brigham of Princeton University. He wrote an influential book, called “A Study of American Intelligence,” in 1923, which proclaimed that the “Nordic” race had the highest intelligence and that the increasing numbers of immigrants from Southern and Eastern Europe were causing a decline in American intelligence.
His findings encouraged Congress to set quotas to limit the immigration of so-called “inferior” national groups from places like Russia, Poland and Italy. Brigham, a faculty member at Princeton, used his knowledge of I.Q. testing to develop the Scholastic Aptitude Test in 1926. Because they could be easily and cheaply scored by machine, the SAT tests eventually replaced the well-known “College Boards,” which were written examinations prepared and graded by teams of high school teachers and college professors.
Standardized testing occasionally made an appearance in American schools in the second half of the 20th century, but the tests were selected and used at the will of state and local school boards. The Scholastic Aptitude Test was important for college admission, especially for the relatively small number of elite colleges. Nonetheless, it was possible to attend an American public school from kindergarten through 12th grade without ever taking a standardized test of academic or mental ability.
This state of affairs began to change after the release of the Reagan administration’s “Nation at Risk” report in 1983. That report claimed that the nation’s public schools were mired in “a rising tide of mediocrity” because they were too easy. Politicians and education leaders became convinced that American education needed higher standards and needed tests to measure the performance of students on higher standards.
President George H.W. Bush convened a national summit of governors in 1989, which proclaimed six national goals for the year 2000 in education, including:
• By the year 2000, United States students will be first in the world in math and science.
• By the year 2000, all students will leave grades 4, 8, and 12 having demonstrated competence over challenging subject matter including English, mathematics, science, foreign languages, civics and government, economics, arts, history and geography.
Such goals implied measurement. They implied the introduction of widespread standardized testing.
In 1994, President Bill Clinton introduced his Goals 2000 program, which gave grants to every state to choose their own standards and tests.
In 2001, President George W. Bush put forward his No Child Left Behind legislation, which required every student in grades 3 to 8 to take a standardized test in reading and mathematics every year, as well as one test in high school. Test scores would be used to judge schools and eventually to punish those that failed to make progress toward having every student achieve competency on those tests. The NCLB law proclaimed that by 2014, virtually every student would achieve competency in reading and mathematics. The authors of NCLB knew the goal was impossible to achieve.
When Barack Obama became president, he selected Arne Duncan as secretary of education. The Obama administration embraced the NCLB regime. Its own program — Race to the Top — stiffened the sanctions of NCLB.
Not only would schools that did not get high enough test scores be punished, possibly closed or privatized for failing to meet utopian goals, but teachers would be individually singled out if the students in their classes did not get higher scores every year. The Bush-Obama approach was recognized as the “bipartisan consensus” in education, built around annual testing, accountability for students, teachers, principals and schools, and competition among schools. Race to the Top encouraged states to authorize charter school legislation and to increase the number of privately managed charters, and to pass legislation that tied teachers’ evaluations to the test scores of their students.
Duncan also promoted the Common Core State Standards, which were underwritten by philanthropist Bill Gates; the U.S. Department of Education could not mandate the Common Core, but it required states to adopt “common national standards” if they wanted to be eligible to compete for a share of the $4.35 billion in federal funding that the department controlled as part of the recovery funds after the Great Recession of 2008-09.
The department was able to subsidize the development of two new national tests aligned to the Common Core, the Partnership for Assessment of Readiness for College and Careers (PARCC) and the Smarter Balanced Assessment Consortium (SBAC). At the outset — in 2010 — almost every state signed up for one of the two testing consortia. PARCC had 24 state members; it is now down to two and the District of Columbia. SBAC started with 30 state members; it is down to 17.
Politicians and the general public assume that tests are good because they provide valuable information. They think that the tests are necessary for equity among racial and ethnic groups.
This is wrong.
The tests are a measure, not a remedy.
The tests are administered to students annually in March and early April. Teachers are usually not allowed to see the questions. The test results are returned to the schools in August or September. The students have different teachers by then. Their new teachers see their students’ scores but they are not allowed to know which questions the students got right or wrong.
Thus, the teachers do not learn where the students need extra help or which lessons need to be reviewed.
All they receive is a score, so they learn where students ranked compared to one another and compared to students across the state and the nation.
This is of little value to teachers.
This would be like going to a doctor with a pain in your stomach. The doctor gives you a battery of tests and says she will have the results in six months. When the results are reported, the doctor tells you that you are in the 45th percentile compared to others with a similar pain, but she doesn’t prescribe any medication because the test doesn’t say what caused your pain or where it is situated.
The tests are a boon for the testing corporation. For teachers and students, they are worthless.
Standardized test scores are highly correlated with family income and education. The students from affluent families get the highest scores. Those from poor families get the lowest scores. This is the case on every standardized test, whether it is state, national, international, SAT, or ACT. Sometimes poor kids get high scores, and sometimes kids from wealthy families get low scores, but they are outliers. The standardized tests confer privilege on the already advantaged and stigmatize those who have the least. They are not and will never be, by their very nature, a means to advance equity.
In addition, standardized tests are normed on a bell curve. There will always be a bottom half and a top half. Achievement gaps will never close, because bell curves never close. That is their design. By contrast, anyone of legal age may get a driver’s license if they pass the required tests. Access to driver’s licenses are not based on a bell curve. If they were, about 35 to 40 percent of adults would never get a license to drive.
If you are a parent, you will learn nothing from your child’s test score. You don’t really care how he or she ranks compared to others of her age in the state or in another state. You want to know whether she is keeping up with her assignments, whether she participates in class, whether she understands the work, whether she is enthusiastic about school, how she gets along with her peers. The standardized tests won’t answer any of these questions.
So how can a parent find out what he or she wants to know? Ask your child’s teacher.
Who should write the tests? Teachers should write the tests, based on what they taught in class. They can get instant answers and know precisely what their students understood and what they did not understand. They can hold a conference with Johnny or Maria to go over what they missed in class and help them learn what they need to know.
But how will we know how we are doing as a city or a state or a nation? How will we know about achievement gaps and whether they are getting bigger or smaller?
All of that information is already available in the reports of the National Assessment of Educational Progress (NAEP), plus much more. Scores are disaggregated by state, gender, race, disability status, poverty status, English-language proficiency, and much more. About 20 cities have volunteered to be assessed, and they get the same information.
As we approach the reauthorization of the Every Student Succeeds Act — the successor law to No Child Left Behind — it is important to know this history and this context. No high-performing nation in the world tests every students in grades 3 to 8 every year.
We can say with certainty that the No Child Left Behind program failed to meet its purpose of leaving no child behind.
We can say with certainty that the Race to the Top program did not succeed at raising the nation’s test scores “to the top.”
We can say with certainty that the Every Student Succeeds Act did not achieve its purpose of assuring that every student would succeed.
For the past 10 years, despite (or perhaps because of) this deluge of intrusive federal programs, scores on the NAEP have been flat. The federal laws and programs have come and gone and have had no impact on test scores, which was their purpose.
It is time to think differently. It is time to relax the heavy hand of federal regulation and to recall the original purposes of the 1965 Elementary and Secondary Education Act: to distribute funding to the neediest students and schools; to support the professional training of teachers; and to assure the civil rights of students.
The federal government should not mandate testing or tell schools how to “reform” themselves, because the federal government lacks the knowledge or know-how or experience to reform schools.
At this critical time, as we look beyond the terrible consequences of the pandemic, American schools face a severe teacher shortage. The federal government can help states raise funding to pay professional salaries to professional teachers. It can help pay for high-quality prekindergarten programs. It can underwrite the cost of meals for students and help pay for nurses in every school.
American education will improve when the federal government does what it does best and allows highly qualified teachers and well-resourced schools to do what they do best.
One of the BEST pieces I have read about TESTING in American Schools.
YES indeed, the ASSUMPTIONS of high stakes testing are so WRONG.
Sharing this with others. 👍🏽
Thank you, Diane. 🍎
The problem is that we think learning is a science. That is why we think we need to include such words as measure and outcomes to describe whether the students are learning.
I suggest we divorce ourselves from the perception that what we are doing is scientific. This is an art. Like artists, we will not know whether the things we do are successful until generations later, people look back and remember. Who though Bach was magnificent in his day?
Psychology and Sociology….also NOT sciences! They are studies. Yet we allow these quacks to drive education reform with their faux “research”.
What were Bach’s test scores?
Test scores correlate with wealth. Bach got low scores because he was always baroque. Ba dum bump.
Bach was out of Monet. That is why he was Baroque
Back was always baroque
Yet his low ‘scores’ spoke to the woke
Beethoven was a romantic
His work also crossed the Atlantic
oops Bach not Back
Bach was sadly left Back
Cuz he was always Baroque.
Strauss got promoted
Cuz he was so loaded
BTW, I love your doctor and pain in the stomach analogy to standardized testing. It makes the testing conundrum understandable to most people.
Thank you. Analogies and metaphors are good teaching tools.
” Like artists, we will not know whether the things we do are successful until generations later, people look back and remember”
I suspect that Mozartists would agree.
Mozartists would agree if they weren’t still de-composing.
Very clever LCT!
Agreement among Mozartists
Concert of Mozartists
Doubtless is the hardest
When they’re decomposing
After coffin closing
I agree with you mostly…..BUT…..there are MANY parents out there who want to know how their children are “ranked” and “compared” county, state and nationwide by these test scores. I reside in such a district and public schooling here is just dreadful for children, especially boys. Test scores around here drive expensive real estate.
Yes. As Diane points out in her great article, from the very beginning, standardized testing in the US was used to paint a false veneer of scientific respectability onto economic inequality. We’re on top because we are the smartest–the winners in the Race to the Top, the struggle for the survival of the fittest. The guy who invented the SAT was a eugenicist. What standardized testing does most effectively is sort kids by ZIP Code and stamp the imprimatur of the state on the ones with wealthy parents–the ones who had all the advantages.
I live in one of the most ethnically diverse counties in the US, but in my state (MD) my county is the most segregated of our counties……because of wealth and test based accountability. The people here live in a bubble and I don’t feel comfortable living here and I don’t like the effect that it has had on my 2 children.
I have two adopted children of color, and both were grateful when we finally moved to more diverse communities.
Test scores drive expensive real estate because they signal where the affluent families live.
There might be parents who want to compare their children to others. Let’s be honest about their reasons. Many of them might want their children in schools and classes separate from, say for example, whatever is the most recent group of huddled masses yearning to be free. The tests have always been a way to suppress the upward mobility of already marginalized groups of people. That hasn’t changed. De facto segregation is on the rise. Racism is alive and well. Standardized tests play a big part in it. Standardized testing is not progressive reform; it is reactionary regression.
Exactly, LCT!
Advantages of Testing
Compared to udders
Mine are best
Milkmaid shudders
From the test
Like it or not, all parents look at test scores. One of the PEP Members who voted against the G&T contract last week sends her child to a Harlem public school with abysmally low state test scores: 19% scoring 3 or 4 on math (51% citywide average), 26% scoring 3 or 4 on reading (49% average). I think the state tests are a waste of time and money, but those low scores gave me pause. Can they at least bother to look like they are making some effort? Then, you look at the test scores for a neighboring Success Academy: 97% math, 85% reading. I am no fan of charter schools and we all know that Success Academy engages in extensive test prep. However, if you are a parent and you compare those test scores, it’s pretty obvious which school you’d want for your child. You pick the school that looks like they give a damn about education.
Success Academy gets those high test scores by a calculated strategy of: choosing the right kids; getting rid of low-scoring kids; filtering families with kids; intensive test prep; attrition.
When they take the same kids as the neighboring public schools, let me know.
Well, yes, but no.
How many kids in that school are English language learners?
How many are kids living in poverty?
How many have some kind of disability?
How many teachers are certified in teaching kids with those needs?
How many teachers are rookies vs career professionals?
How long has the principal been in the position?
Is the principal an educator or just a designated watchdog?
All of those factors have an impact on test scores.
People are not choosing “the school that looks like they give a damn about education.” They are choosing the school that does not give a damn about racism.
Beth,
Success Academy doesn’t get those scores because of extensive test prep, although that surely helps.
It gets those scores because they weed out the kids who struggle academically. They end up at schools like the Harlem public school you believe have “abysmally low state test scores”. So which school cares more about those kids?
But even at that extremely disadvantaged, “abysmally” low-scoring public school, 1/4 to 1/5 of the students are still performing fine academically, which has never been explained by those who promote charters.
“You pick the school that looks like they give a damn about education.”
You seem to be equating high test scores with caring about education. High test scores equates with caring about high test scores and teaching the kids who will get them for you.
Do you really think that Stuyvesant – with the highest test scores – cares more about “education” than Brooklyn Latin? Do they care more about “education” than Edward R. Murrow, which serves a wider range of students?
My kid went to a public elementary school that was over 50% economically disadvantaged and did not have particularly good test scores at the time (but better than the school you mentioned). Some students struggled and some thrived, and the ones who did well went to the same middle and high schools as those who were in special programs with nearly 100% state passing rates.
That elementary school is now far more affluent and test scores are better. Do you really assume that now it “gives a damn about education” but it didn’t before? That’s just not true.
I don’t assume Harvard “cares more about education” than U. of Virginia because of its’ students’ test scores.
Sorting kids at age 5 is just that – sorting. It isn’t about caring about education. Especially when those who sort are happy to abandon the struggling kids and only teach the ones they want.
All – Like it or not, this is how parents think. If you are against testing and want to see change, it would benefit you to come down from the Ivory Tower and see what goes on at ground level.
Beth, you say “Like it or not, this is how parents think”
Really? Maybe you are in your own Manhattan-centric ivory tower where parents want their kids to be in kindergarten classes where “not good enough” students are counseled out or excluded from so-called “g&t” classes.
I acknowledge that some parents believe that only an elementary school that has the very top test scores is good enough for their 5 year old (they are often the ones obsessed with getting their kids into a citywide g&t Kindergarten class), but many others understand that a school with an 80% state test passing rate is not necessarily better than one with a 50% state test passing rate. I also acknowledge that many parents might pause at a 19% passing rate, but the ones who don’t – like the PEP panel member you cited – usually end up quite happy, and when more affluent students follow, the test scores at those schools rise, too.
Test scores tend to reflect how affluent the population at the school is or whether the school screens incoming students or counsels out students who won’t get high test scores. Outside of affluent Manhattan, many parents with means and education sent their kids to schools that didn’t have especially good test scores and the percentage of students who were proficient on state tests rose. But the earliest group of students who attended those schools when they had much lower state test passing rates received the same education as the ones who came when test scores were much higher and they did as well academically when they attended middle and high schools with students who came from elementary schools with 80% or 99% proficiency rates.
Schools become popular with parents for all sorts of reasons but only a subset of parents would choose entirely based on state test scores and nothing else.
The purpose of government is NOT to allow people to do whatever they please to one another in self-interest. The purpose of government is to enable the people of a nation to live in safety and happiness. All people.
What a great piece, Diane! I particularly love that a) you reiterated in this your history of the origins of standardized testing in eugenics and b) emphasized the pedagogical uselessness of the testing.
I very much hope that your superb article will be widely read and will influence policy! Thank you, thank you, thank you for being such a fierce, knowledgeable advocate of ending child abuse by standardized test!
Here, a companion piece that opens the hood of the standardized state English tests and looks at them closely: https://bobshepherdonline.wordpress.com/2020/03/19/why-we-need-to-end-high-stakes-standardized-testing-now/
Sad to say, but the Democratic leaders of the education committees in House (Bobby Scott of Va.) and Senate (Patty Murray, WA) believe that standardized testing will identify what kids need (they don’t) and increase equity (they don’t) and reduce achievement gaps (they don’t). After 20 years of standardized testing, we should have learned what the tests can do. We haven’t.
All the more wonderful, Diane, that you are there telling the truth, making “good trouble”!
Patty Murray may get a substantial contribution from Bill Gates each time she is up for reelection. Kinda like a scratch on the back.
White males must be very upset now that Asian test takers have surpassed them. I doubt Asian are so much smarter than other groups. Based on what I know about many Asian cultures, students are often trained in test taking strategies so they have learned to game the system better than other groups. Test taking skills mean nothing in the real world. If tests are central and narrow curricula, it is the students that are losing. Students need a rich, comprehensive program with science, social studies, civics, literature and the arts. A rich, varied curricula will better prepare students to face tomorrow’s challenges.
Asians are smarter than other groups in the sense that they recognize what is required to get into the best universities.
It’s the difference between a black jack player who knows how to play and one who does not.
Yup! Some Asians spend a fortune to train students to take tests. They know how to play the game.
SomeDAM Poet….you are exactly correct. Test prep, test prep and more test prep. It doesn’t make the kids smarter….it makes them better test takers> and that’s what I tell my children when they think they aren’t smart enough to hang with the asian kids.
when in-school SAT testing fever hit our low-income school, suddenly teachers were given classes on how to help kids game the test. I kid you not
Is the SAT being used as an exit exam?
It’s not valid for that purpose, even the College Board admits.
I need to point out that asians as a group have consistently had higher High School GPA’s than white, black, or hispanic students since 1990, so this is not new. I don’t think it can explain as the result of test prep expenditures either unless the test prep also increases high school grades. See https://www.nationsreportcard.gov/hsts_2009/race_gpa.aspx?tab_id=tab2&subtab_id=Tab_1
Christine,
The SAT is not valid for any purpose.
No lie.
All the ranking and sorting that standardized tests provide do nothing to improve outcomes for poor students. In fact, when test scores are used to close public schools and students are sent to a private charter school, it does not benefit most students. Disruption and privatization are no magic bullets. When students attend charter schools, they lose their legal protections afforded to them in community public schools. They may also be attending a school that is more highly segregated and operated by education amateurs. The test, punish and privatize syndrome must end as it is not worth the disruption, expense and imposed inefficiency it causes. It is time to provide equity in community public schools that serve the neediest students with wrap around services.
Public schools have tremendous social value as they take all students and a give students the opportunity to forge relationships with all types of students. In a society with rampant income inequality, we need to bring our people together to promote mutual respect and understanding. Privatization separates diverse students, and public schools unite them.
“Privatization separates diverse students, and public schools unite them.”Privatization separates diverse students, and public schools unite them”
Worse, privatization separates communities, Public schools were intended to be, and still are, a unifying force when professionally attended to, requiring well trained teachers and staff.
Public education is to our country as our gut biome is to us. Privatization introduces the bad bugs, that normally exit through the tube of elimination, a poorly nourished gut will let through, leaking into the system, eventually, disrupting healthy integration.
Supplementary probiotics, in the form of well written books and articles are prescribed.
Yes, thank you! A home run. This should shake up the billionaire boys’ and girls’ clubs and the other doctrinaire school privatizers.
You would think it would shake them up, but it won’t. They have their ear plugs and blinders on plowing forward without listening to anyone or anything. They see a profit for testing, not an educational benefit.
If you subscribe to WaPo, go read the comments. It’s deform world in DC and the surrounding counties. They love the ‘data’ and they will portray Diane Ravitch as some voodoo, left wing, nut case. It’s ALL about the profit margins. It’s all about the value of real estate.
Good morning Diane and everyone,
I’ve always had small class sizes but with the in person and remote learning, I don’t have more than 6 kids per class and sometimes I only have 2 or 3 kids in class. I haven’t even given tests in class this year. I can observe that they are understanding and using the material correctly so why waste time with a test? If they need more practice, we do more practice. It’s not that complicated. But what allows me to do this is small class sizes. That’s the key.
Leonie Haimson will love your comment. She has spent years fighting for class size reduction.
Here is the money quote:
” . . . but she doesn’t prescribe any medication because the test doesn’t say what caused your pain or where it is situated.”
Here’s the educator’s version:
A teacher can’t implement any instructional practices to improve student test scores because the scores alone do not identify which items were answered incorrectly and can’t begin to identify the reasons why.
The best a teacher can offer is counterproductive to actual learning: relentless test prep.
In the medical field, this would be the equivalent of mal-practice.
Exactly.
Not only are the scores not disagggregated by standard, and ther are only one or two standards per question anyway, and the standards themselves are often not validly measureable, AND, even if they were (they emphatically aren’t), the scores arrive too late to be of any use.
The ignorance of these “facts on the ground” among policy makers is profound. I’m pretty sure that most of the politicians who vote on this junk never read one of these tests. So, they are voting from a place of complete ignorance and listen only to the meretricious pundits whose money flows from the oligarchs who love the standardized testing sorting mechanism.
I administered every grade 8 ELA test from the inception of NCLB up to spring 2019 (the last administration). Based on my professional observations, the tests had almost nothing to do with fundamental reading comprehension. They were poorly constructed, in large part because of mostly subjective standards that targeted vague concepts and soft (immeasurable) skills. Add a dash of arbitrary cut scores intended to produce hyper-failure rates and voila – a toxic recipe for politicizing the failure of public education.
In my middle school, the passing rate for the grade 8 ELA test hovered around 33%. Yet when those same students took the federally mandated grade 8 science tests, (1 hr. lab test, 2 hr. written), passing rates doubled! The bulk of the 3 hour long battery of science tests required in inordinate amount of technical reading. How is that possible for a cohort with a 67% failure rate in ELA?
Magic
States change these cut scores according to the political winds. If they want to implement a reform, they will set high cut scores and point to them and say, “How terrible! We need to x.” If they want to say that their reform succeeded, they set the cut scores low and say, “Look how well we did because of x.” I did a graph over time, a few years ago, of the cut scores for the ELA and Math exams. They jumped around like gerbils on methamphetamines. In some years, the cut scores for math were barely above what kids would have gotten via random guessing. Another aspect of the scam.
I forgot to mention that the cut scores–the difference between levels–is completely subjective and arbitrary.
How do you know what gerbils on amphetamines are like?
Do you have personal experience?
So glad you asked, SomeDAM. No. This is pure speculation. However, I have seen spiders on meth and LSD, in a laboratory at Indiana University.
Look out when spiders start Breaking Bad. A spider on meth has the moral compass of Stephen Miller.
Steve Miller is indeed pretty immoral. In a class with another p***ygrabber
Abraabracadabra
I wanna reach out and grab ya
We’re out fighting the good fight against MCAS, Massachusetts’ state test. Governor Charlie Baker, who counts the Waltons among his donors, is adamant about testing kids this spring. Here’s a rebuttal from retired teacher and principal Bill Henderson, whose career in Boston Public Schools spanned 36 years. Henderson became blind about ten years into his career and went on to found an innovative and quite sucessful inclusion school, where students with a range of disabilities are included in their classes with non-disabled kids.
Most people in Massachusetts recognize MCAS as the Massachusetts Comprehensive Assessment System, which public schools use to test students in a variety of subjects from grade 3 into high school. In these times, though, students also desperately need another kind of MCAS from their educators– More Compassion, Assurance, and Support.
https://www.dotnews.com/2021/heres-different-kind-mcas-more-compassion-assurance-support
The MA State Ed department has had blinders over their eyes for a very long time now.
When I lived in mA decades ago, StatecEd Commissioner David Driscoll was pushing MCAS.
The Boston Globe reported the case of a high school student who had had to retake the test a couple times in order to graduate because her score fell just below the cut score but within the standard error reported for individuals taking the test.
I wrote several letters to Driscoll pointing out that what the state was doing — failing those whose score fell within the uncertainty for the test — was invalid EVEN BY THEIR OWN claimed methodology (ie, according to their reported statistics)
But it was all for naught (a waste of my time)
Despite being a former high school math teacher, Driscoll either did not read my letters or did not understand the concept of test score uncertainty.
Of course, this does not even get into the validity of the test itself.
But the fact that they were failing someone when their own stats did not allow them to legitimately do so made it quite clear that the state Ed department had absolutely no clue what they were doing.
I left MA shortly thereafter and quit following the MCAS issue so I’m not sure whether they ever got a clue.
Not incidentally, the issue of “uncertainty” keeps rearing its head. The latest examples are claims of covid test positivity that are smaller (in some cases much smaller) than the uncertainty of the test.
Apparently, even some people who should know about it don’t understand statistical uncertainty.
Nope, never got a clue.
The legislation from 1993 which implemented MCAS also enabled the first charters, under the patrician Republican Bill Weld. They called it “The Grand Bargain” and under it localities gave up some of their autonomy in exchange for more money, tied to “oversight” from the state. We did get money for 7 years, then it dried up. The legislators who pulled it off have gotten sinecures with privatizers.
In 2019, activists managed to pass the Student Opportunity Act, which restored the “foundational budget” for poor cities lacking property taxes to properly support their schools. Baker has dragged his feet on the funding, long enough so that, with covid, we are now in year two of the agreement, but with no funds yet. The tests must continue unabated because how else can the charters live long and prosper?
Diane,
If
“…standardized tests are normed on a bell curve.”
Is the National Assessment of Educational Progress (NAEP) on a bell curve as well?
If it is, how can NAEP accurately measure any academic gap?
Yes, NAEP–like all standardized tests–is normed on a bell curve.
But NAEP–unlike the state tests mandated by federal law–has zero consequences for students, teachers, or schools. No one is labeled “failing” based on NAEP scores. It measures trends.
No one can prepare for NAEP tests because no one knows who will take them.
No single student takes the entire test because they are a composite of many students in the grade.
NAEP is a no-stakes test.
If we want to see trends, NAEP has the information we say we want.
Diane,
Thank you for answering my question. And I have one last question.
NAEP scores as posted, are they Bell Curved?
If the question is identical to the question I already asked I apologize.
I have always considered norming a test to be different than the published results. In part because of the different scaling systems used. Like the ones, I see in state results for, New York, Florida, Georgia, and California. And the consistent scaling systems used for NAEP, SAT, ACT, and international assessments.
Life is hard enough when students sit down to take a standardized test, and they become part of a five-way intersection round-about vortex of human-error, and curving the results is a lie they do not deserve.
bkendall I know you didn’t ask this, but just to expand on it: state-standardized tests (normed to bell curve like all stdzd tests) ergo could at best [if well-designed, which many aren’t] show state trends, maybe regional trends within the state. Yet they are used via ‘accountability systems’ mandated by fed govt as though capable of comparing one student’s achievement to another’s, one school’s to another’s, one teacher’s to another’s.
bethree5, I ask questions to learn. And I appreciate any sincere honest offer to expand the depth and breath of my knowledge.
Thank you!
The I.Q. test was applied to the screening of recruits for World War I, used to separate the men of high intellect — officer material — and from those of low intellect, who were sent to the front lines.”
And the smartest ones didn’t have to go to war at all.
Does that mean IQ resides in bone spurs?
Diane and Valerie at the Washington Post. Thank you for this superb presentation on the history and abuses of standardized test scores. They are useless in exactly the way you illustrate, and with the results of medical tests on humans a brilliant example. The same people who are pushing for these tests also fund the corrupt ratings of schools at Great Schools.org where Zillow is a prime client.
Isn’t it interesting that there always seems to be a loop with a corporation at the beginning and end and schools in the middle?
Raj Chetty strikes again! This time, with a study arguing that fewer people should be eligible for COVID relief.
http://americanprospect.activehosted.com/index.php?action=social&chash=b337e84de8752b27eda3a12363109e80.553&s=ed75e9d2b1158e079db5b5129446ebfc
From David Dayen of The American Prospect:
The answer to the why is largely predicated on a study from Raj Chetty and his group Opportunity Insights, which attempts to turn an obviously political imposition (to allow moderate Democrats to say they had a role in scaling back the bill) into an evidence-based one. This study is playing an outsized role in the debate, all the way up to the White House. There are several major problems with using Chetty’s data to make the case for more stinginess on the direct payments, however.
The Opportunity Insights analysis looked at how families used the most recent $600 direct payment in January. They found that households with incomes under $46,000 saw their spending increase by 7.9 percent in the two weeks after receiving the checks, while those with incomes over $78,000 had spending increase only 0.2 percent. They estimate that those higher-income households would spent almost none of the $1,400 checks, and therefore that money should be better targeted.
The first problem is that, deeper in the data, the spending effect holds up for households up to $59,000. Yet any single households over $50,000 in the proposed targeting would get less money, despite the data showing that they need it enough to use it immediately, in the first couple weeks, after receiving it.
Support Independent, Fact-Checked Journalism
The second, and much bigger, problem, is that the data really only tells you that there’s dire need below $59,000. The reason that these households would spend quickly relative to higher-income ones is that they are running a severe deficit and need that money to fill immediate needs. Just because slightly higher-income households aren’t spending as quickly doesn’t mean the money won’t be used.
Remember that the checks in the study came in at the beginning of the month. By the end of the month, those higher-income households might need that money to pay bills, or buy durable goods. Or maybe they drew down savings to cover for lost income during the pandemic, and now they’re building it back up. Would that be a “waste,” to allow people to accumulate emergency funds? Would it be a waste to allow families to pay down debt? The fact that these households don’t spend the very moment they receive a check says nothing about whether or not it’s good policy.
Yup. The loop is that corporations are backed by lots of money with paid lobbyists that swirl around and overwhelm any newly elected representative with campaign donations. Their influence is the one sided echo chamber.
VAManujan should be eligible for remedial mathematics courses.
I think that the American Prospect is conflating two policy goals. If the policy goal is to stimulate spending in the economy, we should be giving checks to the people who are most likely to spend the money. If the policy goal is to improve the wellbeing of many households, then it does not matter if the household spends the money or not. As the American Prospect correctly says, having less debt or more emergency savings improves the welfare of a household. It does not, however, stimulate spending.
The American Prospect is criticizing research that looks to find the most cost efficient way to stimulate spending in the economy because it was not research to find the mosts cost efficient way to increase the welfare of households. That criticism seems illegitimate to me.
Teaching Economist is just creating a straw man argument when he implies that the only (or even primary) goal of the ” covid relief” bill currently being debated in Congress is ” stimulating spending in the economy”
Poor TE just can’t countenance any criticism of his math-challenged hero , VAManujan
Looks like none of the Democrats in the Senate were dumb enough to buy into VAManujan’s BS.
They just passed the covid relief budget reconciliation bill with not a single clown…I mean Republican vote.
Poor VAManujan.
Only idiots take him seriously these days
VAManujans days of being celebrated and quoted by Democratic Presidents would seem to be over.
Now all he has left is a band of monkeys fawning over his “research”.
Overripe Chetty’s
His fifteen mins are over
And fame has passed him buy
So set him out to clover
The has-been Harvard guy
Put him out to pasture with Rogoff, Reinhart, Mankiew, Friedman, Fryer and the rest of the Harvard econ has-beens.
Thank you, Laura!
Purrrfect.
In statistics, that’s called the Student’s Tree Test
And my money is on the fish.
…so are we testing this year?
That decision will be made by Secretary Cardona, who will decide whether to grant waivers to states that ask for them. Some states want them, some don’t.
This country can spend an additional one trillion dollars on public education beginning today – targeted at Kindergarten – 3rd grade, and in 4 years, 50% of the 3rd grade students will test below the median score on a standardized test.
This country can close down all schools right now and spend $0 and in 4 years, 50% of the 3rd grade students will test below the median score on a standardized test.
Half of the student population will always test below the median score on a standardized test.
The only question is how those tests are manipulated and how those in power decide whether the top 50% of all scores are “proficient”, whether the top 75% of all scores are “proficient” or whether only the top 25% of scores are “proficient.”
Education pundits love to extol such “multiple guess” tests for allowing them to “mine the data,” “drill down” for supposed revelations, or get purported “granular” information. But my guess is there’s no “there” there–or none that a well-trained, well-paid teacher can’t get in a half hour’s good conversation with pupil and/or parents. Kudos to Diane Ravitch for her uncommon common sense and vast knowledge.
Thank you, Thomas. In addition to its many other deficiencies, the bubble test teaches simplistic thinking. Most decisions in life don’t have one right answer. The thoughtful student learns to think of good questions, not the right answer.
Thank you for providing enriching historical evidence about standardized testing. It’s really helpful to understand how testing can be used and abused for wrong purposes and draw a devastating consequence in teaching and learning. I think this is true regardless of any country.
I am very skeptical of any type of standard testing, whether it’s language arts, math, or foreign language. I’m from Japan, a country where many people consider its public education is excellent– except for English as a foreign language. Even though there’s no move for privatizing education like the US, Sweden, Chile, and some other countries, Japanese government is establishing the channels to lure private corporations and consultants linked with Education Ministry for years. They are throwing tons of money into flawed language assessment tools and bogus testing centers for college-bound students, which will help no one but lawmakers and private education establishment. They justify their scheme as part of education for ‘globalization,’ yet what they are basically doing is giving tablets and textbooks written by those who do not really have teaching/research experience in second language/linguistics. And measure progress for students and teachers by using standardized language proficiency test such as TOEIC that has no value for assessing language skills in a broader context. This doesn’t lead to any improvement of language fluency and literacy for both students and teachers.
What’s more problematic is that Japanese education ministry is creating an assessment system that converts learning into quantifying measures so that they can apply it to any academic subject, that includes “moral education.” It’s really chilling to see the state use and abuse the metrics in this manner, because students are already getting screwed with flawed English language education and rigid learning system fettered with examination ordeals. To anyone interested in Japanese education, I always say to them, “You can forget about diversity and equal education because 99% of students are ethnic Japanese. Many Japanese schools don’t even bother mentioning discrimination against minority students because they don’t believe there is racism in Japan, which is ludicrous.” Students of non-Japanese and biracial students are the ones who are labeled as “inferior”–or even worse, wrongly diagnosed as “development disability”– with racialized practice of standardized testing and assessment. And don’t even mention equity. It only flies in the face of obsession with academic meritocracy that is widening the gap between students of mid-income and wealthy family and students of working poor.
Ken,
That’s a terrifying report from a nation that used to claim to value creativity and moral development. Metrics crush those.
A Nation At Risk
A tide of mediocrity
Among the class of pols
The purest kakistocracy
Bureaucracy of trolls