The news reports say that the test scores of American students on the latest PISA test are “stagnant,” “lagging,” “flat,” etc.
The U.S. Department of Education would have us believe–yet again–that we are in an unprecedented crisis and that we must double down on the test-and-punish strategies of the past dozen years.
The myth persists that once our nation led the world on international tests, but we have fallen from that exalted position in recent years.
Wrong, wrong, wrong.
Here is the background history that you need to know to interpret the PISA score release, as well as Secretary Duncan’s calculated effort to whip up national hysteria about our standing in the international league tables.
The U.S. has NEVER been first in the world, nor even near the top, on international tests.
Over the past half century, our students have typically scored at or near the median, or even in the bottom quartile.
International testing began in the mid-1960s with a test of mathematics. The First International Mathematics Study tested 13-year-olds and high-school seniors in 12 nations. American 13-year-olds scored significantly lower than students in nine other countries and ahead of students in only one. On a test given only to students currently enrolled in a math class, the U.S. students scored last, behind those in the 11 other nations. On a test given to seniors not currently enrolled in a math class, the U.S. students again scored last.
The First International Science Study was given in the late 1960s and early 1970s to 10-year-olds, 14-year-olds, and seniors. The 10-year-olds did well, scoring behind only the Japanese; the 14-year-olds were about average. Among students in the senior year of high school, Americans scored last of eleven school systems.
In the Second International Mathematics Study (1981-82), students in 15 systems were tested. The students were 13-year-olds and seniors. The younger group of U.S. students placed at or near the median on most tests. The American seniors placed at or near the bottom on almost every test. The “average Japanese students achieved higher than the top 5% of the U.S. students in college preparatory mathematics” and “the algebra achievement of our most able students (the top 1%) was lower than that of the top 1% of any other country.” (The quote is from Curtis C. McKnight and others, The Underachieving Curriculum: Assessing U.S. Mathematics from an International Perspective, pp. 17, 26-27). I summarized the international assessments from the mid-1960s to the early 1990s in a book called National Standards in American Education: A Citizen’s Guide (Brookings, 1995).
The point worth noting here is that U.S. students have never been top performers on the international tests. We are doing about the same now on PISA as we have done for the past half century.
Does it matter?
In my recent book, Reign of Error, I quote extensively from a brilliant article by Keith Baker, called “Are International Tests Worth Anything?,” which was published by Phi Delta Kappan in October 2007. Baker, who worked for many years as a researcher at the U.S. Department of Education, had the ingenious idea to investigate what happened to the 12 nations that took the First International Mathematics test in 1964. He looked at the per capita gross domestic product of those nations and found that “the higher a nation’s test score 40 years ago, the worse its economic performance on this measure of national wealth–the opposite of what the Chicken Littles raising the alarm over the poor test scores of U.S. children claimed would happen.” He found no relationship between a nation’s economic productivity and its test scores. Nor did the test scores bear any relationship to quality of life or democratic institutions. And when it came to creativity, the U.S. “clobbered the world,” with more patents per million people than any other nation.
Baker wrote that a certain level of educational achievement may be “a platform for launching national success, but once that platform is reached, other factors become more important than further gains in test scores. Indeed, once the platform is reached, it may be bad policy to pursue further gains in test scores because focusing on the scores diverts attention, effort, and resources away from other factors that are more important determinants of national success.” What has mattered most for the economic, cultural, and technological success of the U.S., he says, is a certain “spirit,” which he defines as “ambition, inquisitiveness, independence, and perhaps most important, the absence of a fixation on testing and test scores.”
Baker’s conclusion was that “standings in the league tables of international tests are worthless.”
I agree with Baker. The more we focus on tests, the more we kill creativity, ingenuity, and the ability to think differently. Students who think differently get lower scores. The more we focus on tests, the more we reward conformity and compliance, getting the right answer.
Thirty years ago, a federal report called “A Nation at Risk” warned that we were in desperate trouble because of the poor academic performance of our students. The report was written by a distinguished commission, appointed by the Secretary of Education. The commission pointed to those dreadful international test scores and complained that “on 19 academic tests American students were never first or second and, in comparison with other industrialized nations, were last seven times.” With such terrible outcomes, the commission said, “the educational foundations of our society are presently being eroded by a rising tide of mediocrity that threatens our very future as a Nation and a people.” Yet we are still here, apparently the world’s most dominant economy. Go figure.
Despite having been proved wrong for the past half century, the Bad News Industry is in full cry, armed with the PISA scores, expressing alarm, fright, fear, and warnings of imminent economic decline and collapse.
Never do they explain how it was possible for the U.S. to score so poorly on international tests again and again over the past half century and yet still emerge as the world’s leading economy, with the world’s most vibrant culture, and a highly productive workforce.
From my vantage point as a historian, here is my takeaway from the PISA scores:
Lesson 1: If they mean anything at all, the PISA scores show the failure of the past dozen years of public policy in the United States. The billions invested in testing, test prep, and accountability have not raised test scores or our nation’s relative standing on the league tables. No Child Left Behind and Race to the Top are manifest failures at accomplishing their singular goal of higher test scores.
Lesson 2: The PISA scores burst the bubble of the alleged “Florida miracle” touted by Jeb Bush. Florida was one of three states–Massachusetts, Connecticut, and Florida–that participated in the PISA testing. Massachusetts did very well, typically scoring above the OECD average and the US average, as you might expect of the nation’s highest performing state on NAEP. Connecticut also did well. But Florida did not do well at all. It turns out that the highly touted “Florida model” of testing, accountability, and choice was not competitive, if you are inclined to take the scores seriously. In math, Florida performed below the OECD average and below the U.S. average. In science, Florida performed below the OECD average and at the U.S. average. In reading, Massachusetts and Connecticut performed above both the OECD and U.S. average, but Florida performed at average for both.
Lesson 3: Improving the quality of life for the nearly one-quarter of students who live in poverty would improve their academic performance.
Lesson 4: We measure only what can be measured. We measure whether students can pick the right answer to a test question. But what we cannot measure matters more. The scores tell us nothing about students’ imagination, their drive, their ability to ask good questions, their insight, their inventiveness, their creativity. If we continue the policies of the Bush and Obama administrations in education, we will not only NOT get higher scores (the Asian nations are so much better at this than we are), but we will crush the very qualities that have given our nation its edge as a cultivator of new talent and new ideas for many years.
Let others have the higher test scores. I prefer to bet on the creative, can-do spirit of the American people, on its character, persistence, ambition, hard work, and big dreams, none of which are ever measured or can be measured by standardized tests like PISA.
Most excellent assessment.
Sure wish common sense instead of politics ruled education.
“if pigs could fly”, then politics would not trump education and Arne would be shilling for some other sauce maker. Time will tell, .
As usual, an excellent rebuttal.
There’s also a good article at the washingtonpost.com Valerie Strauss site supporting everything that Diane has stated. http://www.washingtonpost.com/blogs/answer-sheet/wp/2013/12/01/how-public-opinion-about-new-pisa-test-scores-is-being-manipulated/
Looking at the average scores of U.S. schools with less than 10% free or reduced lunch then:
U.S. schools are second behind Shanghai in Reading and Science and sixth behind some Chinese Cities, Singapore and Korea in Mathematics. When the schools with high percentage of free and reduced lunch get factor in, the ranking falls.
The conclusion should be that the United States educates more children in poverty than those with higher rankings!
Anyone have a quick answer for “how much of the variance in test scores is explained by free/reduced lunch status”?
Emmy, the way I understand it is that we have no information on income levels of schools other than ours. We only have a general knowledge of income levels of areas such as Singapore.
Dr. Baker released a graph today of the relationship of Pisa scores and relative poverty level. It is as one expects, low poverty-high scores, high poverty – low scores!
http://schoolfinance101.wordpress.com/2013/12/03/graph-of-the-day-my-contribution-to-pisa-palooza/
It seems to me that, as we undermine earning capacity for more and more families, :including those with college degrees, we will continue to increase poverty. So, that should contribute to lower test scores in the future. Since lower incomes produce lower test scores and higher incomes produce higher test scores, we need to reduce poverty. Yet we are increasing poverty. So why aren’t Gates and friends investing in jobs? It is not poor education but poor living conditions and lack of hope that brings down this country.
Thank you Dr. Ravitch. With all due respect, most of the things you mentioned anyone with a creative mind can decipher. Looking from below (quite literally from Puerto Rico) I can always count on human nature to show its true colors. The actions of the past reveal the truth no matter what comes from the mouth.
Jose, what may seem obvious to you is not obvious to many others–whether in the news media or the government. A historical perspective grounded in facts helps see the current situation wisely.
“A historical perspective grounded in facts helps see the current situation wisely.”
And yet another beautifully stated reason to support liberal arts type full, rich curricula for all students.
Thank you, Diane!
Soooo…. are you saying that since we have always been mediocre, it’s OK to be mediocre?
Jenny McPhee, I don’t think you read what I wrote. I am saying that the tests don’t measure what matters most. We are not mediocre. We are the most powerful nation on earth. We should nurture the qualities of heart, mind, and spirit that have created the best in our civilization. Standardized tests don’t do that. Read it again. If you feel we are a mediocre nation, we disagree.
Lemme guess, you’re a product of No Child Left at the Top? Shows in your reading comprehension.
Ahhh… First the deflection, then a personal insult. I’m not writing about being a mediocre country… Instead it is the mediocre test scores I am writing about. As for the insult, it’s not worth replying to.
Creativity is good. It gave me the iPod I use daily to listen to some great music every day.
But creativity alone does not cut it. The questions on the PISA are – at most – basic Algebra. Yes, the Algebra is presented in a different way that what students see in their textbooks. Isn’t that what creativity is? Shouldn’t students be able take what they know and apply it when it is needed?
If I have the most creative idea in the world, but not the knowledge to carry it out, what good is the idea?
Rather sad that you think that scoring well on the PISA has anything to do with implementing creative ideas.
Jenny,
First, please define what you mean by “mediocre”? Thanks in advance!!
Second, have you read any peer reviewed critiques of the whole process of making, giving and disseminating the results of educational standards and the accompanying standardized testing? If so, then what are your rebuttals/refutations of those studies? Again, thanks in advance!
When you answer those two questions we can continue the conversation.
Duane
Mediocre is average. As a country, we can do better. Right?
Why do I need to refute the test and dissemination of the results? Data is what data is. You can either do something about it, or complain that the test is unfair. I choose to do something.
Jenny,
Please define what you mean by “mediocre”. You haven’t defined it so. . . .
What is data?
So far you have not answered the questions. Please do.
Jenny McPhee,
The test is not unfair. It is meaningless in relation to the future of our economy. Our future depends on innovation and imagination, not picking the right bubble on a test. How many jobs are available for bubble-pickers?
JMP,
“You can either do something or complain ….”
False choice. A logical fallacy.
What we are doing is attempting to point out that this “data” is meaningless or perhaps has a very limited meaning when discussing teaching and learning.
But you know that, right?
We’re not Lake Wobegon. All of our children are not “above average.” If the PISA scores are on a curve (I don’t know that they are), then it doesn’t matter how much kids know. Most will ALWAYS be average, because that is how the curve works.
And let’s not even discuss how we include students with disabilities and English Language Learners FAR more often than many other countries. By definition, students with special needs will bring our scores down. I’m not saying that’s a problem, it’s just a fact.
You haven’t defined what mediocre is.
First identify that and we’ll go from there!
Again, thanks in advance!
Duane, you asked me three times to define mediocre. I answered your question after the first time. Why do you continue to ask a question that was already answered?
Diane,
I respect you and what you do. But, here’s a test that tells us our tenth graders aren’t scoring well on ninth grade math. It’s not about filling in bubbles. It’s about having the basic knowledge to be successful.
I know the current trend is that all standardized tests are bad. In isolation, yes, they are. But we can use them with other data points to help us improve education.
The problem with most math tests is that they are not a test of a students ability to calculate. Instead, they are a reading test in which calculations must be completed to determine the correct answer.
Most problems with learning begin very early, 1st or 2nd grade. If a student is a struggling new reader at that age, then they will be a struggling learner for a long time. The foundation is reading. If a person can not read then the rest is meaningless.
KrazyTA, as always, to lend a hand. In this case as a bilingual TA…
English-to-English translation: like others of its ilk, the latest round of PISA doesn’t tell us whether students will be successful at anything other than taking PISA tests.
In other words, meaningless if we are trying to determine anything about “success” except when defined as being successful at taking another round of the same test.
$putnik, anyone?
😎
Another who lets idiology blind them.
(purposely misspelled)
You can’t have it both ways. You can’t say the scores are worthless and then use them to bash education programs you don’t like. Here is my take on how are public schools can and do close the achievement gap through diversity. http://systemschangeconsulting.wordpress.com/2013/11/27/closing-the-achievement-gap-through-diversity/
You clearly don’t understand a subtle argument. The reform claim is that test matter and the so called reforms will boost scores. The reforms have clearly failed to do so. Reformers such as yourself have failed on what you have promised using the methods of testing. The reform movement chose the measurement and failed to deliver. The most reform minded states do the worst on these measures. That should tell you something, try something else. After more than a decade your methods, systemchangeconsulting, are a dismal failure. The tests are meaningless, we should not obsess over them. We should go back and adopt the Finnish notion of education; find a student’s talents and nurture them. Then help them find their place in society. We should not be defining their pigeon hole and doing the work of business and providing job training for free after we have subsidized them through tax subsidies and food stamps for their employees. I suggest that we need fewer consultants that have failed us..We need to refocus on what made us successful and renew a commitment to a first rate education for all, and I do not mean rigorous inappropriate tests for all. Being number one in test world doesn’t mean a thing in the real world. Life is not a multiple choice test.
Standing ovation.
My methods? Did you read my blog? Apparently not, because while I believe that testing has some value, my entire blog was about enriching students through diversity. So, please save your insults for others.
My point to Diane, is that she and other anti-testers, can’t complain about testing and then use the test results to bash the testers.
THIS!
In case it is not obvious, my comment was in response to Old Teacher and in agreement with Dienne.
@systemchange. Why not? The reformers set the metric themselves. In order to find out if recent reforms have been successful, we need to look at any changes since the reforms were implemented. I could be sympathetic to “we haven’t had enough time” or even “we prevented even further decline” arguments (given adequate evidence) but the reformers themselves set the international tests as the metric.
SCC,
“My point to Diane, is that she and other anti-testers, can’t complain about testing and then use the test results to bash the testers.”
Basically, I agree because the tests have no validity whatsoever.
As an “anti-tester” I, in echoing Wilson, believe that since these tests have no validity whatsoever, why use them???
Have you read Wilson’s “Educational Standards and the Problem of Error”. If so, please provide a rebuttal or refutation as to why we should even begin to use those educational malpractices to judge anything. If not, I invite you to read and understand it. If you have any questions about the study, I’ll be more than happy to help you understand it!
Thanks,
Duane
Thanks for the suggestion. I haven’t read the book. I’ll check into it.
Brilliant article, Dr. Ravitch! Here’s hoping that this one goes viral. Readers of this blog, please do what you can to make that happen!
Time To Think Outside The Bubble …
This was posted in Forbes complete with links to some observations. This should not be squelched by testing companies and data collection. If anything, the imparted devaluation of the teaching profession needs to be recognized for the negative impact that squelching autonomy, creativity, and success has had on far too many lives.
http://www.forbes.com/sites/cherylsnappconner/2013/11/18/mentally-strong-people-the-13-things-they-avoid/
Systemschangeconsulting, when you say “diverse” you appear to mean “African-American”.
Are you aware of the the phenomenal rate of improvement of African American students on the NEAP scores in the last 20 years. Bob Somerby points out:
Score gains, black students, 1992-2013
National Assessment of Educational Progress
Grade 4 math: 37.04 points
Grade 8 math: 26.61 points
On the NAEP scale, ten points is often compared to one academic year. We regard that as a very rough rule of thumb. But it’s often applied by ‘education reporters’ when it can be used to spread the gloom about our achievement gaps.
Does that look like an embarrassing decline? On average, our black kids have a long way to go. (Don’t we all? Many black kids are doing brilliantly, of course.) But that doesn’t look like any kind of K-12 “decline” to us.
***
Guess what? Scores of white students have improved, too. So they are still ahead. There is still a gap. This is deplorable.
Nevertheless, the idea that American schools are in decline because of rotten teachers is not true and has never been true. That does not mean that we do not need improvement, but the last thing we need to do is further de-fund our schools, disrespect our teacher and take away their job protection, and hand over educational policy to the malefactor-of-great-wealth class and their clueless relatives and cronies in the media and (money-laundering) Think Tank business.
If you read my blog post and looked at the picture of the incredibly diverse group of East High School kids, you will see that I do not equate diversity with one race.
Harold:
The sizable improvement on NAEP is noteworthy. However, and this goes for looking at the PISA scores as well, these relative movements in scores actually contain minimal information. We really need to look at absolute standards. For example, at a practical level, we might have a view as to what percentage of 12th Graders should be able to (a) determine whether their paychecks have been correctly calculated; (b) calculate the total annual cost of owning a car; (c) how much to charge for painting a store front or a house; (d) summarize in writing what happened during a traffic accident or sports event; (e) summarize in writing the arguments for and against the use of grades in school.
More abstractly, we might have a position on the percentage of 12th Graders who can answer the following questions from the NAEP correctly?
a) Identify when two lines are perpendicular (you pick from four image of two lines intersecting)
b) What is the sum of the interior angles in a rectangle (you pick from four equations)
c) What is 200% of 30 (you pick from 4 answers)
d) Solve f(z)= z +8 for f(6) (you pick from four answers)
Note that these are labeled easy questions on the NAEP for 17 year olds.
Here are some questions from the standard matriculation exam in Mathematics for Finnish students.
1. Solve the inequality (2/3)*(x + 1/4) < (1/5)*(x – 1/4)
2. A cube is divided into 64 smaller cubes. Find the edge length (cm) of a small cube provided that the volume of the original cube is 1000 cc.
3. Find the area of the region bounded by the line y = 3*x – 2 and the parabola y = x^2 – 2
4. Find the points (x0,y0) on the curve y = x^3 – 2*x^2 + x – 1 such that the tangent line of the curve through (x0,y0) intersects the x-axis at 45o.
5. The regulations of a commune state that no house can be constructed closer than 100m to the shore. An island, shaped like an equilateral triangle and 5ha (ha = 10000 sq meters) in area, lies in the commune. Is one allowed to construct a house on the island?
What % of US 12th Graders should be able to answer each of the above questions?
Without knowing the actual content of the standardized tests like PISA, NAEP, TIMMS, SAT, AP, etc., we cannot gauge whether the collective performance of students is where we would like it to be.
Personally, I would prefer to see the results for questions that we expect close to 100% of an age cohort to answer correctly. It is like trumpeting that we won more Olympic Gold Medals than anyone else, while our obesity rate is also the highest.
Bernie,
Who determines what is an “absolute standard”?
What is an “absolute standard”? Please define.
Thanks,
Duane
Duane:
You can take your pick as to who sets the benchmarks: A group of teachers of the subject at the target grade level, subject matter experts, parents, test publishers, you and me. It is not really relevant so long as the standards are explicit and can be discussed and understood.
I meant absolute in the sense of the % getting an item correct rather than the average score across items. Test scores are the average across items and as with all summary measures you lose important information.
>bet on the creative, can-do spirit of the American people, on its character, persistence, ambition, hard work, and big dreams
We don’t hear talk of this attitude from teachers. We repeatedly hear them describe trying to teach a generation of students who don’t want to work, don’t want to think, and don’t care.
The occasional Steve Jobs notwithstanding, the typical worker needs basic skills, and employers hire workers one at a time, not based on national averages. High tech companies like Google and Microsoft continue to clamor for more H1B visas because they need to hire qualified workers and they find it easy to show that they have taken “good faith steps” but been unable “to recruit U.S. workers for the job for which the alien worker is sought”. (US Dept. of Labor certification requirement)
The US can live on its past glory, but these modern kinds of jobs are not the same as were being filled only a generation ago.
Our takeaway, at minimum, is that these tests are the writing on the wall.
Finally, while we agree that poverty is a major contributor to problems in education, it is interesting to note that Viet Nam, a country not known for its wealth, and torn to shreds almost a half century ago by its civil war, in which the US had a central role, exceeded the US in all three areas of PISA: mathematics, reading and science.
Not everyone in Vietnam gets to go to school, they also pick who takes these tests, a common practice in communist parts of Asia.
Your comments sound exactly like “A Nation at Risk” in 1983.
“Typical workers” in the U.S. have more than the “basic skills” Microsoft and Google need – witness the number of U.S. workers who were, in fact, doing exactly what Microsoft and Google wanted. The problem is that U.S. workers generally expect to be paid a living wage, which is what your ilk wants to beat out of them by starting early with this testing and failure regime. Workers should understand from the get-go just how lucky they are that their betters like Bill Gates are even willing to let them lick their boots.
Go take your neoliberalism elsewhere. No one here is buying.
Game, set, match to Dienne
Thomas J. Epenshade (2001) of Princeton University says that “the higher quotas on H1-B visas [were] a response more to pressure from special interest groups than to solid evidence of a skilled labor shortage” and that better data are needed with regard to the skills of the American workforce.
Interesting. I remember sitting in a staff-development a few years ago, looking at a dismal graphic showing U.S. performance compared to other countries (namely Asian). It was the first time I’d heard the story of our impending doom. As a young mother and teacher, it scared the wits out of me. I wish I had known then that we were being presented with only a partial look at reality. I also remember hearing that U.S. business leaders were having to look outside the U.S. To hire people with the needed skills. I took that statement at face value. Now, I’d love to know the truth behind it, other than that it was intended I induce fear.
Bookworm, I believe that the corporations who can’t find qualified workers are looking for an excuse to outsource jobs to low-wage countries. And blame it on the schools.
CCSSIMath said: “High tech companies like Google and Microsoft continue to clamor for more H1B visas because they need to hire qualified workers and they find it easy to show that they have taken “good faith steps” but been unable “to recruit U.S. workers for the job for which the alien worker is sought”. Sorry, the only reason the big corporations are seeking H1B visas is to replace American workers with cheaper foreign workers. There are tons of qualified and capable US workers clamoring for jobs but they want to be paid good wages with good benefits, how dare they. Google and Microsoft have the US workers train the H1B visa people and then fire the US workers once the training of the cheaper worker is done. This whole garbage that there are not enough qualified US workers is a stinking lie and propaganda to insource and outsource and to stab US workers in the back.
Re: supposed lack of highly-qualified STEM graduates, read about the glut of US STEM graduates & their difficulty in finding jobs in industry organ IEEE Spectrum Sept 2013 issue. The econ.board stats show a surplus of U.S. born and trained tech and engineering grads, which explains why salaries are stagnant in engineering (w/ a few specialty exceptions), programming, technology… BUT companies want younger, cheaper, ‘more motivated’ , loyal workers. (Note most H1-B hires come from low-wage countries, mostly India). Hence the push for more H1-B visas.
Agree that PISA, as any test, must be looked at with a sober mind. But must disagree that Baker did an extensive analysis: he ‘just’ calculated some correlations. See http://216.78.200.159/RandD/Phi%20Delta%20Kappan/International%20Comparisons%20-%20Baker.pdf
PISA, like other assessments, is useful to see that Socio-Economic Status has a big influence on achievement.
I also agree with the comment that if PISA is not to be taken to seriously then don’t use them as ‘proof’ that the US is on the wrong way.
Diane,
The release of NAEP, TIMSS and PISA scores always produces debate. How do we compare with others (and on what)? Among us, who has improve and who has not? Are we improving and, if so, are we improving fast enough?
You and others have cogently argued that quickly leaping to favored policy implications usually lacks much evidence and is often misleading.
Arguments in a democracy are natural and could be healthy, but I worry we are not making much progress when it comes to current education policy. Maybe a dose of engineering design thinking can help.
An essential step in such thinking is defining and delimiting the problems. The biggest problem with education is the US is not test scores. Rather, three central problems plague public education the United States. The most dramatic is inequity. There are vast inequities in educational resources and in the conditions of students’ lives, resulting in persistent race- and class-based disparities in educational outcomes.
Second, we are far too focused on a narrow range of outcomes — reading and math test scores — and not enough on a broader range of subject matter or essential domains, such as critical thinking, creativity and collaborative skills. Third, we gravitate toward partial quick solutions, rather than thinking systemically and having the patience allow strategies time to develop, take hold and be refined.
Next, we need to consider both values and technical constraints for ideal solutions. For example, we need to ask what mix of collaborative and competitive strategies align with our values and research on systems that have been successful in sustaining significant educational improvement.
In addition, since ideal solutions always prove better in theory than in practice, we need to plan for optimization– repeated cycles of testing, redesign and retesting.
Finally, to make progress we need mobilize the necessary political will. To do so, we need to hear more about common sense, high-leverage solutions– framed as messages that respect people’s intelligence and tap into their values, aspirations and sense of fairness.
I made several suggestions about these messages last week on the Washington Post’s education blog, The Answer Sheet: http://www.washingtonpost.com/blogs/answer-sheet/wp/2013/11/30/how-thinking-like-an-engineer-can-help-school-reform/
Good three points Arthur!
“My point to Diane, is that she and other anti-testers, can’t complain about testing and then use the test results to bash the testers.”
She actually CAN do that. She’s using their own measure of success. Had they not put standardized tests forth as the measure, they wouldn’t be open to the attack, but they did, so they are.
They couldn’t stay in the box they created anyway. I’ve now read pleas from parents to keep “failing” charter schools open here in Ohio. The fact is, I don’t know any parents who exhibit the obsessive reliance on test scores that ed reformers do. There are lots of ways to measure the value of a school to a community, obviously.
They built the box. It’s absolutely fair of Dr. Ravitch to keep them in it.
Chiara, well done. Reform did indeed feed this test-obsessed monster, and now that it is grown, the reforms cannot manage to both outscore AND promote a well-rounded education.
Outscoring requires a paring down of the education experience such that it becomes test-taker training.
In her writings, Ravitch repeatedly highlights as much.
Sadly, I think those in power want an intellectually dulled work force like those produced in Asia; they want a public that’s always looking over their shoulders, afraid to stand up to power; testing and worrying about test scores is an excellent way to do this.
I agree one hundred percent….I see this daily in the elementary school. By following new mandates put forth by the government, and due to the relentless pressure to perform on tests, an environment is being created that completely stifles creativity and independent. Take it from someone who witnesses it daily: today’s children WILL be an intellectually dulled workforce. They will know nothing different.
Independent THOUGHT
Actually, China appears to be unhappy with this model and is headed in the opposite direction. In June they announced ed reform policy seeks to reduce the importance of standardized tests (http://www.washingtonpost.com/blogs/answer-sheet/wp/2013/06/25/chinas-new-education-reform-reducing-importance-of-test-scores/), and just recently floated a ban on written homework in lower grades (http://www.npr.org/blogs/thetwo-way/2013/08/28/216510627/china-weighs-ban-on-homework-teachers-students-argue-against)
My comment got eaten I think so here’s a synopsis without the cites: it was reported at Valerie Strauss’s site in June 2013 that China is looking to reform ed policy, seeking ways to lower the importance of standardized tests; more recently (reported on NPR) they have floated the idea of banning written h.w. prior to 3rd grade. Both press releases noted China is looking for ways to decrease stress & increase innovation
Love the words.. “creative” and “can do” as this defines what has really enabled Americans to excel in various pursuits.
“My point to Diane, is that she and other anti-testers, can’t complain about testing and then use the test results to bash the testers.”
They don’t even follow their own rules on testing! Why isn’t she allowed to point that out? It’s THEIR measure.
Charter schools in Ohio don’t score any better on standardized tests than the public schools they replaced, and they’ve known for a decade that Catholic schools in Milwaukee don’t either. Yet they continue to push these policies. Why can’t she call them out on that?
With all due respect so some posters that I greatly respect, I too believe that if those in pursuit of $tudent $ucce$$ bet the house on their massaged and tortured numbers, then one of the best ways to refute their inane policies is to show that by their own standards they are sorely wanting.
IMHO, that helps open up the discussion to “ok, then, what standards or guidelines or evaluative measures do we use now that the scores from high-stakes standardized tests are tossed out?”
Or even more crucial: “Can we really measure and weigh some, or even most, or any, of the really important things that we hope students learn and teachers teach in schools?”
Just my dos centavitos worth…
😎
I was a sophomore in high school when “A Nation at Risk” was released.
I am now 46.
The sky fell more from the corporate greed precipitating the economic crisis in 2008.
No one seems to be broadcasting a report on that one.
Absolutely, Mercedes. Not to mention that those who precipitated the crisis were the best and the brightest, no doubt high scorers on any international test.
Youngster!
Said beautifully. The madness continues. I have something for you on Massachusetts–it will be ready in a few days. Its will also match what you and I say–that good scores come from healthy communities–not from accountability plans. Best David David C. Berliner Regents’ Professor Emeritus 120 E. Rio Salado Parkway, Unit 205 Tempe, AZ 85281-9116 Ph: 480-861-0484
Dienne, format restrictions prevent me from responding in-line….
PISA measures the ability to apply your knowledge in new ways. That’s life. I will never encounter Train A leaving a station at whatever time, but I will have to meet friends half-way across town and figure out when I have to leave to make it there on time.
I am not saying this is the only measure. Instead, it is one of many measures. If our kids can’t do ninth grade math in tenth grade, that is an issue.
Sure, there are plenty of creative people who have made it. But, they had the knowledge to support their creative idea. It’s not a “one or the other” situation. The two go hand in hand.
Standardized tests, whether the PISA or whatever, tell us how well people take standardized tests. There are tons of people who can ace the tests, but can barely tie their shoes. Conversely, there are tons of people who can do pretty much anything any job calls for, but they can’t pass a standardized test. Read STANDARDIZED MINDS for much more detail.
Dienne: quite so.
Standardized tests excel in measuring only one thing—
How well people do on standardized tests.
Otherwise, very limited and inherently imprecise in what they can measure, and infamous for lending themselves quite readily to purposes for which they are ill-suited.
Thank you for your comments.
😎
JMP,
Please also acquaint yourself with how other countries “do” these tests, who are allowed to attend their schools , the % of children in these places living in poverty and how the scores stack up when you compare apples to apples.
Have you read Diane’s new book?
How about Gerald Bracey’s books?
The sky is not falling.
There is no doubt that some countries are gaming these tests. PISA I’m sure is entirely hapless when it comes to managing a country like China, where rural migrants can be sent home on a moment’s notice and the bureaucracy is opaque even to insiders.
“PISA measures the ability to apply your knowledge in new ways”
NO! It doesn’t “measure” anything. To understand why, read Noel Wilson’s “Educational Standards and the Problem of Error” found at: http://epaa.asu.edu/ojs/article/view/577/700 I have provided a brief summary (which doesn’t even begin to do justice to this epic work) below.
Brief outline of Wilson’s “Educational Standards and the Problem of Error” and some comments of mine. (updated 6/24/13 per Wilson email)
1. A quality cannot be quantified. Quantity is a sub-category of quality. It is illogical to judge/assess a whole category by only a part (sub-category) of the whole. The assessment is, by definition, lacking in the sense that “assessments are always of multidimensional qualities. To quantify them as one dimensional quantities (numbers or grades) is to perpetuate a fundamental logical error” (per Wilson). The teaching and learning process falls in the logical realm of aesthetics/qualities of human interactions. In attempting to quantify educational standards and standardized testing we are lacking much information about said interactions.
2. A major epistemological mistake is that we attach, with great importance, the “score” of the student, not only onto the student but also, by extension, the teacher, school and district. Any description of a testing event is only a description of an interaction, that of the student and the testing device at a given time and place. The only correct logical thing that we can attempt to do is to describe that interaction (how accurately or not is a whole other story). That description cannot, by logical thought, be “assigned/attached” to the student as it cannot be a description of the student but the interaction. And this error is probably one of the most egregious “errors” that occur with standardized testing (and even the “grading” of students by a teacher).
3. Wilson identifies four “frames of reference” each with distinct assumptions (epistemological basis) about the assessment process from which the “assessor” views the interactions of the teaching and learning process: the Judge (think college professor who “knows” the students capabilities and grades them accordingly), the General Frame-think standardized testing that claims to have a “scientific” basis, the Specific Frame-think of learning by objective like computer based learning, getting a correct answer before moving on to the next screen, and the Responsive Frame-think of an apprenticeship in a trade or a medical residency program where the learner interacts with the “teacher” with constant feedback. Each category has its own sources of error and more error in the process is caused when the assessor confuses and conflates the categories.
4. Wilson elucidates the notion of “error”: “Error is predicated on a notion of perfection; to allocate error is to imply what is without error; to know error it is necessary to determine what is true. And what is true is determined by what we define as true, theoretically by the assumptions of our epistemology, practically by the events and non-events, the discourses and silences, the world of surfaces and their interactions and interpretations; in short, the practices that permeate the field. . . Error is the uncertainty dimension of the statement; error is the band within which chaos reigns, in which anything can happen. Error comprises all of those eventful circumstances which make the assessment statement less than perfectly precise, the measure less than perfectly accurate, the rank order less than perfectly stable, the standard and its measurement less than absolute, and the communication of its truth less than impeccable.”
In other word all the logical errors involved in the process render any conclusions invalid.
5. The test makers/psychometricians, through all sorts of mathematical machinations attempt to “prove” that these tests (based on standards) are valid-errorless or supposedly at least with minimal error [they aren’t]. Wilson turns the concept of validity on its head and focuses on just how invalid the machinations and the test and results are. He is an advocate for the test taker not the test maker. In doing so he identifies thirteen sources of “error”, any one of which renders the test making/giving/disseminating of results invalid. As a basic logical premise is that once something is shown to be invalid it is just that, invalid, and no amount of “fudging” by the psychometricians/test makers can alleviate that invalidity.
6. Having shown the invalidity, and therefore the unreliability, of the whole process Wilson concludes, rightly so, that any result/information gleaned from the process is “vain and illusory”. In other words start with an invalidity, end with an invalidity (except by sheer chance every once in a while, like a blind and anosmic squirrel who finds the occasional acorn, a result may be “true”) or to put in more mundane terms crap in-crap out.
7. And so what does this all mean? I’ll let Wilson have the second to last word: “So what does a test measure in our world? It measures what the person with the power to pay for the test says it measures. And the person who sets the test will name the test what the person who pays for the test wants the test to be named.”
In other words it measures “’something’ and we can specify some of the ‘errors’ in that ‘something’ but still don’t know [precisely] what the ‘something’ is.” The whole process harms many students as the social rewards for some are not available to others who “don’t make the grade (sic)” Should American public education have the function of sorting and separating students so that some may receive greater benefits than others, especially considering that the sorting and separating devices, educational standards and standardized testing, are so flawed not only in concept but in execution?
My answer is NO!!!!!
One final note with Wilson channeling Foucault and his concept of subjectivization:
“So the mark [grade/test score] becomes part of the story about yourself and with sufficient repetitions becomes true: true because those who know, those in authority, say it is true; true because the society in which you live legitimates this authority; true because your cultural habitus makes it difficult for you to perceive, conceive and integrate those aspects of your experience that contradict the story; true because in acting out your story, which now includes the mark and its meaning, the social truth that created it is confirmed; true because if your mark is high you are consistently rewarded, so that your voice becomes a voice of authority in the power-knowledge discourses that reproduce the structure that helped to produce you; true because if your mark is low your voice becomes muted and confirms your lower position in the social hierarchy; true finally because that success or failure confirms that mark that implicitly predicted the now self evident consequences. And so the circle is complete.”
In other words students “internalize” what those “marks” (grades/test scores) mean, and since the vast majority of the students have not developed the mental skills to counteract what the “authorities” say, they accept as “natural and normal” that “story/description” of them. Although paradoxical in a sense, the “I’m an “A” student” is almost as harmful as “I’m an ‘F’ student” in hindering students becoming independent, critical and free thinkers. And having independent, critical and free thinkers is a threat to the current socio-economic structure of society.
Jenny:
I essentially agree with each of your points. At the same time using standardized tests, PISA or not, as the primary means for evaluating students and teachers is problematic for many reasons. The PISA results are interesting at the level of aggregate scores for aggregated groups they contain next to no information.
Duane believes that since all standardized tests are flawed – which, of necessity, they are, there should be no standardized tests. The latter is a leap that I do not agree with. You will not be able to change his mind on this. Daniel Koretz’s book Measuring Up is a much better and more measured critical and skeptical look at Educational Testing than Wilson’s over the top articles. Of course, Duane will not agree.
Competition: An event in which there are more losers than winners. Otherwise it’s not a competition. A society based on competition is therefore primarily a society based on losers…John Ralston Saul.
+1
What does the PISA report tell USA about US education:
https://m.youtube.com/watch?v=XchNCnYo6KA&desktop_uri=%2Fwatch%3Fv%3DXchNCnYo6KA
An interesting counterpoint, but there’s this about patents:
http://www.nytimes.com/2012/06/26/business/immigrants-played-role-in-majority-of-us-technical-patents-study-finds.html?_r=0
Here is a view on Pisa from Professor David Spiegelhalter
Winton Professor of the Public Understanding of Risk, University of Cambridge and
senior scientist, MRC Biostatistics Unit
http://understandinguncertainty.org/pisa-statistical-methods-more-detailed-comments#comment-form
@DianeRavitch and her followers should read it.
Paceni, thank you for the excellent citation. The good professor points out one more set of false assumptions that limit the utility of PISA scores as far as what should influence policy. Thanks for the article.
Diane-
Thank you for your work. I hope your health has greatly improved!
I’m currently engaged with several private sector employees regarding the validity of the PISA scores. As I’m generally not well schooled in Baker’s study, I need some help spreading word in an informed manner. After a 12 hour work day with several more hours of work to complete, I find myself lacking in the time to research the following statements sufficiently. Can you please help?
One gentleman has argued that (your) “statistics are outdated and incredibly limited. 12 is too small a sample size to make any meaningful conclusions like she does. PISA surveys 65 and is much more recent. Conduct Baker’s research on this group using these tests and you’ll have a much stronger case. The fact that she’s recycling limited studies from the 1960s makes me think the better, more applicable data available today does not fit her agenda. She’s an educated person and should know better.”
He goes on to state “I’m also certain Baker’s study would have a much different result if he looked at rate of growth over that period rather than level of wealth. The case can easily be made that growth would be a much more logical dependent variable.”
How would you respond to these statements? (Other respected replies are greatly appreciated!)
Thanks very much!
NYSTEACHER
(BAT)
Baker looked at the progress of he nations that took the tests in 1964. There’s no way anyone could do a study and predict the economic progress of nations that took PISA in 2012 and determine what will happen to their economies in 2052.
Read Yong Zhao’s “World Class Learners” and you will find more recent evidence making the same argument: test scores of 15-year-olds have no bearing on future economic progress and may actually dampen creativity.
I agree. What we measure is what we find easy to measure and what may be totally useless to a happy, creative and productive life. Tests, irrational cut scores to categorize students as “masters” and the frightfully narrow learning curriculum aligned with state exams added stress and destroyed the joy in learning that students and teachers brought to their classes. Now, how do teachers and school leaders deal with their test score iconic reality? Ignore the whole myth and teach each child to love learning, to enjoy discovery, and to recognize how one learns.
Sure: Test, smest! I agree.
When American university-level business students need explanation as to how to compute a 10% price discount, something is very not good at the secondary level. I don’t need a standardized test to analyze that situation. Not matter how you slice it, far too many of our university students are functionally illiterate with respect to arithmetic, let alone algebra and other mathematical subjects. This is not a national recipe for success in the context of a high-tech world.
Part of the problem in this scenario is that there are many people who really aren’t academically inclined but are still pursuing college as the “correct” choice to achieving success.
It wasn’t until fairly recently that I started seeing “…and career…” added to “College ready” in the Race to the Top bandwagon.
We’ve outsourced our jobs. First it was blue collar (remember when Billy Boy said it would “only” be those jobs…like that was “ok”). Then it got to the white collar professions.
The problems our nation is facing go far beyond the area of education.
I’m a bit OCD:
“The problems facing our nation go far beyond the area of education”.
*whew*
I’m somewhat off topic to the post, but not the comments, in pointing out that the White House, working through the regional accreditation agencies, is working to see standardized testing and what I can’t help but identify as other clutter of the No Child Let Behind Act established in U.S. higher education. The drumbeat is that the colleges are cheating students by failing to teach them basic skills such as writing and critical thinking and so they can’t get jobs necessary to repay their college debt. Obviously, I’ll claim, the problem is the economy much, much more than graduates’ lack of basic skills.
YUP, the Obama White House and the oligarchs behind the scene who actually run the place until the Common Core Curriculum Commissariat and Ministry of Truth is given authority over higher education as well.
One ring to rule them all!
Denying tenure is the shortest road to insecure teachers, grade inflation, and low standards to make the kids and their parents happy.
The people running our education system are totally clueless but they do like to make private profit off public money.
GW Bush had a commission studying the standardization of college curriculum and testing through both of his terms.
Interesting that Massachusetts and Connecticut, which are heavily Democratic states, did a lot better than achieved much better results than Florida, a more Republican state.
“””” secret weapon of USA””” is the
1. work visa
2. university in STEM subjects
3. English as first global language.
4. No one goes to china, japan, korea, macau, hong kong to attend their colleges.
All top students wants degree from ENGLISH speaking Nation.
ENGLISH IS FIRST GLOBAL LANGUAGE.
it all about supply/demand.
USA wants best STEM people who can speak/write English
Poverty[edit]
University of Southern California professor Stephen Krashen[50] and Mel Riddile of the NASSP say that low performance in the United States is closely related to American poverty, but the same reasoning applies to other countries.[39][40] US schools with poverty rates comparable to Finland’s (below 10%) outperform Finland and schools in the 10-24% range aren’t far behind.[51]
Reduced school lunch participation is the only available intra-poverty indicator for US schoolchildren; areas with less than 10% of the students having free or reduced price lunch averaged 551 (higher than any other OECD country). In comparison with the rest other OECD countries (which have tabled figures on children living in relative poverty):[40]
Country
Percent of reduced school lunches (US)[40]
Percent of relative child poverty (Other OECD countries)[52]
PISA score[53]
United States 75% 446
Poverty[edit]
University of Southern California professor Stephen Krashen[50] and Mel Riddile of the NASSP say that low performance in the United States is closely related to American poverty, but the same reasoning applies to other countries.[39][40] US schools with poverty rates comparable to Finland’s (below 10%) outperform Finland and schools in the 10-24% range aren’t far behind.[51]
Reduced school lunch participation is the only available intra-poverty indicator for US schoolchildren; areas with less than 10% of the students having free or reduced price lunch averaged 551 (higher than any other OECD country). In comparison with the rest other OECD countries (which have tabled figures on children living in relative poverty):[40]
Country
Percent of reduced school lunches (US)[40]
Percent of relative child poverty (Other OECD countries)[52]
PISA score[53]
United States 75% 446
See also[edit]
United States 75% 446
Sorry having trouble copying and pasting the table.
The real measure of our education system have never been test scores. It is our economic, industrial, creative, and scientific standings in the world. It is our record on human rights and the quality of life. It is measured by the throngs who flock to our shores for a better life for their children.
Standardized tests used to measure the masses against each other are nothing more than a tool that has been developed to rationalize agendas and false promises driven by fabricated fear.
And they flock to our shores for a better life for their children because of our public school system, not despite it.
Oh double pshaw! I just looked at the raw data table. All this time, I thought we only had to beat out Singapore but now I realize, gasp!, we were beat out by Estonia, Latvia, the Slovak Republic, and so many more. Thank goodness that we at least were able to beat Lithuania. Raw data shows that Finland dropped. So do we still want to be like them or are they too far down on the list to be a contender? The people in Peru must really be bummed; at least we know which country has the worst teachers. Hmm… new markets opening for Common Core in South America? Maybe we can make money selling them used Pearson books.
Hey, now don’t give the edudeformers and edupreneurs any ideas to mess with “mi patria chica”!
I think it’s pretty clear that the reform policies of the last decade have failed at worst or have had no effect at best. While I am not a fan of using standardized tests as the end-all be-all of school and education system valuation, this is the VERY criterion that reformers have used to justify their ideas. Reformers have chosen it as the measure and therefore must live by its results.
Consider that so much of the reform has been predicated on improving test scores. It has made test scores(and PISA in particular) a game or competition to be “won.” Well, their game plan has not yielded the results they promised for at least a decade now.
(And Common Core and the associated testing is actually more of the game. I was not aware,until today, that PISA uses more open-ended questions,than the typical state standards tests. Does it seem that Common Core tests are possibly designed to raise our standing in PISA as their primary goal? It does to me. These new tests will be practice for PISA!)
I live in a state (Michigan) that has had charters for 20 years. Yet our performance has not improved relative to other states as a result of this market-based competition model. NCLB increased testing dramatically. That hasn’t moved the needle. Teacher evaluations are increasingly tied to test scores since 2011. No effect again.
I’m not saying that we can’t do better. But I am saying that what we have been doing hasn’t worked. Yet we keep listening to the same people, or at least policymakers do. Maybe it’s time that we turned to the people who actually know education.
Not Bill Gates. Not teachers with three years of teaching experience or less (that’s right you “well-meaning” TFA alums who think you know everything because people have told you that your entire life). Not fools whose reforms failed miserably (Arne’s Renaissance project has been horrific and many of the schools Rahm Emanuel closed were, in fact, Renaissance schools). Not groups like the U.S. Chamber of Commerce who have a different view of what education really is. Let’s face it, they claim they want more qualified workers but what they really want is cheap labor.
It’s time we listened to respected career educators. Not every veteran teacher is great but we rarely heed the voices of the best in our craft. Yet those voices are quashed at every opportunity. Where exactly were those voices in state legislatures as evaluation laws were pushed through relentlessly by outsiders? Where were those voices in the creation of CCSS? Where are they now?
Marginalized because the powers that be only claim to care about education when it benefits the agendas they have pre-conceived. And teachers would question that very agenda.
What you say is oh-so-true, but has led me to different conclusions than that we just need to listen to educators. In government as in business, when things don’t ‘make sense’– for example, when govt keeps pushing an ed agenda counter to everything ed research shows works, that time & results have shown to be without merit– there’s usually a money agenda that is really running things.
Remember the HUGE rallies against our second invasion of Iraq? Worldwide rallies. It made no difference, whatsoever. Once the troops were mobilized, it meant the money had been and would continue being spent. The dye had been cast. There was no turning back.
I’m wondering if that’s what we’re looking at here, with testing and the CCSS. You see an immoveable NYS Commissioner King and Regents Chancellor Tisch, despite the public outrage. Arne and the mainstream media sneer at parent’s concerns.
The money’s been spent. And will continue to be spent, if the current agenda is allowed to continue. So it doesn’t matter whether people are upset. It’s already a done deal.
I know that’s not any kind of rallying cry against these people who would destroy our public schools system. And I’m sorry for that. But it’s come up in some conversations I’ve had with both teachers and administrators, lately.
So well stated. Thank you.
If only Charlie Rose would invite you for an interview so more people could hear another view of the future for public education in our great nation.
Powerful country with state of the art military but do not supply schools with proper supplies. The priorities of the U.S.
True peace will have been achieved when schools are fully funded and the military has to hold a bake sale to buy a bomber.
Reblogged this on nytechprepper.
I just came from a BASIS Independent School info session for parents, where PISA scores were plastered all over the place, in an attempt to prove that what they’re (planning to do) in Red Hook is legitimate. I am very interested to hear you speak about Basis at your talk at PS 15 on 12/11 (just blocks away from the future site of this first private school from the AZ-based charter company you mentioned in your book and on this blog). Meanwhile that same evening, Community Board 6 will be hosting a vote on the fate of Basis school in our neighborhood. Everything that rises must converge.
Kristin,
BASIS is known for charging high fees to parents. How can they get away with that in Red Hook, Brooklyn?
Red Hook’s been pretty trendy, as of late. Housing prices have been going up for the past few years. That despite Sandy.
I was disappointed in tonight’s PBS NewsHour coverage of the PISA scores, & commented at the site:
Why does PBS NewsHour select the OECD deputy director, who “helped develop and runs the test” to explore ” the role and importance of the [PISA tests and] What.. they actually tell us”? It would have been nice to hear from at least one of the education experts who “question just what and how much PISA tells us, given social, cultural, and economic differences among nations”.
The news media in the United States are owned by the oligarchs and are official propaganda outlets, something like Pravda in the old Soviet Union. Gates’s Microsoft is the MS in MSNBC. Murdoch owns Fox. Gates and Murdoch are business partners in inBloom. As for PBS, look at the donor list–it’s almost identical to the list of plutocrats pushing the current deforms on the country.
By the bean counters’ own criteria “choice” has failed also.
Sweden, which introduced “market based” reforms on the advice of the test-peddling neo-cons, has seen its scores go down down down as well. The verdict is in — education is a public good that doesn’t lend itself to business-style management. QED
A moment’s thought could have predicted this with far less pain and suffering.
2012 – Sweden reading 483. Sweden Math 478.
2003 – Sweden reading 516. Sweden Math 503.
https://en.wikipedia.org/wiki/PISA
https://en.wikipedia.org/wiki/PISA
How much more data do we need before the ideologues will accept reality?
The U.S. is just excellent at stealing the smartest people from around the world and this shows no sign of abating as far as I can tell. All Chinese-heritage Nobel winners have ended up in the U.S. This is the crux of why test scores ‘don’t matter’.
Also, be assured that China is gaming the system. Face is more important than anything with that government, and I’m quite sure PISA is hapless in the face of that governments machinations. Why are they even letting them test one city ?
When 10% control 90% of a nation’s assets, the ‘free market’ becomes about serving the rich.
Therefore the free market has zero to offer an education system based on equal opportunity.
Because:
https://dianeravitch.net/2013/12/02/tom-loveless-why-shanghai-leads-the-world-on-international-tests-like-pisa/
By the way, Finland is dropping because they are getting a wave of immigration.
Monocultures thrive on these tests.
I just wish there were a way to use testing diagnostically so that students that are deficient in certain areas could have their needs addressed. As it is, the tests don’t really seem to be sequentially relevant so that the students can learn from their errors and have instruction as to how to reach the goal of proficient. My experience has been like stabs in the dark with students who score a certain level on third grade tests being expected to show a “year’s growth” on substantially more difficult tests each subsequent year. That score is then supposed to be indicative of the VAM growth that is used to determine whether a given teacher is effective, regardless of the amount of time that had to spent on students who arrive from other districts or from charter schools who didn’t even test the children or students with high rates of absence.
The tests wouldn’t be so horrific if they were use as stepping stones to success, not designed to produce winners and losers from districts to teachers to students.
I became a teacher to HELP students succeed. This is not a vehicle for success for anyone.
These international tests can be interpreted by various groups to mean whatever they wish. They do NOT compare oranges to oranges. They never have and never will.
When Ohio decided to use their diagnostic proficiency tests as part of the NCLB requirement, the handwriting was on the wall that there would be abuse and misuse of testing for as long as I could foresee.
And here we are, approaching 2014, with the obvious fact hitting us in the face. ALL students cannot be on grade level due to the many factors that impede that possibility. And, it SHOULD BE ok.
The US is NOT Lake Wobegone. And, it never will be.
Students are not clones. Do we think of children like a crop of corn? Do we really think we can get the same results from ALL children through someone’s idea of “excellent teaching”? Do we want children to be GMOs? Well, that is what will be necessary to pull off this ridiculous view of educability.
From wikipedia (oops didn’t mean to cite it twice!):
2012 – Sweden reading 483. Sweden Math 478.
2003 – Sweden reading 516. Sweden Math 503.
Sweden introduced privatization on the advice of the corporatizers. Enough said.
Do we even know what those scores mean? Are they raw scores, scaled scores, etc?
On the Ohio tests a student can miss one question and it will subtract, say, 12 points, but another student can miss that same question and it may count as 4 points. It has to do with the number of questions students miss. I don’t know the scale they use because they won’t tell us.
Also, one year a score of 456 might mean one thing and another year something else. They slide the numbers all over the place. Also, Proficient and Advanced are the same numbers for math and for reading.
All this “mystery” is never revealed … no wonder we feel like we are aiming at a moving target while wearing a blindfold.
What ever happened to longitudinal studies on students’ scores? Oh, I know, it takes too long.
Pisa reports are public and available for download. There is no mystery if you are willing to read all 600 pages of the report.
Reblogged this on Middletown Voice and commented:
There are some really important points made by Diane regarding international testing and how well US students perform. We have always been mediocre performers and pushing harder like the Arne Duncan at the US Department of Education would like us to do actually will have negative consequences. Studies performed show that once a certain level of achievement has been reached, any further push for test scores will have a negative impact because it negatively impacts “ambition, inquisitiveness, and independence.
Let’s just pretend for a moment that the PISA scores mean anything. If so, doesn’t that show that what the “reformers” are doing doesn’t work? They’ve been running the show for well over a decade now – they own the results.
Thank you for your insight and your ongoing support for public education!! Again, you state the obvious truth about ongoing standardized testing ploys that do nothing but reinforce the bureaucratic rhetoric about our country’s failures.
US seniors may test low in Math because high school (and university) education in the US is broader than other countries. In the UK for example, students specialize in only 3 or sometimes 4 subjects in 11th and 12th grade, say Math, Physics and Chemistry or English, History and French. Naturally they cover these subjects at a much deeper level, but at the expense of getting a more well rounded education.
Gillian:
These are 15 year olds so they have yet to specialize.
What I find ironic about the annual pundit race to declare the end of American civilization, is there own inability to apply the critical thinking skills they all lament are lost, to the findings of these international exams. The situation becomes even worse when the pundits invite other pundits, political operatives, and CEO’s to share their “expert” opinion on the implications of the latest international test ranking. What these conversations do confirm is the propensity of human mind to jump to simple cause and effect relationships—low international test score/economic decline—the difference between “thinking, fast and slow” (Kahneman). I give a pass to pundits/journalists –they are paid to think fast. What disturbs me, as an educator, is seeing the same kind of thinking coming out of the Department of Education –who should be paid for thinking slow.
“What I find ironic about the annual pundit race to declare the end of American civilization, is there own inability to apply the critical thinking skills they all lament are lost, to the findings of these international exams.”
Its not their fault Alan, they were educated in the Year of Our David, 40 BCC. (Befor Common Core), plus or minus a few.
You didn’t mention that in the United States we test and then report the scores of EVERY child. In most European countries, students are separated out at a high school level. Reported scores are often from the academically tracked students and do not include the students that are not top in their class.
Debb B:
These are supposed to be 15 year olds – so in countries like Finland and the UK the tracking really has not taken place yet. There may be other issues with how countries draw their samples but there are protocols that countries who agree to participate are supposed to follow that eliminates the type of issue you raise.
Did anyone else notice that only Indonesia had a lower percentage of students who tested? Or that our results only come from three states? Hardly a representative sample.
There is a US Sample plus additional samples from Massachusetts, Connecticut and Florida.
See http://nces.ed.gov/pubs2014/2014024.pdf Appendix Table B2
That’s where I was looking. Are you saying that the sample from these three states is in addition to the US sample?
Yes, but I did not see it explicitly stated. Perhaps it is in the text. If you add up the participants for the three States it comes to a smaller number than the US sample. The OECD stat folks are pretty savvy, they are unlikely to report the results from 3 States as reflecting the US as a whole.
Good to know. I’ll edit an upcoming post on my blog then.
The part about the small sample size still concerns me, however.
okeducationtruths:
The issue of sample size depends what you want to represent. For a national sample where you want to look at gender and quintiles in terms of poverty, I doubt that there is much of an issue with the sample size.
As Diane indicated in her post, there are many more fundamental issues as to what the average aggregated data really tells us. They are interesting but, like batting averages and pitching ERAs, they tell little about what actually happened.
okeducationtruths:
The US sampling procedure is laid out on page 34/35 as part of Appendix A. It is a regionalized sampling frame, with ethnic and location considerations. Speicifically, they write:
Sampling and Data Collection in the United States
The PISA 2012 school sample was drawn for the United States by the PISA consortium. The U.S. PISA sample was stratified into eight explicit groups based on control of school (public or private) and region of the country (Northeast, Central, West, Southeast).3 Within each stratum, the frame was sorted for sampling by five categorical stratification variables: grade range of the school (five categories); type of location relative to populous areas (city, suburb, town, rural);4 combined percentage of Black, Hispanic, Asian, Native Hawaiian/Pacific Islander, and American Indian/Alaska Native students (above or below 15 percent); gender (mostly female [percent female >= 95 percent], mostly male [percent female < 5 percent]; and other); and state. The same frame and characteristics were used for the state samples.
For the U.S. national sample, within each school, 50 students aged 15 were randomly sampled. The United States increased its national sample from the international standard of 35 to 50 in order to reach the required number of students and in order to administer the optional financial literacy assessment. Connecticut, Florida, and Massachusetts participated in PISA 2012 with separate state samples drawn by the PISA consortium. The state samples are not part of the main sample. In each of the three state samples, 42 students aged 15 were randomly sampled within each school. If fewer than 50 age-eligible students (in schools in the national sample) or fewer than 42 age-eligible students (in schools in the state samples) were enrolled, all 15-year-old students in a school were selected. Thus, in each school, each age-eligible student had an equal probability of being selected. Sampled students were born between July 1, 1996, and June 30, 1997 (hereafter the sampled students are referred to as “15-year-olds” or “15-year-old students”).
The description continues but appears to be pretty standard stuff.
Reblogged this on David R. Taylor-Thoughts on Texas Education.
Just Lift Harder
Headlines across the nation warned that our children had become “soft’ – they had somehow grown much weaker than youngsters in other countries. In fact, objective tests of physical strength proved that children in other parts of the world could bench press much more weight than those here in our country. Overlooked was the fact that all of the other countries culled their weakest students before lifting tests were administered, yet we insisted on testing every child, even those with severe physical disabilities. Despite this important difference, the media, parents, and the general public became quite alarmed that we had fallen so far behind these “stronger” countries.
Obviously physical education standards for weight lifting in our country lacked the necessary rigor; our entire approach to weight training was questioned. What was a nation to do? Enter the lobbyists – and our prayers were answered. The apparent solution to this national emergency was a new set of laws intended to increase the strength of our children. Every student, K to 12, would now be required to bench press 20 times their grade level (4th grade = 80 lbs., 8th grade = 160 lbs., 10th grade = 200 lbs., etc.). Finally we had the rigorous standards required to beat those other countries in this important test of strength. As most personal trainers already knew, the solution to increasing a person’s physical strength is to simply add more weight!
As coincidental as it may seem, the lobbyists that pushed for these new standards also worked for a multi-national company that sold specialized, state-of-the-art, hydraulic weight lifting equipment (required for the new high stakes lifting test), dietary supplements, protein shakes, and weight training DVDs –all guaranteed to help our children meet these rigorous new standards in physical education.
In weight rooms across our great land, most students struggled mightily to lift 20 times their grade level. In one physical education class, a 4th grade student with a fractured right arm asked her teacher, “What about me? How am I supposed to lift 80 lbs. with a broken arm?”
The teacher under much pressure to increase his student’s strength scores simply responded, “Just use that good left arm and try twice as hard.”
In a physical education classes across the country, students started to complain to their teachers:
“We’re tired of this endless weight lifting, how come we don’t play basketball anymore?”
“Yeah. What about floor hockey?”
“This is getting really boring; I hate gym more than ever!”
“Quit complaining and just lift harder.” their teachers replied irritably. “Don’t you realize that students in other countries are significantly stronger than us?”
A concerned 8th grader asked her teacher, “What happens if I can’t bench 160 lbs. by April? Does that mean I won’t be able to move on to high school?”
The phys ed teacher paused , “Actually, no. The amount you lift in April doesn’t affect grade promotion at all. As a matter of fact you probably won’t get your lifting score until sometime next year, maybe.”
“Then why is everyone making such a big deal about these bench press tests anyway?” asked the middle school student.
“Well,” answered the teacher, “if you can’t lift 160 lbs. by April I will probably be labeled as an ‘ineffective’ teacher – if enough of my students can’t make the lift I could be denied tenure and lose my job. People will also realize that our building principal had failed to provide the leadership required to make you all just want to lift harder. Before you know it, many parents will enroll their kids in private weight training centers.”
“Really? You mean we can get back at you for working us so hard?”
The teacher merely shrugged.
“Maybe the lobbyists will change the law to make the new weight lifting standards more realistic”, sympathized the student, “We’re only kids you know and we’re all different.”
“I don’t think so” said the teacher, “their company is making a fortune selling hydraulic weight lifting equipment, protein shakes, and DVDs. Besides, don’t you realize that students in other countries are significantly stronger than us?”
“Whatever.”
Thanks. That was good.
Pushups. That’s what I say.
Diane conveniently fails to mention that the majority of US engineering graduate students are foreign students. As an MIT Ph.D. who works in the telecommunications industry I can tell you that the large numbers of immigrants in technology industries is not due to their being paid less (they are paid well) but because of their technical skills, companies want to hire the people with the best skills.
Click to access New%20NFAP%20Policy%20Brief%20The%20Importance%20of%20International%20Students%20to%20America,%20July%202013.pdf
Whats your point? The main discussions here are about teaching children. Common Core debates tend to focus on kids that are 8 to 14 years old. US public schools are not in the business of training adults for technically skilled jobs. However, if you are using this observation to advocate for a two-tracked system, academics and vocational, no one here, including Diane will argue withyou.
There is a convoluted point here, which I am certain, does not interest Ms. Ravitch or you, but, neverththless:
1. US has been sucking up Asian engineers and scientists into technology companies.
2. Their children, look at the parents, and follow into Math/science fields.
3. This crowds out other races. You can walk into high school magnet program and see this.
4. Lower aspirations in math lead to lower test scores.
5. Of course, this does not explain the verbal gas, but nonetheless, we can agree that the parents lead the children to higher achievements.
6. Now the US sucks up more engineers and scientists from abroad.
I have no answers, but this cycle continues endlessly.
Diane’s argument is that higher PISA scores in other countries are completely irrelevant for assessing the state of US education, that there is no “crisis” in education, reformers are only interested in profits, not school quality.
You don’t just magically show up at age 22 ready for graduate school in science or engineering, quantitative and analytic skills are gradually acquired starting in elementary school. Teachers should understand this better than anyone. Foreign students are often better prepared for graduate schools than Americans, that’s why graduate schools admit them.
My father was a public school math/science teacher and administrator, he would not have agreed with your statement that “US public schools are not in the business of training adults for technically skilled jobs”. Most of the public would not agree with that either, remember where your paycheck comes from.
If the Common Core is so horrible why does the National Council of Teachers of Mathematics support it? My father was a lifetime member of NCTM.
http://www.nctm.org/standards/mathcommoncore/
Admission
The selection process at MIT is holistic and student centered: each application is evaluated within its unique context. No school, state, or regional quotas are applied; neither is preference given to those with alumni relations. Selection is based on outstanding academic achievement as well as a strong match between the applicant and the Institute, including:
•Alignment with MIT’s mission
•Collaborative and cooperative spirit
•Initiative and risk-taking
•Hands-on creativity
•Intensity, curiosity, excitement
•Balancing hard work with downtime
Selected undergraduate admissions statistics for 2012:
•Applications for freshman admission were received from 18,109 candidates.
•Admission was offered to 1,620 candidates (8.9 percent), of whom 1,135 enrolled.
•Approximately 46 percent of the freshman class was female.
•A majority had attended public high schools.
•Fourteen percent were among the first generation in their family to attend college.
•Ten percent were international citizens hailing from 52 countries.
•Forty-six US states were represented.
Applicants for graduate degree programs are evaluated for previous performance and professional promise by the department in which they wish to register.
NY teacher:
You did not mention the screening role SAT scores appear to play in MIT admissions. For example, 96% of incoming freshman in 2013 had SAT scores in Math of over 700.
53 countries represented in MITs freshman class, 2012.
90% were from the US, the majority of which attended public high schools. Sounds like US schools are holding their own regarding technical training. Odd that an MIT Ph.D. forgot to do his homework.
And yes I know this is undergraduate admissions data.
Considering the fact that MIT (along with Stanford) is the pre-eminent STEM university in the world, I gather that undergraduates are no slouches when it comes to “technical training”.
vjay
What really doesn’t interest me is your extraordinarily convoluted, six-point, nonsensical screed.
Your post could imply students educated in the USA don’t cut it in the field of engineering when compared to immigrants.
I’d suggest that “immigrants” doesn’t mean one country. We’re talking about people from all over the world. For some reason, they want to come to the United States to do their graduate (and undergraduate work).
Admittedly, I only skimmed your link (which is a good one, thanks)…but one of the things it tells me is what I’ve always known: part of the greatness of the USA is it’s openness to people of all cultures. It’s one of the things that spurs new ideas and innovation.
We still have a good percentage of our “homegrowns” in all fields of graduate work when you take this into account. I know some brilliant people who’ve come from our “substandard” educational system. They know quite a few, too. As well as others from other countries.
It’s not all about competition.
In general. I think competition breeds all kinds of negativity. Challenging oneself to do better than prior is one thing. We have taken competition to a level of absurdity, gloating in “victory” in an unhealthy way. I just find that when more people are able to succeed, there is more happiness. I know some don’t care and I know who will disagree with me. I no longer care. I am just tired of the negativity.
All these tests give students false senses of inadequacy. This isn’t stimulating positive lives in any way. A few people are running the show while the rest are treading water. It is getting worse thanks to this greedy, judgmental world.
The fact is: it does not matter how hard you work, how smart you are, how honest or loyal you may be, if you aren’t on the “side” of whatever is the “rule of the moment”, your opinion doesn’t matter.
These tests are part and parcel to an attitude supporting a continuation of allowing the 1-2% to run over everyone else. We are fighting a tsunami of misguided but gilded and technological unproven and risky changes that can’t be conquered with facts. Facts aren’t pretty. They aren’t marketable.
Just tired of the daily presentation on the news of negative views about almost everything that used to signify being a dedicated, productive human being in favor of a world that makes no sense.
Has anyone else read “The Smartest Kids In The World” by Amanda Ripley? It just came out a few months ago and I just happened to finish it today. She’s a Time journalist that followed three American exchange students for one year in South Korea, Poland, and Finland. Anyone interested in this topic would appreciate this book. Some take aways: teaching was more rigorous abroad and expectations were high, regardless of poverty or adversity. Successful schools had no or delayed tracking (into vocational schools or lower subject levels), and no school sports. “Kids bought into the promise of education.” Even “the stoners” did their school work, as the exchange student from Oklahoma put it.
Good blog. It makes many valid points.
I know little about all this, but I do wonder about what’s really going on.
Are the students tested in, e.g., Japan or Finland equivalent to the students being tested in the US? In other words, do either or both of those countries have alternative training/education paths for many of their teens, who are not inclined to pursue an academic track? If so, how does this affect the universe of data collected viz-a-viz the US? I know that Germany has something like this, where some students go to a Hauptschule, some to a Realschule and others to a Gymnasium. I do not know if the students in all these, and perhaps other, schools are tested.
Just curious.
Also, I remember the Sputnik Panic of the late 50s, early 60s. I was just a boy, but I remember standing in our yard as my father and some neighbors pointed to a white dot in the sky and said that was “Sputnik.” They claimed it was moving. I had no idea. People were really scared. The nation really thought it was sinking into an abyss of second-class mediocrity in the sciences. I remember, in particular, my school enacting a program to encourage children to study math and science.
In the 1980s, the boogeyman was Japan. The Japanese were going to clean our clock. Their adults worked non-stop, had few indulgences, and saved like mad. Their children were all brilliant and driven.
Some things never change.
Great blog!
I do not think test scores are a good gauge of accomplishment. GDP? May not be much better though.
Wayne
Luvsiesous.com
Explain that comment to the SAT/ACT board. lol
Politicians and pundits who are intent on holding our students, teachers, and schools responsible for the fate of the economy are engaged in a media side show designed to distract attention from the more fundamental “pillars” of a globally competitive economy.
The World Economic Forum publishes The Global Competitiveness Report, an annual ranking over 130 countries on 12 “pillars” of an economy. The pillars are: trustworthy institutions, investments in infrastructure, macroeconomic environment, health and primary education (pre-collegiate), higher education and training, goods and market efficiency, labor market efficiency, financial market development, technological readiness, market size, business sophistication, and innovation.
In the 2010-11 report, Switzerland topped the overall ranking, followed by Sweden, Singapore, and the United States. The United States fell two places, to fourth, due to the failure of financial institutions, not educational performance.
In the2012-13 report, the United States remains in the top ten countries, but is said to be in decline from a slow economic recovery, political gridlock and brinksmanship, business criticism of essential public institutions, and policies that ignore issues of environmental sustainability, not from student scores on international tests. See http://www.weforum.org/issues/global-competitiveness or http://www.weforum.org/gcr.
For a different report on United State Innovative Capacity relative to other nations, see http://www.innovationfordevelopmentreport.org/ici.html
Great post. Thanks.
With due respect, it seems a lot of things are mixed together in this article that don’t stand mixing. American emerged from WWII as the preeminent world power and with English as the world’s lingua franca. This provided a huge head start. In post war America, one didn’t even need to have a high school diploma in order to land a job that could lead to a middle class lifestyle. There’s more to it than all this…
Things are changing. Setting aside Arne Duncan and Jeb Bush (test and punish is no answer), I believe our schools have stagnated, and I believe this is already proving to be a problem for the United States. It most definitely is a problem for growing numbers of students and communities who are poorly served by underfunded, badly run schools.
“I believe our schools have stagnated, and I believe this is already proving to be a problem for the United States”
Stagnant schools? How do define stagnated? On what factual information do you base this belief?
Proving to be a problem for the US? Really? What precisely is the problem?
“It [Stagnant schools] is most definitely is a problem for growing numbers of students and communities who are poorly served by underfunded, badly run schools.”
How do you conclude that schools are badly run? Is this conclusion based on first hand experience? How many schools have you personally observed and evaluated? What exactly were your criteria for judging how well a school was “run”?
Mr. Ford, I agree with you as a mathematics teacher/researcher who has taught mathematics in public high schools in Japan for nearly 20 years and in private high schools in US for about 15 years. I’ll check your blog posts for more information.
I post links on my FB page. This from a friend of mine, after reading this article and thread:
“I am about to retire from a career functioning as a math teacher set in classrooms as a soldier in the battle to improve high school students’ scores on standardized testing. Recruiting at-risk middle school students entering as freshmen in my middle-class high school in Oregon, I have endured wave after wave of testing and curriculum models, the latest being Common Cores standards. Today, I see teachers around me having to justify their existence, with classroom and student goals required of all teachers to be aligned with state standards, just the latest burden set on schools. Classroom sizes grow to 35+, an ever-expanding cohort of students failing to make it through the standard programs without supports and funding for education being held hostage by political games that serve the few. The pattern over the past 20 years has been a decreasing capacity of a growing number of students entering high school to remain academically focused when confronted with classroom challenges, where understanding takes effort. The middle third of the bell curve (those who must work to succeed) are slipping, moving to the left. Some causes seem clear…. more students in homes without adequate supports, more students in economic stress, more children who face outside challenges that affect schoolwork. Millions of home foreclosures = millions of disrupted childrens’ lives, lives that find it harder focus in school. Our Oregon school has hit a critical mass: 40% of incoming freshmen are being labeled as at-risk. That is unbelievable.”
These are problems with origins far, far away from the education arena. Problems that are not so easily fixed. Especially when the people who are primarily responsible for them aren’t held accountable…so that the problem recurs.
The intentional destruction of our economy and educational system has been perpetrated by libertarians, right-wing and religious extremists, as well as corporatists, who want every last penny for themselves and their doctrines through private prisons, charter schools, private armies, a biased corporate media– everything, while they ship our factories and jobs overseas. There can be no economy and no way out of poverty until America rises up and realizes what’s being done to them. There can be no economy without jobs. Now there are few jobs except low-paying ones where people must work two or three to make ends meet, forcing children to grow up without adult supervision and time to care for, help them, and love them. It’s all intentional.
These multinational corporations are determined that only the elite few shall be well-educated–after all, no one else can afford good college educations today. They want to profit from phony standards for schools, unaccountable charter schools, while they dismantle collective bargaining rights and pensions, not only from teachers, but from every workerr in this country and overseas. We will have no country ever again worth two cents until and unless these greedy corporatists are forced to keep their hands out of our schools, until we give each and every child the right to the best education possible with excellent thinking skills, challenges, necessary facts, real history, civics, building a base of knowledge and critical thinking for the future. I’m afraid these extremists have so overtaken our country, that there may be no turning back–but we must keep fighting. I taught at a time when creativity and thinking and knowledge were highly regarded and excellent public schools were respected.
is this post asserting that american education is *not* stagnant? perhaps it’s merely a matter of semantics. my public school education in the late 1960-70’s seemed to be all about obedience and rote performance. i imagine now that those attributes were welcomed in the workplace. now: perhaps not so much?
even if american students have always been inferior to their asian counterparts, is it acceptable to believe the status quo is permanent? my understanding of pisa is that it encourages borrowing best practices, without regard to whether one’s system is stagnant.
Orionoir,
Read the post. PISA scores predict nothing for the future of our economy.
If you think the scores are important, then you must agree that NCLB and Race to the atop failed.
We are not China.
We have a culture that prizes creativity and freedom.
Unfortunately, we also have a culture that ignores poverty and discards children.
Are we sure that our society DOES value creativity? If we look at these tests. that is NOT the case. It seems that we have decided to allow business decisions to dictate what is valued. That seems to be “sameness” and a willingness to be agreeable to living a mundane existence trying to survive on minimum wages. There seems to be further devaluation of female opinions and contributions by undermining salaries and replacing teaching jobs with computer technology.
Who gets to stake a claim on defining what our culture wants, needs, stands for.
Deb: it’s these forces that would devalue our spirit of innovation and creativity that we’re fighting. These are the same forces that value the achievements of a totalitarian country such as China over those of their own country.
There is a nice article in the Washington Post that contains an essay by a bunch of leaders in mathematics, statistics, and education. http://www.washingtonpost.com/blogs/answer-sheet/wp/2013/12/06/the-future-of-high-school-math-education/
Corey:
The WP commenters do not appear to be impressed.
Without a detailed analysis of the PISA results (or NAEP or similar assessments) the appropriateness of any existing or proposed Math curriculum surely cannot be determined. A number of commenters raise questions as to the basic computational abilities of students. Is this accurate? Is it reflected in the answers to the PISA items? If it is, then it is reasonable to ask how are such deficiencies to be addressed.
A quick check suggest that per capita GDP growth since 1965 has been far greater in countries where PISA scores have rapidly improved than in the US. And of course while per capita GDP has grown in the US in that period, there’s been almost no change in median earnings. Furthermore, current US STEM unemployment is quite high (see http://www.cjr.org/essay/it_doesnt_add_up.php?page=all). So Ravitch might be factually wrong.
Note that I am not endorsing increasing school testing; we need to improve STEM scores in other ways, above all by promoting upward mobility (which in turn catalyses hard work in schools).
Paul Adams,
There have been a number of articles published saying that the STEM “crisis” is overblown. See the links in this post, quoting an article saying that there is no shortage: https://dianeravitch.net/2013/09/12/is-there-a-stem-shortage/
Diane:
I take a different view of the STEM shortage. I see it not in terms of filling existing jobs, but actually creating future jobs. Of course, this begs the question of the nature of STEM related education initiatives.
“And when it came to creativity, the U.S. “clobbered the world,” with more patents per million people than any other nation.”
Well, if we’re using this measure to rate this country’s education system, we should exclude patents gained by people who received their education outside the US and immigrated. I’ll bet that’s a lot of them.
Jim, why did they immigrate here? Freedom? Opportunity? Great universities?
Hello, I’m a parent of three children ranging from ages 17, 15 and 8. I had a parent teacher meeting today for my 8 year old and was blown away to find out that my 8 year old was given a standardized math test which consisted of 30 plus 3-digit problems and timed for 2 minutes to assess how many she can get correctly. Of course she did poorly, but for a number of reasons. The first question I posed to the teacher is this…”Do you mean to tell me that my 8 year old is being pressured and placed under a high competitive level of stress to answer 30 plus 3-digit math concepts in 2 minutes and the district is calling me into school to tell me that “my child” is the one that’s having the inability to grasp the fundamentals of how one should learn? I as an adult couldn’t even answer three problems in that time. Riddle me this…how is this learning?… I asked…to me it appears my child is being taught to memorize concepts rather than learn how to do the math. Is our educational system this bad that my child is no longer being taught the basic fundamentals of math/reading/comprehensive but rather shortcuts in an effort to spend up her efficiency in test taking?” Her teacher apologized and stated that she agrees and understands my concerns, however the State of NJ authorizes them to give such timed testing to assess the child’s increase of accuracy as the school year progresses. She admitted that it’s not learning and indeed repetition/memorization of the problems in effort to increase her accuracy vs. speed and it’s out of her hands. That some students can grasp this method of learning faster than others, and she call me in to provide me with “tools” I can use at home to assist her in picking up speed and flash cards to help with memorization. Having said this, all three of my children learn differently and are each strong and weak in areas the other is not, but all are far from dumb and extremely artistic and talented in many ways. They excel and flourish in their own individualized way at home when these areas are tapped in to and used to help improve their weakness and increase their strengths. It’s unfortunate our teacher’s aren’t allowed or given the opportunity to teach our children in the same manner. As a parent I feel a major problem with teaching today’s children is that there’s to much pressure and focus being placed on test scores, which has created this wayward method of teaching memorization and preventing our “teachers” from truly providing the tools our kids need. I agree that yes in some areas of learning and life that repetition is warranted, but in my opinion I feel the educational system has gone overboard when it comes to this “teaching tool”. Our teachers follow second to the parents as our children’s first gatekeeper’s of learning and aiding in recognizing their strengths, weaknesses, creativity and all they can offer to our future expansion of successful growth. NO two students are alike! Every child learns at a different speed and/or method. It’s unfortunate that I send my daughter to school each day to learn only to find out that her confidence of learning is being shattered as a result of the amount of “timed competitive” pressure/stress she’s being subjected to. My child leaves feeling she’s not good enough, smart enough and stupid because she didn’t complete as many problems as Bobby did in 2 minutes, because she couldn’t focus and add fast enough. When the reality of it all is little Bobby isn’t adding faster than you but rather he’s memorized the answers from repetition so that NJ’s school test scores can give the false impression that our teacher’s are actually being given the opportunity to “really teach” our children. I took a copy of this test home to see my daughter’s true accuracy based on providing her a responsible/respectable and fair timetable of 30 minutes for 30 problems (i.e. a minute per problem) and she got 28/30 of them correct because she actually worked the math problems. She finished with a feeling of confidence and somewhat cockiness knowing she did well, because there was no pressure and she actually worked the problem rather than rush to a guess in an effort to beat the clock. Our children are our future doctors, scholars, scientist etc. and I refuse to allow my three to be taught such methods when this isn’t how the real world works. How many of us have witnessed our young people today who work in our supermarkets as cashiers become stumped when not given the exact change that the register computed and are expected to actually count change backwards? It’s for these reasons and several others that I’m having my daughter evaluated to assess her IQ and true level of learning as I did ten years ago with my older two. Doing so, will assist me in implementing a 504 Plan which will afford her that one simple tool our school systems are lacking….”reasonable time” for our children to grasp and learn the fundamentals without the unnecessary pressure for accuracy based on these unfair timetable to number of problems ratios.
Respectfully,
A very concerned parent
Thank you, Angel. Spot on. You can’t imagine what it’s like to be told to teach the children in front of you in a way that you know is not caring, pertinent, or effective. But, as Mr. Coleman, chief architect (under Gates) of the CCSS, stated: “…nobody gives a s*#t what you feel or think…”.
I wonder if you all have looked over any of the PISA test questions? This isn’t your run-of-the-mill multiple choice test…in fact, it is not a multiple choice test at all. It tests ones ability to think, and to apply, what one has learned (or not learned). You can try some of the test here: http://www.oecd.org/pisa/test/
This is exactly the kind of test that we should want our students to do well on…and as a whole, we aren’t…
Anyone reading this blog should check out Amanda Ripley’s book The Smartest Kids in the World…it is incredibly eye opening.
On what are you basing your statement “…and as a whole, we aren’t…”, Benjamin?
From what I understand, there are studies that have shown our scores to compare very favorably, relative to other nations, when students from impoverished backgrounds are factored out of the equation. The demographics of Finland and Singapore, for example, are far different than those of the USA.
But I might be missing something, here. I’ll check out the book. I’ve heard of but haven’t yet read it. Thanks.
Whether or not careful analysis of PISA results indicates shortcomings in US education relative to other developed economies and whether or not inequality in the US results better or worse results than in other countries, can we agree on this: It sure would be better if more classrooms emphasized developing critical thinking and deep transferable knowledge more often? Wouldn’t more emphasis on social responsibility be a good thing? The first debate is important, because combating misinformation matters. But a real debate about how to target the three latter goals might unify more folks and be productive rather than defensive.