Stephen Krashen is an expert on linguistics and literacy. He read Arthur Levine’s scathing criticism of US test scores on the PISA exam and decided to do his own analysis. He decided Levine was far too negative.
Krashen decided that: “the US does quite well, controlling for SES. And maybe American scores are ‘just right.'”
He writes:
“In a recent article in the Wall Street Journal, Arthur Levine discusses the performance of high socio-economic status (SES) students on the PISA math examination, thus controlling for the effect of poverty (the PISA is an exam given to 15 year olds in countries throughout the world). Levine concludes that high social class American students fall in “the middle of the pack” in PISA mathematics.
“Levine’s definition of high social class was having at least one parent with a college education. After reading Levine’s article, I decided to do my own analysis. I used a different measure of SES: the PISA index of economics, social and cultural status. I looked at reading scores for students in 66 countries who were at the 75th percentile of this measure, in other words the upper quarter of socio-economic status.
“According to my calculations, students in only 12 “countries and economies” scored significantly higher than American students on PISA reading and students in 44 “countries and economies” had significantly lower scores. Levine says the US scored in the “middle of pack” in math. Controlling for poverty, they certainly did not score in the middle of the pack in reading but were well within the upper quarter. (See note 1 below; I was unable to find the data necessary to do an analysis of mathematics scores controlling for SES in this way.)
“Yong Zhao of the University of Oregon has reported that countries that score high on international tests score low on measures of “perceived entrepreneurial capabilities.” This result is consistent with research cited by D. K. Simonton in his book Genius, Creativity and Leadership: an optimal amount of formal education is best for creative accomplishment in science and the arts and humanities – not too much and not too little. Simonton also concludes that that those who achieve high scholastic honors do not always attain eminence in their work.
“Maybe US scores are just right.”
Note 1: American students scored 569 on the PISA reading test, with a standard error of 4.6. As mentioned, 12 “countries and economies” scored significantly higher (i.e. their scores fell outside the 95% confidence interval around the US’ score, 560 to 578).
Of the 12 scoring higher than the US, several were not countries. Shanghai is a city, with 23 million people, about 1.5% of the population of China and is a clear outlier: Even Shanghai students in the lowest quartile in socio-economic status scored 500, close to the overall average for all OECD countries.
Singapore is considered a “city-state” and has a population of five million. Hong Kong is a “special administrative region (SAR)” of China with a population of seven million. Both Singapore and Hong Kong have fewer people than Los Angeles County, states of Michigan or Georgia, all around 10 million.
Thus, only nine actual countries did better than the US. Note also that other countries doing better than the US also have small populations: Finland, 5.5 million, New Zealand, 4.5 million, and Belgium, 11 million.
Sources:
Levine, A. 2012. The Suburban Education Gap. Wall Street Journal, November 14, 2012.
Simonton, D.K. 1984. Genius, Creativity and Leadership. Cambridge: Harvard University Press.
PISA 2009. Overcoming Social Background. Programme for International Student Assessment. http://www.oecd.org/pisa/pisaproducts/pisa2009/pisa2009resultsovercomingsocialbackgroundequityinlearningopportunitiesandoutcomesvolumeii.htm
Zhao, Y. 2012. Flunking innovation and creativity. Phi Delta Kappan 94 (1): 56-60.
The scores: (from: Table 11.1.1, PISA 2009, p. 152).
Shanghai
613 (2.8)
Finland
597 (2.2)
Singapore
597 (2.1)
New Zealand
595 (2.8)
Korea
595 (3.4)
Hong Kong
592 (2.5)
Japan
590 (3.0)
Canada
588 (1.7)
Australia
584 (2.7)
Belgium
583 (2.2)
Netherlands
575 (5.4)
France
572 (4.0)
Switzerland
569 (3.0)
USA
569 (4.6)
Norway
568 (2.9)
Germany
567 (2.8)
Iceland
567 (2.0)
Poland
565.(3.2)
Sweden
565 (3.2)
Ireland
562 (2.8)
UK
561 (3.2)
Liechtenstein
560 (4.5)
Estonia
559 (2.8)
Hungary
559 (3.6)
Italy
556 (1.7)
Taipei
555 (2.9)
Israel
554 (3.4)
Denmark
554 (2.8)
Portugal
551 (3.4)
Greece
550 (3.1)
Slovenia
550 (1.7)
Luxembourg
547 (1,7)
Austria
545 (3.3)
Czech Rep
545 (3.3)
Austria
545 (3.3)
Czech Rep
545 (3.3)
Slovak Rep
543 (2.7)
Spain
543.(2.0)
Latvia
541 (3.3)
Leichtenstein
541 (3.3)
Macao-China
540 (1.4)
Croatia
539 (3.1)
Dubai
536 (2.4)
Lithuania
530 (3.1)
Turkey
522 (4.5)
Russian Fed.
519 (3.2)
Bulgaria
512 (6.5)
Serbia
501 (2.5)
Trinidad/Tobango
496 (2.3)
Uruguay
495 (3.1)
Romania
488 (4.7)
Mexico
485 (1.9)
Brazil
474 (3.9)
Argentina
473 (7.1)
Columbia
473 (3.9)
Thailand
469 (2.6)
Indonesia
468 (3.5)
Tunisia
462 (3.4)
Albania
458 (4.8)
Kazakstan
452 (4.2)
Qatar
450 (1.4)
Indonesia
447 (4.6)
Peru
437 (5.2)
Panama
436 (7.7)
Azerbaijan
413 (4.0)
Kyrgystan
377 (4.2)
It would be interesting to replicate this study at the other end by comparing the scores of the bottom quarter across countries.
Well, may be Mr. Krashen is right! The analysis below may help to buttress many people’s view why American education isn’t so bad after all:
The education of Nobel Prize winners
By Eduardo Andere M .
The 2012 Nobel Prize edition is over. Most Nobel’s awards throughout history have been assigned to people of a country, whose pre-university education is deemed, by the fans of league tables, mediocre or deficient.
In the international league table OECD’s PISA game, the US is located at around the mean result. For example, in the latest published PISA results, 15 to 16 years old American students ranked somewhere between the 21 and 29 position in mathematics out of 34 OECD countries. Mexico and Chile are tied at the bottom. Finland and South Korea, meanwhile, top the list. So, the U.S. is closer to the bottom than it is to the top.
Most disappointing is the fact—the critique goes—that US pre-university education is among the most expensive in the world. While Americans spent in 2007 (latest published data) $ 129,000 per elementary, middle and high school student, the Finns spent 87 000, and the South Koreans 80 000 (OECD 2010). This makes each PISA point cost the U.S., $87, while Finland and South Korea pay 53 and 49 respectively.
Let’s see what happens at the other end of the educational and knowledge pyramid. The Nobel Prize is one epitome of the educational, scientific and technological apparatus. The award is given in five categories: physics, chemistry, medicine, literature, economics and peace. In many cases an award is given to several winners, so there are more winners than prizes. In 2012, for example, there are 10 winners and five awards: two in physics, two in chemistry, two in medicine, two in economics, one in literature and one, peace award, to the European Union.
Of the nine human-recipient awards, five are American by birth, one is Moroccan, one Japanese, one British, and one more, Chinese (literature). And of the eight who have university affiliation (because the literature prize has not so) six are affiliated to U.S. universities.
Historically, from 1901 through 2012, 555 awards have been granted to 863 people, of which 246 are US nationals. From a total of 620 university-related laureates 321 are affiliated to US universities. And if one looks at the top ten universities with Nobel laureates nine of them are American.
China, whose Shanghai province and the Special Administrative Region of Hong Kong, obtained outstanding results in PISA 2009, has a total of 10 Nobel winners in history. Finland, South Korea and Singapore, the top countries in basic and high school education, have earned three, one and zero Nobel Prizes.
If one delves deeper into science, technology and innovation, the United States shines with most of the production in all three areas. And within the realm of business success in the knowledge era, all, or almost all star companies in the 21st century, which permeate the lives of all of us, such as Google, Apple, Amazon, Intel, Facebook, Dell, Yahoo, Microsoft, Wikipedia, YouTube, PayPal, and Twitter, among others, are of U.S. origin.
So, what is going on? If the Nobel contest is the point of a knowledge iceberg, the so-called quality education assessment of students, schools and teachers is missing something. How come the shooting stars of basic education pale in higher leagues?
Click to access the_nobel_prize_winners.pdf
This debate whether “American” students are middle of the pack, higher, or “just right” would be simply comical if it weren’t for its insidious message about what constitutes “American” standing or, for that matter, other “countries and economies” in the education of children.
In short, this is the message; Levine thinks the most privileged students are still doing less than students in other more “advanced” countries, Krashen thinks that looking at privileged students and doing a “better” analysis shows that privileged “American” students are “just right”. The overall message? The education of privileged children throughout the world is an appropriate measure of the “goodness” of the education system among “countries and economies”.
It is easy to dismiss this “debate” as a useless exercise if it were not for what it tells about “American” intellectuals (i.e.,privileged, mostly, White “educators) and what they consider important in issues of educating a multicultural pluralistic population of youth in the U.S. compared, in the main (but not all) with mostly homogeneous privileged students in other “countries and economies”. PISA scores? “Suburban achievement gaps”? This is what “world class” educators concern themselves about? Did anyone actually learn anything from this last 4 year exercise in privatizing public education based on the fallacy of standardized testing as a measure of an education and the social worth of a truly educated society?
I am led to think that “progressive” educators are simply poseurs for the pretense of education for all that are in reality perpetuating a system of education focused on “enlightening” the privileged few.
Some countries, including New Zealand, don’t allow illegal immigrants to go to school. For NZ it’s no big problem because very few people get here illegally given we are an island deep in the South Pacific. However, it makes comparisons with the USA on PISA a bit apples and oranges given that illegal immigrants, who count for PISA in the USA, are often English Langauge Learners.
An interesting perspective but I have some sympathy with the previous comments. Putting aside moral issues of equality of opportunity, with the rapid rise of populous nations we cannot put all our eggs in the baskets of the top SES quartile. I think it also neglects to address the per capita cost of education. The USA is one of the highest spending nations on education and our PISA scores do not reflect this. I am also troubled by what I view as a dangerously common attitude. While USA students may perform poorly on the whole in PISA mathematics, for example, they demonstrate high levels of self confidence. I don’t like national generalizations, but I have heard far too many people state that America is the most free, most advanced, most morally correct nation on earth. What I have described as the ‘curse of riches’ makes many of us too inward looking and self congratulatory. There are many of us who find it simply too hard to admit that other nations may be doing things better than us, and so we seek to defend and justify and question the methodologies of comparison rather than learn from outside our own boundaries. I think this may be changing. I hope so.That said, I agree wholeheartedly that PISA needs to be examined more deeply. it should not be seen as yet another league table. It is filled with rich data and information about many of the more subtle influences on achievement than the actual scores on the tests.
@ Pat – “There are many of us who find it simply too hard to admit that other nations may be doing things better than us, and so we seek to defend and justify and question the methodologies of comparison rather than learn from outside our own boundaries. I think this may be changing. I hope so.”
And what is it that other countries do better? Every classroom around the world is similar – there are teachers facilitating and students learning. In the Asian countries, teachers switch classrooms while the students stay. These Asian countries rely heavily on direct instruction and drill and kill methods. Finland’s classrooms look much like ours, of course, without the standardized testing. The one difference in Finland that is very appealing to me is their vocational track in high school. They don’t pretend that all kids should go to college like we do here in the U.S. In fact, I just wonder how much of the agenda, to send ALL of our kids to college, has to do with the fact that they represent future profits for both public and private enterprises.
The bottom line is this – with a little bit of research, from both sides of the educational reform argument, it is clear that schools and teachers only play a part in a child’s education. What we do at school only reinforces and builds upon the motivations of children that were developed long before they stepped in our classroom.
The argument of the “effective teacher” is a sham. It has been built in order to attack public schools. There is nothing “better than us” in the sense that someone in another country is doing something in the classroom that we are not, and that what they are doing would “fix us”.
Socioeconomic status drives education. It is the engine that produces the numbers we see in every measure. And even the outliers that we may see, schools and/or teachers that produce high test scores, either here in the U.S. or abroad, (given the number of high poverty students), does NOT guarantee success. I have a hard time trusting any standardized test outcomes, especially those of high-stakes state standardized tests. There is so much prepping, coaching, and downright cheating, high-stakes tests in America are meaningless.
If we would fix our high child poverty rate, instill a respect for education among all people, and provide a safe environment at home and at school, we would do more to fix our schools than any reformy plan.
Finland’s teacher education programs look nothing like ours. It is easier to get into medical school than into primary teaching. In Australia – the other country I am familiar with – the entry requirements for education courses at university continue to fall. I was deeply disturbed by the literacy levels of some of the teachers in the school I led in the USA. I was asked to proof a paper being submitted for a M.Ed. at a reputable university. It was awful and that person now has a doctorate in education. Teach for America and Troops to Teachers place minimally prepared adults in front of children, not professionally trained teachers. Is it any wonder we do not trust teachers to control curriculum, methodology and assessments in the ways in which Finnish teachers are trusted? In Singapore, 10% “white time” is provided to all teachers to enable them to meet, talk, think, prepare their teaching. It’s too easy to push aside Asian schools as ‘drill and kill’. That misrepresents the diversity among schools. It also fails to acknowledge the very nature of the PISA assessments which (unlike TIMMS and PIRLS) require students to apply their learning to new situations. Simple rote learning through drilling will not facilitate that kind of learning.
I agree, the US PISA scores aren’t bad. Neither are they all that good. More shocking: the comment in the interim report, that of all participating countries, only in the U. S. is there a decline in overall evidence of learned knowledge and so on. The real failure here: The normal colleges and their product. An EdD from Teacher’s College should be grounds for dismissal; a PhD in Educational whatever from NYU should be considered criminal. From the ’60s on, these weenies have been foisting mediocrity and bad learning on American kids. The “conservative” normal-college weenies are no better than the liberals.