Archives for category: International

Bob Somerby, taught for many years in the Baltimore public schools. His blog The Daily Howler offers a fearless critique of media coverage of critical events.

His post on the latest international assessments (TIMSS) and the media’s decision tiresome putdown of American students is a classic.

He points out that on the math portions of the TIMSS tests, US students performed about the same as their peers in Finland. On the eighth grade TIMSS math tests, American students in several states outperformed Finland.

This should have been major news, in light of the constant ballyhoo about how poorly U.S. students have been doing for years on international tests. Decrying American student performance is the reformers’ trump card.

But instead of pointing to the real news, most papers told the same old story, which they might as well have written 20 years ago: “US Lags…”

At least a few thoughtful testing experts (Yong Zhao, Pasi Sahlberg, Keith Baker) recognize that the international horse race is nonsensical.

Once a nation reaches a certain level of development, the scores don’t tell you much about the national system or about the future of the economy.

Not everyone can be first. And it really doesn’t matter who is first.

Perhaps we should look at other metrics as more important, for example, what proportion of children are healthy? What proportion live in poverty? What proportion have access to high-quality preschool?

 

 

 

GF Brandenburg, retired math teacher, analyzed the latest international reading test, and it is chock full of good news.

Good news that it is for American children, parents, teachers, principals, administrators and school board members.

Not so good news for all the prophets of gloom and doom who have been prophesying the imminent collapse of the American economic and national security, while offering to sell snake oil to make it all better.

 

At my request, Pasi Sahlberg has written comments on the latest international test scores. Sahlberg is a prominent Finnish educator and author of the award-winning book “Finnish Lessons.”

Sahlberg writes:

International testing mania

This week educators around the world got a new opportunity to benchmark their students’ performance to their international competitors when The International Association for the Evaluation of Educational Achievement (IEA) released the results of TIMSS (Trends in Mathematics and Science Study) mathematics and science of 63 countries and PIRLS (Progress in Reading Literacy Study) in 48 countries. The United States took part in both of these studies that tested how well 4th grade children can read and what 4th and 8th grade students know about mathematics and science in school.

The media gave rather blunt headlines of the U.S. performance in these international tests this week. “U.S. students continue to trail Asian students in math, reading, science” wrote the Washington Post and “Competitors Still Beat U.S. in Tests” reported the Wall Street Journal. Only to be Number One seems to be enough for America media. Similar headlines were published in Canada, New Zealand and Norway – all countries with lower than expected results.

But a glance at participating countries’ national averages reveals some interesting aspects of American students performance in the 2011 TIMSS and PIRLS studies. 4th grade Americans scored high in science and reading and a bit lower in mathematics (7th, 6th and 11th respectively). Ahead were only East Asian countries (South Korea, Singapore, Hong Kong and Japan) and Finland. Americans 4th graders did better than most of their European peers in all tested areas.

Eighth grade American students also did well, hitting 9th in mathematics and 10th in science. Here again, before the U.S. came East Asians, Finns and, perhaps against the odds, Russians. This may seem to some in America as not good enough. But it is good to remember that according to historical data, American education has never been good if the criterion is performance in international studies. IEA has tested students in mathematics and science since the 1960s, the U.S. being one of the permanent participants. Over the half century, as Yong Zhao has concluded, American students performance in international mathematics and science tests has improved from the bottom to above international average.

Another interesting revelation in TIMSS 2011 is amazingly high performance of some U.S. states that took part in that study as ‘countries’. For example, 4th grade pupils in Florida performed above Canadian provinces of Alberta, Ontario and Quebec in reading, science and mathematics and were on par with Finland, except in science. Furthermore, 8th grade students in Massachusetts, Minnesota and Colorado were better than high performing Hong Kong in science. If Massachusetts, Minnesota, North Carolina, Indiana and Colorado were countries, they would all fit into top ten in 8th grade mathematics. Not bad at all.

Less than a month ago Pearson Corporation published another international study that compared 40 selected education systems, among them the U.S. and Finland. This study was based on an analysis of cognitive skills and educational attainment in these countries. In a way, “The Learning Curve” as Pearson has named its study, is a composite index that combines different sources of data and information. Finland was the winner in this new index, the U.S. being 17th. There has been some controversy concerning this study because it has been architectured and conducted by a commercial firm that has high interest in pushing forward certain education reforms around the world.

To make the scene of international comparisons even more complex, there is yet another international study, one that has gained more momentum and popularity than any other study. This is the Programme for International Student Assessment, better known as PISA, administrated by the Organisation for Economic Cooperation and Development (OECD). PISA was first run in 2000 and it tests 15-year-olds competences in math, literacy, and science in 34 OECD countries and similar number of non-member countries. It is conducted in three-year cycles – the results of PISA 2012 will be launched in December 2013.

In my book Finnish Lessons (2011) I highlighted early trends of American and Finnish students’ performance in reading, mathematics and science literacy. Findings were rather interesting. The U.S. students’ performance trend in PISA 2000 to 2006 was declining, similarly to all other countries that were infected by GERM (global educational reform movement of competition, choice, testing and privatization) in the 1990s. At the same time Finland’s scores in all areas were improving. Overall, as many people in the U.S. now know, American students have been left behind by most other OECD countries according to PISA test.

All that is said above invites two important questions. First, how is it possible that different international studies that compare education systems by having a particular look at students’ learning outcomes lead to such different results? Who is right? What do these studies really tell us? Second, are these studies in the end really able to inform policy-makers and guide education reforms in coherent ways so that teachers and students would have better opportunities to succeed? Do they help politicians to understand the nature of human learning?

Well, TIMSS and PISA are technically different studies, although they both build on similar measurement methodology. Simplified distinction of these two studies is that where TIMSS tests students’ mastery of what have been taught from the curricula, PISA assesses how students can use those knowledge and skills that they were taught in new situations. These both are student assessment studies. Pearson’s “The Learning Curve” index is different kind that consists of different indicators and is therefore a composite index. The problem with any study that relies on composite index is that it is open to designer manipulation. “Global Economic Competitiveness Index” and “The Best Country in the World” are good examples, just like “The Learning Curve.”

One may also conclude that these international standardized tests are becoming global curriculum standards. Indeed, OECD has observed that its PISA test is already playing an important role in national policy making and education reforms in many countries. Schools, teachers and students are now prepared in advance to take these tests. Learning materials are adjusted to fit to the style of these assessments. Life in many schools around the world is becoming split into important academic study that these tests measure, and other not-so-important study that these measurements don’t cover. Kind of a GERM in grand scale.

Pasi Sahlberg
Helsinki FINLAND

Now that many Republican dominated states like Louisiana, Indiana, Michigan, and Wisconsin are enacting vouchers, it is a good time to look at the experience of vouchers in Chile. The Pinochet military dictatorship became infatuated with free-market ideas and imposed vouchers in the early 1980s.

To learn about the Chilean experience with vouchers, I turned to one of Mexico’s best-known independent researchers, Eduardo Andere.

Eduardo Andere writes:

“I began doing research about Chile in 2005. I was most struck by the fact that Chile is the country, perhaps together with New Zealand, that initiated a long and deep stream of education policy reforms since the 1980s . In the case of Chile, the reforms were imposed by a military regime and were very different from those adopted in New Zealand. The Chilean reforms were what is now often described as “neo-liberal”: decentralization of decision making, vouchers, standardized testing and accountability with league tables, teacher assessment or evaluation, privatization of school education services.

“The results of the reforms in Chile are: very low performance in PISA. At the last published PISA 2009 test, Chile was tied with Mexico as the lowest performing countries, among 34 members, in Math. Chile ranks about the same as Mexico but below the rest in Science and Reading. Chile has launched deep reforms; Mexico has not; and yet the two of them show very similar performance.

“The voucher system in Chile is very limited and only works partially for certain kinds of schools, i.e. private subsidized. There are three types of schools: municipal (for the poorest); subsidized private (for middle class); paying private (for the elites). Academic performance is highest in the last ones, which have no vouchers or public subsidy.

“With the new Chilean government, education is in the midst of deep institutional reforms: new agency for quality education with increasing power to supervise and rank schools, recurrent failing schools will be closed; a revision of the voucher system; the creation of a superintendent of education to oversee the use of resources; and a national council of education to set the national policies of education. The new government, in other words, is not abandoning the reforms imposed by the military regime, just fine-tuning them.

“So far, it is the same story for US, Mexico and many other systems: many reforms, few changes: or “much ado about nothing.’”

For another perspective on vouchers in international context, read Martin Carnoy here. This was published in 1996 but the lessons remain the same: Vouchers increase the gap between the haves and the have-nots.

This suggests the perverse genius of the corporate reform movement, led by right-wing think tanks, which tout vouchers as a way to “close the achievement gap” and to “save minority children from failing schools.”

How clever to market vouchers by promising to do what vouchers have never done and will never do. How clever to claim that the free-market, which produced our current income gap, will produce equity in schooling and equality of opportunity. The most astonishing aspect of this claim is the utter lack of evidence for it.

The release of the latest international test scores has set off a new round of wailing and gnashing of teeth about America’s schools.

Yong Zhao has a completely different take on the scores and what they mean. It is a long post but well worth reading.

GF Brandenburg has a great post on the latest TIMSS test.

It puts paid to the customary hand-wringing (did you hear that, Wall Street Journal?) about the international test scores.

No crisis.

The real question, aside from the horse race, is whether the scores mean anything at all. The US came in last when the first such test was offered in 1964 and we competed with 11 nations. Yet we went on to be more successful as an economic power than any of the other 11.

Do we have problems? Yes. The biggest problem is the failure of our political leaders to address the social context in which children live and schools function–or not.

Andrew Hargreaves has some ideas about how education can improve and stop demoralizing those who work in schools. First, he looks for the good that Race to the Top may have accomplished. Then he looks at other nations’ experience and finds that those who are most successful are not doing anything that looks like Race to the Top. Hargreaves published two books in 2012: The Global Fourth Way: The Quest for Educational Excellence, with Dennis Shirley; and Professional Capital: Transforming Teaching in Every School, with Michael Fullan.

Hargreaves writes:

Now that the bickering and backbiting of presidential electioneering is over, we have a new opportunity to look at the future of American education with fresh eyes. Many of us, especially Diane Ravitch in this blog, have been critical of the US Race to the Top Strategy and of No Child Left Behind before it.

But suppose, at this moment, even if through gritted teeth, we concede what the work of RTTT has perhaps accomplished. The rise of charter schools has prompted many districts to question the bureaucratic hierarchies and inflexibilities that have strangled innovation and improvement in the past. The new performance-based reward agenda has undoubtedly brought teachers unions to the table to set aside some of their old blue-collar mentality and engage in different conversations about professional quality and recognition. The emergence of online alternatives for learning may be opening more teachers’ minds about the ways that technology can enhance their teaching. Suppose RTTT advocates have been at least partly right when they have insisted that the system had to be broken before it could be fixed.

What does that now mean for the next four years?

First, let’s acknowledge one of the key lessons of Change 101: in any change process, the strategies that get people to one point are rarely the same ones that will get them further. Charismatic leaders can fire people up, but they often have to be followed by more inclusive leaders who are able to distribute wider responsibility for the long-haul of change. No-nonsense leaders may be able to impose immediate order on chaos, but they usually need to be succeeded by leaders who can build collective responsibility for lasting improvement.

What does this mean for the next phase of RTTT?

Are we going to face four more years of breaking up the system into more and more charter school pieces, staffed by teachers with barely one or two years experience? Should educators be confronted with another unrelenting era of fear, threat and cut-throat competition?

In the short-term, fear and threat can create a sense of urgency and grab people’s attention. In the long-run, however, states of perpetual fear and threat just drive all the best people away. Just look at the exodus of top educators who have fled Wisconsin after their grueling battles with Governor Scott Walker.

We believe it’s time to build a new platform on which we can bring our schools back together, strengthen communities of teachers, inspire the educational profession, and keep the best young people in teaching instead of seeing them cycle in and out of the system as if it were a rapidly revolving door. This isn’t just a matter of our personal preferences and beliefs. It’s what the international evidence on high educational performance is clearly showing us.

In our new book, The Global Fourth Way: The Quest for Educational Excellence http://www.sagepub.com/books/Book235155, we describe our research evidence on some of the highest achieving schools and systems around the world such as Finland, Singapore, Alberta, and Ontario.

The first thing that is striking is what we don’t find in all these high-performing systems. We don’t find governments pushing charter schools, fast-track alternative certification programs, and salary bonuses for teachers who get the test scores up.

We don’t see systems testing all students in grades 3 through 8 on reading, writing, and mathematics with a national Department of Education setting the goals from afar, year after year.

We don’t come across governments setting up escalating systems of sanctions and interventions for struggling schools and endless rotations of principals and teachers in and out of schools that erode trust and destroy continuity.

What do we find instead?

We do find a lot of leadership stability and sustainable improvement at the system level, that establishes a platform for innovation to take off in districts and schools.

We do find educators who have gone through excellent university-based preparation programs that are also backed up by extensive practice in schools, and who study research and bring a stance of inquiry to the work they do with their students every day.

We do find a highly respected profession along with a public that lets and expects these trusted professionals to bring their collective talents to bear in their work.

We do find testing that is applied in a couple of grades, not all of them; or to a representative sample of students rather than an unnecessary census of everyone.

And we do find turnaround strategies that rely on connecting struggling schools with higher performers who are tasked with helping them, rather than on parachuting in intervention teams from the top.

In high-performing systems, there is a strong teaching profession backed by powerful and principled professional associations that are in the forefront of educational change. These professional associations are not afraid to challenge government when necessary or to collaborate with them whenever they can. Over 50% of the resources of the Alberta Teachers’ Association, for example, goes to professional development for its members; whereas just 5% or so of teacher union budgets are currently allocated for these purposes in the US.

If you want to improve as a teacher, it’s important to learn from teachers who are doing better. If you are trying to turn around as a school, look to a higher performing school that can give you clues about the best way to proceed. The same is true for the US and other nations.

If, like the US, you are languishing far below the leaders in the international rankings of student achievement, then look, with open eyes and no excuses, at what the highest performing countries are doing instead. Their path is clearly the opposite of what has been pushed on American schools.

Let’s concede that districts and unions may have needed shaking up a bit, if America’s education system was to move forward. But shaking things up isn’t the same thing as improving them. Real and lasting improvement, rather than a few triumphant turnarounds here and there, is going to need something else. High performing counterparts from around the world provide some of the best ideas about what this might be.

If the United States is going to be the world-leader in education that the country’s national wealth and international status lead everyone to expect, what might it do in the next four years to move to the next level? Here are five big changes that can make a huge difference based on the international evidence:

  • Test prudently, in two or three subjects in a couple of grades, not pervasively in almost every single grade all the way up to Grade 8.
  • Shift the focus from fast track programs into teaching itself, to strong pathways that retain the best teachers in the profession.
  • Redirect half of the resources from top-down intervention teams whose impact is temporary at best, towards strategies for schools to assist each other in raising achievement results across district boundaries and even state lines.
  • Commit everyone to exploring how technology can enrich teaching wherever it is truly needed, rather than insisting it replace teachers at every opportunity.
  • Invest more resources in public services as a whole – in housing and infant care, for example – so that educators don’t always have to pick up the slack.

It’s time to look elsewhere for inspiration again. America has always learned from other countries. It adapted Harvard College from Cambridge and Oxford in England, imported the kindergarten from Germany, and adopted the Suzuki method of violin instruction from Japan. The same spirit of curiosity and inventiveness that has served Americans so well in the past can and shoud serve the nation once more.

Stephen Krashen is an expert on linguistics and literacy. He read Arthur Levine’s scathing criticism of US test scores on the PISA exam and decided to do his own analysis. He decided Levine was far too negative.

Krashen decided that: “the US does quite well, controlling for SES. And maybe American scores are ‘just right.'”

He writes:

“In a recent article in the Wall Street Journal, Arthur Levine discusses the performance of high socio-economic status (SES) students on the PISA math examination, thus controlling for the effect of poverty (the PISA is an exam given to 15 year olds in countries throughout the world). Levine concludes that high social class American students fall in “the middle of the pack” in PISA mathematics.

“Levine’s definition of high social class was having at least one parent with a college education. After reading Levine’s article, I decided to do my own analysis. I used a different measure of SES: the PISA index of economics, social and cultural status. I looked at reading scores for students in 66 countries who were at the 75th percentile of this measure, in other words the upper quarter of socio-economic status.

“According to my calculations, students in only 12 “countries and economies” scored significantly higher than American students on PISA reading and students in 44 “countries and economies” had significantly lower scores. Levine says the US scored in the “middle of pack” in math. Controlling for poverty, they certainly did not score in the middle of the pack in reading but were well within the upper quarter. (See note 1 below; I was unable to find the data necessary to do an analysis of mathematics scores controlling for SES in this way.)

“Yong Zhao of the University of Oregon has reported that countries that score high on international tests score low on measures of “perceived entrepreneurial capabilities.” This result is consistent with research cited by D. K. Simonton in his book Genius, Creativity and Leadership: an optimal amount of formal education is best for creative accomplishment in science and the arts and humanities – not too much and not too little. Simonton also concludes that that those who achieve high scholastic honors do not always attain eminence in their work.

“Maybe US scores are just right.”

Note 1: American students scored 569 on the PISA reading test, with a standard error of 4.6. As mentioned, 12 “countries and economies” scored significantly higher (i.e. their scores fell outside the 95% confidence interval around the US’ score, 560 to 578).

Of the 12 scoring higher than the US, several were not countries. Shanghai is a city, with 23 million people, about 1.5% of the population of China and is a clear outlier: Even Shanghai students in the lowest quartile in socio-economic status scored 500, close to the overall average for all OECD countries.

Singapore is considered a “city-state” and has a population of five million. Hong Kong is a “special administrative region (SAR)” of China with a population of seven million. Both Singapore and Hong Kong have fewer people than Los Angeles County, states of Michigan or Georgia, all around 10 million.

Thus, only nine actual countries did better than the US. Note also that other countries doing better than the US also have small populations: Finland, 5.5 million, New Zealand, 4.5 million, and Belgium, 11 million.

Sources:

Levine, A. 2012. The Suburban Education Gap. Wall Street Journal, November 14, 2012.

Simonton, D.K. 1984. Genius, Creativity and Leadership. Cambridge: Harvard University Press.

PISA 2009. Overcoming Social Background. Programme for International Student Assessment. http://www.oecd.org/pisa/pisaproducts/pisa2009/pisa2009resultsovercomingsocialbackgroundequityinlearningopportunitiesandoutcomesvolumeii.htm

Zhao, Y. 2012. Flunking innovation and creativity. Phi Delta Kappan 94 (1): 56-60.

The scores: (from: Table 11.1.1, PISA 2009, p. 152).

Shanghai
613 (2.8)
Finland
597 (2.2)
Singapore
597 (2.1)
New Zealand
595 (2.8)
Korea
595 (3.4)
Hong Kong
592 (2.5)
Japan
590 (3.0)
Canada
588 (1.7)
Australia
584 (2.7)
Belgium
583 (2.2)
Netherlands
575 (5.4)
France
572 (4.0)
Switzerland
569 (3.0)
USA
569 (4.6)
Norway
568 (2.9)
Germany
567 (2.8)
Iceland
567 (2.0)
Poland
565.(3.2)
Sweden
565 (3.2)
Ireland
562 (2.8)
UK
561 (3.2)
Liechtenstein
560 (4.5)
Estonia
559 (2.8)
Hungary
559 (3.6)
Italy
556 (1.7)
Taipei
555 (2.9)
Israel
554 (3.4)
Denmark
554 (2.8)
Portugal
551 (3.4)
Greece
550 (3.1)
Slovenia
550 (1.7)
Luxembourg
547 (1,7)
Austria
545 (3.3)
Czech Rep
545 (3.3)
Austria
545 (3.3)
Czech Rep
545 (3.3)
Slovak Rep
543 (2.7)
Spain
543.(2.0)
Latvia
541 (3.3)
Leichtenstein
541 (3.3)
Macao-China
540 (1.4)
Croatia
539 (3.1)
Dubai
536 (2.4)
Lithuania
530 (3.1)
Turkey
522 (4.5)
Russian Fed.
519 (3.2)
Bulgaria
512 (6.5)
Serbia
501 (2.5)
Trinidad/Tobango
496 (2.3)
Uruguay
495 (3.1)
Romania
488 (4.7)
Mexico
485 (1.9)
Brazil
474 (3.9)
Argentina
473 (7.1)
Columbia
473 (3.9)
Thailand
469 (2.6)
Indonesia
468 (3.5)
Tunisia
462 (3.4)
Albania
458 (4.8)
Kazakstan
452 (4.2)
Qatar
450 (1.4)
Indonesia
447 (4.6)
Peru
437 (5.2)
Panama
436 (7.7)
Azerbaijan
413 (4.0)
Kyrgystan
377 (4.2)

The conservative British government is hurrying to convert its state schools to academies with private sponsors, akin to our charter schools. In the mad rush to expand the academies, so much was spent on them that there will be deep cuts in the budget of state schools. This works to the advantage of the academies as the state schools tighten their belts, cut programs, increase class size and become less attractive.

Thomas Friedman of the New York Times thinks that Arne Duncan should be the next Secretary of State. He would like to see Race to the Top applied to our international relations.

Readers have reacted. Leonie Haimson in New York City suggested that Arne could close embassies that can’t end wars and conflicts.

Here is another good idea:

He could start an innovative new trend of “Charter Embassies.” They would be U.S. embassies that are publicly funded, but cheaper to maintain and not beholden to rules of international law.

Actually, if you take it to its logical conclusion, every embassy would have its own foreign policy.