Andreas Schleicher is the director of that section of the OECD in charge of international testing. He recently claimed that Americans are not over tested. He can’t understand why parents and teachers are complaining so much, when students in other nations take many more tests than American students.
Since this seemed counter-intuitive, I called on two great international experts–Pasi Sahlberg and Yong Zhao– who work with OECD data frequently. Both responded promptly.
Here are their comments on Schleicher’s claim that American students are not over tested:
Pasi Sahlberg, author of Finnish Lessons and currently a Visiting Professor at the Harvard Graduate School of Education, writes:
“Education myth: American students are over-tested,” says the title in the Hechinger Report on 7 December 2015. That story covers the frustration of OECD’s education chief Andreas Schleicher after he attended recent education summit held at the White House. Schleicher concluded that the United States is not a country of heavy testing and that standardized testing is not the bottleneck for improvement.
Wait a minute. So, standardized testing is not an issue in the U.S. education? My experience based on school visits and many discussions with parents and teachers around the U.S. suggest quite the opposite. It is clear to me that one of the main obstacles in focusing more on real learning, giving more room to music and arts in American schools, building learning in schools around curiosity, creativity and exploration of interesting issues, is standardized testing.
I have been in school districts where principals told me that they spend up to one third of annual instructional time to testing and related activities. I have seen tens of schools and hundreds of teachers who tell how there is no more recess or physical education or music in their schools because time is needed to do well in obligatory tests. And it is not just tests themselves but everything that comes with high-stakes nature of them: fear of failure, pressure of performance, and time spend in and out of school on preparing for these tests. And perhaps most importantly, I don’t know any other OECD country where cheating and corruption are so common in all levels of the school system than it is in the U.S., only because dominance of standardized tests.
Schleicher writes in his blog that “over the years I have learned to trust the reports of students on what actually happens in the classroom more than the claims of many experts.” But how can a teenager tell the difference between standardized test and other kind of classroom assessments that are rarely standardized? If 15-year-old students in Finland tell that they take standardized tests three to five times a year they clearly don’t know what standardized tests are. And how could they when they have never seen one.
I tend to trust more on quantitative research and data from experts than surveys that reflect often opinions more than actual facts. In a recent (October 2015) study by the Council of the Great City Schools (CGCS) researchers examined the amount of standardized testing in American urban schools. Their research found that “students in the 66 districts were required to take an average of 112.3 tests between pre-K and grade 12.” It is worth of note that this number does not include optional tests, diagnostic tests for students with disabilities or English learners, school-developed or required tests, or teacher designed or developed tests. According to this same study the average student in these districts will typically take about eight standardized tests per year, e.g., two NCLB tests (reading and math), and three formative exams in two subjects per year. This is heavy testing to me. It is about eight times more than in Finland.
Andreas Schleicher is right when he writes that “it is actually very hard to find comparative data on the prevalence of testing in OECD countries”. But he is wrong in hoping that students would be a more reliable source of answers than experts. When 20 per cent of students in the state of New York opted out mandated standardized state tests earlier this year, it was a clear sign that both students and parents think that their schools are over-tested.
In the end, what Schleicher’s simple international comparisons ignore is that toxic and often misused accountability systems that link data from standardized tests to teachers, schools, districts and, through PISA, to entire education systems. GSCS’s study confirmed that “there is no correlation between the amount of mandated testing time and the reading and math scores in grades four and eight on the National Assessment of Educational Progress (NAEP)”. Therefore, rather than suggesting that there is still room for more standardized testing in the U.S. it would benefit more to advice authorities and politicians to invest that money to improve the existing tests. Standardized testing is a growing industry globally and those with most interests in having even more testing in schools are corporations that have direct economic interest to test our children over and over again.
Yong Zhao, author of Who’s Afraid of the Big, Bad Dragon? Why China Has the Best (and the Worst) Schools in the World, and professor at the University of Oregon, also responded with the following post: “Are American Students Overtested: Schleicher vs. Schleicher”:
It begins:
Just as the U.S. is about to move away from over testing its students, PISA’s Andreas Schleicher says American students are not really over-tested: “The U.S. is not a country of heavy testing,” said Schleicher in a column published in the Hechinger Report.
Schleicher drew the conclusion based on PISA 2009 student survey data, which was not released publicly. Schleicher claims to “trust the reports of students on what actually happens in the classroom more than the claims of many experts” in his blog post that argues that U.S. is not a country of heavy testing. One wonders why he has not released that data.
However the publically available PISA report contains standardized testing data reported by school principals. Given the lack of access to the student data, reports by school principals are the best source we have. I’d like to think that school principals know as well as students if standardized tests are given in schools. Moreover, comparing the few data points Schleicher reveals in his blog suggests that the perception of students is not far off from that of principals. Based on the principal reports about standardized testing, I found Schleicher’s statement misleading, to say the least.
Is U.S. a country of heavy testing?
First, what is considered heavy testing? Schleicher seems to think at least once a month is not heavy enough: “In many countries there is a test going on every month,” while in the U.S., “only 2% of students said they took standardized tests at least once a month.”
Is 3 to 5 times a year heavy? That is about one standardized test every 2 months of the school year. About 40% of American students take standardized tests 3 to 5 times a year. How about 1 to 2 a year? That’s almost every American student (97%).
Schleicher’s conclusion is based on international comparisons. He highlighted two nations that have more standardized tests than the United States but neglected to mention that there many countries that have fewer standardized tests. For example, according to the 2009 PISA principal survey, 76.4% of students in Slovenia, 73.2% in Belgium, 71.1% in Spain, 67.6% in Austria, and 60% in Germany “never” had standardized testing. Japan (34.6%), U. K. (32.5%), Australia (29.9%), and Ireland (35.0%) also have more students never given standardized tests. Only 2.5% of students in the U.S. never had a standardized test. Only three OECD nations—Korea (2.1%), Luxembourg (1.0%), and Finland (1.5%) – reported lower percentage of students who never take standardized tests.
While the U.S. does not have the largest percentage of students given standardized testing “at least once a month,” it is one of the countries with the largest proportion of students experiencing standardized testing “1 to 5 times a year.” With over 95% of students who attend schools whose principals reported giving standardized testing 1 to 5 times a year, the U.S. is only after four (Korea:96.5%, Finland:96.3%, Luxembourg: 96.4%, Hong Kong: 98.4%) out of the nearly 70 countries participated in PISA had a slightly larger percentage of students experiencing standardized testing 1 to 5 times a year. Even Shanghai, Singapore, and Chinese Taipai reported fewer students taking standardized tests with this frequency.
More importantly, does standardized testing help improve education quality?
To learn the answer to this crucial question, open the link and read Zhao’s conclusion.
Should we be surprised that Andreas Schleicher—the director of that section of the OECD in charge of international testing—recently claimed that Americans are not over tested.
Look who is in charge of development of the frameworks for the OECD’s PISA student assessment for 2015, and this can’t be a rumor because Pearson is the one reporting that they are in charge.
“Pearson to develop frameworks for OECD’s PISA student assessment for 2015
Published: 19/09/2011
“Pearson, the world’s leading learning company, today announces that it has been chosen by the OECD to develop the frameworks for the OECD’s landmark PISA educational assessment in 2015”
If you click on the link and read what Pearson has to say, I suggest that you have a barf bag close by.
http://uk.pearson.com/home/news/2011/september/pearson-to-develop-frameworks-for-oecds-pisa-student-assessment-for-2015.html
Good catch Lloyd.
Remembering the later Gerald Bracey’s caution that “when comparing groups, make sure the groups are comparable”—
When comparing widely varying school systems in a great many countries [not to mention the great diversity and differences within countries!], it is embarrassing to hear Andres Schleicher spout such an incomplete and meaningless bit of rheephormish.
Over-testing. Under-testing. The right amount of testing. These are very slippery terms and need to be placed into specific contexts and cultures. *Think of other oft-used terms too like “grade-level” and “functional literacy.”
There are value judgments and assumptions that need to be made explicit and discussed before delivering oneself of such a vacuous statement.
Perhaps he might learn a thing or two if he paid attention to what Yong Zhao and Pasi Sahlberg have to say on the subject…
😎
Note also the problem with a standard definition of standardized testing. Finland’s students reported a fairly heavy number of standardized tests, which Pasi Sahlberg points out, they have never taken.
This is the White House take on the new ed bill.
https://www.whitehouse.gov/blog/2015/12/07/qa-what-you-need-know-about-fix-no-child-left-behind
Business as usual in DC. “Accountability” (testing and ranking, but with new names!) and charter schools.
The testing proponents shouldn’t fret. Ed reform still sees public schools primarily as data collection centers.
Even as long as we’ve seen this, I continue to be amazed and alarmed at how out of touch some (most? all?) of our major educational policymakers prove to be.
This argument that testing a child leads to a greater education is so beyond absurd it is mind numbing that we have to engage in it at all.
Break it down to a swallowable thought:
You have an 8 year old. He does not know his multiplication tables. What will more likely lead to him knowing his multiplication tables?
A: Test him on his multiplication tables
B: Have him (or help him) study his multiplication tables
If you choose option “A” you will have data that shows what we already know: he does not know his multiplication tables. And he will learn nothing new that he did not know before taking the test,
If you opt for “B” he will know more of his multiplication tables than he knew before spending time studying – and the teacher will have data on what he has learned because (s)he is, well, there…
The only two differences are: option A provides data to the state or federal government instead of to the teacher, parent, and student. and no new knowledge is gained.
Duh.
Extrapolate this out to every subject and every hour of every day spent in school.
What will make a better educated child? Time spent learning with a teacher who can then communicate progress to the child and parents? Or time spent measuring his current knowledge on a test that generates data usable to the government but unusable to the teacher, parent and child?
I repeat: Duh.
I don’t understand Zhao’s post. It seems he is saying that Finnish students take more standardized tests than US students:
“Only 2.5% of students in the U.S. never had a standardized test. Only three OECD nations—Korea (2.1%), Luxembourg (1.0%), and Finland (1.5%) – reported lower percentage of students who never take standardized tests.”
“With over 95% of students who attend schools whose principals reported giving standardized testing 1 to 5 times a year, the U.S. is only after four (Korea:96.5%, Finland:96.3%, Luxembourg: 96.4%, Hong Kong: 98.4%) out of the nearly 70 countries participated in PISA had a slightly larger percentage of students experiencing standardized testing 1 to 5 times a year. ”
This directly contradicts what Sahlberg writes
“If 15-year-old students in Finland tell that they take standardized tests three to five times a year they clearly don’t know what standardized tests are. And how could they when they have never seen one.”
Mate, that must have been an error, as students in Finland never see a standardized test until they end high school.
Maybe the data comes from Finnish students Schleicher polled, and Sahlberg discredited.
Is it possible that all this latest standardized test craze came about just because of a single incorrect data provided by Schleicher about the Finnish students?
OK, so I looked up credible looking data. They are at
Click to access 109EN.pdf
The relevant data is on page 27. According to that, Finnish kids get national tests in 6th and 9th grade, but they are *sample* tests and are not compulsory at all.
Though Malta and Denmark give compulsory tests almost every year, even these are not high-stakes for teachers.
In summary, Schleicher’s data on Finland and Luxembourg is complete BS.
Interestingly (and to my dismay), Hungary tests kids 3 times during K-12. My understanding is that we are doing this because of US influence, and there is push for more testing. Under communist education, which supposedly controlled and standardized people to churn out top workers for the economy, we had only one standardized test: at the end of 12th grade.
I feel so helpless to see the power, the rich and the authority intentionally destroy the public education system = abuse the democracy = create chaos with INVALID testing scheme in order to establish the control in public through intimidation of teaching career security. Back2basic
Please listen to the speech in this link:
http://www.history.com/topics/us-presidents/calvin-coolidge/videos/wall-street-owns-the-country
Wall Street Owns the Country (3 min) TV-PG
Kathleen Chalfant performs the words of an 1800s activist on how Wall Street runs America.
Thanks Veteran Teacher Lloyd Lofthouse for the informational link.
http://uk.pearson.com/home/news/2011/september/pearson-to-develop-frameworks-for-oecds-pisa-student-assessment-for-2015.html
Here is the end paragraph from the link:
[start quote]
Head of the PISA programme at the OECD Andreas Schleicher said:
“PISA 2015 has the potential to be the start of a new phase of our international assessments. We need to make much smarter use of technology in how we test young people, and we need to assess problem-solving abilities as governments around the world seek to equip young people with the skills they need for life and employment.
“Pearson have put forward an ambitious strategy to support the OECD and member governments in creating a GLOBAL benchmark for education.”
[end quote]
In short, everything under the sun is GLOBALLY controlled and manipulated by the rich from foods, medicines to education = FROM BIRTH TO OLD AGE.
We cannot JUST let this happen. We must cultivate younger generation to practice self-control in being aware of marketing scheme, of the double-meaning word usage, and of all INVALID TESTING SCHEMES. Back2basic
Interestingly, Schleicher went to a Waldorf school in Germany. Waldorf is a holistic school system, the antithesis of standardized testing. But Schleicher then went to a university which was first in Victoria, Australia, to specialize in distance learning. He studied physics and math there, but I guess he wasn’t good enough, and blamed it on the Waldorf system, so he ended up taking revenge on the world through PISA.
Actually, the freest people on the planet are probably the poorest people who don’t have much money and who have to barter for goods they need to survive.
When I saw free, I mean they are not controlled by corporations or banks—yet, but it is arguable that Pearson is working hard to change this and even suck in the world’s one billion poorest people into their net and enslave them with debt too.
These are the world’s poor as measured by how much money they earn or property they own on paper, but many of these people still manage to survive in remote areas anyway.
The live in huts with dirt floors made from local materials grown naturally. They didn’t go to a lumbar yard to buy the wood. They chopped it down themselves.
They grow most of the food they eat and work hard to do it, but they do not have bank accounts, they don’t have debit or credit cards. They don’t take out loans to buy cars, take vacations and buy houses and fancy clothing. They do not rely on the local market to buy their food and if civilization and its infrastructure collapsed today, they are probably the ones who stand the best chance of surviving because they feed themsevles and don’t depend on a truck, ship or airplane to carry their food to the markets were urban people shop for food.
I wonder how many of these people there are out there. Hundreds of millions I’m sure who are free from the prison of corporate controlled urban civilization.
Schleicher’s agenda is all the more curious given his own Waldorf schooling, schooling commonly which eschews formal, high-stakes testing.
See, for example: http://www.educationstate.org/2015/06/28/andreas-schleichers-special-education/
Click to access WEHighStakesTest.pdf