Tom Loveless has been writing about international assessments for many years. He was quick to blow the whistle on China when the previous international test scores came out, noting that unlike the U.S. and most other nations, China was not testing a cross-section of its students.

In this article on Valerie Strauss’s Answer Sheet blog, Loveless calls out China again for rigging the outcomes to make its students #1.

China’s gains on the tests from 2015 to 2018 were so large as to be incredible, literally not credible.

So the typical change in a nation’s scores is about 10 points. The differences between the 2015 and 2018 Chinese participants are at least six times that amount. The differences are also at least seven times the standard deviation of all interval changes. Highly unusual…

The past PISA scores of Chinese provinces have been called into question (by me and others) because of the culling effect of hukou on the population of 15-year-olds — and for the OECD allowing China to approve which provinces can be tested. In 2009, PISA tests were administered in 12 Chinese provinces, including several rural areas, but only scores from Shanghai were released.

Three years later, the BBC reported, “The Chinese government has so far not allowed the OECD to publish the actual data.” To this day, the data have not been released.
The OECD responded to past criticism by attacking critics and conducting data reviews behind closed doors. A cloud hangs over PISA scores from Chinese provinces. I urge the OECD to release, as soon as possible, the results of any quality checks of 2018 data that have been conducted, along with scores, disaggregated by province, from both the 2015 and 2018 participants.

The OECD allows China to hide data and game the system. This lack of transparency should not stand.