Archives for category: International

Tom McMorran was named Connecticut’s principal of the year in 2012. Here he offers a lesson to our nation’s politicians about the Common Core standards and high-stakes testing. Send this to your state legislators and your member of Congress and the Senate.

 

Tom sent the following comment:

 

It is time to school our politicians about CCSS and High-Stakes testing.
Here is a day in course level 101.

Tom McMorran
2012 High School Principal of the Year NASSP

Philosophy 101:

In order for an argument to carry weight and cause one not only (1) to believe it, but also (2) to take action based on that belief, the argument must have warrant. There is nothing subtle here. The weakest form of argument is some version of “I am in power and I say so…” Or, in any teen’s mother’s words: “Because I am the parent!”

When the person presenting the argument relies on some authority to shore up his/her argument, then we have a duty to test the reliability of the authority. In philosophy or rhetoric or simply argumentation this is known as an appeal to authority.

Last week Gina, Mary Ann, and I attended another workshop at the Connecticut Association of Schools (CAS). This is the body that is, in theory, an institution that is independent from the State Department of Education. The presentation was made by Dr. Diane Ulman, who is the Chief Talent Officer at the DOE. She was appointed by Commissioner Pryor.

As part of her presentation, Dr. Ulman reminded us that the Governor’s Council, The Gates Foundation, a range of other foundations and 46 states have signed on to CCSS. In other words, she offered an appeal to authority. Now, for an appeal to authority to work, credentials must be established. And any group that has a personal, financial interest in public policy must make their bias known. So, let’s ask a very basic question: Where’s the money? For Pearson, Houghton Mifflin, and other publishing companies the prospects are enormous. Smarter Balance, the private, for-profit company received half a billion federal dollars to develop the next generation of assessments, which will replace the CMT and CAPT and be administered in about 26 states. You may recall the President’s State of the Union Address; he all but bragged about the 4.3 billion for Race to the Top (RTTT) funding, and how it was amazingly inexpensive for the Federal government to get these 46 cash-strapped states to sign on.

So, when you hear the proponents of the Common Core State Standards and High-Stakes Testing appeal to authority, you have a duty to weigh the degree to which the authority has sufficient warrant to be believed. Here, let me try it: Elvis is still alive. Evidence? 50 million Elvis fans cannot be wrong.

Statistics 101:

Before meaningful inferences can be drawn from any data set, the researcher has a duty to ensure that the social phenomenon under consideration has not been conflated with other factors. In other words, if you want to give a test that measures the contributions of a teacher to a student’s growth, you must account for and guard against any other factor that might conflate with the primary inquiry. It works like this:

1. We want to know if the teacher’s skill as a reading teacher leads to observable reading skills in her/his students.
2. Therefore, if we give all students the same reading assessment, we should be able to conduct a comparison between teacher A’s students and teacher B’s students.
3. From that comparison we can tell if one teacher is better than another at teaching reading.

So, what’s wrong with that?
A. If the assessment was designed to measure student performance, it can only be used for teacher evaluation by an act of hopeful extension. If the assessment had been designed to measure teacher performance, then it could only be used to measure student performance indirectly.
B. In order for teacher A to be compared with teacher B, the context for all potentially confounding factors for the experiment must be the same. In other words, the only factor that can be measured is, in this case, reading.

But wait, Tienken, Lynch, Turnanian, and Tramaglini have something to say about this in “Use of Community Wealth Demographics to Predict Statewide Test Results in Grades 6 & 7.”

Here’s the very short version: If you tell these researchers three out-of-school demographic variables, then they can tell you a New Jersey school system’s 6th Language Arts scores on the New Jersey Assessment of Knowledge for grade 6 (NJASK6). Tell them (a) the percentage of lone parent households in the community, (b) the percentage of people with advance degrees, and (c) the percentage of people without a high school diploma, and they can plug those data points into a formula that will predict the scores within an acceptable range.

If confounding factors such as a town’s wealth are predictors of performance, then how can we use a reading assessment designed to measure a student’s performance in order to decide whether or not a teacher has effectively taught the skills or knowledge measured by the test?

Here is another wee complication: In New York the APPR rating system that is a year ahead of Connecticut’s uses a growth over time model, which sounds great. But, if you are the unlucky teacher who earned the highest rating in your first year and then for some reason you “slipped” to proficient in your second year, you have not shown growth over time, have you?

Economics 101:

The foundation of the CCSS argument has been negative comparisons between international assessments of 15 year olds in which Americans appear to come out near the middle of the testing range. The argument runs like this: The future economy needs 21st Century Skills. Other countries are out-scoring us, therefore the strength of our economy is threatened over the next few decades.

But, if we recall our faculty reading of Yong Zhao’s Catching Up, or Leading the Way, we recall that there is an inverse relationship between performance on a standardized international assessment and productivity over time. Yes, that’s right. The same group of 14 yr olds who came in dead last in the First International Math Study (TIMS) is now a group of the 60-somethings who control the American economy, which is still rated among the top three most productive economies according to the World Economic Forum.

So, to make the international comparisons look bad, the proponents of this argument have to place the USA into a comparison with the 58 countries for which there is competitive data. Yikes, it looks like the mid-21st century will be dominated by Bulgaria; didn’t see that coming, but that’s what the tests show. If, on the other hand, one compares the US to the G-20 or G-7 Economies, the negative comparisons cease to be statistically valid.

Also, let’s just pause for a minute here and consider the PISA study of 15 year olds. You have to be 15 to take the test. So, if an American kid averages 170 days of school attendance a year, and among those days are mid-years, finals, and field trips, then let’s say there is a good chance for 140 days of instruction. But Asian countries regularly offer up to 240 days of school, so let’s knock off twenty and call it 220. Should an American student be able to compete with his/her counterparts in math? Well, actually, even on the much-vaunted PISA fully one out of four students performing at level five, the highest level, is an American.

So, if we follow the scores-to-economics argument, we would be likely to engage in behaviors that promote success on a test, but this will lead to lower creativity and productivity in the adult world!

Sociology 101:

Campbell’s Law: 1975 “The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social process it was intended to monitor.”

Here is what Nichols and Berliner have to say at the end of a comprehensive examination of NCLB and high-stakes testing: “We are going to do something unheard of in the history of academic research. In this concluding chapter, we are not going to call for more research. There is absolutely no need for new research on high-stakes testing! Sufficient evidence to declare that high-stakes testing does not work already exists.” (2006, Collateral Damage, p. 175).

CONCLUSION:

1. I am NOT saying that we should have no standards. I am not saying that a standards-based curriculum is a bad thing; in fact, I am in favor of it.
2. I am NOT saying that we shouldn’t desire excellence for all students. I am not saying that all students should be able to have meaningful adult lives.
3. I am NOT saying that teachers shouldn’t link their performance to student achievement. I am not saying that we should avoid standardized assessments.

I AM SAYING that the worn out application of so-called hard-nosed business practices (which I do not believe business men or women apply to their own concerns) have any place in a school. I AM SAYING that there is a better way, and it is for all of us educators to embrace our responsibilities as professionals and act from Informed Professional Judgment. I AM SAYING that we can either define ourselves or accept the so-called reform that is happening to us.

It might be that we have to acknowledge and optimistically embrace the following proposition: The High School Structure that has served us so well is not broken; it is obsolete, and it is time for us to transform it!

Tom

This NPR program contrasts the different paths of Finland and South Korea. Too bad it relies only on results of PISA tests. US students did much better on the latest TIMSS.

Frankly, I’m getting tired of the same old talk about international test scores.

We live in the world’s most economically successful nation, with the most advanced this, that, and the other. Why are we always looking for another nation to copy?

We do lead the world–that is, the most industrialized nations–in child poverty. Why not aim to be #1 in children’s health and well being?


Professor Henry M. Levin is a distinguished economist and director of the National Center for the Study of Privatization in Education at Teachers College, Columbia University.

He recently participated in a conference in Sweden convened by the Royal Swedish Academy of Sciences to review the evidence about the effects of vouchers, which were initiated in 1992. He learned that Swedish performance on international tests has declined since 1995, private school enrollments have grown, social stratification has increased, and the for-profit sector is thriving.

He wrote this post specifically for the blog. It provides important information about the effects of vouchers. We can learn from the Swedish experience, if we are willing to learn.

Professor Levin writes:

In 1992 Sweden adopted a voucher-type plan in which municipalities would provide the same funding per pupil to either public schools or independent (private) schools. There were few restrictions for independent schools, and religious or for-profit schools were eligible to participate. In 1994, choice was also extended to that of public schools where parents could choose either a public or private school. In the early years, only about 2 percent of students chose independent schools. However, since the opening of this century, independent school enrollments have expanded considerably. By 2011-12 almost a quarter of elementary and secondary students were in independent schools. Half of all students in the upper secondary schools in Stockholm were attending private schools at public expense.

On December 3, 2012, Forbes Magazine recommended for the U.S. that: “…we can learn something about when choice works by looking at Sweden’s move to vouchers.” On March 11 and 12, 2013, the Royal Swedish Academy of Sciences did just that by convening a two day conference to learn what vouchers had accomplished in the last two decades. Interest in the subject had been piqued by several developments including the dramatic growth in private school enrollments and a fairly precipitous decline in Swedish performance on international tests. Results in reading, science, and mathematics had fallen at all grade levels from 1995 to the present in the international studies.

In addition there was evidence of increased stratification and segregation of students by socio-economic status and ethnicity over the same period. Finally, there were concerns about the reportedly substantial profits being amassed by the independent schools from public funds.

The conference comprised a Swedish audience with both Swedish presenters supplemented by a few international experts (Austria, Finland, UK, and U.S.). I was assigned to provide an overview on “Evaluating Consequences of Educational Evaluation. In the remainder of this note I describe the overall framework that I used and my conclusions.

As in all of the analyses on school choice and vouchers of our National Center for the Study of Privatization, I presented the four criteria that we use for evaluation of particular schemes: freedom of choice, productive efficiency, equity, and social cohesion. I also discussed how design of the plans draws upon three policy instruments: finance, regulation, and support services. The details of design are crucial for shaping the outcomes of choice and voucher plans.

In using these criteria for evaluation, I employed the research evidence that had emerged on the Swedish voucher system. This compendium of research comprised a number of highly sophisticated studies on the impact of the system on student achievement and student stratification. The following was my verdict:

  • On the criterion of Freedom of Choice, the approach has been highly successful. Parents and students have many more choices among both public schools and independent schools than they had prior to the voucher system.
  • On the criterion of productive efficiency, the research studies show virtually no difference in achievement between public and independent schools for comparable students. Measures of the extent of competition in local areas also show a trivial relation to achievement. The best study measures the potential choices, public and private, within a particular geographical area. For a 10 percent increase in choices, the achievement difference is about one-half of a percentile. Even this result must be understood within the constraint that the achievement measure is not based upon standardized tests, but upon teacher grades. The so-called national examination result that is also used in some studies is actually administered and graded by the teacher with examination copies available to the school principal and teachers well in advance of the “testing”. Another study found no difference in these achievement measures between public and private schools, but an overall achievement effect for the system of a few percentiles. Even this author agreed that the result was trivial.

In evaluating these results, we must also keep in mind that the overall performance of the system on externally administered and evaluated tests used for international comparisons showed substantial declines over the last fifteen years for Sweden. For those who are interested in the patterns of achievement decline across subjects and grades, I have provided the enclosed powerpoint presentation.

We also heard from Swedish researchers that the independent schools were putting considerable resources into marketing, including using teachers to serve the marketing function. My conclusion was that there is little evidence of improved productive efficiency from the initiation of the Swedish voucher system.

  • With respect to equity, a comprehensive, national study sponsored by the government found that socio-economic stratification had increased as well as ethnic and immigrant segregation. This also affected the distribution of personnel where the better qualified educators were drawn to schools with students of higher socio-economic status and native students. The international testing also showed rising variance or inequality in test scores among schools. No evidence existed to challenge the rising inequality. Accordingly, I rated the Swedish voucher system as negative on equity.
  • Finally, there was no direct assessment of the effect of the system on social cohesion. This criterion refers to the quest of schools to prepare students for successful participation in social, economic, and political institutions requiring a common set of skills and capabilities for mutual interaction, communication, and democratic behavior. No evidence was available. Although I did not provide a conclusive judgment for this criterion, one might surmise that the increasing stratification represents an obstacle to social cohesion.

This evaluation was well-received, in part, because it was presented matter-of-factly and with clear reference to the evidence. There was no disagreement over the existing evidence by the assemblage. Among the industrialized countries, only three have a universal voucher or choice system Chile, Holland, and Sweden. Some would also argue that Belgium qualifies in this category. The former three countries have very different designs with the Dutch system being the most highly regulated and devoting the most attention to equity. Even so, the tracking that takes place at age 12 in the Netherlands between vocational and academic secondary schools has important equity consequences in terms of socio-economic stratification. Although based upon choice, the available choices available to a student are heavily dependent on her achievement test results. The Chilean system has witnessed an increasingly notable stratification of the population, both within and between public and private sectors. Students from more educated and wealthier families are found in the private schools which receive public funding, but can choose which students to accept from among applicants. The Chilean system allows schools to charge additional fees beyond the voucher, also favoring more advantage families.

I have enclosed the powerpoint slides from my presentation. These provide further details on the overall evaluation framework and the basis for my conclusions for Sweden. Those who wish to peruse our collection of more than 200 papers on choice and privatization should check the website of the National Center for the Study of Privatization in Education (www.ncspe.org) or contact me at HL361@columbia.edu.

Click below to download the powerpoint

Swedish Educational Privatization-1

We are not alone.

We are not the only great nation doing truly absurd things to our education system to advance the interests of private enterprise, under the guise of “reform.”

Great Britain’s Minister of Education Michael Gove has invited Bain & Company of the U.S. to advise him on how to make cuts to the national education budget and encouraged them to apply for contracts in the newly reconstituted Department for Education.

Bain is the company created by our own Mitt Romney.

Now if Minister Gove brings in Boston Consulting (the company that birthed Bain & Company), Stand for Children, and Andy Smarick of Bellwether Partners, he can get a report recommending full privatization of the British education system and finish the job.

Yong Zhao knows that American policymakers are obsessed with getting higher test scores.

Not their own test scores, of course, because they don’t take the tests, but the scores of America’s children.

They want higher scores than those of China.

Actually, we don’t know what China’s scores are, because the national scores have never been released.

We have only the scores of students in Shanghai, which are not representative of the nation.

Yong Zhao offers advice here on how to do it.

I am on my way to Baton Rouge for a mini-debate with Chas Roemer, the president of the state Board of Elementary and Secondary Education. I read some of Mr. Roemer’s ideas on the Internet, and he is a big enthusiast for vouchers, charters, and every kind of privatization, as well as lowering standards for teachers.

A group called Leaders with Vision is sponsoring our discussion. It is affiliated with the League of Women Voters.

Since we will have only 15 minutes each, I won’t get to say everything I would like to say, but would like to bring this article about vouchers in Chile to Mr. R’s attention. Maybe he will have time to read it after I depart.

The takeaway: vouchers have led to increased inequality.

Here is an excerpt:

“And yet, the student achievement gap in Chile, and the resulting economic divide, is growing.
Three-fourths of the public school enrollment in Chile are students from the lower 40 percent in family income. Only 10 percent of disadvantaged students use vouchers to attend private schools. Ninety percent of the private school students come from the top 60 percent.

“The opportunities, where they have existed, have been for the benefit of upper-middle income families. Students in private schools, especially in those that charge fees above the voucher amount, are doing pretty well. Students in public schools struggle amid a host of challenges. Budget cuts have led to overall decline in quality. Disadvantaged students and students with disabilities – the students Romney’s plan is said to help – are vastly overrepresented in the public schools, in large part because public schools are the last resort for students turned away because of income, ability or discipline issues.

” The education marketplace has grown in Chile, as Friedman predicted, but quality is not the only factor people take into consideration. For parents, price and proximity also matter. For private schools, the emphasis is on serving students that are cheapest to educate, not tailoring different programs to the unique needs of students.

” Many parents are driven to seek any alternative, even if the alternative is sometimes worse. Disadvantaged students are more likely to be served in franchise private schools rather than independent or religious private schools. The frustration of students, teachers and parents is at a breaking point.

” Since 2006, Chilean students, teachers, and parents have been engaged in the Penguin Revolution, a reference to school uniforms. They are organizing, agitating and demonstrating for something many Americans take for granted – free public schools.

“They call for an end to profiteering in education. They want a greater federal role in funding and in setting and enforcing consistent standards. They want the government to built more colleges to meet the growing demand. “

Want to see the hand-writing on the wall?

Look at what is happening in the U.K.

The minister of education, Michael Gove, is moving rapidly to increase privatization of state schools.

There is lots of talk about choice, competition, testing, accountability.

Consider this account:

“This is a story about England’s schools, but it could just as well describe the razing of state provision throughout the world. In the name of freedom, public assets are being forcibly removed from popular control and handed to unelected oligarchs.

“All over England, schools are being obliged to become academies: supposedly autonomous bodies which are often “sponsored” (the government’s euphemism for controlled) by foundations established by exceedingly rich people. The break-up of the education system in this country, like the dismantling of the NHS, reflects no widespread public demand. It is imposed, through threats, bribes and fake consultations, from on high.”

And here is news of a secret memo about turning the free schools and academies (equivalent to our charters) into profit-making schools.

Robin Alexander writes here about the collateral damage inflicted by the testing-and-accountability regime in the U.K.

His analysis will be familiar to American readers. As we all seek to be “world class” and to compete with one another, our governments are imposing a dreary conformity on every school and draining them of the spontaneity and joy that is the life blood of teaching and learning.

As the Hechinger Report explains, Finland doesn’t give standardized tests, yet its students excel on the international standardized tests. Finland has this idea deeply grounded in its education system: it trusts its teachers to make their own tests and to decide how well students are doing.

By contrast, we trust no one and test everyone.

We waste billions of dollars on testing even as budgets are cut, teachers are laid off and class sizes grow. Worse, we waste a large number of weeks of instruction on testing and preparing to take tests. Kids are practicing to satisfy Pearson instead of learning new skills and knowledge.

Will our leaders ever come to their senses? Probably not until millions of parents withhold their child from the testing machine. Probably not until thousands of superintendents and principals speak out. Probably not until thousands of school boards say no.

Probably not until entire school districts refuse to give the tests or refuse to send the results to the state.

Who is the miracle reformer of Colorado? Who wrote its law to evaluate teachers by their test scores? Who claimed that his high school graduated 100% of its seniors and sent them to college? Who so lauded by President Obama and DFER? Whose legislation became a model for ALEC? Why, Michael Johnston, of course.

Mercedes Schneider continues her portrait of the board of NCTQ by looking into Johnston’s history. NCTQ is the organization that tells the nation how to get high-quality teachers.

Previous posts by Schneider have included Wendy Kopp, Michelle Rhee, and Joel Klein, who have a cumulative teaching experience of three years among them (Rhee’s).