Archives for category: Testing

A reader who works for an international agency sent me this essay about a pressing problem. For obvious reasons, he will remain anonymous, but his sources are cited.

Learning Metrics Taskforce: If you can’t teach the students of poor countries, just test them!

 

Much has been written about testing problems and corporate interests in the US. Could similar forces be operating outside the US? Here is a story that few readers probably know.

In poor countries education is mainly for the middle class. Most citizens of countries such as Rwanda, Congo, or Papua New Guinea have traditionally remained illiterate. In 1990 a worldwide initiative was launched, called “Education for All”. It was led by the World Bank and has evolved into a multi-billion dollar fund. About 55 low-income governments have received grants to build schools, buy books, and recruit teachers. Parents desperately want to send children to school, so when schools open, they quickly fill up. But there is a glitch: In very poor circumstances, children fail to learn. A World Bank study estimated in 2012 that only 67% of students in Subsaharan Africa finish primary school and of those who finish, 25% are illiterate.

The ‘learning crisis’, as it is called, has multiple causes. My partner and I spent about 12 years teaching for a charity organization, and we witnessed them first hand. Urban classes have 60-120 students with children seated on the floor. Teachers are often absent, may not know how to teach, and they are never supervised. Corrupt officials often demand bribes, and textbooks are stolen before they get to schools. Children are malnourished and hungry. Not much is taught under these conditions.

Donors such as the World Bank ought to have a good handle on this reality. But their staff hardly visit classrooms. They prefer the company of high officials who send their children to private schools and have private agendas. Most world bankers are economists, so they love the virtual reality of datasets and glossy publications. Incredibly, the donors’ response to scant instruction is not better teaching but better testing. Governments are encouraged to develop learning benchmarks, test students against them, and then figure out how to teach children to achieve the benchmarks.

The triumph of testing over teaching was definitively proclaimed through the “Learning Metrics Task Force” deliberations. The prestigious Brookings Institute conducted a large-scale consultation that involved 1700 staff members of 30 organizations. They were asked to define what children should learn in school and how the learning should be measured. Dozens of organizer staff flew to exotic destinations like Dubai and Bellagio, Italy to deliberate on the findings.

The report was formally launched on September 24, 2013 at the 68th session of the United Nations General Assembly. [click here http://globaleducationfirst.org/2996.htm see entire report here http://www.brookings.edu/research/reports/2013/09/learning-metrics-task-force-universal-learning

The report affirms the need to take immediate action to ensure children’s right to quality education. Nevertheless, it says nothing about the practical obstacles to learning such as corruption, harassment, book thefts, and failure to teach. In fact the word “teach” is not mentioned even once. Students are somehow expected to learn through “opportunities to develop competencies across seven domains of learning, starting in early childhood through adolescence.” To achieve this, a small set of key learning indicators will be tracked globally, such as literacy and numeracy. Countries will obtain technical help to diagnose the quality of their assessment systems, convene stakeholders to determine priorities, identify inequities, and make the appropriate policy changes.

To justify this view, the task force introduces the concept that assessment is a Public Good (pp. 12, 32). No country should be denied the opportunity to test students just because they cannot afford to. Parents and other stakeholders should become advocates of testing (p. 15) and for increased funding for testing (p. 17).

To help children quickly there is not a moment to lose. The task force will meet in November 2013 and develop a plan for moving forward. Launch events will be held in at least 15 cities around the world from September through November 2013, to make stakeholders aware of the test benefits.

The “learning metrics” task force seems so out of touch with reality that its main recommendation is a “Global Paradigm Shift” – from mere investment in access to “access plus learning”. Really, in 2013? Over the last 20 years piles of studies have documented learning failures, while numerous UNESCO workshops have taken place on quality improvement. With the same surreal touch, the document omits references to the large-scale testing that has already taken place. Since the 1990s the kids have been fed alphabet-soup tests such as PASEC, SACMEC, TIMSS, EGRA, EGMA, ASER, Uwezo, and other tests (see www.eddataglobal.org). And practically no cases are known of governments that put test results to good uses and improved outcomes.

So why did the Brookings Institution compromise its standards for this initiative? Why not form a teaching-for-poverty task force? Cynics point to money, but experience with poor schools leads to some sobering decisions. Donors mainly want to see activities and feel optimistic for the future. The most productive activity is to help schools teach students, but it is time-consuming, sometimes dangerous and often frustrating. Donors may become disappointed and pull out. By contrast, testing is a winner. Field work takes just a few weeks, and analyses can be done from the comfort of air conditioned offices. The staff involved get invited to international conferences, pad their resumes, get promoted. It’s up to the host governments to use test results for policy improvement.

As the task force rushes into implementation, the only certain outcome is consultant welfare. Testing companies are asked to donate time (p. 35), but seven domains in all countries of the world amount to huge numbers of tests. USAID and other donors have spent millions on testing in the past, so consultant companies and associated nonprofits are preparing for a windfall. Our boss is also optimistic.

The smell of money may be one reason why no one has criticized the report publicly. The people who are building careers and retirement funds from money destined to educate poor kids will strongly argue that they are doing the very best they can for them. Anyway many countries are slowly rising out of poverty, and eventually the poor will turn up educated. It may not be exactly ‘Education for All’, but ‘Testing for All” is considered acceptable progress.

 

 

Jason Stanford, who lives in Austin, reports here on the efforts to 23 school districts to develop a sensible alternatives to the standardized testing that everyone hates, except for the testing industry and their lobbyists.

He writes:

Despite the difficulty in chasing two tails, Dawson Orr, Consortium co-chair and superintendent of Highland Park ISD, pledges to press on to find an accountability system that actually measures what goes on in schools.

“You know, there’s just an awful lot of authentic work that goes on in classrooms that represents student learning that state and federal bureaucracies don’t know how to handle because they need the ease and convenience of a multiple choice test,” Orr said.

Another Texas leader, the late Speaker Sam Rayburn, once said, “A jackass can kick a barn down, but it takes a carpenter to build one.” There are a lot of folks trying to get rid of high-stakes testing—and a lot of merit in doing so—but thanks to 23 gutsy school districts, we now have some carpenters looking for an accountability system that makes sense. Good luck to them.

There are other alternatives: One, look at what Finland does. Select the best teachers; educate them well. No standardized testing. Let the teachers write their own tests. Trust them to do what is right for their students.

Or do what the best private schools do: I have never heard of any that administer standardized tests, other than for admission purposes.  Have you? Might be worth checking out what accountability looks like at Sidwell Friends (where President Obama’s children are in attendance), Lakeside Academy in Seattle (where Bill Gates went), Maumee Country Day School in Ohio (where Michelle Rhee went), Harpeth Hall (where Rhee sends one of her daughters), the University of Chicago Lab School (where Mayor Rahm Emanuel sends his children).

Let’s learn from the best!

David Greene, experienced teacher and mentor, was out of the country for afew weeks. When he returned, he was excited to hear echoes of our struggle against high-stakes testing, privatization, the theft of public schools, and data piracy in the mainstream news. Is the silence over? Are we on the cusp of the change we have all been hoping for?

An informed public will not permit a corporate takeover of its schools. An informed public will not give away personal information about their children to data mining.

David Greene writes:

THE SOUND OF SILENCE

I’ve been sitting relatively silently for a few weeks for a couple of reasons. I was out of the country for three weeks. Upon return I began new job. I was growing frustrated with the barking and lack of movement. I have been completing a book soon to be pubished. Other voices were more important to be heard.

Over the past few days however a number of events stirred the silence within me. First, I read Joe Nocera’s October 14th NY Times column, “A World Without Privacy”.

That was followed by a one-two punch of articles in The Local Gannett paper, The Journal News. The first, on October 16th validated what I am currently reading in Diane Ravitch’s brilliant new book, Reign of Error. The second article that moved me entitled “Study faults N.Y.’s teacher evaluations“, was written by Gary Stern, a reporter who seems to be figuring out what is really happening in the privatization process of public schools.

The third followed a day later also in The Journal News by Gary Stern was entitled, “Local parents seek ouster of N.Y. education commissioner”.

Finally, the one that moved me to this keyboard was in the October 20th edition of The NY Times Magazine entitled, “No diagnosis left behind”.

The fact that these articles came out within a week shows me the turn around in mainstream media we have been searching for may be coming sooner than I had thought. It inspired me to speak out again, to end my “sound of silence”.

One of my favorite songs of all time is Simon and Garfunkel’s “Sounds of Silence”. It is haunting and timeless. It speaks to the horrors in societies that are perpetuated when,

“ And in the naked light I saw ten thousand people, maybe more. People talking without speaking. People hearing without listening. People writing songs that voices never share. And no one dared disturb the sound of silence.”

Nocera’s column tells us how close to Orwell’s 1984 we have become as he compares Dave Egger’s new novel, The Circle to Orwell’s prophecies. Orwell’s, Big Brother government’s Ministry of Truth uses the big lie, repetitious slogans (ominously similar to chapters in Mein Kampf): WAR IS PEACE. FREEDOM IS SLAVERY. IGNORANCE IS STRENGTH. Egger’s private technology corporate world power (ALA Google, Facebook and Twitter) uses similar phrases: SHARING IS CARING. SECRETS ARE LIES. PRIVACY IS THEFT.

My God…. Is that not the strategy used by corporate education reformers and their governmental allies in stealing public education form the public and it’s employees?

“Fools,” said I, “you do not know. Silence like a cancer grows. Hear my words that I might teach you. Take my arms that I might reach you.” But my words, like silent raindrops fell; and echoed in the wells of silence.”

Have the “Emperor With New Clothes” actions of NY Commissioner John King awakened us from our sounds of Silence?

Has Gary Stern and Lo-Hud inadvertently become a leader in this new voice calling for his resignation by finally voicing the concerns of thousands of parents, students, and teachers in this article that finally doesn’t attack those voices as King does.

Has their expose regarding the improper use of invalid testing to evaluate teachers finally allowed other mass media publications and networks to come out of their sounds of silence and become:

“The sign [that] flashed out its warning in the words that it was forming. And the sign said, “The words of the prophets are written on the subway walls, and tenement halls?”

Finally, the NY TIMES reports, in “No diagnosis left behind” that:
“High-stakes standardized testing, increased competition for slots in top colleges, a less-and-less accommodating economy for those who don’t get into colleges but can no longer depend on the existence of blue-collar jobs — all of these are expressed through policy changes and cultural expectations, but they may also manifest themselves in more troubling ways — in the rising number of kids whose behavior has become pathologized.”

And, The No Child Left Behind Act, signed into law by President George W. Bush, was the first federal effort to link school financing to standardized- test performance. But various states had been slowly rolling out similar policies for the last three decades.

North Carolina was one of the first to adopt such a program; California was one of the last.

The correlations between the implementation of these laws and the rates of A.D.H.D. diagnosis matched on a regional scale as well. When Hinshaw compared the rollout of these school policies with incidences of A.D.H.D., he found that when a state passed laws punishing or rewarding schools for their standardized-test scores, A.D.H.D. diagnoses in that state would increase not long afterward.

Nationwide, the rates of A.D.H.D. diagnosis increased by 22 percent in the first four years after No Child Left Behind was implemented.

To be clear: Those are correlations, not causal links. But A.D.H.D., education policies, disability protections and advertising freedoms all appear to wink suggestively at one another. From parents’ and teachers’ perspectives, the diagnosis is considered a success if the medication improves kids’ ability to perform on tests and calms them down enough so that they’re not a distraction to others. (In some school districts, an A.D.H.D. diagnosis also results in that child’s test score being removed
from the school’s official average.) Writ large, Hinshaw says, these incentives conspire to boost the diagnosis of the disorder, regardless of its biological prevalence.

Times have changed. The words are now on Facebook and Twitter and the Blogosphere. They are increasingly in the streets, in the “public forums”, and in legislative, not tenement, halls.
And needed to get out! Let’s all of us, let out our sound of silence and change what is happening to us and to our children.

“Hello darkness, my old friend. I’ve come to talk with you again because a vision softly creeping left its seeds while I was sleeping, and the vision that was planted in my brain still remains within the sound of silence.”

Commissioner King and the New York Board of Regents have scheduled 16 events around the state to tell parents how terrific the Common Core is, how good they should feel about their child’s failing grade on the Common Core tests, and how overall magnificent the State Education Department is. There are 12 hearings and four televised presentations. No hearings are scheduled for Néw York City, although parents there (including potential troublemakers) can always watch on TV.

Here is a statement by the Grassroots Education Movement and Change the Stakes:

STATEMENT: NYC Parents Deserve to be Heard

October 22, 2013 · by Grassroots Education Movement

FOR IMMEDIATE RELEASE Contact: changethestakes@gmail.com

New York City Public School Parents Deserve to be Heard by Education Commissioner John King

New York City – It is unacceptable that State Education Commissioner John B. King, Jr. and the State Board of Regents are planning to hold a series of 12 forums across the state to meet with parents and educators to discuss the Common Core Standards and other education reforms, yet not a single forum will be held in New York City. NYC’s one million public school students account for a third of the state’s total public school enrollment. Change the Stakes calls on state legislators who represent NYC students, their parents and their teachers to demand that the Board of Regents schedule a public forum in each of the five boroughs. These forums must offer meaningful public discussion in which education officials acknowledge and respond to questions and concerns rather than dismissing them or explaining them away.

The Regents scheduled the forums, along with four additional events to be broadcast on public television, after Commissioner King abruptly cancelled four state-sponsored PTA town hall meetings after parents responded angrily at being given little time to speak at an event in Poughkeepsie. King later alleged that the meeting was “co-opted by special interests whose stated goal is to ‘dominate’ the questions and manipulate the forum.” The newly scheduled forums will undoubtedly be much more tightly controlled than the original large, town hall meetings.

King’s outrageous statement about “special interests” and the shutting down of public debate are indicative of a much larger problem: New York State education officials, from the governor on down, have completely disregarded the genuine, sincere and deeply-felt concerns of parents about what is in the best interests of our children. It is demeaning, demoralizing and downright undemocratic to attempt to silence parents, teachers, principals and others who, day in and day out, witness the harmful effects on children of poorly formulated and rashly implemented state education policies.

Commissioner King: The public school parents and educators of NYC deserve to be heard.

According to an October 18th press release from the State Education Department:

The first forum will be held in the Albany City School District on October 24. Other locations for the forums are Rochester, Westchester, Suffolk County (2), Nassau County (2), Schroon Lake, Binghamton, Amherst, Syracuse, and Jamestown.
The four PBS televised forums will be in Syracuse -WCNY (November 7), Plattsburgh-WCFE (November 20), Binghamton- WSKG (date tba) and Rochester- WXXI (December 3). King said more PBS forums will be scheduled.
###

Change the Stakes (changethestakes.org) is a group of parents and educators working to reduce the harm caused by high stakes-testing, which we believe must be replaced by valid forms of student, teacher, and school assessment.

__,_._,___

Almost everyone agrees that high-stakes testing for little children is a huge mistake. The parents not only wrote their elected officials, they took direct action.

More than 80% of the parents of the children at the Castle Bridge Elementary School in New York City refused to allow their children to be tested.

They opted out.

The tests were canceled.

NO TESTS. NONE!

The parents knew that the only purpose of the tests was to evaluate the teachers, not the children.

Most Castle Bridge School parents — representing 83 of the 97 students — refused to permit their children to be tested.

“My feeling about testing kids as young as 4 is it’s inhumane,” said PTA co-chairwoman Dao Tran, mother of first-grader Quyen Lamphere, 5. “I can only see it causing stress.”

The state now requires schools to factor test scores — in one form or another — into their teacher evaluations, which are new this year in the city.

The parents thought the testing was absurd.

As the Daily News reported earlier this month, such exams, given to kids as young as 4, require students to fill in bubbles to show their answers.

It’s like the SAT for kids barely older than toddlers. And parents resent it.

“Our principal does a good job,” said PTA co-chairwoman Elexis Pujolos, mother of kindergartner Daeja, 4, and first-grader AJ, 6. “A test could not possibly measure what she is able to.”

Principal Julie Zuckerman canceled the required tests because the scores wouldn’t provide statistically meaningful data once so many parents opted out.

She also hates judging teachers even partly on the basis of a test.

“It can’t be used as evaluation tool of teachers even if it were a valid test — which it’s not,” she said.

If all parents did this, they could stop the testing madness that is ruining education and children’s love of learning.

If it can happen at Castle Bridge, it can happen anywhere!

Without data, the giant testing machine can’t function. The children can learn stress-free. Education becomes possible.

Message: OPT OUT.

Susan Ochshorn, who advocates for early childhood education, is aghast at the idea that children as young as four or five are expected to take standardized tests. She explained that experts in early childhood education were appalled by the idea of testing young children with bubble tests.

Then she discovered a school where anti-testing sentiment had grown to include not only the principal and the teachers but the parents as well.

Parents and teachers always ask: What can we do? At the Castle Bridge Elementary School in New York Coty, they figured out what to do, and they took action:

“Late last week, an email arrived from Emma Frank, mother of two, including a first-grader at Castle Bridge, a K-5 school in Washington Heights led by progressive educator Julie Zuckerman. After a school-wide decision to opt out of K-1 testing, Frank was calling each member of the city council (“I’m up to ‘G,’ she wrote), to protest the policy. She also passed along the following letter, written by Don Lash, to state-level officials, which she is circulating as fast as she can:

“Dear Assembly Member Nolan and Senator Flanagan:

“I am contacting you because I am the parent of a first grade student who is expected to take a multiple choice standardized test as a result of a policy directive from the New York State Education Department (NYSED) that students from Kindergarten to 2nd grade be tested using an exam mandated by NYSED.

“The test is not intended to reveal any information that would be used to improve instruction to my child, but would be used solely to evaluate her teachers. Having seen some of the sample testing material published in news accounts, which was developed by the for-profit testing conglomerate PearsonEd, I don’t believe the test has any validity in assessing the quality of her instruction or the level of mastery of the curriculum. Moreover, I deeply resent the intrusion on her learning time that would be required to master test-taking skills that would serve no purpose beyond the test.

“Finally, my child is in a dual language program, with some students acquiring English as a second language and others acquiring Spanish as a second language. The test was developed and normed in English, so it would be worse than useless in evaluating the performance of my child’s teachers. I have exercised my right to opt out of this pointless testing, but I am nevertheless concerned that if my child’s teachers and the administrators of the school are forced to administer a test with no educational value, her instruction time will be reduced whether she takes the test or not.

“As a taxpayer, I object to the diversion of funds into Pearson’s or any other developer’s coffers, and the waste of the time of teachers and other school personnel, time that could be dedicated to teaching and learning. I am requesting that as chairs of the Assembly and Senate Education Committees, with oversight responsibility for NYSED, you demand that Commissioner King reverse this ill-considered and poorly implemented policy.”

Faced with a widespread parent rebellion against the Common Core testing, the New York Board of Regents declared they have no intention of making any changes. It’s full steam ahead!

Stay tuned. Rough waters, unseen obstacles, captain not at the helm.

Race to the Top placed a $4.45 Billion bet that the way to improve schools was to tie teachers’ evaluations to their students’ test scores.

As it happens, the state of Tennessee has been using value-added assessment for 20 years, though the stakes have not been as high as they are now.

What can we learn from the Tennessee experience. According to Andy Spears of the Tennessee Education Report, well, gosh, sorry: nothing.

Spears has a list of lessons learned. Here are the key takeaways:

“4. Tennessee has actually lost ground in terms of student achievement relative to other states since the implementation of TVAAS.

Tennessee received a D on K-12 achievement when compared to other states based on NAEP achievement levels and gains, poverty gaps, graduation rates, and Advanced Placement test scores (Quality Counts 2011, p. 46). Educational progress made in other states on NAEP [from 1992 to 2011] lowered Tennessee’s rankings:

• from 36th/42 to 46th/52 in the nation in fourth-grade math[2]

• from 29th/42 to 42nd/52 in fourth-grade reading[3]

• from 35th/42 to 46th/52 in eighth-grade math

• from 25th/38 (1998) to 42nd/52 in eighth-grade reading.

5. TVAAS tells us almost nothing about teacher effectiveness.

While other states are making gains, Tennessee has remained stagnant or lost ground since 1992 — despite an increasingly heavy use of TVAAS data.

So, if TVAAS isn’t helping kids, it must be because Tennessee hasn’t been using it right, right? Wrong. While education policy makers in Tennessee continue to push the use of TVAAS for items such as teacher evaluation, teacher pay, and teacher license renewal, there is little evidence that value-added data effectively differentiates between the most and least effective teachers.

In fact, this analysis demonstrates that the difference between a value-added identified “great” teacher and a value-added identified “average” teacher is about $300 in earnings per year per student. So, not that much at all. Statistically speaking, we’d call that insignificant. That’s not to say that teachers don’t impact students. It IS to say that TVAAS data tells us very little about HOW teachers impact students.”

Read the whole article.

It is one of the best, most sensible things you will read on value-added assessment. It is a shame that Tennessee has wasted more than $300 million in search of the magic metric that identifies the “best” teachers. It is ridiculous that Congress and the U.S. Department of Education wasted nearly $5 billion to do the same thing, absent any evidence at all. Just think how many libraries they might have kept open, how many health clinics they could have started, how many early childhood programs initiated, how many class sizes reduced for needy kids.

But let’s not confuse the DOE with actual evidence when they have hunches to go on.

We have heard numerous calls for NY’s Commissioner of Education John King to resign. He disrespects parents. He brooks no dissent. He accuses them of refusing to engage in dialogue after they sit patiently through his hour-plus monologue. And when they boo and hiss him, he storms away and cancels all future scheduled meetings with parents, fearing, no doubt, the same humiliating response.

This blogger, Teacherbiz, has a fresh look at the whole sorry episode. She sees the event presaged in “Hamlet” and demonstrates how literature helps us to understand life (with apologies to David Coleman, who may find greater meaning in “informational text”).

This news item appeared in Politico.com:

ED REFORMERS MEET IN BOSTON — More than 800 state legislators, school chiefs and policy wonks of every description will convene today in Boston for former Florida Gov. Jeb Bush’s annual National Summit on Education Reform. The two-day conference will feature several big-name speakers, including former Secretary of State Condoleezza Rice and a mystery guest that summit organizers have kept secret to build suspense… though (spoiler alert!) your Morning Education team hereby unveils him as Chicago Mayor Rahm Emanuel. The summit features panels on everything from vocational education to pre-K to a strategy session on how to sell ed reform to the public. Added at the last minute: A panel at which top execs from four big companies, including Microsoft and Exxon Mobil, make the case for Common Core. Watch for updates from the conference from Pro Education’s Stephanie Simon.

I have often speculated that there were not enough ed reformers to fill a large ballroom.

Well, here they are, and they say there will be 800 of them! 800 people determined to privatize public education in America and get rid of the education profession.

A bipartisan group too! No surprise there. Arne Duncan, Joel Klein, Condoleeza Rice, and Jeb Bush have been on the same page for years. And of course Rahm Emanuel has gone to the head of the pack because he succeeded in closing a history-breaking record number of 50 public elementary schools, to be replaced by 52 non-union charter schools.

Yes, they definitely need a “strategy session” to figure out how to sell privatization, teacher-bashing, and school closings to the public. It is not working anywhere.

And no surprise that the nation’s biggest corporations will give a panel on why we need Common Core, instead of a panel in which they explain why they have outsourced millions of jobs to low-wage countries. In this country, they can’t seem to find anyone willing to work for $10 a day. That is their problem.

Hope is on the way, Boston. I will be speaking at Memorial Church in Harvard Yard on October 24, sponsored by Citizens for Public Schools. I have no corporate sponsorship, but I will arrive with plenty of pins to burst the reformy bubbles.