Archives for category: Testing

John Merrow of PBS helped to make Michelle Rhee the national face of the privatization movement (often mistakenly called the “reform” movement). Merrow featured her on national television a dozen times, often adoringly. Like many others, he was impressed by her tough talk.

But he came to realize that nothing she promised was happening. And he looked closer and found that the DC cheating scandal had been pushed under the rug. He probed more and ran into a stonewall. He has written powerful pieces on his blog, but when he tried to find a national publication to print what he wrote, no one was interested.

He reveals that Rhee has engaged Anita Dunn as her public relations advisor. Dunn was White House director of communications in 2009 and now appears on NBC and MSNBC (the “Education Nation” network).

He decided to drop the Rhee story because his friends told him he was obsessed. So he is moving on.

He writes:

“But Michelle Rhee is not the point of all this. What matters much more is what she failed to accomplish in Washington. She espoused a certain approach to reforming failing schools, a path that she and her successor have followed for six years, and that approach has not worked. That’s the central point: Rhee’s “scorched earth” approach of fear, intimidation and reliance on standardized tests scores to judge (and fire) teachers and principals does not lead to improved schools, educational opportunities, graduation rates or any of the other goals that she presumably embraces.”

Sorry, John, you can’t drop the central narrative of the “reform” movement. Nor can you forget that you, more than anyone else but Adrian Fenty, made Rhee. You owe it to the public to follow the story you made important. Without the national spotlight you shone on her, she would be just another tyro superintendent who tried her way, failed, and landed a job in quiet obscurity.

Instead, she just collected $8 million from the Walton Family Foundation. She is pouring millions of dollars collected from people who hate unions and public education and then making big contributions to rightwing Republicans and a few Democrats who support vouchers.

John, the story remains. It is not finished.

Eduardo Andere is an education researcher and lawyer in
Mexico who has published widely about international trends in
education. After reading
articles
about teachers demonstrating in the streets, I
asked Andere if he would explain what is happening in Mexico. He
sent the following post:   What is real and
what is rhetoric in the Mexico’s 2013 Education
Reform?
Eduardo Andere
For you to get a clearer view
of the polemical Education Reform in Mexico you ought to have some
facts about education and education policy in the
country.
Education
policy and education curricula from kindergarten to 18 is ruled,
directed or ordered by the national federal government. By
constitutional law education in Mexico is a federal matter. States
or local authorities implement the national policy; they are local
CIOs as compared to the national CEOs, so to speak.

Under Mexican law, education
is compulsory from K to 12. Kindergarten or preschool education
runs from age three to five and children start a six-year long
elementary school at six. Middle school or lower secondary school
runs from grade 7 to 9; and upper secondary school from grade 10 to
12, although there are two-year long high school
programs.

Student-wise, the size of the whole student population
from K to university is around 40 million; all of them under the
national law, and a national authority called the Secretary of
Public Education (SEP). In this sense SEP is much more powerful
than the U.S. Department of Education. Mexico is probably the most
centralized OECD educational system. It is probably as centralized
as the Singapore’s high performing country, but in sheer numbers
Singapore is a small city-state-nation of 5 million people compared
to 118 million people in México.

Nobody knows for certain the
real number of teachers hired by SEP or other sub-systems of
education; and nobody knows for certain how many of the hired
teachers are really sitting for class or doing “commissioned-type”
work for special, some times no-transparent activities, for both
the government or the union. Many constituencies have complained
about this situation. They say that for starters this is a proof of
corruption between the governments and the union. Official
statistics number around 2 million teachers in the whole system of
which 1.2 millions are teaching at basic education (K to
9).
There are
several unions of teachers in Mexico, but by law, the union with
the highest registered number of teachers is the one with the right
to negotiate annual contractual agreements with the government.
Union membership is mandatory in Mexico. Teachers have no way to
opt out and the government retains a compulsory union’s fee from
their salary pay. This fee is transferred to the unions.

The largest teacher union in
Mexico is the SNTE (Sindicato Nacional de Trabajadores de la
Educación or Workers of Education National Union). Of course, over
the years there have been some democratization efforts that have
given rise to dissenters within the national union. One of these
attempts gave rise to a “separatist” group that operates de facto
rather than de jure called CNTE (Coordinadora Nacional de
Trabajadores de la Educación; or Workers of Education National
Coordination Group). This group has been the one making all
the street noise against the education reform.

What about the much more
powerful in terms of members SNTE? Most of the teachers are SNTE’s
main track teachers, and most of them are quiet. Dissenters are the
minority. But here as well there are some contextual facts that you
need to know before I continue the story behind the education
reform.
The SNTE
was born in 1943. Over the years as education became massive the
education union grew in members and power. By the 1980s the union
leader became very powerful and by government and media accounts
very corrupt and anti-governmental. In 1989, and under the
government of President Salinas, (influenced by a public sector
modernization movement from around the world, sometimes called New
Public Administration) many public policy reforms were launched.
Well, in the late 1980s the Salinas’ government tried to pave its
way for the new reforms by removing a couple of very powerful, and
again, perceived, very corrupt union leaders. One of those leaders
was the SNTE leader. A teacher, who later became known as “La
Maestra” (“The woman teacher”), replaced him. For years she was
wooed and lured by the national government to implement
modernization projects or keep teachers in the classrooms and
peaceful. The government and the union developed a close
corporativist relationship that lasted until late 2012. One of
those projects was the 1992-1993’s education reform. Since then, La
Maestra and her union became very powerful, not only in union
matters but also in policy and political matters.

Under the former President of
Mexico, Felipe Calderón’s regime, La Maestra became very
influential. She was even able to place her son-in-law as assistant
secretary of basic education at SEP, the second most important and
influential position in national school education in Mexico. But
not only that, for decades she managed to get annual real salary
increases for teachers who for decades earned very low salaries.
But most importantly, her union became co-signer in all relevant
national new policies of education. She was so powerful that some
people would call her the de facto vice president of Mexico.
Presidents came and went under her tenure but her power and
influence in politics and policy became uncomfortable to policy
makers and politicians. Since she was no shy at all in
showing off her political muscle she became very unpopular. Her low
charisma and extravagant way of life didn’t help either. She was
shrewd but not smart enough to foresee her demise.

The same day that President
Peña’s constitutional education reform was officially published she
was arrested (at the writing of this post, September
8th, 2013 she is still in jail). The news
became national level immediately, and the President’s popularity
skyrocketed among the media and the public opinion. Ever since the
SNTE’s leaders and most of teachers have been very quiet and
accommodating to the education reform. That is not the case with
the dissenters.

After the constitutional approval some secondary laws had
to be passed by the national or Union Congress. During the last two
weeks three new laws were passed pending only the presidential
approval (promulgation) and the publication by the federal
registrar.
What
are some of the main issues with the education reform?

1) Evaluation and
assessment of school education becomes a national state policy. A
new national body of evaluation called the Instituto Nacional para
la Evaluación de la Educación (National Institute for the
Evaluation of Education) has been established with federal state
powers. This is an agency with a governing body of five prestigious
former academic professors or researchers, La Junta, which will be
able to set national assessment policies, practices and criteria
that will influence national education policies as well. This Junta
has the power to overrule or nullify any evaluation attempt or
exercise against the federal wishes. This Institute (INEE) will set
up binding policies for federal and local authorities of education
and even set the rules for the assessment of teachers and students.
La Junta will also be able to set the minimum criteria to become a,
or remain as teacher from K to 12 grades. Indeed, a very powerful
mandate.
2) A new civil career
program for teachers is established with very precise rules and
regulations. All teachers will have to be examined by law: if they
fail to pass three rounds they will be ousted from the classroom.
If failing teachers have tenure they will be given non-teaching
jobs, positions or activities; no-tenure teachers will be fired.
This is one of the outcries from dissenters and no-dissenters
alike. Historically teachers’ unions, with the acquaintance or
acceptance of governments, were able to name, handle or manage the
hiring and promotion of teachers, principals and supervisors. Some
arrangements between the unions and governments even allowed the
sale and inheritance of “plazas” or teachers’ jobs. This was part
of the explicit or implicit corporativist arrangement between the
government and the unions. For years some academic experts and
media observers regarded this practice as corrupt. Some local
authorities on their own initiated changes in favor of some sort of
open competition for assignments or promotions of plazas or jobs,
but some kept the old system intact. Teachers who benefited from
this “rare” arrangement of course don’t like changes and bitterly
oppose to the new rules. What the new authorities see as corrupt
practices the union leaders and some teachers see it as a
class-obtained gain after many years of work and negotiation. You
have to know that historically teachers’ salaries have been very
low specially compared to the salary of the secretary and assistant
secretaries of education. I once did research about the topic and
the difference in the salary between an elementary school teacher
and the high-ranking officers of national education amounted to
around 40 times without fringe and PR benefits for the latter. So,
some dissenters and some main track teachers don’t see these
practices as necessarily corrupt but as a “well-deserved benefit”
for teachers and their families after years of struggle. After all,
the argument goes, many politicians and businesspeople have
obtained law or governmental protections or benefits, sometimes
monopoly-based, that have earned them much sizable assets to sell
or inherent to their children. Changing the rules of the game in
the middle of the game has made the big noise, and the problem does
not have a clear-cut solution. Of course, no one wants a system of
selling and inheriting jobs, but even as bad as it sounds, the full
story has to be laid out.
3)
Teachers, as deficient as they could be in their learning and
teaching, have been selected, trained and placed by the
government for decades. The national or state governments control
the training of basic education teachers in Mexico. Universities
are not allowed to train teachers for public or private basic
school education, although many schools, especially private, have a
way of gaming the system. There is no competition for training;
there is a national curriculum set up and controlled by the
national government; the newest curriculum dates from 1997; the
national curriculum for basic education students dates from 2011.
Quality is low. So, “what is the purpose of assessing teachers
whose average cognitive quality is low and we know it already
without tests?” Some say, this is a way of putting pressure on
teachers. If the new assessment policy is criterial (i.e., what
they should know) most of them will flank; if it is normal-based
(i.e., what they really know) most of them will pass. This is a
dilemma: If most of them fail, where from are we going to
find the new teachers? If most of them pass, we will keep the same
low level of quality in teaching. The new laws-to-be have loopholes
that could allow teachers to fence-off from the consequences of
high stake assessments, however, they also grant authorities enough
lee-way to apply strict measures of assessments and accountability
to teachers, principals, supervisors and students.

4) There are some miscellaneous
provisions like autonomy to schools, bans to junk food in schools
and full-day schools that follow popular perceptions rather than
academic recommendations.

Apparently, most of the teachers in the streets come from
the poorer states of Oaxaca, Michoacán and Guerrero. They face one
more strategic challenge: the more education policy is centralized
the less bargaining power they have in education and labor matters.
With decentralization they would negotiate at a local level, where
they maximize their negotiating power; with centralization a group
of local teachers, from one federal entity among 32 federal
entities, has to negotiate with the national government.

At the end it is not clear
how everything will change, my own perception is that the new
government bought the wrong diagnosis of the causes of the low
quality of education in Mexico. The new government fell into the
spell of the corporations’ view of education reform: more testing,
more accountability, more pressure on teachers, more
standardization, and less unionization. Little is said about the
real causes of education failure: poverty, segregation, inequality,
low quality in selection, training and placement of teachers, and
lack of family, school and community learning environments. Does
this sound similar to the U.S. education reform pushed by big
business and private donors?

Funny, I kept thinking about this famous speech of student leader Mario Savio, who led the Berkeley student protests in the 1960s. And a reader read my mind after reading Liz Rosenberg’s post where she explained that she and her partner would not look at their child’s test scores. They don’t care. They don’t matter. They don’t care if their child has higher or lower scores than children of the same age in Hong Kong or France. Stop the machine.

This reader takes me back 50 years with this comment:

“As a retired educator with 30+ years service in Special Education, I can only say BRAVO to Liz Rosenberg, her partner and all the parents and educators who have joined in the struggle to turn back the tide of what has become the dominant paradigm for “Educational Reform”. Diane has provided a critical mechanism for cross-country communication by those who oppose these so-called reforms, Reading Liz Rosenberg’s communication, I am drawn back some 50 years to the words of Mario Savio one of the spokespeople for the Berkeley Free Speech Movement:

““There’s a time when the operation of the machine becomes so odious—makes you so sick at heart—that you can’t take part. You can’t even passively take part. And you’ve got to put your bodies upon the gears and upon the wheels, upon the levers, upon all the apparatus, and you’ve got to make it stop. And you’ve got to indicate to the people who run it, to the people who own it, that unless you’re free, the machine will be prevented from working at all.”

We are at that moment that Mario Savio spoke about. I take heart from those who resist the machine of “Educational reform”

California officials want to end state testing as they prepare to phase in Common Core testing. They don’t want students subject to double testing. Now the state is locked in a showdown with Arne Duncan, who has warned the state that he might cut off federal aid if it stops state testing. Yesterday the state senate ignored Duncan’s threat and passed a bill to move forward with the plan to end current tests.

In his statement, Duncan said in part:

“A request from California to not measure the achievement of millions of students this year is not something we could approve in good conscience. Raising standards to better prepare students for college and careers is absolutely the right thing to do, but letting an entire school year pass for millions of students without sharing information on their schools’ performance with them and their families is the wrong way to go about this transition. No one wants to over-test, but if you are going to support all students’ achievement, you need to know how all students are doing.”

Nancy Carlsson-Paige, professor emerita of early childhood
education at Lesley University in Cambridge, Massachusetts,
prepared this short
guide for parents
about child-rearing. It was written in
collaboration with United Opt Out.

This question comes up again and again, and different studies reach different conclusions. Typically, TFA teachers get better than usual results in math, but not in reading, which is less susceptible to test prep and more influenced by home life.

Mathematica Policy Research released a new study today, saying that TFA and TNTP teachers get better results in math than traditionally prepared teachers. But Dana Goldstein analyzes the findings and learns that the headline oversimplifies.

For one thing, the gains were modest: “For the average child in this study, who scored in just the 27th percentile in math compared to her peers across the country, having a TFA teacher will help her move up to the 30th percentile–still a long way off from grade-level math proficiency.”

For another, the study shows that experience matters: “The bias against first-year teachers is borne out in the data. The students of second-year teachers outperformed the students of first-year teachers by .08 standard deviations–a larger gap than the one between the students of TFA and non-TFA teachers. And even though TFA recruits did well in this study, that doesn’t mean teachers reach their pinnacle after two years on the job. To the contrary, the researchers found that for teachers with at least five years of experience, each additional year of work was associated with an increase of .005 standard deviations in student achievement. ”

And Goldstein notes that 89% of the TFA teachers in the study were white, which causes concern because there are many reports of urban districts losing teachers of color, especially African Americans. That may be as big or bigger a problem in the long run that a few percentage points up or down.

Liz Rosenberg, New York City public school parent, has a
new idea about her daughter’s test scores: she ignores them. This
is what she wrote: Refusing our Daughter’s Test Scores Earlier this
month, New York state made headlines when it revealed how poorly
schools and districts had fared on the state’s new Common
Core-aligned standardized tests. Beginning August 26, families of
the roughly 400,000 New York City public school pupils who took the
tests can log into ARIS (the system that stores student records) to
see their children’s ELA and math scores. My partner and I,
however, have decided that we will not be joining our fellow
parents in this endeavor. Instead, we are sending our school a
letter asking that they not share this year’s scores with our
daughter nor send them home via backpack or snail mail. Why? In
order to trust the reliability of this year’s scores, we would need
to believe that the tests are valid instruments that can accurately
measure what our daughter knows and is able to do. But how can
we–or educational experts, for that matter–assess the tests when
we can’t even see them? When New York signed a contract allowing
Pearson LLC, the producer of the tests, to keep the actual tests
private, it enabled the for-profit testing behemoth to shield
itself from scrutiny–and to dominate the lucrative test-prep
market. Since only small fragments of the tests are being made
public, the only other state-condoned resource that we have to go
by are the curricula the state has purchased and posted online
(produced by Core Knowledge and Expeditionary Learning). Looking at
a series of lessons that focus on frogs, we find a text called
“Everything You Need to Know about Frogs and Other Slippery
Creatures (DK Publishing). Who wouldn’t want third graders to read
a book by this title? But reading a book in class with your teacher
is quite different than testing students on their ability to
analyze a particular text. Everything You Need to Know about Frogs
and Other Slippery Creatures has a Lexile score of 1040 (Lexile is
a well regarded system for mapping the complexity of texts), which
puts it in the 6-8th grade range of text complexity. The Lexile
“analyzer” predicts that an average 3rd grade reader will
comprehend 50% of this text. Assessing students using texts that
are 3-5 years above their grade level does not help teachers or
parents learn much of anything about what those students know and
are able to do. Many high profile ed reform advocates, like Arne
Duncan, have voiced their support of NY state Education
Commissioner John King’s choice to set the bar for proficiency on
the tests so high. “I think the only way you improve is to tell the
truth, and sometimes that’s a brutal truth….,” he commented.*
Aside from “telling the brutal truth,” is there something else to
be gained politically from King’s choice? Perhaps he (and by
extension, his boss, Governor Andrew Cuomo) want to use low
proficiency rates to justify some of the reforms they have put in
place. The more “trouble” our schools are in, the more we need the
state or city to move to fix them. The fixes range from assessment
driven “personalized learning environments” (part of the national
Race to the Top applications for this year) or commercially
produced curricula to closing district schools, opening more
charters, and placing more schools on the turnaround list. They
also include expanding standardized testing to even our youngest
students–those in kindergarten through 2nd grade. As money and
personnel are diverted to these “reforms,” the byproducts are
larger class sizes; curricula that have no ties to schools,
students, or communities; an exodus of talented teachers frustrated
by their loss of autonomy; a stronger argument for charter schools,
and a weakened union. Given all of this, the state has not given us
any reason to trust the scores our daughter (or anyone’s daughter
or son) received this year. So like Michelle Rhee, President Obama,
Commissioner King and federal Department of Education Secretary
Arne Duncan–all of whom send their children to private schools–my
partner and I will have to rely on factors other than the state’s
standardized test scores to evaluate our child’s learning and
progress towards the standards. Our faith will lie with our school,
our daughter’s teachers, and with our own ability to assess her
learning in relationship to the standards. For other parents who
question the content, methodology, and uses of NY State’s 3rd-8th
grade tests, please consider refusing the scores with us. Our hope
is that this action will not only be the best choice for our
family, but that it will help spur a conversation about these
issues among parents/guardians around the city and state.
*http://www.wnyc.org/blogs/schoolbook/2013/aug/06/lower-scores-expected-duncan-backs-ny-new-state-tests/
Liz Rosenberg is a co-founder of NYCpublic.org, an organization
that is creating more opportunities for public school parents to
learn, organize, and take action — together. She lives in Brooklyn
with her partner, Sue Schaffner and their two children.

One of the most effective ways to throw a monkey wrench into harmful mandates is to resist. Say no. Refuse to participate. When they tell you to walk the plank into a sea of sharks, don’t do it.

In the case of high-stakes testing, a growing number of parents are keeping their children home on testing day. If enough parents opt out, the numbers for the school and for the district become invalid. The machine can’t run without the willing participation of those it harms.

Think about it.

The New York Times published an online debate about what is needed next in NYC.

Pedro Noguera, Geoffrey Canada, So Stern and I weigh in.

Who is defending the status quo? You decide.

One of the favorite complaints of the corporate reformers
is that we are “losing” the international test score race. Richard
Rothstein and Martin Carnoy put that canard to rest in a report
released earlier this year.

It did not get the attention it deserved because it challenged the conventional wisdom. Since
the Obama administration’s education policy rests on the
conventional wisdom, and since the privatizers rely on the
conventional wisdom, the report was greeted not with elation but
stony silence.

No, we are not first in the world: by their
calculations, that distinction goes to Canada, Finland, and Korea.

But our average performance is dragged down by the very large
proportion of children living in poverty. When demographics are
factored in, our performance is quite good–not perfect–but not
the disaster claimed by those who have a vested interest in making
American schools and teachers and students look bad. They find:
“Because social class inequality is greater in the United States
than in any of the countries with which we can reasonably be
compared, the relative performance of U.S. adolescents is better
than it appears when countries’ national average performance is
conventionally compared. “Because in every country, students at the
bottom of the social class distribution perform worse than students
higher in that distribution, U.S. average performance appears to be
relatively low partly because we have so many more test takers from
the bottom of the social class distribution. “A sampling error in
the U.S. administration of the most recent international (PISA)
test resulted in students from the most disadvantaged schools being
over-represented in the overall U.S. test-taker sample.

This error further depressed the reported average U.S. test score. “If U.S.
adolescents had a social class distribution that was similar to the
distribution in countries to which the United States is frequently
compared, average reading scores in the United States would be
higher than average reading scores in the similar post-industrial
countries we examined (France, Germany, and the United Kingdom),
and average math scores in the United States would be about the
same as average math scores in similar post-industrial countries.

“A re-estimated U.S. average PISA score that adjusted for a student
population in the United States that is more disadvantaged than
populations in otherwise similar post-industrial countries, and for
the over-sampling of students from the most-disadvantaged schools
in a recent U.S. international assessment sample, finds that the
U.S. average score in both reading and mathematics would be higher
than official reports indicate (in the case of mathematics,
substantially higher). “This re-estimate would also improve the
U.S. place in the international ranking of all OECD countries,
bringing the U.S. average score to sixth in reading and 13th in
math. Conventional ranking reports based on PISA, which make no
adjustments for social class composition or for sampling errors,
and which rank countries irrespective of whether score differences
are large enough to be meaningful, report that the U.S. average
score is 14th in reading and 25th in math. Disadvantaged and
lower-middle-class U.S. students perform better (and in most cases,
substantially better) than comparable students in similar
post-industrial countries in reading. In math, disadvantaged and
lower-middle-class U.S. students perform about the same as
comparable students in similar post-industrial countries. “At all
points in the social class distribution, U.S. students perform
worse, and in many cases substantially worse, than students in a
group of top-scoring countries (Canada, Finland, and Korea).
Although controlling for social class distribution would narrow the
difference in average scores between these countries and the United
States, it would not eliminate it.

“U.S. students from
disadvantaged social class backgrounds perform better relative to
their social class peers in the three similar post-industrial
countries than advantaged U.S. students perform relative to their
social class peers. But U.S. students from advantaged social class
backgrounds perform better relative to their social class peers in
the top-scoring countries of Finland and Canada than disadvantaged
U.S. students perform relative to their social class peers. “On
average, and for almost every social class group, U.S. students do
relatively better in reading than in math, compared to students in
both the top-scoring and the similar post-industrial countries.

Because not only educational effectiveness but also countries’
social class composition changes over time, comparisons of test
score trends over time by social class group provide more useful
information to policymakers than comparisons of total average test
scores at one point in time or even of changes in total average
test scores over time. “The performance of the lowest social class
U.S. students has been improving over time, while the performance
of such students in both top-scoring and similar post-industrial
countries has been falling. “Over time, in some middle and
advantaged social class groups where U.S. performance has not
improved, comparable social class groups in some top-scoring and
similar post-industrial countries have had declines in
performance.”