Archives for category: Testing

SInce Pearson bought control of the GED test, there has been a staggering collapse in the number of students who passed it and won a high school diploma. Pearson raised the cost of taking it and made it harder by aligning it with the Common Core.

 

Before Pearson took over, about half a million students took the GED, and most passed. After Pearson took control, passing rates dropped by a stunning 90%.

 

These days, employers often require a high school diploma even for menial jobs. No diploma, a life of limited opportunity.

 

New York City once had a superb adult education program, one of the best in the nation. But that program is now producing few graduates.

 

“The city Department of Education touts its $47 million-a-year adult-education program as the biggest in the state and second-biggest nationwide, but last school year it awarded just 299 high-school equivalency diplomas, The Post has learned.

 

“About 27,000 people over age 21 were enrolled in classes offered by the DOE’s Office of Adult and Continuing Education, including 15,700 learning English as a second language and nearly 11,000 in basic education classes that can lead to a diploma.”

 

The New York Post blames the program’s leadership, but in light of the national data, the test itself might be flawed. Still, $47 million to produce 299 graduates. Wow.

 

Mercedes Schneider recently reported that the GED was dropping its cut score, though not by a lot. This was a recognition that the failure rate was too high. But will this solve the problem?

 

 

 

 

Benjamin Herold of Education Week reports that students who took the PARCC test online got lower scores than those who took the test with paper and pencil.

 

 

“Students who took the 2014-15 PARCC exams via computer tended to score lower than those who took the exams with paper and pencil-a revelation that prompts questions about the validity of the test results and poses potentially big problems for state and district leaders.

 

“Officials from the multistate Partnership for Assessment of Readiness for College and Careers acknowledged the discrepancies in scores across different formats of its exams in response to questions from Education Week….

 

“It is true that this [pattern exists] on average, but that doesn’t mean it occurred in every state, school, and district on every one of the tests,” Jeffrey Nellhaus, PARCC’s chief of assessment, said in an interview….

 

“In general, the pattern of lower scores for students who took PARCC exams by computer is the most pronounced in English/language arts and middle- and upper-grades math.

 

“Hard numbers from across the consortium are not yet available. But the advantage for paper-and-pencil test-takers appears in some cases to be substantial, based on independent analyses conducted by one prominent PARCC state and a high-profile school district that administered the exams.

 

“In December, the Illinois state board of education found that 43 percent of students there who took the PARCC English/language arts exam on paper scored proficient or above, compared with 36 percent of students who took the exam online. The state board has not sought to determine the cause of those score differences.”

 

Rep. Mike Stewart and his wife Ruth decided to opt their child out of state testing. The MommaBears of Tennessee were overjoyed. Tennessee has no law permitting opt out. The MammaBears hope that the Stewart’s decision will make the voices of other parents heard by state officials.

 

 

This is the letter that Ruth Stewart sent to the school and made public:

 

 

Please accept this letter as a record of my decision to refuse for (name redacted for privacy) to participate in TN Ready/TnReady TCAP test and pretests at (school name redacted for privacy) for the remaining school year. My refusal to allow (child’s name) to participate is because I believe standardized high stakes testing take away time from the instructional experiences my child might otherwise receive. I want more teaching and learning, and less testing! I am aware that there is no “opt out” clause in the state of Tennessee. But the state has yet to provide any legal documentation that my child may not exercise his or her right to refuse the tests.

 

I understand that it is state and local policy to require all students to are to be evaluated for proficiency in various subject areas at each grade level. However, I believe that testing is not synonymous with standardized testing and request that the school and my child’s teacher(s) evaluate her progress using alternative measures including project-based assignments, teacher-made tests, portfolios, and performance-based assessments.

 

(Child’s name) is prepared to come to school every day during the testing window with alternative meaningful, self-directed learning activities that support the essential curriculum, or is willing to participate in other meaningful activities as determined by the school or her teachers during testing times. Please let me know beforehand what I can expect as far as instructional experiences (child’s name) will experience during testing windows. I am happy to develop material for her if the teachers believe this is appropriate. I have a tremendous respect for (child’s name)’s teachers and her school. My issue is with frequent high-stakes standardized testing and the harm it does to children, teachers, and our public schools.

 

 

Respectfully yours,
Ruth Stewart

Paul Thomas of Furman University spent 18 years as a teacher in South Carolina. He now prepares teachers and writes articles, posts, and books.

 

He writes here about South Carolina’s reaction to the new Every Student Succeeds Act (ESSA). Politicians and editorialists say there must be no back-sliding on accountability, that the state must recommit to holding teachers, students, and schools accountable.

 

But he notes that South Carolina’s dedication to testing and accountability started thirty years ago, and the state still lags far behind other states. So-called reformers say that the answer is to double down on failed strategies. Wouldn’t you think that thirty years of failure is enough?

 

Thomas writes:

 

The greatest education challenge, then, facing our state is addressing poverty and racism in our society so that education reform has a chance to succeed. Without adopting policy that deals directly with stable jobs with adequate pay and benefits, healthcare, childcare, and an equitable criminal justice system, our schools are destined to continue to struggle.

 

Next, we need to reconsider entirely education reform—not based on accountability but on equity of opportunity.

 

Labeling and ranking our schools—whether we use more than test scores or not—has been harmful, and it is past time to consider another process. As Bruce Baker, Professor in the Graduate School of Education at Rutgers, and researcher Gerald Bracey have argued often, educational rankings tend to reveal more about conditions outside of the school’s control than about the quality of education. Overwhelmingly in all types of educational rankings the greatest predictor of high or low rankings is wealth or poverty.

 

However, The State actually hits on a better alternative: “But the focus must remain on the core function of the schools: providing all children in this state the opportunity to receive a decent education, of the sort that will allow them to become self-supporting, productive, taxpaying citizens.”

 

Equity of opportunity must replace accountability in SC—although this doesn’t mean lowering expectations or absolving schools or teachers from their responsibilities to students and the state.

 

What I propose is transparency about the opportunities to learn that all students are receiving in the context of social programs that help every student enter the doors of those schools on much more equal footing than they have historically or currently.

 

Those equitable opportunities must include for all students access to experienced and certified teachers, open door policies for challenging courses and programs (such as Advanced Placement and International Baccalaureate), and equitably funded schools and facilities across the state. As well, we must end inequitable disciplinary policies and outcomes, tracking, and harmful current policies such as third-grade retention based on reading scores.

 

But grading and ranking schools must end as well.

 

Will we waste another generation of children by holding onto failed strategies?

Michael Hynes, superintendent in Patchogue, New York, has been outspoken against the current wave of test-driven reform in New York State.

 

He posted the following comment:

 

 
What is Best for our Children

 

 

Many parents, educators and legislators are talking about the possibility of federal and state funds being withheld from schools. The fact is, hundreds of New York State public schools fell below the 95% participation rate for the 3-8 assessments last year. Here are some facts you should know before testing season begins this spring:

 

1. The Commissioner believes parents have the right to opt their children out of 3-8 state assessments.
2. The Governor stated that parents have the right to opt their children out of 3-8 state assessments.
3. The Governor stated the 3-8 assessments will not count for students and teachers for the next several years.
4. The 3-8 assessments this year are still a Pearson test.
5. The “new” 3-8 assessments are now “untimed” which means our children can actually take tests that will last for several hours over several days.
6. The assessments are still fundamentally age inappropriate and aligned with the Common Core standards. The Common Core Standards will no longer be in New York State. I repeat, they will no longer be in New York State.

 

 

There is absolutely no reason for any student to take the assessments until we have some true fundamental changes. I don’t believe making the tests a few questions shorter or allowing students to have an unlimited amount of time is the answer. This is not in the best interest of our students, especially our special education and ELL students.

 

 

 

 

Fear and misinformation is being spread by Newsday and other agencies that believe public schools are failing. This is not only unfair but unethical. School districts with high opt out rates should not be sanctioned by the State Education Department or the U.S. Department of Education. In fact, the school districts with the highest opt out rates should be rewarded. They should be rewarded because it exemplifies that we value our children. It yells from the rooftops that we are free from the burden of the Pearson crafted Common Core poisoned assessments which have zero value to anyone. Well, except for Pearson.

 

 

We need true leadership in our schoolhouses.

The National PTA adopted a resolution opposing parents’ decision to have their child opt out of state testing.

The resolution endorses the federal requirement of annual testing and says:

 

“National PTA does not support state and district policies that allow students to opt-out of state assessments that are designed to improve teaching and learning. While we recognize that parents are a child’s first teacher and respect the rights of parents to make decisions on behalf of their children, the association believes the consequences of nonparticipation in state assessments can have detrimental impacts on students and schools. Nonparticipation can result in a loss of funding, diminished resources and meaningful interventions for student subgroups, which would have a disparate impact on minorities and students with special needs and widen the achievement gap. Opting out also stalls innovation by inhibiting effective monitoring and improvement of programs, instructional strategies and exams, and could thwart transparency by providing incomplete data sets for states and schools.”

 

Di, despite 15 years of mandated testing, the National PTA still thinks that testing somehow promotes the best interests of the children in the bottom half if the bell curve, that testing narrows achievement gaps, and that testing promotes innovation. Note that no evidence is provided for any of these claims.

 

Fifteen years of testing and accountability and the National PTA says, “Stay the course.”

 

Surely this has no connection to the fact that the National PTA has received $3.7 million from the Gates Foundation, which has a deep faith in data and testing. $1 million of the total was earmarked specifically to promote Common Core.

 

Gates gave the group another $1 million in October 2015 specifically to support Common Core assessments and the results of those assessments.

One of the funniest and sharpest commentators on the follies and madness of contemporary education policy is EduShyster, known to friends and family as Jennifer Berkshire.

 

Jennifer is launching a podcast, which she calls “Have You Heard?”

 

Her first podcast is about the opt-out movement in Philadelphia. She is a great interviewer, and her podcasts will help to spread the word about the good and terrible things happening in education today.

 

She travels the country in search of stories, and she will be interviewing some of the leading figures in education from different ends of the ideological spectrum, asking tough questions.

 

Add EduShyster’s podcast to your reading and listening routine.

It was difficult for Congress to agree on a replacement for the failed No Child Left Behind. NCLB was supposed to be reauthorized in 2007, but it took eight long years to finally reach a bipartisan agreement.

 

The good part about the Every Child Succeeds Act is that it spells the end of federal punishment for schools, principals, and teachers whose students have low test scores, and it restricts the ability of the U.S. Department of Education (ED) to dictate how schools should reform. There is no more AYP (adequate yearly progress); there is no more deadline of 2014 by which time every student everywhere will be proficient, which was always a hoax that no one believed in.

 

The bad part about ESSA is that it preserves the mindset of NCLB, a mindset that says that standards, testing and accountability are the keys to student success. They are not. NCLB proved they are not. Since “A Nation at Risk” in 1983, policymakers have been in love with the idea that this combination will cause a dramatic rise in test scores and close the achievement gap among different groups. It has done neither, yet ESSA continues the fable.

 

At the outset of the Senate deliberations, Senator Lamar Alexander offered a choice between annual testing, as in NCLB, and grade-span testing (e.g., grades 4, 8, 12). A group of civil rights organizations issued a statement saying that annual testing guaranteed the civil rights of disadvantaged minorities. This sealed the deal; most other organizations and the Democratic majority fell in line behind the civil rights groups. In my view, annual testing does nothing to advance civil rights; to the contrary, it labels children based on test scores and disproportionately and adversely harms children of color and children with disabilities and English language learners. These groups should have been fighting for measures other than standardized tests, but they did not.

 

And so the children of American remain saddled with annual testing, and states remain saddled with the enormous expense of annual testing.

 

My view: The federal government should not dictate any testing. The decision to test or not should be left to every state. Contrary to the belief promoted by ex-Secretary Duncan, NAEP testing gives us all the information we need based on sampling about performance in math and reading, by race, language, gender, poverty status, disability status, and also achievement gaps. Annual tests of every child are a waste of instructional time and money. They provide no useful information.

 

I am disappointed, though not surprised, that the law encourages more privatization of public schools by promoting the funding and expansion of privately managed charter schools. More genuine and beloved community public schools will be replaced by corporate McSchools. The new federal money plus Walton’s new $1 billion commitment, plus Eli Broad’s charter zealotry, will spur the continuing destruction of public education, especially in urban districts, but their ambition is to go beyond the big cities and into the suburbs, the exurbs, and even rural areas.

 

I am disappointed that the new law encourages phony “graduate” schools of education, like Relay and Match, which have no scholars, no research, nothing but charter teachers teaching charter teachers how to raise test scores. This will not improve education. It will simply expand the supply of charter school enforcers who have learned to “teach like a robot.”

 

 

I am disappointed that there are strict limits on the number of children with disabilities who can be exempted from regular state testing and given accommodations. This seems to me to be a decision that should be made at the school level, not by the federal government.

 

I am disappointed that the law does not permit parents to opt out of state testing. As a law written by a dominantly Republican Congress, it is surprising that it does not recognize parental rights. Furthermore, a Congress that favors choice of schools should also favor the parents’ choice to say no to testing that they believe is useless and unnecessary for their child’s education.

 

I would have written a different law.

 

I would have removed testing and accountability altogether from the law and left that to the states. Why should Congress decide how often children should be tested? What is their authority for making this decision? What knowledge do they have? If states want to know how they are doing, they can review their NAEP scores.

 

I would have strengthened the enforcement of civil rights and student privacy within the law.

 

I would have established standards for charter schools, so that they disclose their finances fully and accept students that are similar to those in the community they serve. I would have prohibited for-profit charter schools and for-profit virtual charter schools.

 

I would have increased funding for special education.

 

I would have encouraged teacher education programs to raise their standards for entry, but not by relying on standardized tests (they might look, for example, at grade-point average and essays about why the candidate wants to teach. I would have encouraged the professionalism of teachers by requiring certification in the subjects taught, as well as at least a year of student teaching, so that states were not able to drop their standards for teachers. I would have required certification for district superintendents and state superintendents.

 

I would have funded and required school nurses, psychologists, librarians, guidance counselors, and social workers in every Title I school. I would have expanded funding specifically for reduced class sizes in Title I schools. I would have required an arts program staffed with certified arts teachers in every school.

 

But instead, we are saddled with standards, testing, and accountability.

 

The good thing that the law does is to shift the issues to the state level (except when it doesn’t). That means that citizens have some chance to get a better perspective on education by voting out those legislators who are currently crippling public education in their states.

 

The outlook is that, as a result of ESSA, the states in a downward spiral–like Wisconsin, Indiana, Ohio, Texas, Alabama, Kansas, and many more–will continue in that direction until there is a rebellion among the citizenry. ESSA gives people a chance to take action. But that’s about all it does. I’m grateful that AYP is gone; I am grateful that the timetable is gone; I am grateful that the Secretary of Education can no longer boss everyone around. I am glad that Race to the Top is gone. Otherwise, it is NCLB handed over to the states to tinker with.

 

After 15 years of nonstop testing and accountability, we need a new vision. ESSA is not it.

 

 

A few weeks ago, I posted a video of David Berliner’s speech in Australia, in which he explained why teachers and teachers’ education programs should not be evaluated by standardized test scores. This, as you know, is the policy that was the centerpiece of the failed Race to the Top. Its main effect has been to create teacher shortages; many experienced teachers have left the profession and enrollments in teacher education programs has sharply declined since the introduction of “value-added modeling” (VAM).

 

Audrey Amrein-Beardsley has done all of us a favor by transcribing Berliner’s speech. You can find it here.

 

 

Here are a few (not all) of his reasons:

 

 

 

“When using standardized achievement tests as the basis for inferences about the quality of teachers, and the institutions from which they came, it is easy to confuse the effects of sociological variables on standardized test scores” and the effects teachers have on those same scores. Sociological variables (e.g., chronic absenteeism) continue to distort others’ even best attempts to disentangle them from the very instructional variables of interest. This, what we also term as biasing variables, are important not to inappropriately dismiss, as purportedly statistically “controlled for.”
In law, we do not hold people accountable for the actions of others, for example, when a child kills another child and the parents are not charged as guilty. Hence, “[t]he logic of holding [teachers and] schools of education responsible for student achievement does not fit into our system of law or into the moral code subscribed to by most western nations.” Related, should medical school or doctors, for that matter, be held accountable for the health of their patients? One of the best parts of his talk, in fact, is about the medical field and the corollaries Berliner draws between doctors and medical schools, and teachers and colleges of education, respectively (around the 19-25 minute mark of his video presentation).
Professionals are often held harmless for their lower success rates with clients who have observable difficulties in meeting the demands and the expectations of the professionals who attend to them. In medicine again, for example, when working with impoverished patients, “[t]here is precedent for holding [doctors] harmless for their lowest success rates with clients who have observable difficulties in meeting the demands and expectations of the [doctors] who attend to them, but the dispensation we offer to physicians is not offered to teachers.”
There are other quite acceptable sources of data, besides tests, for judging the efficacy of teachers and teacher education programs. “People accept the fact that treatment and medicine may not result in the cure of a disease. Practicing good medicine is the goal, whether or not the patient gets better or lives. It is equally true that competent teaching can occur independent of student learning or of the achievement test scores that serve as proxies for said learning. A teacher can literally “save lives” and not move the metrics used to measure teacher effectiveness.
Reliance on standardized achievement test scores as the source of data about teacher quality will inevitably promote confusion between “successful” instruction and “good” instruction. “Successful” instruction gets test scores up. “Good” instruction leaves lasting impressions, fosters further interest by the students, makes them feel competent in the area, etc. Good instruction is hard to measure, but remains the goal of our finest teachers.
Related, teachers affect individual students greatly, but affect standardized achievement test scores very little. All can think of how their own teachers impacted their lives in ways that cannot be captured on a standardized achievement test. Standardized achievement test scores are much more related to home, neighborhood and cohort than they are to teachers’ instructional capabilities. In more contemporary terms, this is also due the fact that large-scale standardized tests have (still) never been validated to measure student growth over time, nor have they been validated to attribute that growth to teachers. “Teachers have huge effects, it’s just that the tests are not sensitive to them.”

 

 

Sandra Stotsky was deeply involved in the transformation of public education in Massachusetts from 1999-2003. As senior associate commissioner of education, she oversaw the development and implementation of curriculum frameworks and testing of entry-level teachers. Massachusetts rose to the top of the National Assessment of Educational Progress. As she explains here, the Bay State did not have annual testing.

She writes:

“K-12 schools have coped with an abundance of mandated testing since the early 1990s. Worse yet, under federal guidelines, the consequences of poor student performance have in the name of accountability come to fall more on teachers than students. The 2001 No Child Left Behind Act (NCLB) expanded the educational-level testing mandated in the 1994 authorization of the Elementary and Secondary Education Act (ESEA), mandating annual testing for reading and mathematics in grades 3-8, once in high school, and at several grade levels in science.

“The 2015 re-authorization of the Elementary and Secondary Education Act (ESEA), called ESSA (Every Student Succeeds Act), continued NCLB’s annual testing mandate. It did so in large part because of strong support from education researchers (e.g., Whitehurst, West, Chingos, Dynarski, among others, in Education Next). Yet, none provided evidence that annual testing via ESEA had significantly increased the achievement of low-income students in K-12 in both subjects. They couldn’t because there is none. Nevertheless, even though the national needle had not moved in reading at any National Assessment of Educational Progress (NAEP)-tested grade in 50 years, ESSA punished the states with a continuation of annual testing and test-based accountability.

“A big question is why education researchers don’t look at what Massachusetts did and did not do to increase low-income student achievement. Remember, its average scores in both reading and mathematics, for grade 4 and grade 8, on NAEP tests in 2005, 2007, 2009, 2011, 2013, and 2015 were the highest or among the highest of all 50 states. On the one international test of curriculum-based achievement (Trends in International Mathematics and Science Study—TIMSS), the state, entered as a separate country, tied with Singapore for first place in grade 8 science and was among the top six countries in mathematics in grades 4 and 8 in both 2007 and 2013. Surely, there should have been a long look at what the Bay State did, beyond its testing schedule.

“This is the testing that was done: From 1998 to 2000, testing took place in four major subjects (math, science, reading, and history) annually in grades 4, 8, and 10, or at one grade per educational level as mandated by the state’s 1993 Education Reform Act. After 2000, testing in math and reading took place annually but only at every other grade level (grade span testing) and at one grade per educational level annually in science and history until 2006, when NCLB’s annual requirements kicked in for math and reading because the tests were now ready for previously untested grades. The state’s high math and reading scores beginning in 2005 cannot be accounted for by annual testing. Nor can the state’s stunning performance in grade 8 science in 2007 or 2013.

“As the person in charge of the total revision or development of all the state’s K-12 standards, teacher and administrator licensing regulations, most teacher licensure tests, as well as criteria for professional development from 1999-2003, I have some basis for suggesting what I think likely contributed to students’ enduring academic gains in the past decade even if education researchers do not seem to want to learn what the Bay State did.

“Under my direction, the state department of education revised major documents to increase the content knowledge requirements in standards for all students, and to strengthen academically the licensure requirements for the state’s teacher and administrator corps. The results of high quality research were clear; teachers’ knowledge of the subject they teach is the only trait associated with enhanced gains in student achievement. The documents we developed during the years I was a public bureaucrat, including definitions of terms used, embedded policies approved by the field (via frequent public comment), the Commissioner of Education David Driscoll, and the Board of Education under James Peyser, chair.

“Annual testing at every grade level in math, reading, and science was not one of them. Nor was it apparently necessary for higher and enduring academic achievement in these subjects, even though ESSA froze it in for reading and math. Nor can the case be made today that annual testing improves low-income student achievement. It’s possible it may even retard achievement. We don’t know because the idea has not been explored by education researchers. Why civil rights organizations or the Gates Foundation support a policy that exists in no other country needs explanation.”