Archives for category: Testing

Kevin Glynn, elementary teacher in Long Island, Néw York, analyzed the questions for third grade on the Common Core test using readability and found, to his surprise, that the language was far above the level they could understand.

“In English Language Arts tests, the grade level appropriateness of text used is a gray area. Some would argue that it is perfectly fine for third graders to be assessed using texts with readability levels of 5th and 6th graders. But even the champions of rigor must adhere to the golden rule of testing- the questions MUST be written on the grade level you are attempting to assess. It only makes sense. Students can’t answer questions that they do not understand. These tests are constructed for ALL students in a given grade level and therefore it is imperative that the questions are grade appropriate.

“As a former test developer for Pearson, PARCC, CTB, and NYSED we were never permitted to use words or vocabulary in questions that were too far above the grade level being tested (i.e. – 3rd grade questions were all constructed on grade 3 or 4). Again, the concept was simple- students cannot answer questions that they do not understand. After all, how much comprehension support is there in a test question?

“It is clear the Common Core state tests have no regard for the most widely understood testing principle- write questions that are on grade level. Look at these questions [open link to see them] from the Common Core NY state third grade ELA tests. They have questions that place 3,4, and 5 grade levels above the year being tested. Imagine giving 3rd graders 6th, 7th, and 8th grade level questions and thinking this is somehow the proper measure of their growth or their teacher’s instruction.”

Open the link to see questions that are far over the heads of third graders.

John Kuhn, Texas superintendent, is a brilliant orator and writer. In this article, he skewers the cheerleaders for high-stakes testing in Texas by showing how they cherry pick data to buttress their case for testing kids more and more instead of providing adequate resources for them to learn.

 

He begins by demonstrating how they situate their love of testing as a civil rights issue. They cite the Brown decision and in other ways claim that they love the children who are poor and needy and want the best for them. But what they never do is to advocate that the Legislature restore the billions of dollars that were cut from the schools attended by the children they claim to love.

 

Here is a small sample of a smartly argued and well documented analysis:

 

In “The Big Idea of School Accountability,” their slick apologia for high stakes testing and punitive accountability, both of which have dominated American education politics and pedagogy since the 1980s, Bill McKenzie and Sandy Kress start out on the high road. McKenzie is a high-ranking opinion-shaper at the George W. Bush Institute and a former editorialist for the Dallas Morning News. Kress was an architect of Bush’s No Child Left Behind Act of 2001 and, though he leaves this out of his bio attached to the essay, a long-time lobbyist for Pearson, the world’s leading vendor of K-12 standardized tests. The two edu-lobbyists begin their essay by mentioning historical moments in education policymaking and politics that would seem to appeal to a wide audience. They condemn segregation and celebrate Brown v. Board of Education. They praise the Elementary and Secondary School Act of 1965 (later renamed ESEA) and they celebrate its noble intention that “schools in disadvantaged communities would receive the resources to provide their students a decent education.”

 

Pay close attention to that statement, because it is the last time the authors will refer to resources as a necessary element to ensuring quality education in disadvantaged communities. Through the sleight of hand that has been perfected by the modern education reformer—and McKenzie and Kress are education reformers of the highest order—the writers deftly pivot from any and all talk of the need to provide equitable educational resources across all communities so that schools in even the poorest areas can deliver on the promise of education, and they spend the remaining pages of their article discussing something much easier on the taxpayer’s pocketbook: accountability, or the careful creation of just the right punishments to make teachers and students succeed in making learning happen, without respect to the pesky details of resources available to them (or unavailable to them, as they case may be). In the next paragraph—without establishing that the equity of resources LBJ’s law intended to guarantee was ever successfully attained—the writers begin to speak of campuses being “held responsible,” of the need to “hold schools accountable” and of “what should happen if schools do not show progress for all their students.”

 

Pivot complete.

 

The authors have shifted totally from an inconvenient conversation about fair and equitable investment in children and communities—investment that is adequate and comparable regardless of a student’s zip code or skin color—to one about holding children and communities responsible for their own outcomes. Accountability is constructed on the principle of blame and consequences as leverage to move schools and kids forward (blame and consequences, it should be noted, entirely directed at the teachers and students, with no consequence whatsoever reserved for citizens outside the schoolhouse who may or may not provide adequate fiscal supports for schools and children). At the urging of testing advocates like the authors of this essay, educational improvement via punitive test-based policies has eclipsed humane concepts of shared assistance and support for hurting American children (particularly anything resembling the investment of tax receipts) as the “civil rights issue of our time.” Educational accountability is designed as a low-cost replacement for social responsibility.

 

Children in America’s poorest neighborhoods lack all manner of opportunities and resources from birth that many American families take for granted. This isn’t to say they can’t learn. Of course they can learn, but there are obstacles they must overcome that society has kindly ensured do not litter the path of many other children from middle and upper class areas. From birth weight forward, all the data in impoverished zones is stacked against children, and elevating accountability for schools as our primary lever for improving these children’s lives has the effect of squelching any urgency and attention directed at efforts to feed and clothe and love and help them outside the school. We hear reformers speak of “the fierce urgency of the now” when they speak of improving schools, but we never hear it when they speak of improving lives. More than anyone in the United States, the poor child needs a hand up. More than any organization in the United States, the public school—the place where our children gather, and where they come as they are—needs support…..

 

Folks in the accountability camp like to say “we can’t throw money at the problem.” In fact, they apparently prefer actively pulling money away from the areas where the greatest problems exist. It is lunacy to believe that a testing program can do anything to help children who are being denied the same educational resources provided to their peers in wealthy communities. And to compare those under-funded students with their better-funded peers is nothing short of cruelty.

 

Thanks to the shift in focus toward testing and away from resourcing, in 2015 Texas sank to 49th in the nation in school funding (2). The accountability clique convinced lawmakers that funding was of little import; academic success could be forced upon children at a discount via test-based coercion and threats. An analogy might be if the Good Samaritan in the Bible story had stopped beside the injured traveler and, instead of lifting him out of the dirt and paying for his recuperation at an inn, had stood over him with a stopwatch and told him to hurry and get up, and assured him that he was comparing his time with that of uninjured people.

 

After quickly dismissing the topic of equitable funding for schools in poor areas, the authors praise bipartisanship and claim the legacy of Lyndon B. Johnson and Robert Kennedy as they discuss the debate surrounding ESEA. But even as they quote LBJ opining how his signature education law meant more “to the future of America” than anything he had signed before, they neglect to mention that what they are advocating in this essay—the continuation of required annual standardized testing in grades 3-8 and once in high school and significant punishments for schools, teachers, and students based on said tests’ results—were nowhere in LBJ’s bill.

 

Kuhn knows that reformers like to say that any reference to poverty means that you don’t believe poor children can learn. He knows that poor children can learn, but he also knows that poor children need at least the same resources as affluent children to learn. The “big error” of the accountability hawks is that they think that high-stakes testing is a substitute for resources. It is not. A brilliant and powerful essay.

BASIS schools are known for their high standards and their high attrition rate. There is a BASIS school in Washington, D.C., where students are taking very hard courses and “many”withdraw in January (and, according to Guy Brandenburg) “because they realize that they are on track to fail one or more courses for the semester and will therefore have to repeat the entire grade — something that would not happen at any other school that I know of.” The answer, Mathews suggests: more elite, highly selective schools. This, of course, leaves the public schools worse off, with only the students who can’t meet the high standards.

 

Jay Mathews of the Washington Post argues here that low-income students are up to the challenge of the most rigorous schools. Apparently the problem with public education is that schools have low expectations. Make the schools harder, and the students will rise to the challenge.

 

If that were true, perhaps the “failure” rate on the Common Core tests would not be 70%, including 97% of ELLs in New York, and more than 80% of black and Hispanic students.

 

The biggest problem in education is not what to do with those low-income students who can meet the highest standards, but what to do to help those who cannot. That was supposed to be the purpose of charter schools–to find innovative ways to educate the kids who are failing and unmotivated–not to provide an escape for the most talented students.

At a school board meeting in Palm Beach County, teacher Andy Goldstein sang a song to his superintendent. The haunting refrain is, “What will be your legacy? How will you be remembered?” He calls on the superintendent to opt the entire district out of state testing. He asks him, in song, whether he serves the children or the 1%.

 

It’s funny, sad, and poignant.

This is a video of three girls at Elyria High School taking a PARCC practice test. Two of them are honor students. As you will see, they find the test questions baffling.

The girl in the middle has started a new group called the Badass Student Organization. It is likely to spread.

David Gamberg, superintendent of the Southold and Greenport districts in Long Island, Néw York, here defends childhood and the value of play against the endless barrage of high-stakes testing coming from federal and state officials.

 

He writes:

 

“The curiosity and creativity of a child is at stake. They should be full of wonder. They should be given the proper time and space to venture into the world of others as they read for pleasure, dabble in watercolors that know no bounds, or expend the boundless energy of a little boy or girl on the playground without the fear of being cut short in the name of preparing for a high stakes test. The experiences that children should be engaged in are being sacrificed at an alarming rate…..

 

“The idea that we must designate scores to a narrow band of testable content areas (math and English Language skills) as future predictors of global competitiveness is about as sensible as mining for fool’s gold in the desert. The future of our nation more likely hinges on educating a generation of well-nourished children, who arrive at school excited by the prospect of being socially and emotionally engaged in learning that is joyous. School must promote the use of time that is filled as much with singing, dancing, drawing and running as it is with experimenting in science or practicing essential skills in reading, writing, and math.

 

“I call upon our elected leaders and policymakers to fashion a more balanced and sensible path forward. The current plan that looks at one side of the educational ledger is as misguided as it is destined to produce a generation of children who fail to fully experience childhood to the detriment of our civil well being in the years ahead.”

Robert Pondiscio wrote an article for US News defending Common Core’s requirement that all children in kindergarten must learn to read. [Full disclosure: Robert is a friend though I don’t agree with him about Common Core.]

 

Peter Greene disagrees with Pondiscio.

 

Robert writes:

 

“I’m a fan of the Common Core State Standards, but I recognize there are many reasonable and honorable areas of disagreement about them, both politically and educationally. However one recent thread of opposition strikes me as quite unreasonable: the idea that Common Core demands too much by expecting children to be able to read by the end of kindergarten.

 

“A recent report from a pair of early childhood advocacy organizations (Defending the Early Years and Alliance for Childhood) makes the argument that “forcing some kids to read before they are ready could be harmful” and calls for Common Core to be dropped in kindergarten and “rethought along developmental lines.” It’s a really bad idea. Early reading struggles left unaddressed tend to persist, setting kids up for failure. Common Core is not without faults, but its urgency about early childhood literacy is not one of them.

 

“The first red flag in the report is its insistence that Common Core is “developmentally inappropriate.” That sounds scientific and authoritative, but it’s a notoriously slippery concept, harkening back to the day when Piaget theorized that children go through discrete developmental stages. As Dan Willingham, a cognitive scientist at the University of Virginia points out, “children’s cognition is fairly variable day to day, even when the same child tries the same task.” What critics seem to be saying is that Common Core is simply too hard for kindergarten. But that’s clearly not true either.”

 

Peter Greene responds:

 

“There is a world of difference between saying, “It’s a good idea for children to proceed as quickly as they can toward reading skills” and “All students must demonstrate the ability to read emergent reader texts with purpose and understanding by the last day of kindergarten.”

 

“The development of reading skills, like the development of speech, height, weight, hair and potty training, is a developmental landmark that each child will reach on his or her own schedule.

 

“We would like all children to grow up to be tall and strong. It does not automatically follow that we should therefore set a height standard that all children must meet by their fifth birthday– especially if we are going to label all those who come up short as failures or slow or developmentally disabled, and then use those labels in turn to label their schools and their teachers failures as well. These standards demand that students develop at a time we’ve set for them. Trying to force, pressure and coerce them to mature or grow or develop sooner so that they don’t “fail”– how can that be a benefit to the child.

 

“And these are five year olds in kindergarten. On top of the developmental differences that naturally occur among baby humans, we’ve also got the arbitrary age requirements of the kindergarten system itself, meaning that there can be as much as a six-month age difference (10% of their lives so far) between the students.”

 

 

As for myself, I agree with Dan Willingham, who was quoted by Robert. Children’s development is highly variable, making it impossible to set a hard and fast deadline, such as, they must be able to read at the end of kindergarten. My own children learned to read before they started kindergarten (I read to them and with them daily), but others in their class started reading in first grade; a few became readers as late as second grade. Now they are all adults, and no one remembers when they started reading, except their parents.

Alexandra Miletta is a teacher educator at Mercy College. We have a bond; I was in graduate school almost 50 years ago with her mother.

 

Miletta is outraged by the state’s new certification exams. They are mostly multiple-choice, they are rigid, and they have disparate impacts on white and black teachers.

 

What is so bad about them? Miletta gives us a 101 course and here is part of it:

 

 

Teacher education programs are frantically scrambling to accommodate students who are in a full-blown panic and understandable confusion over the sudden change in regulations. Even the Board of Regents is attempting to reduce the disastrous effects of this completely bungled roll out, perhaps making things worse. Meanwhile, the public is in the dark about what is happening in part because of the technical nature of teacher licensure, and in part because of a lack of attention to teacher education in journalism.
What is so terrible about these certification exams? Overall, there are six issues in my opinion that top the long list. I’ll start with that overview, and then I’ll get into specifics about each of the exams. Consider this my attempt at a 101 course on what it takes to become a teacher in New York State, besides getting a masters degree from a college or university.

 

TIME AND TIMING

 

Each of these tests is timed, with the exception of the edTPA, although that must usually be completed within the one semester of student teaching in the vast majority of programs. No one reports having leftover time, they work right up to the last minute. The timing of when you must take the tests is dictated by individual programs. Some are required for admission, some after a certain number of credits, some prior to student teaching. The problem is if you fail, you are likely to be derailed from your progress in the program, which costs you more than just a retake. There are time limits on when you can retake the exams. Some students are also taking CLEP exams to compensate for missing undergraduate course requirements. Let’s just say that throughout your time in a teacher preparation program you are worrying about certification exams.

 

COSTS

 

The new exams are computer based, and cost more than the old exams. You will easily spend upwards of $1,000 on these exams. Even practice tests cost you $30. There were a handful of vouchers distributed to colleges for some exams, but not nearly enough to meet demands of those with financial aid. If you schedule an exam and need to cancel, you only get a partial rebate. If you want to contest your edTPA score, you must pay $200, which does not entitle you to a new evaluation, only to an internal investigation of the scoring process. It’s half as much to do a one-task retake, so that’s the likelier choice in the event you don’t have a passing score.

 

QUANTITY

 

There are now four exams required for initial certification. It seems they want to cover all the content of the preparation program, maybe so that eventually someone can circumvent a masters program altogether. The state says the tests measure “knowledge and skills that are necessary for service in the state’s schools.” The type of knowledge that can be measured in multiple choice and short essay questions is quite limited, and I think to assume the tests measure skill level accurately is really a stretch. There’s certainly no shortage of the encyclopedic factoids to invent as essential for teachers to know, so they will probably continue to invent new tests and questions ad infinitum.

 

VALIDITY AND TRANSPARENCY

 

Teacher educators would like to know what makes these tests valid, what research has been done to show that those who pass are better teachers than those that don’t. Good luck Googling that! There is virtually no transparency regarding who designed and developed the exams, how and when they were piloted and normed, and zero studies on their validity. The state provides vague details on the “standard setting committees” and cut score processes, claims they were field tested, and that individuals on the committees are qualified to make these important determinations. Even without expertise in psychometrics, it’s easy to see that someone is trying to hide something.

 

These are “one right answer” exams, even though teaching seldom consists of one right answer but requires quick thinking and sound judgment and deep knowledge. Anyone who goes into the classroom with a bunch of one right answers is sure to find that they don’t fit the occasion, which calls for thinking skills and empathy.

 

Miletta expects passing rates to drop, especially for candidates of color.

 

 

 

 

I posted earlier today a comment by Susan Chyn, saying that she was sorry for students who have to take the PARCC test. She explained why she thought the test was not a good test. My description of her left the impression that she was tutoring students for PARCC, but this was incorrect. She tutors students in English language arts, especially literature and writing. She has worked in the standardized testing industry, which gives her insight into the deep flaws of PARCC. Some readers made baseless accusations that she was somehow profiting by tutoring students for PARCC. She is a tutor, period. She helps students prepare for the work in school and for the tests. She should not be criticized for being a tutor or for working in the testing industry. She is a knowledgeable critic of PARCC because of her own experience, and I thank her for her comments and welcome more.

Peter Greene here reviews David Brooks’ latest effort to advise the nation about education issues. Brooks argues that it would be a mistake to try to reduce poverty by redistributionist policies (I assume he means such policies as higher taxes on billionaires or direct benefits to those who are poor or government programs for job creation); instead, we should count on education to reduce inequality and poverty.

 

In earlier columns, he concluded that Geoffrey Canada’s Harlem Children’s Zone charters were “miracle schools” that had closed the achievement gap between white and black students (however, the miracle has not been sustained, even though Canada kicked out the entire entering class whose scores were low, and his schools spend substantially more than public schools with which they are compared); and Brooks endorsed the idea that teachers would produce higher test scores through a trick called “loss aversion,” where they are given a bonus at the beginning of the year, but the bonus is taken away if the scores don’t go up. In 2011, after he heard me speak in Aspen, Colorado, he wrote a column criticizing me for questioning high-stakes testing and charter schools, and of course, he complained that I said that poverty is a leading cause of low test scores. He seems to believe that testing and charters are the answer to poverty, even though after some 13 years of high-stakes testing and 25 years of charters, there seems to be more child poverty, not less.

 

In today’s column, Brooks claims that the way to prosperity is not to reduce poverty by, for example, creating jobs for people who want to work or raising taxes on the super-rich (that would be redistributionist, which is a very bad thing in his eyes), but by making sure that everyone goes to college. If everyone goes to college, then everyone will get good jobs, and no one will be poor. But where will all those new jobs come from? According to the Bureau of Labor Statistics, the 20 occupations that will supply the most jobs between now and 2022 are mostly low-paying. Except for registered nurses and managers, 18 of the 20 occupations are not high-wage occupations. Do we need to improve our schools? Yes, of course. Will that be enough to reduce poverty? No.

 

Greene writes:

 

Mostly Brooks wants to argue for education as the miracle engine of economic justice. And to make his argument, he trots out the work of Raj Chetty, a piece of research that proves conclusively that even researchers at Harvard can become confused about the difference between correlation and causation. (Chetty, for those of you unfamiliar with the “research,” asserts that a good teacher will result in greater lifetime earnings for students. What he actually proves is that people who tend to do well on standardized tests tend to grow up to be wealthier, an unexciting demonstration of correlation best explained by things we already know– people who score well on standardized tests tend to be from a higher-income background, and people who grow up to be high-income tend to come from a high-income background.)

 

Brooks also cites magical researcher David Autor of MIT, who believes that if everyone graduated from college with a degree, everyone would make more money because, reasons. Because if everyone had a college degree, flipping burgers would pay more? Because if everyone had a college degree, corporations would suddenly want to hire more people? The continued belief in the astonishing notion that a more educated workforce causes higher-paying jobs to appear from somewhere is big news to a huge number of twenty-somethings who are busy trying to scrape together a living in areas other than the ones they prepared for these days.

 

Brooks isn’t done spouting nonsense:

 

[Brooks writes:] “Focusing on human capital is not whistling past the graveyard…No redistributionist measure will have the same effect as good early-childhood education and better community colleges, or increasing the share of men capable of joining the labor force.”

 

Because the vast number of high-paying jobs currently going unfilled is….. what?

 

Brooks says that redistributionists don’t get it, that they believe that modern capitalism is fundamentally broken, but that their view is biased by short-term effects of the recession. I have two responses for that pair of thoughtbubbbles.

 

First, it’s not clear whether capitalism is broken or not because we are currently tangled up in some sort of twisted fun-house mirror version of faux capitalism where the free market has been obliterated by a controlled money-sucking machine run by the government on behalf of the oligarchs. I’m actually a fan of capitalism, but what we currently have in this country is not capitalism at all.

 

Second, your argument about the “temporary evidence” of the recession is invalid because the recession was (and is) not the result of some mysterious serious of natural events. The economy went in the tank because the CEOs and Wall Street put it there. The economy broke because the “capitalists” broke it, and consequently the recession itself is Exhibit A in the case against modern faux capitalism and the greedheads who run it.

 

Throwing all this back at a magical belief in education is simply another way to blame poor people for being poor. So sorry you need food stamps and health care, but if you’d had the guts and character to go to college and get a degree, you wouldn’t be in such a mess. Your poverty is just the direct result of your lack of character and quality. Well, that and your terrible teachers. But it certainly has nothing to do with how the country is being run. It’s all on you, lousy poor person. And also your teachers.