Archives for category: Standardized Testing

A big win for all those opposed to the mandatory testing of very young children.

FOR IMMEDIATE RELEASE

April 11, 2022

Samay Gheewala, 312-380-6324, info@ilfps.org

IL LEGISLATURE PASSES ‘TOO YOUNG TO TEST’ ACT

Bill will safeguard grades PreK-2nd from state testing

Young children will be protected from any current or future plans to expand state standardized testing into prekindergarten through second grade if Governor Pritzker signs a new Too Young To Test law passed by the Illinois General Assembly this session.

The Too Young To Test bill, SB 3986, received broad and bipartisan support from legislators and a coalition of Illinois parents, educators, researchers, and advocacy orgs concerned about the possible encroachment of the state testing system into PreK-2. The Too Young To Test bill prevents the state from requiring or paying for any non-diagnostic standardized testing of children before third grade.

“Too Young To Test seeks to safeguard the early years by ensuring that the Illinois State Board of Education does not spend finite resources or require standardized assessments in K-2 that have been proven to be developmentally inappropriate during such a fluid time of child development.” said State Senator Cristina Pacione-Zayas (D-Chicago), the bill’s chief sponsor in the Senate. “Instead, the state should invest in research-based practices that support whole child development such as play-based learning, social-emotional skill building, and teacher coaching. Especially after the unprecedented disruptions of these last two years, we cannot forget that the same part of the brain that registers stress and trauma is also responsible for memory and learning.”

“Our decisions about state standardized testing should reflect evidence-based research and provide reliable data,” chief House sponsor of SB 3986 State Representative Lindsey LaPointe (D-Chicago) said. “Encouraging schools to focus on unreliable standardized tests for children too young will change the focus of classroom instruction and create further inequity. We need to direct our education resources and energy toward proven strategies that enrich the classroom experience for our youngest learners.”

Assessment experts, teachers, and early childhood researchers all agree that test scores from children below age eight are not statistically reliable or valid measures of what children know and can do and should not be used to assess academic achievement or school performance.

Despite this, the Illinois State Board of Education has been considering a proposal to add optional, state-funded K-2 testing in Illinois to the existing 3-8th grade tests. That proposal has been unpopular with parents and teachers. A petition from grassroots public ed advocacy group Illinois Families for Public Schools calling on ISBE to drop the plan garnered over 1300 signatures from parents and community members in over 150 towns and cities across Illinois.

Too Young To Test wouldn’t restrict the ability of districts, schools, and teachers to use or develop assessments paid for with local funding dollars. It also does not stop the state from creating or funding tests or evaluations used for screening or diagnostic purposes.

Since the passage of the federal No Child Left Behind Act in 2001, overtesting has become a significant problem in early elementary school because younger students are being prepped for high-stakes tests in later grades. “We are relieved and encouraged by the General Assembly’s action to set clear criteria for what types of assessment the state can develop, fund and require before third grade.” said Cassie Creswell, director of Illinois Families for Public Schools.

“Before age eight, and even after, kids should be learning via play, exploration and inquiry, and the way teachers assess what they’ve learned should reflect that. What parents want for their children is small classes with teachers who use meaningful assessment methods, not more contracts with commercial test vendors,” added Creswell. “Governor Pritzker has said he’s committed to Illinois becoming the best state in the nation for families raising young children, and we think the Too Young To Test bill is an important part of fulfilling that. We hope we can count on him to sign this bill into law as soon as it gets to his desk.”

Too Young to Test was supported by a broad coalition of organizations, including the Chicago Teachers Union, Defending the Early Years, Illinois Federation of Teachers, Illinois School Counselor Association, Learning Disabilities Association of IL, and the National Association of Social Workers – IL Chapter.

###

About Illinois Families for Public Schools

Illinois Families for Public Schools (IL-FPS) is a grassroots advocacy group that represents the interests of families who want to defend and improve Illinois public schools. Founded in 2016, IL-FPS’ efforts are key to giving public ed parents and families a real voice in Springfield on issues like standardized testing, student data privacy, school funding and more. IL-FPS reaches families and public school supporters in more than 100 IL House districts. More at ilfps.org.

The following post was written by Jill Barshay and reposted by Larry Cuban on his blog. It is a response to the claim by various economists that teachers don’t improve after three to five years. This claim has been used to promote Teach for America, despite their inexperience and lack of substantive teacher education. It has also been used, as the previous post about North Carolina shows, to claim that teachers should not be paid based on their experience. It’s a pernicious idea, and I thank Larry Cuban for featuring this debunking of the conventional but wrong “wisdom.”

Jill Barshay writes:

The idea that teachers stop getting better after their first few years on the job has become widely accepted by both policymakers and the public. Philanthropist and former Microsoft CEO Bill Gates popularized the notion in a 2009 TED Talk when he said “once somebody has taught for three years, their teaching quality does not change thereafter.” He argued that teacher effectiveness should be measured and good teachers rewarded.

That teachers stop improving after three years was, perhaps, an overly simplistic exaggeration but it was based on sound research at the time. In a 2004 paper, economist Jonah Rockoff, now at Columbia Business School, tracked how teachers improved over their careers and noticed that teachers were getting better at their jobs by leaps and bounds at first, as measured by their ability to raise their students’ achievement test scores. But then, their effectiveness or productivity plateaued after three to 10 years on the job. For example, student achievement in their classrooms might increase by the same 50 points every year. The annual jump in their students’ test scores didn’t grow larger. Other researchers, including Stanford University’s Eric Hanushek, found the same.

But now, a new nonprofit organization that seeks to improve teaching, the Research Partnership for Professional Learning, says the conventional wisdom that veteran teachers stop getting better is one of several myths about teaching. The organization says that several groups of researchers have since found that teachers continue to improve, albeit at a slower rate, well into their mid careers.

“It’s not true that teachers stop improving,” said John Papay, an associate professor of education and economics at Brown University. “The science has evolved.”

Papay cited his own 2015 study with Matt Kraft, along with a 2017 study of middle school teachers in North Carolina and a 2011 study of elementary and middle school teachers. These analyses all found that teachers continue to improve beyond their first five years. Papay and Kraft calculated that teachers increased student performance by about half as much between their 5th and 15th year on the job as they did during the first five years of their career. The data are unclear after year 15.

Using test scores to measure teacher quality can be controversial. Papay also looked atother measures of how well teachers teach, such as ratings of their ability to ask probing questions, generate vibrant classroom discussions and handle students’ mistakes and confusion. Again, Papay found that more seasoned teachers were continuing to improve at their profession beyond the first five years of their career. Old dogs do appear to learn new tricks.

The debate over whether teachers get better with experience has had big implications. It has prompted the public to question union pay schedules. Why pay teachers more who’ve been on the job longer if they’re no better than a third-year teacher? It has encouraged school systems to fire “bad” teachers because ineffective teachers were thought to be unlikely to improve. It has also been a way of justifying high turnover in the field. If there’s no added value to veteran teachers, why bother to hang on to them, or invest more in them? Maybe it’s okay if thousands of teachers leave the profession every year if we can replace them with loads of new ones who learn the job fast.

So, how is it that highly regarded quantitative researchers could be coming to such different conclusions when they add up the numbers?

It turns out that it’s really complicated to calculate how much teachers improve every year. It’s simple enough to look up their students’ test scores and see how much they’ve gone up. But it’s unclear how much of the test score gain we can attribute to a teacher. Imagine a teacher who had a classroom of struggling students one year followed by a classroom of high achievers the next year. The bright, motivated students might learn more no matter who their teacher was; it would be misleading to say this teacher had improved.

Michael J. Petrilli drew a lot of criticism a few months ago when he proposed to give NAEP tests to children in kindergarten, arguing that fourth grade was too late to start assessing student skills.

Now he has an even more radical proposal: test the babies, he says.

He writes:

Earlier this year, I took to the pages of Education Next to make the case for NAEP to test starting in kindergarten, stating that, “The rationale for testing academic skills in the early elementary grades is powerful.” Therefore, “Starting NAEP in fourth grade is much too late.”

I was wrong, and I’m sorry.

Kindergarten is much too late. We must begin a program of NAEP testing for newborns. In the hospital. Before parents take them home. Maybe before parents name them.

If we wait until age five to assess students in math and literacy skills, that leaves a half-decade of missing data. How are we to know where our infants fall on a distribution scale of academic achievement? How many of them are already proficient? How can we possibly differentiate preschool playtime with success and rigor?

Some of my critics might point to the difficulty in assessing newborns. Sure, their precious, tiny hands can grip your finger in an act of sublime yet simple affection, but can they grip a pencil? How can they fill in the bubbles on a standardized test when swaddled lovingly in a blanket? How can they deal with a keyboard if they can’t sit up? Do not be swayed by such arguments, which only reinforce the mediocre expectations endemic to America’s nurseries.

Others will assert that newborns are already assessed through the Apgar test. Again, don’t be fooled! The Apgar only measures the ultra-basics, like muscle tone and respiration. Talk about low standards. We’re going to give babies passing marks just for having normal reflexes? Give me a break.

What next? Test the fetuses? Open the link and finish the article. Always good to see people making fun of their own bad ideas on April 1!

Bob Shepherd, a frequent contributor to the blog, is an education polymath. He has authored textbooks, written assessments, developed curriculum, and was most recently a classroom teacher in Florida. He has a long history in the education industry.

He explains here why standardized testing today is neither valid nor reliable.

He begins:

The dirty secret of the standardized testing industry is the breathtakingly low quality of the tests themselves. I worked in the educational publishing industry at very high levels for more than twenty years. I have produced materials for all the major textbook publishers and most of the standardized test publishers, and I know from experience that quality control processes in the standardized testing industry have dropped to such low levels that the tests, these days, are typically extraordinarily sloppy and neither reliable nor valid. They typically have not been subjected to anything like the validation and standardization procedures used, in the past, with intelligence tests, the Iowa Test of Basic Skills, and so on. The mathematics tests are marginally better than are the tests in ELA, US History, and Science, but they are not great. The tests in English Language Arts are truly appalling…

The Common Core tests, he says, are especially useless.

They are almost entirely content free. They don’t assess what students ought to know. Instead, they test, supposedly, a lot of abstract “skills”–the stuff on the Gates/Coleman Common [sic] Core [sic] bullet list, but as we shall see below, they don’t even do that.

Open the link and read on. This is a very important exposé by an expert.

Denisha Jones is a lawyer, an early childhood educator, and a member of the board of DEY (Defending the Early Years). She writes here about the necessity of protecting young children from the resurgence of bad ideas. The worst of these bad ideas is standardized testing.

She writes:

As protectors of childhood, we have a duty to resist bad ideas, policies, and laws and be as vocal in our resistance as the proponents are in their insistence.

Though the effects of standardized testing have permeated certain aspects of childhood, young children typically are immune to mandated standardized testing.

When the testing accountability era began with No Child Left Behind, children below third grade escaped the yearly testing requirement.

This does not mean young children are not subject to many assessments as many schools give practice tests to first graders, but children in grades K-2 rarely take national standardized tests.

Five days into the new year, a proponent of standardized testing argues for beginning the NAEP (National Assessment of Education Progress) tests in kindergarten.

He argues that since advances in technology make it feasible to mass test young children on iPads and computers, we should collect more data in the early years.

Though many feel that NAEP is a good standardized test because it only tests a sample of students, even if this bad idea became the norm, it would only impact a sample of young children.

A THREAT TO SOME CHILDREN’S CHILDHOOD IS A THREAT TO ALL CHILDREN’S CHILDHOOD.

Testing children in kindergarten is a bad idea, period.

We do not need more tests to know what young children learn in school.

More tests lead to more scripted curriculums, teacher-led instruction, and less time to play, explore, and discover.

Please open her article and read it all.

IMPORTANT!!! K-2 Testing Bill (PROHIBITING K-2 Testing) will be heard TOMORROW!!


Subject: Alert: Sign witness slip in support of this bill–Senate Bill 3986

SB3986 will be heard in the Senate Ed Committee tomorrow.

Slip is here bit.ly/SB3986feb8 and post to share with others https://www.ilfps.org/senate_hearing_sb_3986

If you believe that required testing of children in pre-kindergarten through grade two (other than testing for diagnostic purposes) is not needed for students in today’s schools, please sign in as a PROPONENT to support this bill!

Senate Bill 3986—Pacione Zayas.

Amends the School Code. Prohibits the State Board of Education from developing, purchasing, or requiring a school district to administer, develop, or purchase a standardized assessment for students enrolled or preparing to enroll in prekindergarten through grade 2, other than for diagnostic purposes. Prohibits the State Board of Education from providing funding for any standardized assessment of students enrolled or preparing to enroll in prekindergarten through grade 2. Effective immediately.

Veteran teacher Nancy Flanagan was asked by a candidate for advice about education policy. Nancy wrote a list of ten ideas that she thought would be useful guideposts. She now updates her guide for legislators.

She writes (and I summarize):

#1. You don’t know education just because you went to school…

#2. Plan to pay many non-photo op visits to lots of schools…

#3. Take the tests that kids have to take…

#4. Be picky about what you read, listen to, and believe…

#10. Honor our democratic foundations. Public education is the most democratic of our institutions, one of our best ideas as Americans. Public schools may be tattered and behind the technological curve, but systematically destroying the infrastructure of public education is profoundly selfish and immoral. Don’t be that legislator.

This is a thoughtful and thoughtful-provoking post. She updates it.

What would you add to her list?

Paul Bonner, who recently retired as a principal in Alabama, wrote the following comment as part of a discussion of administering NAEP to kindergartners.

He wrote:

One of the experiences that made me aware that my time with public education was coming to an end was when our district began testing kindergartners. I would walk into kindergarten classrooms and watch students struggle and often cry over the inability to navigate iPads. I would leave those classrooms shaken to the core. The students who could work with the devices were not making decisions about correct answers but through simply getting the program to move from question to question. Almost none of these students could understand what the test was asking them to do. This angered me significantly because what we were focusing on ignored the activities that were needed to build an actual foundational developmental standard. No focus on gross and fine motor skill development or social and emotional growth. No test below third grade will give us meaningful understanding of what children actually know and that really is beside the point. The poor quality of most of the tests I have seen keep us from understanding what those form third grade through twelve understand! What we are doing to children, or being asked to do, is criminal and a denial of how the brain can get to a point of meaningful inquiry. The fact that people who have no experience with child development and have done no meaningful study of the early brain, provides further evidence that our society and polity has no appreciation for the professional approach required to raise children to become successful adults. It just seems to be getting worse. I am absolutely appalled to see another presidential administration and the plethora of state governments that refuse to see the damage they are doing. This predatory capitalism that has so infected education, and all of governance, just might result in the same effect led poisoning had on Rome.

Gary Rubinstein began his career as a Teach for America recruit in 1991 and got to know many of the key figures in the corporate reform movement. He is currently a career high school teacher of mathematics in a New York City public school. Over time, he became disillusioned with the phony promises of TFA and charter schools and became one of the most tenacious critics of their hypocrisy.

KIPP, he notes, is considered the gold standard of charter schools. The organization has about 250 charter schools across the nation. It benefited from being featured in the nefarious film “Waiting for ‘Superman'” as a school that was able to “save” kids who were allegedly trapped in failing public schools. The implication of the film was that charter schools had some magic knowledge that enabled them to transform children who had been faring poorly in school. Mostly, that claim is a hoax, but it is good marketing for recruitment of students.

In this post, he reports on the crisis of KIPP in Tennessee. KIPP had seven schools. But in 2020, two were closed because of low test scores and low growth scores. Now two more are on the chopping block due to poor performance.

He writes:

In the cities of Memphis and Nashville, TN there are a lot of charter schools fueled, in part, by the Race To The Top money they received while Teach For America alumni were in leadership positions at the Tennessee Education Department. By 2019, they had grown to seven KIPP schools in Tennessee. In 2020 the network announced that they were shutting down two of those seven schools. The headline from the Chalkbeat, TN article contains the quote from the network ‘‘We’ve been unable to fulfill our academic promise’. So as of 2020 they were down to five schools in Tennessee.

According to a new article in Chalkbeat, TN, this coming Tuesday, January 25th, the Shelby County school system will vote on whether or not to shut down two of the remaining KIPPs: KIPP Memphis Academy Middle School and KIPP Memphis Collegiate Elementary.

Rubinstein researched the remaining five KIPP schools [including the two at risk of closure] in Tennessee and discovered that none of them is successful.

The fact that the schools are even at risk of getting shut down for poor performance definitely should convince anyone that the ‘Waiting For Superman’ narrative that if you give charters flexibility in exchange for accountability, they will outperform the ‘failing’ public schools. But there might be some people who say “There’s bound to be a few bad apples in any bunch so maybe these are just some outliers and the ‘average’ KIPP is still very good.’

To see if that was true in Tennessee I went to the state web portal and looked up the test scores and the growth scores for all five of the remaining KIPP schools there. What I found was that not only did those schools have very low test scores, but all of them had the lowest possible ‘growth’ score (a 1 out of 5). Now I know that sometimes this ‘growth’ score is not the most accurate calculation but if reformers are going to use them to label some public schools as failing, then they would have to label all the KIPPs in Tennessee as failing too.

The Chalkbeat article says:

Three-year TN Ready test averages from the 2016-17 to 2018-19 school years show only about 6% of KIPP Memphis Academy Middle students reached or approached mastery in math, according to district records. During the same time period, about 10% of students reached or approached mastery in English. 

At KIPP Memphis Collegiate Elementary, about 10% of students reached or approached mastery in English and 18% in math, during the same period.

The CEO of KIPP Memphis defends the low test scores and low growth scores by pointing to the students’ disadvantaged backgrounds.

Rubinstein points out the irony of a charter school using this excuse:

The response from KIPP comes from the CEO of KIPP Memphis schools, Antonio Burt. According to the article “Antonio Burt, CEO of KIPP Memphis Schools, said he’s not satisfied with the two schools’ academic performance, but said many KIPP students come from economically disadvantaged backgrounds and often face greater learning challenges.” This is striking to me. The whole narrative of charter schools was that unionized teachers believe ‘poverty is destiny’ and use the economic status of students as an ‘excuse’ for low expectations and for low performance but that charters are ‘no excuses’ and will certainly not say that the students underperformed because of these ‘greater learning challenges.’ But Antonio Burt is saying what he can since he has to give the school board some reason to vote to not close these two schools.

The article in Chalkbeat noted that some board members were inclined to give Antonio Burt more time because he “received national acclaim for his work turning two low-performing Memphis schools into models of student achievement.”

That line was an invitation to Rubinstein to discover Antonio Burt’s prowess as a turnaround specialist who had received “national acclaim for his work.”

Rubinstein goes to the record and checks the data for the schools that Burt led in Memphis. Both of them were and remain among the lowest performing schools in the state.

Gary traces Burt’s career path and can’t find any schools that have been turned around by Burt.

So I see Antonio Burt as someone who has spent 2 years at one school, 3 years at another, then a year and a half overseeing eight schools. He hasn’t turned around any of those schools in any kind of lasting way yet he is hailed as a turnaround guru who will likely use that inaccurate title as a way to save the two KIPP schools from being shut down because they now finally have an expert to improve them.

On Tuesday, January 25, the Shelby County School board will decide whether to close the two failing KIPP schools or to leave them open.

You may recall that charter schools are supposed to be more accountable than public schools. When public schools post low scores, they are closed. When charters fail, they too are supposed to close. Let’s see whether that happens in Memphis. Or are charter schools–especially KIPP charter schools–held to a different (and lower) standard than public schools?

Experienced teacher Nancy Bailey opposes Michael Petrilli’s proposal to give NAEP tests to kindergartners. Petrilli, who is president of the conservative Thomas B. Fordham Institute made this proposal in Education Next.

Petrilli recognizes that the typical 5-year-old can’t read and probably can’t hold a pencil but thinks there is value in online visual tests. He argues that it’s a mistake to delay NAEP until 4th grade, because policymakers are “left in the dark” about what children know by age 5.

He writes:

Grades K–3 are arguably the most critical years of a child’s education, given what we know about the importance of early-childhood development and early elementary-school experiences. This is when children are building the foundational skills they’ll need in the years ahead. One report found that kids who don’t read on grade level by 3rd grade are four times more likely to drop out of high school later on. Why do we wait until after the most important instructional and developmental years to find out how students are faring?

Petrilli assumes that knowing test scores leads to solutions. I question that. We have been testing random samples of 4th and 8th graders (and sometimes seniors) since the early 1970s, and the information about test scores has not pointed to any solutions. After 50 years, we should know what needs to be done. We don’t, or at best, we disagree. Since 2010, test scores have been stubbornly flat. Does this mean that the Common Core and Race to the Top failed? Depends on whom you ask. It’s hard for me to see what educational purpose would be served by testing a random sample of kindergartners online.

Bailey doesn’t see what the purpose is. She points out that Petrilli was never a teacher of young children. He never was a teacher, period. He is an author and a think tank leader who champions conservative causes.

She writes:

The National Assessment of Educational Progress (NAEP) randomly assesses students across the country in math and reading in grades 4 and 8, and in civics and U.S. History in grade 8 and Long-Term Trend for age 9, but it doesn’t test kindergartners. Why should it? Why is the testing of kindergartners necessary? The answer is it isn’t.

Suppose we learn that 52% of kindergartners recognize the color red. Suppose we learn that 38% recognize a square. Suppose we learn that 63% recognize an elephant. So what? Why does any of this matter?

Bailey writes:

The best assessment of this age group is accomplished through observation, by well-prepared early childhood educators who understand the appropriate development of children this age, who can collect observational data through notes and checklists as children play and socialize with their peers.

Who needs the information that might be collected about a random sample of kindergarten children? What would they do with it?

It’s a puzzlement.