Archives for category: Standardized Testing

The National Assessment of Educational Progress released its report on student progress in math and reading for grades 4 and 8. As expected, scores plummeted due to the many disruptions in students’ lives during the pandemic. Schools closed, then opened. Some never closed. Some were online. Some were both in-person and online. Some students lost family members to the COVID. Some students had COVID. Some teachers died or got COVID. Many cities and towns closed down. There was not a right way or a wrong way. There were many people trying to figure out what was the right thing to do. It’s still not clear, although I personally think that vaccines and masks saved many lives and reduced the seriousness of the disease for those who got it.

Leonie Haimson reviewed the results here. She provides links to other cities and states.

The Commissioner of the National Center for Education Statistics, Peggy Carr, said this:

“There’s nothing in this data that tells us that there is a measurable difference in the performance between states and districts based solely on how long schools were closed,” NCES Commissioner Peggy Carr said.

I knew Peggy Carr when I served in the US Department of Education in the early 1990s. She is a career official and a straight-talker.

A few years ago, teachers at Garfield High School in Seattle launched a boycott to protest the use of the MAP test. They believed it was a waste of time. Teacher Jesse Hagopian wrote about the successful protest in his book More Than a Score. The test was canceled in high school, but unfortunately not in middle schools or elementary schools. It’s typically offered (required) three times a year so teachers can measure student progress in the skill of taking standardized tests.

Steven Singer writes that the MAP test is junk.

He was required to attend training to give the MAP test and write the following:

This is an assessment made by Northwest Evaluation Association (NWEA), a so-called non-profit organization out of Portland, Oregon.

The company claims its assessments are used by over 9,500 schools and districts in 145 countries – but none is more popular than the MAP.

Some states even require the MAP as part of their standardized testing machinery. However, in the Commonwealth, the MAP is used as a pre-test or practice assessment by districts that elect to pay for it.

My building – the middle school – used a variety of different assessments throughout the years for this purpose – IXL, CDT, etc.

However, things are changing this year. No, we’re not getting rid of these pretests altogether – why enact sane policy now after a decade of wrongheadedness!?

My district had used the MAP consistently for years at the elementary schools, so someone in administration thought it made sense to bring it to the middle school now and eventually institute it in the high school, as well.

Do we really need an assessment BEFOREthe state mandated assessments?

Heck no!

Classroom teachers give enough assignments and tests of their own to know where their students are academically throughout the year. We grade them after all. What do you think that’s based on – guessing?

But certain administrators just love these pre-tests. They love looking at spreadsheets of student data and comparing one grading period to another. They think if the numbers go higher, it will be proof they’re good principals and functionaries.

It’s pathetic to be honest. What a waste of taxpayer dollars that could be used for actual learning! What a waste of class time that could be used for actual teaching!

And what a negative impact these assessment actually have on students and their learning!

For instance, at the MAP training, teachers were told the assessment’s job was to show how our students were doing in Reading, Math and Science compared with an average test taker.

How is that useful?

I don’t teach average test takers. I don’t even teach average students.

How is constantly comparing them to a norm going to help them improve?

If I went on a diet and stepped on the scale, learning that my weight loss wasn’t as high as an average dieter would not help me stay away from sweets. If anything, it would inspire me to go on a binge in the snack drawer.

It’s the same with my students. Constantly pounding into them how below average their scores are does not inspire them to do better. It teaches them that they cannot do what is being asked of them so they stop trying.

When learning a skill, it doesn’t help to know how well others are or are not learning that same skill. It matters how much you are learning in comparison to yourself. Yesterday I knew THIS. Today I know a bit MORE. Who cares what the so-called average learner can do!?

Students learn at their own rates – sometimes faster, sometimes slower. We don’t quicken the timescale with needless comparisons.

But no matter how many times I say such things to administrators or paid trainers from NWEA, they just don’t get it.

At this training, the instructor actually wanted to know what “elevator speech” teachers were going to give to parents about why the MAP was important!

It’s bad enough we’re being forced to give this crappy assessment, but now you want us to spout propaganda to the very people paying our salaries!?

Why not invite us to the school board meeting and ask us what we really think of this initiative? Why not have us submit comments anonymously and have them read publicly to the school board?

Why not invite us to the school board meeting and ask us what we really think of this initiative? Why not have us submit comments anonymously and have them read publicly to the school board?

But of course not! That would be actually valuing the opinion of the people you’ve hired to teach!

It’s no wonder the trainer was anticipating blow back. Many parent and teacher groups across the country have opposed the MAP test. Most famously in 2013, teachers at several Seattle schools lead by Garfield High School actually refused to give the MAP test.

Having trusted teachers sooth community worry with corporate propaganda would be a big win for the testing company.

However, I’ll give the trainer one thing – she understood that the MAP assessment scores would not be useful unless students could be encouraged to take the test seriously. Nobody tries their best at something they think is unimportant.

Her solution was two-fold. First, NWEA has produced several propaganda videos to show students why the test is important.

I can imagine how much they’ll love that!

Second, the MAP is an adaptive test taken on a computer or iPad. And it actively monitors the students taking the test.

If its algorithm determines that students are answering questions too quickly or “rapid guessing,” the program pauses the student test.

Teachers are supposed to monitor all this on a screen and intervene when it occurs. We’re supposed to counsel kids not to just guess and then allow them back on the test. If the algorithm still thinks students are guessing, we’re supposed to suspend their test and make them take it all over again.

You know, I did not get a masters in education to become a policeman for a standardized testing organization.

Open the link and read the post in full.

This is a 10-minute TED talk by Dr. Yuli Tamir, academic and former minister of education in Israel.

She explains in a direct and lively manner how the PISA standardized testing regime was foisted on the world, destroying children’s imagination, curiosity, and joy of learning.

The fundamental hoax of PISA is the claim that higher test scores will inexorably produce higher economic growth. As she demonstrates, this assertion is false.

If we want children to benefit more from their schooling, we should bend our efforts to reducing poverty. This would seem to be obvious, but it hasn’t slowed the slavish devotion of governments to raising PISA scores.

This is a brilliant presentation. I urge you to watch it.

Tom Ultican, retired teacher of advanced mathematics and physics in California, is now a significant chronicler of the Destroy Public Education movement. He attended the recent national conference of the Network for Public Education in Philadelphia and recapitulates the excitement we shared at being in person after a 2-year hiatus.

After every conference, attendees say, “This was the best one yet.” They enjoy meeting people who are doing the same work to fight privatization of their public schools. By the end of the conference, attendees say they feel energized, hopeful, and happy to know that they are not alone.

I urge you to read Tom’s post. You will get a sense of the embarrassment of riches available to attendees.

I should add that the Nebraska Save Our Schools group shared the Phyllis Bush Award for Grassroots Activism. Nebraska is one of the few states that has managed to protect its public schools and keep out both charters and vouchers, despite being a Red State.

The Pastors for Texas Children, a co-winner of the award, has repeatedly blocked vouchers in the Texas Legislature and has consistently fought for funding for public schools. PTC has opened chapters in other Red states, where they mobilize clergy to support public schools.

A high point for me was interviewing “Little Stevie” Van Zandt, a legendary rock star and actor (“The Sopranos”), who is dedicated to getting the arts into schools, not as an extra, but across the curriculum. we had a wonderful conversation. He has funded lesson plans based on rock and roll, available free at his website TeachRock.

All of the general sessions were taped. I will post them when they become available.

A big win for all those opposed to the mandatory testing of very young children.

FOR IMMEDIATE RELEASE

April 11, 2022

Samay Gheewala, 312-380-6324, info@ilfps.org

IL LEGISLATURE PASSES ‘TOO YOUNG TO TEST’ ACT

Bill will safeguard grades PreK-2nd from state testing

Young children will be protected from any current or future plans to expand state standardized testing into prekindergarten through second grade if Governor Pritzker signs a new Too Young To Test law passed by the Illinois General Assembly this session.

The Too Young To Test bill, SB 3986, received broad and bipartisan support from legislators and a coalition of Illinois parents, educators, researchers, and advocacy orgs concerned about the possible encroachment of the state testing system into PreK-2. The Too Young To Test bill prevents the state from requiring or paying for any non-diagnostic standardized testing of children before third grade.

“Too Young To Test seeks to safeguard the early years by ensuring that the Illinois State Board of Education does not spend finite resources or require standardized assessments in K-2 that have been proven to be developmentally inappropriate during such a fluid time of child development.” said State Senator Cristina Pacione-Zayas (D-Chicago), the bill’s chief sponsor in the Senate. “Instead, the state should invest in research-based practices that support whole child development such as play-based learning, social-emotional skill building, and teacher coaching. Especially after the unprecedented disruptions of these last two years, we cannot forget that the same part of the brain that registers stress and trauma is also responsible for memory and learning.”

“Our decisions about state standardized testing should reflect evidence-based research and provide reliable data,” chief House sponsor of SB 3986 State Representative Lindsey LaPointe (D-Chicago) said. “Encouraging schools to focus on unreliable standardized tests for children too young will change the focus of classroom instruction and create further inequity. We need to direct our education resources and energy toward proven strategies that enrich the classroom experience for our youngest learners.”

Assessment experts, teachers, and early childhood researchers all agree that test scores from children below age eight are not statistically reliable or valid measures of what children know and can do and should not be used to assess academic achievement or school performance.

Despite this, the Illinois State Board of Education has been considering a proposal to add optional, state-funded K-2 testing in Illinois to the existing 3-8th grade tests. That proposal has been unpopular with parents and teachers. A petition from grassroots public ed advocacy group Illinois Families for Public Schools calling on ISBE to drop the plan garnered over 1300 signatures from parents and community members in over 150 towns and cities across Illinois.

Too Young To Test wouldn’t restrict the ability of districts, schools, and teachers to use or develop assessments paid for with local funding dollars. It also does not stop the state from creating or funding tests or evaluations used for screening or diagnostic purposes.

Since the passage of the federal No Child Left Behind Act in 2001, overtesting has become a significant problem in early elementary school because younger students are being prepped for high-stakes tests in later grades. “We are relieved and encouraged by the General Assembly’s action to set clear criteria for what types of assessment the state can develop, fund and require before third grade.” said Cassie Creswell, director of Illinois Families for Public Schools.

“Before age eight, and even after, kids should be learning via play, exploration and inquiry, and the way teachers assess what they’ve learned should reflect that. What parents want for their children is small classes with teachers who use meaningful assessment methods, not more contracts with commercial test vendors,” added Creswell. “Governor Pritzker has said he’s committed to Illinois becoming the best state in the nation for families raising young children, and we think the Too Young To Test bill is an important part of fulfilling that. We hope we can count on him to sign this bill into law as soon as it gets to his desk.”

Too Young to Test was supported by a broad coalition of organizations, including the Chicago Teachers Union, Defending the Early Years, Illinois Federation of Teachers, Illinois School Counselor Association, Learning Disabilities Association of IL, and the National Association of Social Workers – IL Chapter.

###

About Illinois Families for Public Schools

Illinois Families for Public Schools (IL-FPS) is a grassroots advocacy group that represents the interests of families who want to defend and improve Illinois public schools. Founded in 2016, IL-FPS’ efforts are key to giving public ed parents and families a real voice in Springfield on issues like standardized testing, student data privacy, school funding and more. IL-FPS reaches families and public school supporters in more than 100 IL House districts. More at ilfps.org.

The following post was written by Jill Barshay and reposted by Larry Cuban on his blog. It is a response to the claim by various economists that teachers don’t improve after three to five years. This claim has been used to promote Teach for America, despite their inexperience and lack of substantive teacher education. It has also been used, as the previous post about North Carolina shows, to claim that teachers should not be paid based on their experience. It’s a pernicious idea, and I thank Larry Cuban for featuring this debunking of the conventional but wrong “wisdom.”

Jill Barshay writes:

The idea that teachers stop getting better after their first few years on the job has become widely accepted by both policymakers and the public. Philanthropist and former Microsoft CEO Bill Gates popularized the notion in a 2009 TED Talk when he said “once somebody has taught for three years, their teaching quality does not change thereafter.” He argued that teacher effectiveness should be measured and good teachers rewarded.

That teachers stop improving after three years was, perhaps, an overly simplistic exaggeration but it was based on sound research at the time. In a 2004 paper, economist Jonah Rockoff, now at Columbia Business School, tracked how teachers improved over their careers and noticed that teachers were getting better at their jobs by leaps and bounds at first, as measured by their ability to raise their students’ achievement test scores. But then, their effectiveness or productivity plateaued after three to 10 years on the job. For example, student achievement in their classrooms might increase by the same 50 points every year. The annual jump in their students’ test scores didn’t grow larger. Other researchers, including Stanford University’s Eric Hanushek, found the same.

But now, a new nonprofit organization that seeks to improve teaching, the Research Partnership for Professional Learning, says the conventional wisdom that veteran teachers stop getting better is one of several myths about teaching. The organization says that several groups of researchers have since found that teachers continue to improve, albeit at a slower rate, well into their mid careers.

“It’s not true that teachers stop improving,” said John Papay, an associate professor of education and economics at Brown University. “The science has evolved.”

Papay cited his own 2015 study with Matt Kraft, along with a 2017 study of middle school teachers in North Carolina and a 2011 study of elementary and middle school teachers. These analyses all found that teachers continue to improve beyond their first five years. Papay and Kraft calculated that teachers increased student performance by about half as much between their 5th and 15th year on the job as they did during the first five years of their career. The data are unclear after year 15.

Using test scores to measure teacher quality can be controversial. Papay also looked atother measures of how well teachers teach, such as ratings of their ability to ask probing questions, generate vibrant classroom discussions and handle students’ mistakes and confusion. Again, Papay found that more seasoned teachers were continuing to improve at their profession beyond the first five years of their career. Old dogs do appear to learn new tricks.

The debate over whether teachers get better with experience has had big implications. It has prompted the public to question union pay schedules. Why pay teachers more who’ve been on the job longer if they’re no better than a third-year teacher? It has encouraged school systems to fire “bad” teachers because ineffective teachers were thought to be unlikely to improve. It has also been a way of justifying high turnover in the field. If there’s no added value to veteran teachers, why bother to hang on to them, or invest more in them? Maybe it’s okay if thousands of teachers leave the profession every year if we can replace them with loads of new ones who learn the job fast.

So, how is it that highly regarded quantitative researchers could be coming to such different conclusions when they add up the numbers?

It turns out that it’s really complicated to calculate how much teachers improve every year. It’s simple enough to look up their students’ test scores and see how much they’ve gone up. But it’s unclear how much of the test score gain we can attribute to a teacher. Imagine a teacher who had a classroom of struggling students one year followed by a classroom of high achievers the next year. The bright, motivated students might learn more no matter who their teacher was; it would be misleading to say this teacher had improved.

Michael J. Petrilli drew a lot of criticism a few months ago when he proposed to give NAEP tests to children in kindergarten, arguing that fourth grade was too late to start assessing student skills.

Now he has an even more radical proposal: test the babies, he says.

He writes:

Earlier this year, I took to the pages of Education Next to make the case for NAEP to test starting in kindergarten, stating that, “The rationale for testing academic skills in the early elementary grades is powerful.” Therefore, “Starting NAEP in fourth grade is much too late.”

I was wrong, and I’m sorry.

Kindergarten is much too late. We must begin a program of NAEP testing for newborns. In the hospital. Before parents take them home. Maybe before parents name them.

If we wait until age five to assess students in math and literacy skills, that leaves a half-decade of missing data. How are we to know where our infants fall on a distribution scale of academic achievement? How many of them are already proficient? How can we possibly differentiate preschool playtime with success and rigor?

Some of my critics might point to the difficulty in assessing newborns. Sure, their precious, tiny hands can grip your finger in an act of sublime yet simple affection, but can they grip a pencil? How can they fill in the bubbles on a standardized test when swaddled lovingly in a blanket? How can they deal with a keyboard if they can’t sit up? Do not be swayed by such arguments, which only reinforce the mediocre expectations endemic to America’s nurseries.

Others will assert that newborns are already assessed through the Apgar test. Again, don’t be fooled! The Apgar only measures the ultra-basics, like muscle tone and respiration. Talk about low standards. We’re going to give babies passing marks just for having normal reflexes? Give me a break.

What next? Test the fetuses? Open the link and finish the article. Always good to see people making fun of their own bad ideas on April 1!

Bob Shepherd, a frequent contributor to the blog, is an education polymath. He has authored textbooks, written assessments, developed curriculum, and was most recently a classroom teacher in Florida. He has a long history in the education industry.

He explains here why standardized testing today is neither valid nor reliable.

He begins:

The dirty secret of the standardized testing industry is the breathtakingly low quality of the tests themselves. I worked in the educational publishing industry at very high levels for more than twenty years. I have produced materials for all the major textbook publishers and most of the standardized test publishers, and I know from experience that quality control processes in the standardized testing industry have dropped to such low levels that the tests, these days, are typically extraordinarily sloppy and neither reliable nor valid. They typically have not been subjected to anything like the validation and standardization procedures used, in the past, with intelligence tests, the Iowa Test of Basic Skills, and so on. The mathematics tests are marginally better than are the tests in ELA, US History, and Science, but they are not great. The tests in English Language Arts are truly appalling…

The Common Core tests, he says, are especially useless.

They are almost entirely content free. They don’t assess what students ought to know. Instead, they test, supposedly, a lot of abstract “skills”–the stuff on the Gates/Coleman Common [sic] Core [sic] bullet list, but as we shall see below, they don’t even do that.

Open the link and read on. This is a very important exposé by an expert.

Denisha Jones is a lawyer, an early childhood educator, and a member of the board of DEY (Defending the Early Years). She writes here about the necessity of protecting young children from the resurgence of bad ideas. The worst of these bad ideas is standardized testing.

She writes:

As protectors of childhood, we have a duty to resist bad ideas, policies, and laws and be as vocal in our resistance as the proponents are in their insistence.

Though the effects of standardized testing have permeated certain aspects of childhood, young children typically are immune to mandated standardized testing.

When the testing accountability era began with No Child Left Behind, children below third grade escaped the yearly testing requirement.

This does not mean young children are not subject to many assessments as many schools give practice tests to first graders, but children in grades K-2 rarely take national standardized tests.

Five days into the new year, a proponent of standardized testing argues for beginning the NAEP (National Assessment of Education Progress) tests in kindergarten.

He argues that since advances in technology make it feasible to mass test young children on iPads and computers, we should collect more data in the early years.

Though many feel that NAEP is a good standardized test because it only tests a sample of students, even if this bad idea became the norm, it would only impact a sample of young children.

A THREAT TO SOME CHILDREN’S CHILDHOOD IS A THREAT TO ALL CHILDREN’S CHILDHOOD.

Testing children in kindergarten is a bad idea, period.

We do not need more tests to know what young children learn in school.

More tests lead to more scripted curriculums, teacher-led instruction, and less time to play, explore, and discover.

Please open her article and read it all.

IMPORTANT!!! K-2 Testing Bill (PROHIBITING K-2 Testing) will be heard TOMORROW!!


Subject: Alert: Sign witness slip in support of this bill–Senate Bill 3986

SB3986 will be heard in the Senate Ed Committee tomorrow.

Slip is here bit.ly/SB3986feb8 and post to share with others https://www.ilfps.org/senate_hearing_sb_3986

If you believe that required testing of children in pre-kindergarten through grade two (other than testing for diagnostic purposes) is not needed for students in today’s schools, please sign in as a PROPONENT to support this bill!

Senate Bill 3986—Pacione Zayas.

Amends the School Code. Prohibits the State Board of Education from developing, purchasing, or requiring a school district to administer, develop, or purchase a standardized assessment for students enrolled or preparing to enroll in prekindergarten through grade 2, other than for diagnostic purposes. Prohibits the State Board of Education from providing funding for any standardized assessment of students enrolled or preparing to enroll in prekindergarten through grade 2. Effective immediately.