Archives for category: Standardized Testing

The “Regents Exams” in New York State were once a mark of accomplishment for students who chose to take them. They were considered rigorous and prestigious. But sometime in the 1990s, State Commissioner Richard Mills decided that all students should pass the Regents to get a high school diploma. The standards had to be lowered, so that there was not massive failure. Passing the Regents was no longer a badge of high accomplishment.

Now the Regents are debating whether to keep, change, or dump the high school exit exams. Research shows that high school exit exams lead to decreased graduation rates and dropouts. Not surprisingly.

The Albany Times-Union reported:

ALBANY – Members of the Board of Regents debated the value of the Regents exams Monday as part of an overall planned examination of the state testing system and graduation requirements that had been delayed due to the pandemic.

“Maybe the Regents exams are not the be-all and end-all,” said Regent Roger Tilles during a meeting that also included a presentation about how students graduate high school in other states and countries. “We have kids that can’t pass a Regents exam but pass all their courses. Should they be denied a future because they can’t pass a Regents test in one area?”

But the rigorous exams get students prepared for the future, argued Regent Catherine Collins.

“I hope the state does not get rid of the Regents,” she said. “I was fortunate enough to have the Regents science diploma, which gave me the foundation to go into health care.”

The discussion comes after graduation rates increased during two years without Regents exams, due to the pandemic. For now, the Regents are back, but a Blue Ribbon Commission is expected to weigh in on new high school diploma requirements next year. The commission was announced in 2019, but the pandemic led to a slowdown and the commission wasn’t named until last year.

The state Education Department said in an email to the Times Union later Monday afternoon that “the Board was not debating whether to eliminate Regents exams. Rather, they were discussing a 166-page report that has been in the making for three years and heard a presentation based on (the) report’s literature review, policy scan and stakeholder feedback….”

In 2019, Education Commissioner Betty Rosa made it clear that she did not think the Regents exams are “working” for every student, and questioned whether the tests improved college readiness, among other factors. She has pressed for alternative paths to a high school diploma, including career and technical programs.

At Monday’s meeting, she urged the Regents to have an open mind.

“We really have to take into account not what worked for us, but what will work down the road,” she said. “At the end of the day, our job is to keep in mind what our students need for the future.”

Chancellor of the Board Lester Young, Jr. was adamant that the board make no decision right now.

H. Hurley, a reader of the blog, left the following comment, which places NAEP hysteria into context:

The cherry on the journalistic cup cake related to recent NAEP reporting was an interview by Stephanie Ruhle on her 11:00 pm MSNBC program where she rushed in, of all people, ARNE DUNCAN, to discuss the CRISIS OF THE DROPPING NAEP SCORES. Her URGENCY in her set-up and interview was almost reported as a 3 alarm fire. Poor Arne. He actually tried to calm her reactions. But her hysteria is typical related to student test scores.


Nuts!


It’s obvious to real educators that a pandemic, million COVID deaths, ZOOM schooling, kids alone at home, banning books, masking, vaccing…anti vaccing, limited computer/Internet access, Jan6, school shootings, politics, chaos everywhere….shall we go on?


On top of this craziness, when children are finally returning to school, we TEST. We test & react in horror that children didn’t know the grade level content or skills. Scores dropped….who knew? Who could have predicted that?


ACTUALLY…….Anybody with some sense!
Children living in war, migration, fleeing, homeless, famine, rising fascism, massive crime, poverty, lead poisoning, hunger, job losses, craziness, etc…..are then tested under the WORST CONDITIONS.
Meanwhile, journalists hold up those results as if our children were living under heat lamps in incubators to be educated under the best conditions.


Stop the testing madness, end poverty, stop the political madness, allow families to raise their children with proper wages, fund schools, stop destroying public schools & use the election spending zillion$ on real people for a healthy nation.


My 2¢ worth!

The National Assessment of Educational Progress released its report on student progress in math and reading for grades 4 and 8. As expected, scores plummeted due to the many disruptions in students’ lives during the pandemic. Schools closed, then opened. Some never closed. Some were online. Some were both in-person and online. Some students lost family members to the COVID. Some students had COVID. Some teachers died or got COVID. Many cities and towns closed down. There was not a right way or a wrong way. There were many people trying to figure out what was the right thing to do. It’s still not clear, although I personally think that vaccines and masks saved many lives and reduced the seriousness of the disease for those who got it.

Leonie Haimson reviewed the results here. She provides links to other cities and states.

The Commissioner of the National Center for Education Statistics, Peggy Carr, said this:

“There’s nothing in this data that tells us that there is a measurable difference in the performance between states and districts based solely on how long schools were closed,” NCES Commissioner Peggy Carr said.

I knew Peggy Carr when I served in the US Department of Education in the early 1990s. She is a career official and a straight-talker.

A few years ago, teachers at Garfield High School in Seattle launched a boycott to protest the use of the MAP test. They believed it was a waste of time. Teacher Jesse Hagopian wrote about the successful protest in his book More Than a Score. The test was canceled in high school, but unfortunately not in middle schools or elementary schools. It’s typically offered (required) three times a year so teachers can measure student progress in the skill of taking standardized tests.

Steven Singer writes that the MAP test is junk.

He was required to attend training to give the MAP test and write the following:

This is an assessment made by Northwest Evaluation Association (NWEA), a so-called non-profit organization out of Portland, Oregon.

The company claims its assessments are used by over 9,500 schools and districts in 145 countries – but none is more popular than the MAP.

Some states even require the MAP as part of their standardized testing machinery. However, in the Commonwealth, the MAP is used as a pre-test or practice assessment by districts that elect to pay for it.

My building – the middle school – used a variety of different assessments throughout the years for this purpose – IXL, CDT, etc.

However, things are changing this year. No, we’re not getting rid of these pretests altogether – why enact sane policy now after a decade of wrongheadedness!?

My district had used the MAP consistently for years at the elementary schools, so someone in administration thought it made sense to bring it to the middle school now and eventually institute it in the high school, as well.

Do we really need an assessment BEFOREthe state mandated assessments?

Heck no!

Classroom teachers give enough assignments and tests of their own to know where their students are academically throughout the year. We grade them after all. What do you think that’s based on – guessing?

But certain administrators just love these pre-tests. They love looking at spreadsheets of student data and comparing one grading period to another. They think if the numbers go higher, it will be proof they’re good principals and functionaries.

It’s pathetic to be honest. What a waste of taxpayer dollars that could be used for actual learning! What a waste of class time that could be used for actual teaching!

And what a negative impact these assessment actually have on students and their learning!

For instance, at the MAP training, teachers were told the assessment’s job was to show how our students were doing in Reading, Math and Science compared with an average test taker.

How is that useful?

I don’t teach average test takers. I don’t even teach average students.

How is constantly comparing them to a norm going to help them improve?

If I went on a diet and stepped on the scale, learning that my weight loss wasn’t as high as an average dieter would not help me stay away from sweets. If anything, it would inspire me to go on a binge in the snack drawer.

It’s the same with my students. Constantly pounding into them how below average their scores are does not inspire them to do better. It teaches them that they cannot do what is being asked of them so they stop trying.

When learning a skill, it doesn’t help to know how well others are or are not learning that same skill. It matters how much you are learning in comparison to yourself. Yesterday I knew THIS. Today I know a bit MORE. Who cares what the so-called average learner can do!?

Students learn at their own rates – sometimes faster, sometimes slower. We don’t quicken the timescale with needless comparisons.

But no matter how many times I say such things to administrators or paid trainers from NWEA, they just don’t get it.

At this training, the instructor actually wanted to know what “elevator speech” teachers were going to give to parents about why the MAP was important!

It’s bad enough we’re being forced to give this crappy assessment, but now you want us to spout propaganda to the very people paying our salaries!?

Why not invite us to the school board meeting and ask us what we really think of this initiative? Why not have us submit comments anonymously and have them read publicly to the school board?

Why not invite us to the school board meeting and ask us what we really think of this initiative? Why not have us submit comments anonymously and have them read publicly to the school board?

But of course not! That would be actually valuing the opinion of the people you’ve hired to teach!

It’s no wonder the trainer was anticipating blow back. Many parent and teacher groups across the country have opposed the MAP test. Most famously in 2013, teachers at several Seattle schools lead by Garfield High School actually refused to give the MAP test.

Having trusted teachers sooth community worry with corporate propaganda would be a big win for the testing company.

However, I’ll give the trainer one thing – she understood that the MAP assessment scores would not be useful unless students could be encouraged to take the test seriously. Nobody tries their best at something they think is unimportant.

Her solution was two-fold. First, NWEA has produced several propaganda videos to show students why the test is important.

I can imagine how much they’ll love that!

Second, the MAP is an adaptive test taken on a computer or iPad. And it actively monitors the students taking the test.

If its algorithm determines that students are answering questions too quickly or “rapid guessing,” the program pauses the student test.

Teachers are supposed to monitor all this on a screen and intervene when it occurs. We’re supposed to counsel kids not to just guess and then allow them back on the test. If the algorithm still thinks students are guessing, we’re supposed to suspend their test and make them take it all over again.

You know, I did not get a masters in education to become a policeman for a standardized testing organization.

Open the link and read the post in full.

This is a 10-minute TED talk by Dr. Yuli Tamir, academic and former minister of education in Israel.

She explains in a direct and lively manner how the PISA standardized testing regime was foisted on the world, destroying children’s imagination, curiosity, and joy of learning.

The fundamental hoax of PISA is the claim that higher test scores will inexorably produce higher economic growth. As she demonstrates, this assertion is false.

If we want children to benefit more from their schooling, we should bend our efforts to reducing poverty. This would seem to be obvious, but it hasn’t slowed the slavish devotion of governments to raising PISA scores.

This is a brilliant presentation. I urge you to watch it.

Tom Ultican, retired teacher of advanced mathematics and physics in California, is now a significant chronicler of the Destroy Public Education movement. He attended the recent national conference of the Network for Public Education in Philadelphia and recapitulates the excitement we shared at being in person after a 2-year hiatus.

After every conference, attendees say, “This was the best one yet.” They enjoy meeting people who are doing the same work to fight privatization of their public schools. By the end of the conference, attendees say they feel energized, hopeful, and happy to know that they are not alone.

I urge you to read Tom’s post. You will get a sense of the embarrassment of riches available to attendees.

I should add that the Nebraska Save Our Schools group shared the Phyllis Bush Award for Grassroots Activism. Nebraska is one of the few states that has managed to protect its public schools and keep out both charters and vouchers, despite being a Red State.

The Pastors for Texas Children, a co-winner of the award, has repeatedly blocked vouchers in the Texas Legislature and has consistently fought for funding for public schools. PTC has opened chapters in other Red states, where they mobilize clergy to support public schools.

A high point for me was interviewing “Little Stevie” Van Zandt, a legendary rock star and actor (“The Sopranos”), who is dedicated to getting the arts into schools, not as an extra, but across the curriculum. we had a wonderful conversation. He has funded lesson plans based on rock and roll, available free at his website TeachRock.

All of the general sessions were taped. I will post them when they become available.

A big win for all those opposed to the mandatory testing of very young children.

FOR IMMEDIATE RELEASE

April 11, 2022

Samay Gheewala, 312-380-6324, info@ilfps.org

IL LEGISLATURE PASSES ‘TOO YOUNG TO TEST’ ACT

Bill will safeguard grades PreK-2nd from state testing

Young children will be protected from any current or future plans to expand state standardized testing into prekindergarten through second grade if Governor Pritzker signs a new Too Young To Test law passed by the Illinois General Assembly this session.

The Too Young To Test bill, SB 3986, received broad and bipartisan support from legislators and a coalition of Illinois parents, educators, researchers, and advocacy orgs concerned about the possible encroachment of the state testing system into PreK-2. The Too Young To Test bill prevents the state from requiring or paying for any non-diagnostic standardized testing of children before third grade.

“Too Young To Test seeks to safeguard the early years by ensuring that the Illinois State Board of Education does not spend finite resources or require standardized assessments in K-2 that have been proven to be developmentally inappropriate during such a fluid time of child development.” said State Senator Cristina Pacione-Zayas (D-Chicago), the bill’s chief sponsor in the Senate. “Instead, the state should invest in research-based practices that support whole child development such as play-based learning, social-emotional skill building, and teacher coaching. Especially after the unprecedented disruptions of these last two years, we cannot forget that the same part of the brain that registers stress and trauma is also responsible for memory and learning.”

“Our decisions about state standardized testing should reflect evidence-based research and provide reliable data,” chief House sponsor of SB 3986 State Representative Lindsey LaPointe (D-Chicago) said. “Encouraging schools to focus on unreliable standardized tests for children too young will change the focus of classroom instruction and create further inequity. We need to direct our education resources and energy toward proven strategies that enrich the classroom experience for our youngest learners.”

Assessment experts, teachers, and early childhood researchers all agree that test scores from children below age eight are not statistically reliable or valid measures of what children know and can do and should not be used to assess academic achievement or school performance.

Despite this, the Illinois State Board of Education has been considering a proposal to add optional, state-funded K-2 testing in Illinois to the existing 3-8th grade tests. That proposal has been unpopular with parents and teachers. A petition from grassroots public ed advocacy group Illinois Families for Public Schools calling on ISBE to drop the plan garnered over 1300 signatures from parents and community members in over 150 towns and cities across Illinois.

Too Young To Test wouldn’t restrict the ability of districts, schools, and teachers to use or develop assessments paid for with local funding dollars. It also does not stop the state from creating or funding tests or evaluations used for screening or diagnostic purposes.

Since the passage of the federal No Child Left Behind Act in 2001, overtesting has become a significant problem in early elementary school because younger students are being prepped for high-stakes tests in later grades. “We are relieved and encouraged by the General Assembly’s action to set clear criteria for what types of assessment the state can develop, fund and require before third grade.” said Cassie Creswell, director of Illinois Families for Public Schools.

“Before age eight, and even after, kids should be learning via play, exploration and inquiry, and the way teachers assess what they’ve learned should reflect that. What parents want for their children is small classes with teachers who use meaningful assessment methods, not more contracts with commercial test vendors,” added Creswell. “Governor Pritzker has said he’s committed to Illinois becoming the best state in the nation for families raising young children, and we think the Too Young To Test bill is an important part of fulfilling that. We hope we can count on him to sign this bill into law as soon as it gets to his desk.”

Too Young to Test was supported by a broad coalition of organizations, including the Chicago Teachers Union, Defending the Early Years, Illinois Federation of Teachers, Illinois School Counselor Association, Learning Disabilities Association of IL, and the National Association of Social Workers – IL Chapter.

###

About Illinois Families for Public Schools

Illinois Families for Public Schools (IL-FPS) is a grassroots advocacy group that represents the interests of families who want to defend and improve Illinois public schools. Founded in 2016, IL-FPS’ efforts are key to giving public ed parents and families a real voice in Springfield on issues like standardized testing, student data privacy, school funding and more. IL-FPS reaches families and public school supporters in more than 100 IL House districts. More at ilfps.org.

The following post was written by Jill Barshay and reposted by Larry Cuban on his blog. It is a response to the claim by various economists that teachers don’t improve after three to five years. This claim has been used to promote Teach for America, despite their inexperience and lack of substantive teacher education. It has also been used, as the previous post about North Carolina shows, to claim that teachers should not be paid based on their experience. It’s a pernicious idea, and I thank Larry Cuban for featuring this debunking of the conventional but wrong “wisdom.”

Jill Barshay writes:

The idea that teachers stop getting better after their first few years on the job has become widely accepted by both policymakers and the public. Philanthropist and former Microsoft CEO Bill Gates popularized the notion in a 2009 TED Talk when he said “once somebody has taught for three years, their teaching quality does not change thereafter.” He argued that teacher effectiveness should be measured and good teachers rewarded.

That teachers stop improving after three years was, perhaps, an overly simplistic exaggeration but it was based on sound research at the time. In a 2004 paper, economist Jonah Rockoff, now at Columbia Business School, tracked how teachers improved over their careers and noticed that teachers were getting better at their jobs by leaps and bounds at first, as measured by their ability to raise their students’ achievement test scores. But then, their effectiveness or productivity plateaued after three to 10 years on the job. For example, student achievement in their classrooms might increase by the same 50 points every year. The annual jump in their students’ test scores didn’t grow larger. Other researchers, including Stanford University’s Eric Hanushek, found the same.

But now, a new nonprofit organization that seeks to improve teaching, the Research Partnership for Professional Learning, says the conventional wisdom that veteran teachers stop getting better is one of several myths about teaching. The organization says that several groups of researchers have since found that teachers continue to improve, albeit at a slower rate, well into their mid careers.

“It’s not true that teachers stop improving,” said John Papay, an associate professor of education and economics at Brown University. “The science has evolved.”

Papay cited his own 2015 study with Matt Kraft, along with a 2017 study of middle school teachers in North Carolina and a 2011 study of elementary and middle school teachers. These analyses all found that teachers continue to improve beyond their first five years. Papay and Kraft calculated that teachers increased student performance by about half as much between their 5th and 15th year on the job as they did during the first five years of their career. The data are unclear after year 15.

Using test scores to measure teacher quality can be controversial. Papay also looked atother measures of how well teachers teach, such as ratings of their ability to ask probing questions, generate vibrant classroom discussions and handle students’ mistakes and confusion. Again, Papay found that more seasoned teachers were continuing to improve at their profession beyond the first five years of their career. Old dogs do appear to learn new tricks.

The debate over whether teachers get better with experience has had big implications. It has prompted the public to question union pay schedules. Why pay teachers more who’ve been on the job longer if they’re no better than a third-year teacher? It has encouraged school systems to fire “bad” teachers because ineffective teachers were thought to be unlikely to improve. It has also been a way of justifying high turnover in the field. If there’s no added value to veteran teachers, why bother to hang on to them, or invest more in them? Maybe it’s okay if thousands of teachers leave the profession every year if we can replace them with loads of new ones who learn the job fast.

So, how is it that highly regarded quantitative researchers could be coming to such different conclusions when they add up the numbers?

It turns out that it’s really complicated to calculate how much teachers improve every year. It’s simple enough to look up their students’ test scores and see how much they’ve gone up. But it’s unclear how much of the test score gain we can attribute to a teacher. Imagine a teacher who had a classroom of struggling students one year followed by a classroom of high achievers the next year. The bright, motivated students might learn more no matter who their teacher was; it would be misleading to say this teacher had improved.

Michael J. Petrilli drew a lot of criticism a few months ago when he proposed to give NAEP tests to children in kindergarten, arguing that fourth grade was too late to start assessing student skills.

Now he has an even more radical proposal: test the babies, he says.

He writes:

Earlier this year, I took to the pages of Education Next to make the case for NAEP to test starting in kindergarten, stating that, “The rationale for testing academic skills in the early elementary grades is powerful.” Therefore, “Starting NAEP in fourth grade is much too late.”

I was wrong, and I’m sorry.

Kindergarten is much too late. We must begin a program of NAEP testing for newborns. In the hospital. Before parents take them home. Maybe before parents name them.

If we wait until age five to assess students in math and literacy skills, that leaves a half-decade of missing data. How are we to know where our infants fall on a distribution scale of academic achievement? How many of them are already proficient? How can we possibly differentiate preschool playtime with success and rigor?

Some of my critics might point to the difficulty in assessing newborns. Sure, their precious, tiny hands can grip your finger in an act of sublime yet simple affection, but can they grip a pencil? How can they fill in the bubbles on a standardized test when swaddled lovingly in a blanket? How can they deal with a keyboard if they can’t sit up? Do not be swayed by such arguments, which only reinforce the mediocre expectations endemic to America’s nurseries.

Others will assert that newborns are already assessed through the Apgar test. Again, don’t be fooled! The Apgar only measures the ultra-basics, like muscle tone and respiration. Talk about low standards. We’re going to give babies passing marks just for having normal reflexes? Give me a break.

What next? Test the fetuses? Open the link and finish the article. Always good to see people making fun of their own bad ideas on April 1!

Bob Shepherd, a frequent contributor to the blog, is an education polymath. He has authored textbooks, written assessments, developed curriculum, and was most recently a classroom teacher in Florida. He has a long history in the education industry.

He explains here why standardized testing today is neither valid nor reliable.

He begins:

The dirty secret of the standardized testing industry is the breathtakingly low quality of the tests themselves. I worked in the educational publishing industry at very high levels for more than twenty years. I have produced materials for all the major textbook publishers and most of the standardized test publishers, and I know from experience that quality control processes in the standardized testing industry have dropped to such low levels that the tests, these days, are typically extraordinarily sloppy and neither reliable nor valid. They typically have not been subjected to anything like the validation and standardization procedures used, in the past, with intelligence tests, the Iowa Test of Basic Skills, and so on. The mathematics tests are marginally better than are the tests in ELA, US History, and Science, but they are not great. The tests in English Language Arts are truly appalling…

The Common Core tests, he says, are especially useless.

They are almost entirely content free. They don’t assess what students ought to know. Instead, they test, supposedly, a lot of abstract “skills”–the stuff on the Gates/Coleman Common [sic] Core [sic] bullet list, but as we shall see below, they don’t even do that.

Open the link and read on. This is a very important exposé by an expert.