Archives for category: Testing

John Merrow has seen the light. Once you begin to doubt the testing regime, nothing ever looks the same again. The usual ed reform conversation begins to sound like “how many angels can dance on the head of a pin?” You watch people discussing the data but it no longer makes sense. It once did, but no longer.

In this post, he says there are four groups of people in the conversation about education today.

The DeVos crowd wants to abandon public education.

The reformers are locked into the mindset of No Child Left Behind and Race to the Top. They control the debate and their ideas are stale.

The third group is uninformed and not interested.

The fourth group are progressives, who are trying to imagine a different way to educate children, in which they learn with excitement and purpose.

John thinks of himself as a progressive. I do too.

Where do you stand?

Marc Tucker recently wrote a post in which he responded to a question from Mike Petrilli of the conservative Thomas B. Fordham Institute. Mike asked why Marc didn’t look at charter management organizations as models of systems that work. (I would have added “that work for some,” since charters are free to choose their students and oublic schools are not.)

Marc answered. (I’m always reluctant to post articles behind a pay wall.)

“I can see why Mike would take that view. As charter systems have grown, they have had to do what any well-run business has to do: figure out how to hire, train and support first-rate staff, produce the best possible results at an acceptable cost, find efficiencies and improve productivity. As these charter school networks grow, they have to face the challenge of growing without compromising quality, creating leadership structures that will preserve the culture the founders created without suffocating the initiative of the people on the ground and so on.

“Freed of many of the political and legal constraints that public school systems face, some of these charter management companies have been rather innovative as they have dealt with these and many other challenges. It would be natural to see them as a test bed for better ways to organize and manage public school systems. Why, Mike wanted to know, was I so uninterested in viewing them that way? A very reasonable question.

“Part of the answer is the strategy I prefer to use to search for better ways to organize and manage school systems at the scale of a state or nation. The approach that makes the most sense to me is to start by ideinitifying the systems that produce superior results and then try to find out if there are common principles that inform the structure of those systems that distinguish them from less successful systems. I know of no top-performing systems at the scale of a state or nation the success of which can be attributed to their charter-like characteristics. There are top-performing systems that feature choice, but choice does not explain their success. What does explain their success is their adherence to principles that they share in common with systems that do not have strong choice-oriented policies. The Netherlands and Flemish Belgium are good examples of such countries. So is Hong Kong…

“Because choice for parents and students among significantly different alternatives is the core principle of the charter idea, the question we should be asking about the charter idea is not whether any one charter school is better than the typical public school serving a comparable student body, but whether charter schools as a group produce better student performance than regular public schools as a group, when serving comparable students. It is, of course, possible to find very good charter schools but it is no less possible to find equally outstanding regular public schools. When we look in the aggregate at all the charters in any given state, and compare them to all the regular public schools in that state serving the same demographic, virtually all studies show no conclusive advantage for the charters.

“But my reading of the data produces a more troubling conclusion. Both in the United States and abroad, choice policies tend to exacerbate racial and socio-economic segregation. The minority, low-income parents who have the time, education, drive and cars to take advantage of the choices offered, do so and those who do not have these things, do not. The result is that the low-performing schools are drained of the students and parents who have the desire and means to take advantage of the options offered, leaving behind those who don’t, leaving in their wake schools that are even more isolated, chaotic and desperate than they were before…

“I have not given up on our public schools, in our inner cities or anywhere else. It is not just the lowest-performing schools that are in trouble. The students in every quartile of performance in the entire country are behind their counterparts in the top-performing countries. I would spend the rest of my career studying charter school management systems if someone could present any evidence that implementation of charter systems at scale would lift the performance of American students to globally competitive levels. But I have yet to see that evidence.”

I agree with most of what Marc says but I don’t accept international test scores, as he does, as the measure of our students or our schools. Our problems as a society are far greater than what test scores measure, and what they do measure is far too narrow to capture the dynamism of our youth.


The growing impact of the assessment reform movement is clear in this week’s clips, many of which reflect a critical perspective on test overuse and misuse. This fall’s elections will play a major role in determining whether new public officials will roll back standardized exam overkill or if the same old officials will continue discredited test-and-punish policies.

Arizona Why Is “D” Rated School Shamed Instead of Helped
https://www.azcentral.com/story/news/local/arizona-education/2018/05/29/arizona-low-performing-schools-notify-neighborhood-state-letter-grade/635073002/

Florida Test Score Fixation Causes Concerns for Parents
http://www.wflx.com/story/38282136/standardized-tests-causing-concern-for-parents
Florida Late Test Score Reports Delay Grade Promotion Decisions Before School Ends
http://www.tampabay.com/blogs/gradebook/2018/05/22/will-my-florida-third-grader-have-to-repeat-the-grade/

Georgia Are Test Scores Fair Way to Judge Charters . . . or Any Schools?
https://www.myajc.com/blog/get-schooled/are-test-scores-fair-way-judge-charter-schools-any-schools/SnON9X4GXVJMf1KbrBnzkL/
Georgia Poverty, Other Social Factors Best Ways to Predict Test Scores
https://www.ajc.com/news/local-education/students-took-their-milestones-tests-but-what-will-the-scores-reveal/Wz9Z4KkcN3eH18L2cQo0yK/

Illinois Test Scores Sunk After Chicago Closed 50 Public Schools
http://abc7chicago.com/education/test-scores-suffered-after-cps-closed-50-schools-in-2013-study-says/3506585/

Indiana Schools May Get Two Different Grades This Year
http://www.journalgazette.net/news/local/indiana/20180529/schools-to-get-2-separate-grades

Massachusetts Legislators Cut Exam Funding to Challenge Testing Status Quo
http://www.bostonglobe.com/opinion/letters/2018/05/27/with-tug-purse-strings-lawmakers-challenge-status-quo-standardized-tests/zV4zHCNovJbG3fnnSWycCP/story.html
Massachusetts Grading Essays with Computers Sends Wrong Message to Student Writers
https://www.bostonglobe.com/opinion/letters/2018/05/24/your-mcas-essay-may-scored-gorithm/h6rLmHOXy9Z55dJ3oHDAuK/story.html

New Jersey Due to PARCC Screw-Up, Students Will Be Forced to Take the Exam
http://www.myveronanj.com/2018/05/24/state-parcc-screw-up-will-force-sophomores-to-be-tested/

New Mexico Legal Action Filed Against Test-Based Teacher Evaluations
https://www.abqjournal.com/1176776/unions-file-new-motion-over-teacher-evals-usage.html

New York Schools Chief Criticizes Exam-Based Admission and Screening
https://nypost.com/2018/05/23/schools-chief-denounces-nycs-admission-policies/
New York Teachers Union Blasts Abusive “Tyranny of Testing”
https://www.wkbw.com/news/state-teachers-union-calls-2018-standardized-testing-abusive
New York Governor Candidate Takes on Test-and-Punish Policies
https://www.washingtonpost.com/news/answer-sheet/wp/2018/05/25/u-s-education-department-warns-school-districts-to-protect-student-privacy-for-sat-and-act/

North Carolina Assess Students’ Knowledge, Not Test-Taking Skills
http://www.courier-tribune.com/news/20180526/measure-our-knowledge-not-our-ability-to-take-test

Ohio Governor’s Defense of Flawed School Grades Blocks Efforts to Kill Them
https://www.cleveland.com/metro/index.ssf/2018/05/kasich_support_of_a-f_grades_s.html

Tennessee Scores From Computer Test Foul Up Won’t Hurt Teachers

Lawmakers say TNReady test can’t hurt teachers

Texas Testing Service Fined for Computer Exam Glitches
http://www.kxan.com/news/texas/tea-levies-100k-fine-against-ets-for-staar-glitches/1196923819
Texas State Waives Test Passing Requirement for Grade Promotion Due to Computer Disruptions
https://www.chron.com/news/houston-texas/houston/article/TEA-waives-passing-requirement-for-students-hit-12941899.php

University Abolish Standardized Testing for Undergraduate Admission
https://www.huffingtonpost.com/entry/abolish-standardized-testing-for-college-admissions_us_5b045869e4b003dc7e470ee3s

International Irish Teachers Letter Launches Discussion of What Tests Really Measure
https://www.irishtimes.com/news/education/these-tests-do-not-assess-what-makes-you-special-and-unique-1.3507488

Worth Reading Lessons From the Test Opt-Out Movement for Curbing School Violence
https://wtop.com/education/2018/05/could-protest-curb-school-violence-lessons-from-the-opt-out-movement/

Bob Schaeffer, Public Education Director
FairTest: National Center for Fair & Open Testing
office- (239) 395-6773 fax- (239) 395-6779
mobile- (239) 699-0468
web- http://www.fairtest.org

Some sensible Ohio legislators recognize that the A-F letter grades for schools (invented by Jeb Bush to accelerate privatization) measures nothing more than the wealth or poverty of the district. They would like to revise the simplistic letter grade to a “data dashboard,” reflecting the manic love of all things data.

But John Kasich stands in the way. While pretending to be a moderate Republican for the National media, he is still a right winger at heart.

For years, Eva Moskowitz’s Success Academy Charter Chain in New York City has boasted about its test scores. Gary Rubinstein wondered how her students performed on the Regents Algebra 2 exam. He has been watching and waiting for two years. At last they were posted, and the results were unimpressive, especially for a school that boats so much about its math scores.

Defending the Early Years (DEY) was organized to fight for the rights and childhood of little children.

One of their current goals is to stop the pilot testing of what is called “Baby PISA.”

PISA is like a giant octopus that wants to test everything that breathes. It is sponsored by the OECD (Organization for Economic Cooperation and Development.) It already has the nations of the world frantic that only one of them is #1 in test scores.

The expansion of PISA to include 5-year-olds is part of what Pasi Sahlberg dubbed “the Global Education Reform Movement” or GERM.

Five states have agreed to pilot testing of Baby PISA. But no one knows which states they are, and the OECD refuses to say.

DEY issued this press release earlier this year.

In 2012, the Organization for Economic Cooperation and Development proposed an assessment of early learning outcomes called the International Early Learning and Child Well-Being Study. The proposal was made with little consultation with large facets of the early childhood community. In response to this international trend for increasing formal early childhood assessment that is gaining traction, Defending the Early Years releases the following statement:

Ignoring early childhood educators, researchers and scholars in making early education policy is not new, but the scale of this latest effort in the Global Education Reform Movement for young children is a frightening development. PISA (Program for International Student Assessment) has been used to test 15 year-olds since 2000. The new International Early Learning and Child Well-being study (IELS)- dubbed “Baby PISA” – will focus on testing 5 year-olds on narrow academic skills achievement.

The impact on the field of early childhood, already contorted by policies that push early academics and eradicate play, will be disastrous. If Baby PISA gains a foothold, we’ll see more of what we have already endured: more standardization, more academic drills, and more testing. And, we’ll see less of what we have already been losing: less of the arts, less play, less child choice, and less active, hands-on, developmentally meaningful learning. And we will see more children disaffected with school at younger and younger ages.

We early educators in the U.S. need to follow the lead of early childhood communities in Canada, France, Germany, Japan, Norway, New Zealand, Sweden, and Denmark and speak up in protest against the IELS and advocate for appropriate and developmentally meaningful learning.

For more information on Baby PISA please see Baby PISA is Just Around the Corner. So Why is No One Talking About It?

There are two ways to go wrong in scoring student essays. One is to have them graded by computers. The other is to have them graded by the low-wage slackers hired by testing corporations.

There is only one way to go right in scoring student essays. That is to have them read by teachers in the building or district where the student is enrolled.

Massachusetts is pondering turning over the grading of student essays to computers. Les Perelman, a retired professor of writing at MIT, has demonstrated how dumb the computers are when it comes to understanding what students have written. The computers like long sentences; big words; and long essays. But the computers have a serious defect: They can’t tell truth from falsehood. He told a New York Times writer, Michael Winerip, that a computer would not care if a student wrote that the War of 1812 began in 1945. Computers are not fact-checkers. That is why they can score thousands of essays in less than a minute. If you happen to think that knowledge matters, don’t have essays scored by computers.

If you think that it is better to ask Pearson or ETS or any of the other testing companies to have essays graded by humans, think again. Read Todd Farley’s book “Making the Grades: My Misadventures in the Standardized Testing Industry,” where he describes himself as a scorer who was in it for the hourly wage, surrounded by others with little or no interest in the quality of writing or the fate of students. In recent years, we have heard of ads placed on Craigslist, seeking essay readers at $11 an hour, no experience needed. Read the last paragraph of Farley’s book to know why mass-grading of student writing doesn’t work, why parents should fight it with every fibre of their being.

Who should read and assess student work? Teachers who work in the building or the district. At least then one can be certain that teachers are doing the grading, not unemployed and inexperienced college graduates who are expected to read and grade 100 essays an hour or more.

This is the weekly round up of testing news from FairTest, which has been fighting the misuse of standardized testing since 1973:

The message from parents, students, educators and community leaders could not be clearer: the path to educational progress requires reducing testing and eliminating high stakes. Policy-makers in many jurisdictions are starting to listen and implement real assessment reforms. Keep the pressure on!

Florida Kindergarten “Readiness” Testing Is Part of War on Youngest Children
http://curmudgucation.blogspot.com/2018/05/fl-continuing-war-on-littles.html
Florida Increase in Exit Exam Alternative Cut Scores Could Reduce Graduation Rate
https://www.news4jax.com/education/higher-test-score-standards-could-lead-to-drop-in-graduation-rates

Georgia Parent Offers Advice for Gates and Zuckerberg on How to Really Improve Education
https://www.washingtonpost.com/news/answer-sheet/wp/2018/05/16/a-parent-writes-to-gates-and-zuckerberg-you-asked-for-advice-on-education-heres-mine

Louisiana Adding Up the Costs of State-Mandated Testing

Louisiana to Spend at Least $75M on Five Years of PARCC-ish LEAP 2025 Testing

Maine High School Test Scores Are Not Good Predictors of Undergraduate (and Life) Success

Dist. 207 SAT Scores Good, But Not Indicative Of Life After Graduation

Massachusetts School Receivership Is the Ultimate Test-Score Misuse

Massachusetts Debunking Claims About Automated Scoring of Essay Tests
https://www.bostonglobe.com/metro/2018/05/21/mass-ponders-hiring-computer-grade-mcas-essays-what-could-wrong/D7fX11PReUWzVsAAdqC1qN/story.html

Michigan Don’t Punish Schools with Poor Readers, Invest in The

Nancy Flanagan: Don’t Punish Schools or Kids if Johnny Can’t Read; Invest in Them

Mississippi Licensing Test Cut-Off Score a Barrier to Entry for Aspiring Teachers
https://www.clarionledger.com/story/news/2018/05/16/certification-tests-barrier-some-aspiring-mississippi-teachers/586518002/

New Mexico Teachers, School Officials Seek to Block K-3 Testing and Retention Plan
http://www.santafenewmexican.com/news/education/teachers-school-officials-urge-state-to-halt-proposed-reading-intervention/article_c29da3ee-514b-5307-b304-34178a49be83.html
http://krwg.org/post/new-mexico-ped-k-3-testing-and-retention-plan-illegal-and-hurts-children

New York Test-Based Teacher Evaluation Is a Ghastly Mistake That Will Not Die
https://www.lohud.com/story/opinion/perspective/2018/05/17/ny-teacher-evaluation-system/608665002/

North Carolina School Board Wrestles Over Role of “Irrelevant” Tests
http://www.thepilot.com/news/moore-county-school-district-wrestles-with-testing-s-importance/article_d54e2c12-588d-11e8-b46e-d3a2f9e5227a.html

Tennessee New Testing Company Owns Old One That Fouled Up
https://www.chalkbeat.org/posts/tn/2018/05/15/tnreadys-new-testing-company-also-owns-the-old-one/

Texas Thousands of Test Takers Plagued By Computer Exam Glitches Again
https://www.mystatesman.com/news/local-education/thousands-staar-test-takers-plagued-glitches-again/V84LVmYua6k7rEx1eF3r9O/
Texas Special Ed. Students Most Impacted by Testing Foul Ups
https://www.texastribune.org/2018/05/16/glitches-texas-staar-standardized-test-special-ed-students/
Texas Why Do Tests Dominate Education
http://www.oaoa.com/editorial/letters_to_editor/article_f81bd896-5a29-11e8-9f8c-0b19ca5d1f54.html

Utah More Standardization and Testing Is Not the Cure for Education Problems
https://www.deseretnews.com/article/900019114/op-ed-a-crystal-clear-and-lofty-goal-for-utahs-education.html

Wyoming School Board Resists Directive to Test Youngest School Children
https://www.kpvi.com/news/national_news/state-superintendent-natrona-county-school-board-talk-testing-but-make/article_14aee93e-e533-5c0f-9063-9fe1684cc29a.html

University Admissions Why Hampshire College Refuses to Consider ACT/SAT Scores
http://ashokau.org/innovations/mission-driven-admissions-2018-awardee/
University Admissions Tests May Become Optional for Law School Acceptance
http://www.postbulletin.com/news/business/admission-tests-may-become-optional-at-law-schools/article_1edfb525-12a3-5c02-8978-8f299f08d7be.html

Worst Reading Test-Based Rankings for Teacher-Prep Programs Are Bunk
http://blogs.edweek.org/edweek/teacherbeat/2018/05/teacher-prep_rankings_that_use_student_test_scores_not_reliable_study.html

Bob Schaeffer, Public Education Director
FairTest: National Center for Fair & Open Testing
office- (239) 395-6773 fax- (239) 395-6779
mobile- (239) 699-0468
web- http://www.fairtest.org

This article by Amadou Diallo in The Hechinger Report describes schools in Philadelphia that rely on project based learning rather than standardized testing. Unlike many such articles, it acknowledges the differences between schools with selective admissions and those that accept all applicants.

A snippet:

An unqualified success for these new schools would be results like those at Science Leadership Academy, a magnet school that is home to the district’s longest-running project-based learning program, which opened in 2006. The school combines rigorous research with student-driven projects that have impact beyond the school building. One student project involved putting on a city-wide Ultimate Frisbee tournament. In the 2016-17 school year, 99 percent of its seniors graduated, and 84 percent attended college immediately afterward. Algebra, Biology and English literature proficiency scores at the school are more than double the district high school average.

“Projects are really hard, collaboration is really hard.”

“As a magnet school,” said Science Leadership Academy principal Chris Lehmann, “we need to be able to prove that the learning we engage in here shows up on the test … without falling into a teach-for-the-test problem. It’s a balancing act. It always has been.”

It may prove difficult for other schools to replicate Science Leadership Academy’s performance, however. As a magnet school, it has selective admissions and attracts students from a wider range of socioeconomic backgrounds (fewer than half its students receive free or reduced-price lunch, for example) than the city’s other project-based learning schools.

Lehmann acknowledges the inherent advantages at a school that’s able to choose its students — applicants must meet minimum grade requirements and sit for an interview — but, like his counterparts at Philadelphia’s nonselective project-based learning schools, he argues that we need to be taking a more holistic view of school performance. “How you judge a school is an incredibly nuanced thing,” he said. “The way that we take care of each other and the way that we learn are intertwined.” There may not be a quantitative metric to assess whether students are being provided with meaningful work in an environment that lets them know they are cared for, but Lehmann believes that without those components, grades and test scores become an end unto themselves.

“There’s no [statewide] assessment for being able to look people in the eye and speak clearly.”
Vaux Big Picture High School principal Gabriel Kuriloff

Tamir Harper is an 18-year-old senior at Science Leadership Academy whose passion is education reform: In 2017 he founded a nonprofit that advocates for quality urban education. He says that when he arrived at the school he was obsessed with grades. “I just wanted to know ‘How can I get an A?’ I didn’t care if I was learning, or comprehending,” he said. “Now I’m a student that wants to learn, and I don’t worry about the end result [grade]. I’m into the process.” He says a big part of that shift was the relationships he forged at school. “We’re not just project-based, we’re a community-driven school,” he said.

Fellow senior Madison Militello, 18, says her middle school was very strict, with no room for individual connections. “Here I don’t feel like the teachers are above me. I feel like we’re on the same level,” she said, noting that she’s still close with some teachers even though she doesn’t have their classes anymore. “You can’t teach a group of students you don’t have a connection with.”

That sentiment was a common refrain at Vaux, LINC and Workshop, each of which offer slightly different approaches to project-based learning in underserved communities. Educators at each are confident that the skills their students are acquiring — collaboration, critical thinking and problem-solving — will eventually manifest themselves in improved results on more traditional metrics like math and reading tests. More importantly, however, they believe that students will be much more prepared for the real world when they leave school. Whether project-based learning done on a larger scale can turn the tide in Philadelphia is another question.

“You can create the perfect school model and it’s still not going to solve American poverty,” Hauger said. “We’re moving the needle for every child who comes through the door and sometimes that doesn’t feel like enough.”

Carol Burris, executive director of the Network for Public Education, has fun comparing the boasts of reformers and their response to flat scores on NAEP.

They were so sure that the Common Core and charters would promote dramatic gains in testcscores. But they didn’t.

Read how reformers explain their embarrassment.

https://www.washingtonpost.com/news/answer-sheet/wp/2018/05/20/what-they-said-before-and-what-they-are-saying-now/?utm_term=.e47fc51142a7