Chris Webster, a high school English teacher in New York, wrote an outraged letter to State Commissioner John King. Why is the state manipulating the passing mark? Are they making the scores lower to make public education look bad?
Here is Chris’ letter:
Dear Commissioner King:
You often tell the story of a teacher who had a positive influence on your life. We all remember a teacher who acknowledged who we are; one who valued our talents and dreams. That is why I became a teacher. I wanted to have an influence on the next generation; I wanted to help mold and guide young adults and show them their value. And, of course, I wanted to express and share my love of literature. Therefore, I have enjoyed spending the last 16 years as an English Language Arts teacher. And so it is with a heavy heart that I watch the New York State Education Department blatantly manipulate data for their own agenda, the true victims being the children they purport to represent.
I will not nor can I speak to politics and what goes on behind the scenes. I am, however, right there on the front line, not in educational theory but in the classroom. My students completed the New York State Comprehensive Exam in English (the “Regents Exam”) this past Tuesday, and I am shocked and appalled by what the State is doing. I am not a statistician but I can speak in real terms of what I’ve noticed.
On the English Regents Exam, a student can score a maximum of 25 points on the multiple choice questions, and a maximum of 10 points on the three written components. These “raw scores” are then converted into a score out of 100. When one looks at the score conversion chart, one looks at the multiple choice responses along the y-axis, and the essay score along the x-axis, finds the convergence point, and within that box there is a converted score on a 100 point scale. With 25 points along the y-axis and 10 points along the x-axis, there are a total of 250 “boxes” within the chart, each with a score out of 100.
The June 2013 scores introduced a disturbing change. In the last three administrations of this exam, June 2012, August 2012, and January 2013, a passing score of 65 or higher was available in 70 of the boxes. This represented 28% of the possible scores. In the most recent administration, June, 2013, this number was reduced. The 70 boxes with passing scores were reduced to 57 boxes. This represents 23% of the possible scores. Looking at it in this manner – the state is using the same chart with the same raw data, but reduced the passing score possibilities by 5%. Another way of looking at the same data is to look at the passing score numbers. The State went from 70 boxes of passing scores to 57. This is a reduction by almost 20%.
These same numbers work when one looks at Mastery (score 85 or higher) rates on the exam. Again, using the June 2012, August 2012, and January 2013, Mastery scores were available in 15 of the boxes, representing 6% of the scores. In the most recent administration, June 2013, this number was reduced. The 15 boxes with Mastery scores were reduced to 12. This represents approximately 5% of the possible scores. Again, the State reduced this by 1%. Nevertheless, look at the same data in another light. The State went from 15 boxes of Mastery scores to 12. This is a reduction of 20%.
There are yet other concerns. Across the board, with all scores, the scores in the corresponding boxes have been reduced. For example, in the June 2012 administration, a student who scored a 17 on the multiple choice and a 7 on the essays earned a grade of 66. In August 2012 the score was 67. In January 2013 the score was 67. In June 2013 the score was 63, a failing grade, despite the raw scores being exactly the same as the 3 previous administrations. A second example: using the last 3 administrations of the test once again, if a student’s raw score was 24 on the multiple choice and an 8 on the written responses, the grade earned was an 85 (considered Mastery level). However, in the June 2013 administration, these same raw scores converted to an 83, a drop of two points, and, more importantly, failure to achieve Mastery.
It is only a matter of time before we see the newspaper headlines saying “Regents Scores Drop Across the State.” The test has NOT become more difficult or easier; it is similar to recent exams. The State has simply made it more difficult to pass. In my opinion, this feels like one more attempt to prove that public education is not working.
In an effort to push your reform agenda, the students are the victims. New York State’s high school students deserve better. If an 11th grade student took the exam last year, statistically speaking, he or she had a 20% higher chance of meeting with success. The “high stakes” testing agenda is shameful.
Sincerely,
Christopher A. Webster
English Department
South Side High School
Rockville Centre, NY

Thanks Chris for doing this. It is important that parents as well as teachers understand what is happening.
LikeLike
Mr. Webster,
I completely agree with your observation. I believe that all NY teachers unions should be up in arms given this negative manipulation of our student’s grades. I myself have to boys in public education and I am concerned has to how this is going to impact them personally and our school district, given the “Race to The Top” federal funding. My district may be looking at reduced funds as a result of the blatantly false test results. The NYS Ed. Department needs a panel of scholars from elementary, middle, high school and college professors including representatives our PTA to become involved in the decision making which will effect our school’s students, funding, and taxes. ENOUGH OF THE SHENANIGANS !!!!!
LikeLike
Thank you for speaking up about these high stakes graduation exams. My 14 year-old daughter was required to take Algebra 1 this year (in 8th grade) and to take a first attempt at passing the new Pennsylvania, Keystone Exam. We live in the high achieving, suburban Philadelphia school district of Lower Merion, and have been extremely happy with our district until the Common Core Sate Standards and Keystone exams affected her this year. We know other children & families who feel much the same way.
After day 1 of the exam, she came home a ball of stress. As a way of letting out her feelings, she wrote the essay below. At the end, she writes that she will never take a Keystone again, but unfortunately, that may be impossible. As I am sure you are aware, districts need to create projects for students who opt out or fail repeatedly. We have no idea what these projects entail. She is hoping that her essay will be published as a post. Thank you for considering giving her a voice.
STOP KEYSTONES ONCE AND FOR ALL
My Story
By Jordyn Schwartz
Today I have experienced one of the most confidence breaking and mind troubling obstacles in my entire life; the Algebra 1 Keystone exam for the State of Pennsylvania. When I sat down to take this standardized test, I did not know what I was getting myself into. My math teacher had been preparing us for this test, but even with all that drill and practice, my mind could not take it all in. The first 14 questions took me over 10 minutes each when I was trying to solve the unfamiliar equations, long word problems, and words I didn’t even know how to pronounce. I was telling myself that I was going to be fine until all of the stress overwhelmed my body. I was frustrated. “I should know this,” I thought. I wasn’t even half way done when they announced that there were only 10 minutes remaining. I only completed my first set of grueling questions, and still had another set of them and 2 short answer sections containing at least 6 more questions each. I wouldn’t get help from a,b,c or d with these.
At that moment, my mind broke down. I was telling myself that I was stupid, and that these kinds of tests make me feel like I don’t know anything. After hours of work, I still had so much more. It is extremely difficult to continue concentrating at the same intense level as you did when you first started. I was sick and tired of looking at those same boring Algebra problems.
I am an A average student all around, and score advanced on PSSA’s. But I couldn’t even read the next problem without all of those discouraging thoughts spiraling in my mind. I tried telling myself to pull through, but I found myself not caring anymore, and just wanting to circle some letter. I did that for two or three questions and stopped. I dropped my pencil on my desk, tried taking some deep breaths, and thought of ripping my booklet into shreds. I poked holes in my booklet with my pencil, and started squeezing my hands tightly as if I was going to explode. I was that angry, outraged, fuming. I felt so incredibly frustrated that these stupid test companies don’t care what they are doing to the students of our country. All they want is the money, and the worst part is, nothing is being done to stop them. Why don’t the politicians making my generation the most over tested in history try the tests for themselves? I bet most of them would fail or do poorly. I mean, if smart, educated people don’t do well on these tests, than what do they show?
These Keystone tests are breaking kids down, making us feel dumb and not want to learn, instead of making us want to enjoy the wonders and greatness of education. I know that when most people in my grade hear the words, standardized testing, no one is jumping up and down with excitement. I am an 8th grade student in the Lower Merion School District: a district known for their excellent education. When kids here are complaining about how difficult it is for us to take these tests, who knows what kids in struggling school districts are experiencing. Why should these tests be a graduation requirement for high school?
After my big meltdown from the frustration of not knowing how in the world to do these problems, I didn’t continue my test. I told the guidance counselor I couldn’t take it any more, and how it made me feel horrible inside. Although I kept calm on the outside, on the inside I was bomb about to explode. I was holding back my tears. I bet many other kids felt this same way, even if it wasn’t as strongly as I felt. I will tell you one thing, I am never taking one of those tests again. No test shall ever make me feel as low and deflated as I did today. I don’t care what alternative project I have to do in exchange for the Keystone test. Let me be exempted. No one should experience what I have experienced today. Standardized testing needs to be stopped.
LikeLike
My heart goes out to you and your daughter. THIS is what’s sooo wrong with these tests. Anyone who knows ANYTHING about kids is that learning stops when a child is met with failure over and over again. This young lady is an “A” student. She enjoys success. She was met with failure. If this happens to some of the brightest kids, what does it do to our “ordinary” kids, or our kids who struggle the most? It’s dehumanizing. Kids shouldn’t be basing their worth on tests, and yet, this is what education is becoming due to the “high stakes.” How sad.
LikeLike
There is also another brave teacher who spoke out and she was nice enough to let us post it on the website. She is an English teacher from The Wheatley School and wrote a letter to Mr. Katz, NYSED, Director of Assessment on June 15, 2013, expressing the very same concern with regards to manipulating the numbers. You can view her letter here at http://www.stopccssinnys.com on the “Parent’s Corner”…
LikeLike
“On the English Regents Exam, a student can score . . . There are yet other concerns. . . . failure to achieve Mastery. . . ”
A plainer case of mental masturbation will never be found again. Oh, but it is oh so scientific using all these numbers and all sorts of mathematical machinations.
LikeLike
Thanks to this courageous teacher for publicly challenging Commissioner King on this brazen malpractice, which demonstrates the viciousness of so-called education reform, whereby students are directly victimized in order to scapegoat teachers and public schools.
LikeLike
This is akin to saying a “healthy” body temperature is changed to 95° F and everyone who has a higher temperature has a fever! Ridiculous!
LikeLike
Nice and right on!
LikeLike
Thank you for posting this. I know that the same is true for the math, at least 9th grade math. I am so sick and tired of this feeling that everyone wants us to fail as teachers. Thanks again for bringing this to light.
LikeLike
My school in NYC finally got the rest of our scores yesterday. They were dismal. Several of my students who worked very hard cried when they learned that they failed. Interestingly, many of the older scores that we got last week are changed. Students who got zeros on parts of the writing section now had scores. In some cases, scores rose by twenty points. It’s obvious that something went wrong at those grading centers and that someone tried to fix it. But, how do we know that all the mistakes were fixed? What a disaster for our students. Between NYSED making it harder to pass and the grading disaster in NYC, many students are running a race that they can not win. It’s obvious that children are the casualties in New York’s war on teachers.
LikeLike
And who approved the 9.6 million dollar contract with McGraw Hill to scan these exams in Connecticut, no less? Apparently a box was lost – an entire school’s exams vanished.
High school teachers used to grade student exams in house – and we did it in under 3 days. This system took over 7 days leaving students not knowing if they would graduate.
9.6 million dollars for something that teachers used to do as part of their job with no extra cost to taxpayers!
LikeLike
The recent Education Week has an article about State Republicans across the Country balking about funding the Common Core. I have reached out to my own, as well as my State Comptroller, regarding inadequate oversight of testing companies and the related public costs.
LikeLike
What’s going on re: CCSS and high/ stakes testing is a big scam!
LikeLike
While I agree with almost everything Chris has stated (I’m an18-year LI English teacher), the real problem is not necessarily with THIS year’s scoring structure, but the ones before it. I view this year’s as fair and reasonable. The state has been setting us up for years. They claimed to have increased the difficult of the English regents exam around 13 years ago, but they made it easier to pass. Around 3 years ago, they changed the exam again, and the above mentioned scoring conversion structures were used. They manipulate it however they want.
LikeLike
How about assessments in 3-8. The state collects all the data from each district first and then decides what is a level 1,2,3 or 4. How is that logical in any way. They collect everything then manipulate the data to support what ever their hidden agenda is.
Simple solution. Make every test out of 100. Passing is 65. Everyone knows what they must get and their is no guessing.
LikeLike
I’m with you. I used to think it had something to do with creating a nicer bell curve, but now I am not sure. though somehow, it may not be as simple as that. I wish I knew.
LikeLike
Perhaps someone who is more versed in statistics than I am can explain this to me.
As I understand it, scaled scores are supposed to be linear transformations of raw scores. Typically, they are calculated as follows: First, one calculates a z-score from the raw score by subtracting the mean from the raw score and dividing by the standard deviation. Second, one calculates the scaled score by multiplying the z-score by the standard deviation that one wants in the resulting scale and then adding the mean that one wants for the resulting scale. (So, for example, for the SAT, the scaled score is derived by multiplying the z-score by 100 and then adding 500.) This standard conversion calculation of scaled scores from raw scores is linear, having the form of a linear equation: y = mx + b, so a plot of scaled scores over raw scores should result in a line. However, when one does this calculation with New York ELA and Math raw and scaled scores, one gets not linear transformations but, rather, graphs that jump around like gerbils on methamphetamine. I am not a statistician, but it looks to me as though for years NY has manipulated its conversions of raw scores to scaled scores for its ELA and Math tests so that an acceptable, predetemined percentage of students fall above a set scaled score proficiency cutoff of 650. In 2009, the cutoff for proficiency for GR 7 math was a raw score of 44 percent. The cutoff for proficiency in GR 3 ELA was 72.73 percent.
Again, I am not a statistician, and I might be wrong about all this, but it looked, to me, when I examined it, quite suspicious.
And, of course, it’s entirely arbitrary where one chooses to place the cutoffs for proficiency bands.
LikeLike
Corrections to this post:
Perhaps someone who is more versed in statistics than I am can explain this to me.
As I understand it, scaled scores are supposed to be linear transformations of normalized raw scores (z-scores). Typically, they are calculated as follows: First, one calculates a z-score from the raw score by subtracting the mean from the raw score and dividing by the standard deviation. Second, one calculates the scaled score by multiplying the z-score by the standard deviation that one wants in the resulting scale and then adding the mean that one wants for the resulting scale. (So, for example, for the SAT, the scaled score is derived by multiplying the z-score by 100 and then adding 500.) This standard conversion calculation of scaled scores from normalized raw scores is linear, having the form of a linear equation: y = mx + b, so a plot of scaled scores over normalized raw scores should result in a line. However, when one does this calculation with New York ELA and Math raw, after normalizing them, and scaled scores, one gets not linear transformations but, rather, graphs that jump around like gerbils on methamphetamine. I am not a statistician, but it looks to me as though for years NY has manipulated its conversions of raw scores to scaled scores for its ELA and Math tests so that an acceptable, predetemined percentage of students fall above a set scaled score proficiency cutoff of 650.
Again, I am not a statistician, and I might be wrong about all this, but it looked, to me, when I examined it, quite suspicious.
And, of course, it’s entirely arbitrary where one chooses to place the cutoffs for proficiency bands. One sees these wild fluctuations in where proficiency cutoffs are placed. In 2009, the cutoff for proficiency for GR 7 math was a raw score of 44 percent. The cutoff for proficiency in GR 3 ELA was 72.73 percent. And notice that a 44% cutoff for proficiency makes a proficient score not that much higher than what one would get by simply choosing answers at random!
LikeLike
So much for “Trust me; I have the data!”
LikeLike
One response only from me and one term to really master and understand:
MOVING TARGET SCORING
Voter beware. For example, each year, on the NYSESLAT (New York State English as a Second Language Aptitude Test), the summative/exit exam ESL students take each year, the targets for “progress”, such as intermediate, advanced, or proficient, CHANGE every year. A scale score for “Advanced” one year can be a 458, and the following year, a 512.
Moving target score methods look at “norms”. . . . .
Now NYSED is pulling these politricks on other types of exams. Lord knows what the PR they will put out in the corporate sponsored media and to what extent that can continue to manipulate and fool the public.
Parents be informed!!!!!!!
Parents will change this situation if they mobilize aggressively. We enlightendined teachers will also, but not our unions, and we can only add to the momentum of the parents.
Parents Across America is one such organization that empowers us as we begin to right this wrong.
Does the school Dr. King sends his own children to use moving targets in the way public schools are forced to?
Dr. King, please respond. We’re counting on you.
LikeLike
Yes, Robert, and NYSESLAT scores are now being used to evaluate schools.
LikeLike
And moi also . . .
LikeLike
This is no different from what Rick Hess, strong supporter of education “reform”, predicted when he wrote the following:
“First, politicians will actually embrace the Common Core assessments and then will use them to set cut scores that suggest huge numbers of suburban schools are failing.” http://blogs.edweek.org/edweek/rick_hess_straight_up/2012/11/the_common_core_kool-aid.html
Education “reform” is not about improving teaching and learning. It’s a business plan. Lowering cut scores is how neo-liberal politicians and corporate “reformers” have planned to use shock doctrine to alarm suburban parents and lead them into believing their schools are failing, in order to institute crony capitalism, so that charter school entrepreneurs and venture philanthropists can privatize education and invade their real estate, too, just like they have been doing in mayoral controlled urban school districts across the country.
LikeLike
Similar course is running in Ohio. See http://bbbloviations.blogspot.com/2013/03/what-about-students.html
LikeLike
I STRONGLY urge teachers to read the link that Bonny posted here. It provides what will be, for many, a startling insight into how all that “data” the deformers love to talk about is manipulated for political purposes.
LikeLike
Wonderful, Bonny! Thank you.
LikeLike
Interesting. Here in Wake County NC scores were also manipulated. However they were curved to favor the students and improve passing rates. Students who got 50% of the questions right received a score of 75 instead of 50. Scores were inflated across the board which inflated final course averages and graduation rates. The emphasis here is on graduating everyone, not on insuring that students actually have a level of knowledge and competency when they graduate.
LikeLike
Thank you, Chris, for sending this letter! In speaking with a close friend and fellow science teacher, there was a bizarre and disconcerting thing with the scoring of the Chemistry Regents as well. My friend who teaches AP and Regents Chemistry said there was a “reverse” curve on the chem regents – something we didn’t even know existed! Apparently, the students’ raw scores on the chemistry regents were higher than their scaled scores (for example, a student who got a 99 raw score would actually a grade lower than 99 as their final grade!!). I do not understand the reasoning behind this, and I am having a really hard time finding the method to that madness. It is so sad to think about all the kids who are under so much stress and pressure to do well and have no idea the cards that are against them. We as their parents, teachers, and people they trust have a moral obligation to stand up for our children.
LikeLike
“A curse on this game. How can you stick at a game when the rules keep on changing? I shall call myself Alice and play croquet with the flamingos.”
–Jeanette Winterson, Written on the Body
LikeLike
They did the same thing in Michigan a few years back. They raised the cut scores for passing the MEAP, and now it looks like we have way less proficient students than before. It’s ridiculous.
LikeLike
They did the same thing in Michigan a few years so. The raised the cut score on the MEAP, and now it looks like way fewer kids are proficient. It’s ridiculous.
LikeLike