Thanks to Arne Duncan, almost every state now has an elaborate teacher evaluation plan. There is no evidence that the pans identify teachers correctly, but they are widespread because Duncan believes and he is Secretary of Education, with more certainty than any of his predecessors.
What hath Arne wrought? Here is an account I hope he reads. It shows what a mess he has made in thousands of schools.
I”ve been trying to find the right place to share what I’ve written about the ridiculous evaluation process that occurs in Palm Beach County, FL. Friends who have read it asked that I share it with you, Diane.
My teacher evaluation rant
I’m about to write out the long, stupidly involved story of the truth behind teacher evaluations, specifically at my school, but likely not too different than everywhere.
Five (or more) times in the school year my principal does classroom observations. There are three different kinds: 1 formal, forty minute lesson observation; 2 5-15 minute informal; 2 30 second-2 minute walkthroughs. She evaluates me using the Robert Marzano Menu of Design Questions There are about 60 specific behaviors within 4 different domains, each with 3-7 components, that she is looking for during those observations.
Each of the 60 behaviors is then graded on a scale of: not using, beginning, developing, applying, and innovating. The evaluator, after marking off the components then decides how to grade the behavior. Comments, if appropriate are also added (as in: All of the students were actively engaged in the lesson) At the end of each observation I get an email directing me to approve the observation.
At the end of the year, the grades for each behavior are calculated to determine if the teacher is: Highly Effective (3.2 – 4.0), Effective (2.1 – 3.1), Developing (1.2 – 2.0) or Unsatisfactory (1.0 – 1.1). Last year I was deemed Highly Effective based on my observations. I didn’t really look at the details because I was overly pleased with the results.
I should note that for my first two years teaching this was a new evaluation system. Our district decided that during the learning curve process ALL teachers would be given the same grade/evaluation level of Effective, so the observations were a tool for us to begin to look at where we could stand to improve and what we were already doing well. The fact that I was evaluated as Highly Effective had no bearing on anything, since ALL teachers were graded as Effective. Also, last year only 2 of the 4 domains were observed. This year only 3 were observed.
The added domain is for our own personal professional development. I mention this because we were instructed at the beginning of the year that ALL teachers had to have the same personal professional development goal: to improve student success through implementation of the Marzano Techniques of Teaching (see a trend?). I didn’t want this to be my goal, but I didn’t have a choice (don’t get me started). (Last year my personal goal was to improve my ELL students’ oral language assessments by 50% – I reached that goal and then some).
This year’s evaluation has come back and I am now graded as Effective with an overall score of 3.0. I was wondering how I dropped from Highly Effective to Effective, so I started looking more closely at the numbers. Here is what I saw:
I was marked as Innovating (4.0) for 12/31 behaviors
I was marked as Applying (3.0)for 19/31 behaviors.
I had no lower marks than that.
Now in my world of calculating scores, I would multiply 4 x 12 = 48 and 3 x19=57, then add them together 48 + 57 = 105, then divide by 31 which equals 3.39. 3.39 is Highly Effective, but I was graded as 3.0 – Effective. Hmm. I called my union rep and she was not sure how that could be. She also, for what it’s worth, had a similar score drop. She remembered that there was some ridiculous way to calculate the previous two years, and thought maybe they are doing the same thing this year. Regardless, neither of us knew how our scores were calculated, so we knew we would have to ask higher ups.
I asked my principal. She wasn’t sure how it is done, either. She suggested that we both call/email the woman at the district who is in charge. So I did. This is what I learned: If 50% or more of your marks are Highly Effective, then you are Highly Effective; if 50% or more are effective than you are effective, and so on.
Then I began to wonder, as has my union rep, how is it that I was more effective last year than I am this year? What am I NOT doing now that I did then? It turns out that I am, in fact doing the same things. I was marked as doing the same exact components of behaviors this year as I was for last year. The difference is, last year I was rated as innovating more times. So, for example let’s say Behavior A has 6 components. Last year when I was checked off as meeting all 6 I was deemed innovating. This year those 6 components checked off are only earning me applying. WHY? HOW? Fortunately, I am friends with a number of people who have some real answers.
The answer isn’t pretty, but it’s been corroborated by more than one source. Here we go…
The principals and assistant principals were told that they were *giving out too many innovatings and that they needed to mark innovating less often*. In other words, the evaluation that is supposed to determine our level of teaching, which in turn determines our merit pay (no, we don’t really get merit pay. we’re supposed to, but that’s a whole different – let’s lie to the people of Florida – nightmare) is being manipulated by the powers that be in an effort to…I don’t know…make it seem like teachers aren’t as good as we are. So they can pay us less and blame us more. The powers that be are doing to the teachers what the high stakes testers are doing to our students: creating a system that is skewed to failure (or mediocrity).
I am outraged. Mostly I am outraged that Principals and ASsistant principals, who know this is wrong and are being asked to downgrade their own teachers, are going along with it and not fighting back. The people who told me are in those leadership positions. They know it’s wrong. But they pooh-pooh saying things like, “Everyone knows those evaluations aren’t right, so what does it matter? *I* know who’s great and doing a great job, so the evaluation doesn’t really matter between you and me and the kids. ”
And I almost buy it. Except for this: my evaluation is public recod. Any parent can go to the district and access my evaluation score. Most parents won’t, it is true. Only parents who have a beef with a teacher would do that, as it so happens. But that’s when the difference between effective and highly effective DOES matter. I AM highly effective. I know it. My administrators know it. My students know it. But when a parent who is already certain I am picking on his/her kid or that I don’t know how to teach his/her kid goes to access my records, they see I am Effective, not Highly Effective. It’s fuel for their fodder, which I do not like.
And if I go to work in another district, all the hiring people will see is Effective. I don’t like it. NOt one little bit.

everyone knows it is a bad system. everyone knows it is not right. everyone goes along with it. This is how we lose our American freedoms. This is how the wall streeters take over and turn schools into value assets and profit centers. This is how our students who cannot keep up are left far behind. This is how we reach the type of system the racist c. murray and his ilk at the wall street journal and elsewhere describes in his latest racist rant. This is the future.
LikeLike
Another reason why teachers in Florida should be supporting Nan Rich instead of Crist. I hope they look beyond the Crist endorsement and think about how is aligns himself with Jeb Bush.
LikeLike
My wish as well!
LikeLike
Hoping Diane’s PAC puts in a strong endorsement for Nan. If they did, please post it so I can share.
LikeLike
I couldn’t agree more! We need Nan to support teachers in Florida. No other candidate has our backs the way Nan Rich does.
LikeLike
Something similar is happening in New York City. I am not sure if this is happening in the entire state but it is happening in NYC. It is significant in many ways because we have the largest public school system in the state. The Department of Education began sending out what they called “coaches” schools towards the end of the year last year and also this year. Coaches were sent to “help” the principals out with the new teacher evaluation system. Coaches allowed the principals to choose the teachers to observe. Most principals, of course, showed off their best teachers and observed a lesson the teachers did. The principals gave their best teachers great marks and the coaches said no – they were doing it all wrong. Their best teachers are at best mediocre (effective with developing traits). Principals were told that they were rating the teachers too high. (This anecdotal: I know an 8th grade teacher got highly effective marks from the state from state testing but developing marks from the coach… Figure that out.) Anyway, so if the best teachers in NYC are mediocre, what are the rest of the teachers? Yep, you got it, developing and ineffective. Looks like the state just might get enough teachers to fire in couple of years thanks to NYC.
LikeLike
Same thing is happening in Miami Dade. Teachers who were rated highly effective by their principals last year, are suddenly finding themselves rated effective. This is the year merit pay plans kick in across counties in Florida and they will have to pay teachers rated “highly effective” more money. It will be interesting to see the drop in “highly effective” rated teachers when the FLDOE publishes the teacher evaluation data. The newspapers will run a story about the sudden drop in performance in Florida classroom teachers and the general public will continue to malign lazy incompetent teachers instead of the bureaucrats playing the numbers game and obeying unethical orders from above.
LikeLike
OK, you are sitting in your year-end evaluation session, and you’ve heard from every other teacher in your school that his or her scores were a full level lower this year than last, and so you know that the central office has leaned on the principal to give fewer exemplary ratings even though your school actually doesn’t have a problem with its test scores and people are doing what they did last year but a bit better, of course, because one grows each year as a teacher–one refines what one did before, and one never stops learning.
But you know that this ritual doesn’t have anything, really, to do with improvement. It has to do with everyone, all along the line, covering his or her tushy and playing the game and doing exactly what he or she is told. And, at any rate, everyone knows that the tests are not particularly valid and that’s not really the issue at your school because, the test scores are pretty good because this is a suburban school with affluent parents, and the kids always, year after year, do quite well.
So whether the kids are learning isn’t really the issue. The issue is that by some sort of magic formula, each cohort of kids is supposed to perform better than the last–significantly better–on the tests, though they come into your classes in exactly the same shape they’ve always come into them in because, you know, they are kids and they are just learning and teaching ISN’T magic. It’s a lot of hard work. It’s magical, sometimes, of course, but its’ not magic. There’s no magic formula.
So, the stuff you’ve been told to do in your “trainings” (“Bark. Roll over. Sit. Good Boy”) is pretty transparently teaching-to-the-test because that’s the only way the insane demand that each cohort will be magically superior to the last as measured by these tests can be met, but you feel in your heart of hearts that doing that would be JUST WRONG–it would short-change your students to start teaching InstaWriting-for-the-Test, Grade 5, instead of, say, teaching writing. And despite all the demeaning crap you are subjected to, you still give a damn.
And you sit there and you actually feel sorry for this principal because she, too, is squirming like a fly in treacle in the muck that is Education Deform, and she knows she has fantastic teachers who knock it out of the park year after year, but her life has become a living hell of accountability reports and data chats to the point that she doesn’t have time for anything else anymore (she has said this many times), and now she has to sit there and tell her amazing veteran teachers who have worked so hard all these years and who care so much and give so much and are so learned and caring that they are just satisfactory, and she feels like hell doing this and is wondering when she can retire.
And the fact that you BOTH know this hangs there in the room–the big, ugly, unspoken thing. And the politicians and the plutocrats and the policy wonks at the Thomas B. Fordham Institute and the Secretary of the Department for the Standardization of US Education, formerly the USDE, and the Vichy education guru collaborators with these people barrel ahead, like so many drunks in a car plowing through a crowd of pedestrians.
LikeLike
do the tests really provide a measure of student growth? For example, if a student scores a 450 on the 4th grade exam, what score do they need on the 5th grade exam to show growth? Or should we increase the testing load and pre and post test? That would be the best measure of teacher effectiveness on specific children (ignoring life experiences that may or may not impact student learning that do not happen equally across students) and would increase the profits of the testing company. In Indiana, we adopted a growth model but the grade level exams were never fine tuned enough to provide an accurate measure of growth–our test gurus always punted the question down the road. shame on them.
Are the tests based on the common core given at each grade level? Are they aligned and created to measure growth from one year to the next? Have they even been completed yet or are they still being tested in the field?
LikeLike
The new national ELA tests are completely invalid. NOTHING that students do on these EVEN REMOTELY resembles real reading and writing as it is done by real readers and writers in the real world, and so, ipso facto, these cannot be valid tests of real reading and writing ability. They are supposedly measures of achievement of the “standards,” but they have not even been independently validated for that, and certainly, the “standards” were not independently validated as appropriate measures of attainment in ELA.
1.The standards being tested in ELA neither cover world knowledge (knowledge of what) nor formulate procedural knowledge (knowledge of how) in ways sufficiently operationalized to allow for valid testing.
2. And they misconceive much of ELA that does not involve, primarily, explicit learning processes as involving such processes and so, again, misconceive, at a very basic level, much of what would be measured if we were following scientifically informed, rational assessment procedures.
Other varieties of assessment–diagnostic and formative and performative assessment–actually serve some educational purpose.
These national summative assessments serve no instructional purpose (teachers cannot even see the questions and detailed breakdowns of which their students got right and wrong and so cannot use them to inform instruction) but do negatively affect instruction by a) leading to narrowing and distortion of pedagogy and curricula (for example to teaching of the InstaWriting required by the test rather than to the teaching of writing) and by b) imposing an extrinsic punishment and reward mechanism that is known to be highly DEMOTIVATING for cognitive tasks. The second of these runs counter to our prime directive as teachers, which is to nurture intrinsic motivation–to build self-motivated, independent, life-long learners.
Because these are criterion-referenced tests, the determination of cut scores for them is completely arbitrary and subject to manipulation for political rather than educational purposes.
These tests use many so-called “objective” question formats that are inappropriate, generally, for testing anything more sophisticated than simple factual recall, and because these questions formats are pushed into a kind of service for which they are unsuitable, generally, the questions tend to be convoluted and the results generated highly suspect.
The tests are invariant, but appropriate instruction should not be, for students are not widgets to be identically milled, and testing should, of course, be based on instruction.
The only purpose for these tests that I can see is to institute a national program of stack ranking.
LikeLike
And, of course, to provide a ready means for adjusting costs by adjusting the percentage of teachers receiving Highly Effective ratings.
LikeLike
“do the tests really provide a measure of student growth?”
NO! Because they don’t “measure” anything. They aren’t measuring devices by any stretch of lexical machinations.
That is one of the most fundamental conceptual errors concerning the teaching and learning process, that it is amenable to quantification, i.e., “measuring”. The tests are one of many assessments, albeit piss poor ones at that, none of which (assessments that is) measure anything. The teaching and learning process fundamentally conceptually can be assessed by descriptive narratives and to believe that part (actually the main part these days) of the assessment can be reduced to a number, grade, or named category is to believe in a falsehood.
LikeLike
It’s not a measure of a given kid’s growth from 4th to 5th grade. Next year’s 4th grade test scores have to be higher than this year’s 4th grade scores. It’s not the same cohort of kids. Every year the scores must ascend the stairway to heaven.
LikeLike
Well said, as usual, Bob. Of course, that one type of admin. There are those who have sipped the kool-aid. Usually the young ones who spent two to three years in the classroom and moved on up.
LikeLike
yes, I was writing about the older ones; the younger type is really scary.
and ignorant
LikeLike
Right on…..
LikeLike
THAT was the most spot on, poetic, amazing description of this that I have ever read. Thank you. It makes me feel less crazy.
LikeLike
Isn’t the scoring in error since it is averaging ordinal numbers?
LikeLike
It is the same in TX: I get rated “effective” for all my walkthroughs, then, at the end of the year, if they like me, they bump up some to “highly effective”. But not enough to get more than effective overall.
They also told me the same thing: that everyone has to be that level: effective, or below.
They just did not put it in an email.
LikeLike
The galling thing is that this practice also makes it look like the administrations “interventions” were successful, so that justifies doing the same thing to the teachers the following year.
LikeLike
Principals and assistant principals can fight this absurd evaluation process by giving everyone highly effective. Let them prove otherwise. Stupid is as stupid does.
LikeLike
Who is Marzano and why should we allow him to be the authority on good teaching? What if a teacher uses NONE of his pet methods and yet manages to get kids to learn lots? The writer complains about the use of the instrument: I think the instrument itself is a problem.
LikeLike
There are many, many ways in which to be a great teacher.
Socrates would get the lowest possible score on any of these evaluation rubrics but he has been remembered for a couple thousand years as one of the greatest teachers who ever lived.
LikeLike
I always tell the kids that Socrates is my role model as a teacher, and look what they did to him.
LikeLike
LOL. Watch out!
LikeLike
I’m considering using Jesus’ of Nazareth’s Sermon on the Mount and running it through our Marzano evaluation. He doesn’t do a lot of the things teachers are “supposed” to do.
LikeLike
extraordinarily well said
LikeLike
I believe Marzano taught for a couple of years back in the 1960’s.
LikeLike
http://www.alfiekohn.org/teaching/research.htm
LikeLike
It’s one and the same. The evaluation system, Marzano’s or any other, is irrelevant if the administrators are being instructed to skew the outcomes regardless. Marzano’s design questions, in my opinion, aren’t awful. But they weren’t designed to be an evaluative tool. They were designed to be a guide to good teaching.
LikeLike
In NYC, we have the same nonsense – only they use the Danielson Rubric. What I don’t understand is how I can be rated highly effective on a component in November and ineffective on the same exact component in February? Did I lose my teaching ability in 3 months? It is simply senseless. Teachers are being rated ineffective because one child made an animal sound in the classroom while the teacher was giving their mini-lesson. Can we control the sounds that every child makes all of the time? The NYC DOE has sunk to a brand new low, and that’s hard to do!
LikeLike
How can you be raged effective in November and ineffective on the exact same component in February?
That’s an easy one: these evaluation rubrics are intended to be used as weapons (I am fortunate that my Principal and AP don’t use them as such, but many do) to homogenize teaching, and intimidate and remove teachers.
LikeLike
Yes, one idiot can ruin your rating. No student accountability-only the teacher.
LikeLike
Who is the “idiot”? The student or the administrator doing the evaluating?
LikeLike
TAGO! Susannunes!
LikeLike
Nothing has anything to do with it other than a set of numbers have been concocted, and no one is to be graded the highest, or best. In NJ there is a system for new teachers (perhaps all teachers, I know of one teacher’s story in particular) where the grades are from 1 to 4, and no one, NO ONE, is to be graded with 4s. All 4s would make the teacher excellent on all accounts.
The point of the grading, and sending in the coaches to tell the principals they are doing it wrong, is to make sure that the top grades/numbers are never chosen–so teachers can be marked as effective or worse, but never excellent.
LikeLike
Reblogged this on David R. Taylor-Thoughts on Texas Education.
LikeLike
” (no, we don’t really get merit pay. we’re supposed to, but that’s a whole different – let’s lie to the people of Florida – nightmare)”
I would love to hear more about that. The merit pay is the whole argument they give to the public. If they aren’t actually delivering it, we should probably be told that.
I’m all about accountability 🙂 For lawmakers.
LikeLike
or Secretaries of Education
LikeLike
“You can’t manage what you can’t measure”
I need a VAM on these gimmicks they’re selling public schools.
LikeLike
I was informed by my CTA rep (classroom teachers’ association) that we will not be getting merit pay because there is no money for it. Big surprise! I can not find a citation for this on either the State or District sites, though.
LikeLike
Louisiana’s similar and maybe worse system is why after last school year I left teaching in public schools and went to a private school. It was a tough decision to make, and one that I wrestled with greatly, but I could no longer continue to take what I felt were attacks on me by politicians and a corrupt system. In Louisiana, I would get good scores on my evaluations but my VAM wasn’t where I needed it. When I would ask principals and supervisors what I needed to do differently to improve my score, I was told I needed to improve my students test scores, that I was doing the rest correctly. When I asked how to do that, (usually with a hint of sarcasm), they never had an answer except for what I was doing already.
This past year, at my new school, I haven’t had to worry about that. For the first time in a long time, I have felt validated by administration, students, and parents. The sad part of it, and the part I want to say over and over again, is the same support I get where I am now should be received by good teachers in the public schools. I love the private school where I am now, but we have to stop beating up our great educators in the public schools and I shouldn’t have ever had to come to a place where I felt the only way to save my career and sanity was to leave public schools.
LikeLike
It seems that this new way to evaluate teachers “down” is similar to the new Common Core Math that turns 1+1 into calculus with pages of notes to reach the answer of two.
And it’s obvious that the Machiavellian scheme behind Obama’s education agenda is to make public school teachers look bad any way possible revealing that the goal is to destroy public education and turn the job of teaching America’s children over to people like the Walton family, Bill Gates and Hedge Fund billionaires.
Race to the Top and Common Core Standards were never meant to improve education in America, because they were designed to be the tool used to destroy democratic public education as the neon-liberals change American into an oligarchy and get rid of the people’s democracy.
Instead of “neo”, I deliberate used “neon” because it is so obvious what the end game is.
LikeLike
What’s unbelievable to me, having been in the classroom nearly three decades, is how far wrong we’ve gone, how fast it has happened, and how no one seems to be able to say “The Emperor is naked!”
Thanks Robert and Diane for working so hard for those of us working so hard in the classrooms. 🙂
LikeLike
Let’s get together, with the parents, and everyone needs to vote out these “lawmakers” who make sure they still get their pensions, and dont touch the firemen and policemen pensions, but they sure want to go after ours! They want our pension money, plain and simple, but we are smart, and need to fight back legislatively. Everyone start writing letters and speak and get active in your unions before it is too late.
LikeLike
I too am a Palm Beach County District public teacher. In one Design Question area I was marked as Applying. To make the highest grade one in that area one has to mentor others. All within that Design Question area, my professional portfolio documented two presentations I did for staff after school hours on my own time and one after school hours for parents; both well attended. I also presented at a district sponsored activity during normal work hours. I use a website to connect with other teachers like me and assist many staff members one on one. When I re presented the information and asked for my evaluation rating to be changed, I was told that I took the evaluation tool too seriously. Since the evaluation tool it supposed to be a learning tool, I asked what was being looked for so I could do what was being looked for next year. My administration had no answer.
What makes no sense is that I won the District’s Innovative Educator in this Design Question area and I was very enthusiastic to share all I do with my administrator. Unfortunatly, it doesn’t count and doesn’t matter.
I’m an older teacher and the District can pay two new teachers for what it pays me. I really try to do all I can to help my students achieve. I consistantly go above and beyond because it gives me satisfaction and helps my students. It sure doesn’t count with the new evaluation.
LikeLike
“I really try to do all I can to help my students achieve.”
I don’t!! Wouldn’t even think about helping the students to “achieve”. Now I’ll do what I can to help them learn Spanish but to achieve, no!
LikeLike
I work in Orange County. The rabble rousers at my school (myself included) decided that if an administrator coded us lower in one of the elements than we had been rated in the past, we would ask them to show us what they are looking for to be applying or innovative. You don’t know how many teachers were referred to the Marzano website to look at videos of perfectly compliant students in obviously well funded classrooms (drooling over the technology). When we invited admin into our classrooms to literally show us how to achieve innovatings with our students, they refused.
The truth is they’re making this stuff up as they go along.
LikeLike
Veteran teachers are probably stuck with this situation but you can be certain they are sharing these insults and injustices with their students, relatives, neighbors and friends. Intelligent, well-educated people are not going to enter a profession where they are treated with such profound disrespect. Just give it a few years and districts will be (once again) desperate for teachers but the Women Without Options will not be there to take these jobs. I just hope I live to see it.
As for younger teachers, I hope you are preparing for another career. You deserve better.
LikeLike
Marzano’s evaluation system is a joke. Good administrators work “around” the system to make it work; bad administrators make the mistake of taking it seriously.
http://ventingmycynicism.blogspot.com/2012/09/the-insanity-of-marzano-evaluation.html
LikeLike
It’s actually even worse than this. The observation piece is worth 50% of the overall rating (wonderful VAM is the other 50%). To be rated highly effective, at least 60% of your Marzano ratings have to be innovative or applying (the top two ratings). Oh, and, you can’t have a single rating that is “beginning” or “not observed,” the two bottom ratings (not observed meaning that you should have done something but didn’t). Otherwise, you’re not highly effective. This might not sound bad, but here’s the thing. If you just touch on something that is on the observation form, they have to rate it, and if you don’t really nail it, just touch on it, bingo, you’re marked “beginning.” Or could be. It’s highly subjective. They say it’s not, but it is, from admin to admin, from school to school, from county to county, no one does it exactly the same. Oddly enough, my county (Pasco) decided that they hadn’t rated teachers highly enough, so they have told admins to lighten up, Francis. I’m sure the pendulum will swing the other way next year (whoa, not that much, what are you crazy!?).
LikeLike
Speaking of VAM, I have a self-contained ESE class. Everyone is at least two years below grade level. Just found out today that everyone scored a 1 on FCAT Reading (this was not unexpected by me). Though everyone is that far below grade level, there is still a wide ability range in my room, from “can read “step into reading” books all the way down to “don’t know all my letter sounds” level. And who scored highest on the FCAT? That’s correct, my lowest student who doesn’t know all of his letter sounds. If these tests are telling us anything of value, I’ve missed it.
LikeLike
I believe in Florida if a teacher gets two bad annual reviews in a row, he or she can have his or her license revoked or not renewed (basically the same thing since you can’t teach without a license).
Once a state starts tampering with your licensing, you can kiss off ever resuming a teaching career in any public school district anywhere in the United States.
LikeLike
I’m also a teacher in Palm Beach County. It’s even worse that all of the above. If, by some miracle, you are rated Highly Effective, in order to get merit pay (which does not currently exist), you would have to give up your professional teaching certificate and be an annual contract teacher. A very cynical system and very demeaning toward teachers.
LikeLike
Same thing in Indiana … Only after a year of the eval system the media reports that TOO MANY teachers in Indiana were rated Effective (90%) and that the ratings system must be flawed….we use a system called RISE. And as for money? Not much. Highly effective pay amounted to about 1k, Effective about $800.
LikeLike
I have a question, for Bob, really. If the standardized tests adjust to each student, then is comparing each student, as to how they did on the test, in comparison to the other students in the class, valid? If they were all taking the same test, yes. But because the questions vary from student to student, I can’t see how that is fair or valid to the teacher’s evaluation. Could someone look into this? Am I missing something?
LikeLike
It’s my understanding that the not-Smarter, imBalanced summative tests will be computer-adaptive, while the PARCC (spell that backward) summative tests will be fixed form.
In both cases, I believe, these are supposed to be criterion-referenced tests, which are supposed to measure absolute attainment (the student does or does not meet some absolute standard of achievement at a particular grade level) rather than norm-referenced tests, which are supposed to be measures of comparative achievement.
Of course, outcomes can be compared after the fact, and, indeed, as the CCSSO points out in its slick new video on Education as Stairmastery, prepared by some shill organization known as the Council of Great City Schools, the whole point of these tests is to do stack ranking of students, teachers, and schools to find out who is and who is not outgritting the Singaporeans.
The idea behind the computer-adaptive tests is that one can create for areas of attainment as complex as are reading and writing and mathematics a simple, valid, invariant set of stepped levels and that the level of the questioning can be stepped up or down on the fly based on a given student’s responses and yield valid measures of a huge number of what are, in ELA, extraordinarily vaguely formulated “standards.” Can you say abracadabra hocus pocus the testing spirits are about to speak?
In practice, operationally, the “standards” become equivalent to whatever happens to be required of students by the tests. There’s an old joke: What does an IQ test measure? Answer: It measures one’s ability to take IQ tests. Well, that same critique applies particularly well to these egregiously misconceived new national assessments. In other words, the Smarter Balanced Tests will be great measures of Smarter Balanced Test-Taking Ability, and the PARCC Tests will be a great measures of PARCC Test-Taking Ability, and neither will be valid for any other purposes, but a lot of people will take them seriously because there are a lot of numerologically inclined folks who think that anything expressed as a number must be meaningful, and of course, curricula and pedagogy in the United States will be massively narrowed and distorted so that it serves the sole purpose of imparting Smarter Balanced and PARCC test-taking ability, which is what our schools will be teaching instead of teaching, as they did in the past, reading, writing, mathematics, social studies, art, and so on.
LikeLike
Another approach is developing in which teachers are truly in charge of public schools – as farmers are in charge of cooperative, and doctors are the majority on some hospital boards. More information about this new approach is here:http://www.teacherpowered.org/resources/tps-white-paper.pdf
LikeLike
yes yes yes
superb, Joe. Thank you!!!
LikeLike
Nearly the same story here in St. Lucie County… with one exception. This District has adopted the policy that NO TEACHER IS INNOVATIVE because the District has been and is unable to define what “innovative” means. Their logic, naturally, escapes me. The District has identified an arbitrary level of performance as being the best (highly effective) but doesn’t know how to explain what constitutes being highly effective. Therefore, in the county that is two counties north of you lies a county full of good teachers but ones who are incapable of innovating–the purest definition of being a classroom teacher.
LikeLike
The highly effective rating makes me ask why it’s there in the first place. If you are effective, then you are effective. Why should that distinction create this kind of concern for the writer, or any other educator?
LikeLike
As a middle school classroom teacher it baffles me when an administrator (thank you Marzano) denies me credit for a classroom environment that I am proud of nurturing and sustaining in which much learning is taking place. The reasoning–one or two students happen to be off task, distracted by something, or simply being an easily distracted adolescent. My evaluation comments read that I failed to have the students engaged–because according to St. Lucie County, FL, if even one student is not completely engrossed in his or her studies at any one given moment, then the teacher has failed the element of teaching.
The politicians and business powers that be need to take a reality break. And a great article to start with is one recently published in Fast Company: “How To Hack Into Your Flow State And Quintuple Your Productivity.” http://www.fastcompany.com/3031052/the-future-of-work/how-to-hack-into-your-flow-state-and-quintuple-your-productivity?partner=newsletter
It cites an October 8, 2011, Gallup Poll about just how disengaged Americans are at work. According to the article and the Poll, ” 71% of American workers are disengaged. “The average business person spends less than 5% of their day in flow.” Flow being the equivalent of being engaged.
Wow! I can’t even imagine what that kind of classroom would look like.
I wonder how the “Great” business leaders would rate if I Marzano(ed) them?
LikeLike
Ugh. I despise Marzano! I am a first year teacher in the district and even though I am doing innovative things, the administration was told that first year teachers should not receive any innovative scores…apparently so we have a place from which to improve.
I still managed to get a few, but not nearly as many in comparison to veteran teachers who are doing the same exact things in their room as I do in mine (in fact, some of these activities and teaching strategies were provided to them by me and they received a better score! How is that fair?).
It’s ridiculous. We educators deserve better than some asinine subjective grading tool.
LikeLike
Um, and ALSO…..Your pay IS based on it!! There may not be bonuses, but there are, albeit right now small ones, differentials! Let ALONE that if you qualified for the Best and Brightest ‘scholarship’ based on you SAT scores, but were only rated ‘Effective’, it just cost you $8,000. So, there’s that. Also, in my County, the new Evaluation system practically treats Effectives as Needs Improvement in terms of how you are to be scrutinized. It’s humiliating. What made it worse? My Administator told me he hadn’t even realized I would be getting Effective instead of Highly Effective….. he thought he was scoring me in a way that would result in HE (I was off by .05 points). Sigh.
Other than that, thank you for articulating this.
LikeLike