Archives for category: Teacher Evaluations

Here are some creative ideas about how to beat the wireless sensor that will be embedded in every child’s galvanic response skin bracelet, if Clemson’s studies come to fruition. Bear in mind that the teacher will be evaluated in relation to the children’s level of excitement, engagement, and anxiety. Are they alert? Are they aware? Are they paying attention? How to create this state of high intensity?

In the first instance, the teacher insists that she herself would never do the following things, but she believes they would definitely work and guarantee a high rating on the responsiveness meter. In the second, the teacher treats the bracelet as a wonderful opportunity for his students to conduct an inquiry into how to game the bracelet.

Set a bell to ring at random intervals. When the bell rings, choose a student (mostly) at random and scream in their face for a minute about the slightest thing they’ve done wrong. Not only would those kids be kept in a high state of excitement, never knowing when or to whom a reaming would be handed, but they’d be the best behaved kids in the school, which I’m sure a lot of charter schools would love.Perhaps one could even create a bit of Stockholm Syndrome by some days being super nice candy teacher and being crazy screaming nutso teacher on others.I mean, the fun/interesting/cool stuff wears off-kids get used to it and you have to keep upping the ante. Not all kids are excited or interested in the same stuff. But fear? Everyone’s afraid of something…Plus, it’s a LOT easier to keep the kids afraid than engaged. I know one (as in, only one) teacher who is naturally so awesome that the kids hang on every word because “they might miss something.” I know a bunch more that try to be that way. But if it came down to keeping a job, keeping the kids afraid is a lot easier and I think that a lot of teachers that wouldn’t dream of teaching that way would do that if they felt they had no other choice.
Finally . . . some inquiry-based science materials!!I’d challenge the kids to figure out how the devices work and how to “game the system”. My 8th grade science students would be abuzz. They’d probably try attaching the bracelets to the class hamster (his metabolism usually registers as pretty excited). The kids would figure it and come up with incredibly creative ways to outsmart it!http://www.makershed.com/Galvanic_Skin_Response_Kit_p/msgr01.htmIt’s about time the reform movement offer our kids a means to develop their innovation! Before this, we have been starved of any materials, resources, support, or time for innovation or intelligence.

 

A few days ago, I learned from Leonie Haimson who learned from Susan Ohanian about a grant from the Gates Foundation to Clemson University to conduct research into the uses of a “galvanic skin response” bracelet. This is a wireless sensor that tracks physiological reactions. What made this grant of special interest was that it was directly connected to the Gates Foundation’s premier teacher-evaluation program, Measures of Effective Teaching (MET). The Clemson team won a grant of $498,055 (wonder what that $55 is for?) to “determine the feasibility and utility of using such devices regularly in schools with students and teachers.” The GSR bracelet, in short, could be used to measure physiological responses to instruction, and such responses might provide yet another metric to add to test scores, student surveys, and observations when evaluating teacher effectiveness.

The story got more interesting when someone on Twitter discovered another Gates grant, this one for $621,265 to the National Center on Time and Learning, ” “to measure engagement physiologically with Functional Magnetic Resonance Imaging and Galvanic Skin Response to determine correlations between each measure and develop a scale that differentiates different degrees or levels of engagement.”

And then a reader noted that the GSR bracelet was unable to distinguish between “electrodermal activity that grows higher during states such as excitement, attention or anxiety and lower during states such as boredom or relaxation.” 

Thus a teacher might be highly effective if his students were in a statement of excitement or anxiety; and a teacher might be considered ineffective if her students were either bored or relaxed. The reader concluded, quite rightly, that the meter would be useless since a teacher might inspire anxiety by keeping students in constant fear and might look ineffective if students were silently reading a satisfying story. In the first instance, a tyrannical teacher might be rated effective on the GRS scale, while an excellent teacher might appear ineffective in the second instance.

The idea that this powerful foundation is setting in motion a means of measuring physiological responses to teachers is deeply disturbing. The act of teaching is complex. It involves art, science, and craft. Learning is far more than can be measured by a GRS bracelet. At any given moment, students may be engaged or disengaged. They may be thinking about what happened at home that morning or a spat with their best friend. They may be worried about their mother’s illness or looking forward to going to the movies. They may be hungry and feeling anxious or they may be hungry and excited about having lunch.

Some aspects of the human experience are more important than teacher evaluation. Like our human dignity, our right to privacy, our need to be treated with basic respect as individuals with the power to shape our own destiny, not just as creatures to be tested, measured, and shaped by the will of others.

Yes, there is a Brave New World quality to the prospect of using wireless sensors to measure physiological reactions to teachers. Yes, there is a line that separates educationally sound ideas from crackpot theories. Yes, there is reason to be concerned about the degree of wisdom–or lack thereof– that informs the decisions of the world’s richest and most powerful foundations. And yes, we must worry about what part of our humanity is inviolable, what part of our humanity cannot be invaded by snoopers, what part of our humanity is off-limits to those who wish to quantify our experience and use it for their own purposes, be it marketing or teacher evaluation.

The line has been crossed.

Diane

This teacher sent a comment; he or she has figured it out. If the galvanic response skin bracelet will give teachers a high effectiveness rating when students are excited, there is an easy way to game the system and fool the bracelet:

Can this galvanic contraption distinguish between different types of excitement? Sometimes a beautiful new female student joins my class and the young men are visibly excited–about the girl, but not about my thrilling explication of adverbs. If I want to keep my job, do I have to hire supermodels to audit my classes to raise the galvanic excitement levels?

Creative teachers will think of many ways to get their students excited. Suppose you invite students to have a wrestling match in the middle of the lesson? How about bringing out the dice and play a game of craps? Show exciting movies?

Let’s hear how you would fool the bracelet and win yourself a high effectiveness rating.

Diane

A reader writes:

What grabbed me was this part:
“electrodermal activity that grows higher during states such as excitement, attention or anxiety and lower during states such as boredom or relaxation.”

So, this means that they can’t tell the difference between excitement, attention and anxiety? So all you have to do is keep a class in constant fear and you ace the evaluation? It also can’t tell the difference between boredom and relaxation. So if you’re doing “sustained silent reading,” which is it? Are students supposed to be “on” all the time?

I’m not a teacher, and even I can see that this is a huge steaming pile. But it got them a $500K grant! Nice work if you can get it – and stomach it.

Let’s see now. The teacher who keeps the class in a state of high anxiety gets points on the “effectiveness” scale. The teacher whose students are feeling at ease in the classroom will get a low rating.

If this reader saw through this flaw, why did no one at the Gates Foundation?

Last night, I googled “galvanic response skin” and got thousands of hits. It is happening, it has many uses apparently.

But surely you can see how it can be used to mine classroom data, to find out whose students sit on the edge of their seats in a state of alertness, attention and anxiety, and whose are slacking off.

Data mining is now a customary part of the business of online corporations who record our every move, which web pages we open, which products we buy online, which books we are interested in. All of this information is assembled, filtered, and compressed into a personalized profile, so that advertisers can target us with their messages wherever we go on the ‘Net. No point advertising automobile products to me, but they will be just right for someone else. Once gathered, this information can be sold and resold.

Once you understand the template, you can understand the logic of the Galvanic Response Skin bracelets. They will be one more piece of “objective” data to add to test scores, student surveys, and observations when evaluating a teacher. He or she may contest the observations, but how can they protest the objective readings of students’ skin responses to instructions?

And think of the professional development opportunities! Soon there will be workshops on how to increase your students’ GRS ratings. And there will be trained GSR facilitators and GSR measurement experts and GSR coaches.

It all fits so nicely with the U.S. Department of Education’s huge investment in data warehouses for every state. Before long, there will be a statistical profile for every student, compiled from their vital statistics at birth to their pre-kindergarten readiness assessments to everything that happens thereafter.

And to what end?

Diane

I opened the following email and at first I thought it was a prank or, as another reader put it, an article taken from The Onion. See what you think:

—–Original Message—–
From: Leonie Haimson
To: nyceducationnews ; paa news
Sent: Fri, Jun 8, 2012 10:08 am
Subject: [nyceducationnews] Gates Foundation: one more step into the dystopian future with electronic bracelets for students & teachers

 
Gates Foundation experimenting w/Galvanic Skin Response (GSR) bracelets in teacher eval project
 See Susan Ohanian, excerpt below:
 http://goo.gl/KBXtO
 
Look up “effective teaching” on Bill and Melinda Gates Foundation grants. Here’s one of the awards.

To: Clemson University
Purpose: to work with members of the Measuring Effective Teachers (MET) team to measure engagement physiologically with Galvanic Skin Response (GSR) bracelets which will determine the feasibility and utility of using such devices regularly in schools with students and teachers [emphasis added]
Amount: $498,055

Think about that!!

NOTE: The emerging field of neuromarketing relies on biometric technologies to determine a participant’s emotional and cognitive response to certain stimuli. In the case of neuromarketing, this stimulus is anything from a television commercial to an internet advertisement. There are six primary biometrics used to gather data on physiological responses to marketing…

So Gates wants to apply it to effective teaching.

The Affectiva Q Sensor is a wearable, wireless biosensor that measures emotional arousal via skin conductance, a form of electrodermal activity that grows higher during states such as excitement, attention or anxiety and lower during states such as boredom or relaxation.

Here’s a paper on the topic: MobiCon: Mobile Context Monitoring Platform for Sensor-Rich Dynamic Environments

Smart mobile devices will be the central gateway for
personal services in the emerging pervasive environment
(Figure 1). They will enable a lot of personal context-aware
applications, forming a personal sensor network with a
number of diverse sensor devices, placed over human body
or in surrounding spaces. Diverse sensors act as the useful
tool for the applications to acquire users’ contexts1 , i.e.,
current status of an individual or surrounding situation that
she/he faces into, without their intervention [42].
 
Wikipedia says neuromarketing is a new field of marketing research that studies consumers’ sensorimotor, cognitive, and affective response to marketing stimuli. So the Gates Foundation joins Google, CB S, and Frito-Lay in looking for ways to measure consumer reactions to products.

Put a Galvanic Skin Response (GSR) bracelet on every kid in the class and you can measure teacher effectiveness in keeping their attention.

Maybe the next step is for the bracelet to zap them with electric current when their attention wanders.

And then the next generation will be the Galvanic Skin Response bracelet on every teacher–to zap her when she veers from the Common Core curriculum. Then. . . bring on the drones to eliminate such teachers.
 
 Leonie Haimson
Executive Director
Class Size Matters
124 Waverly Pl.

I needed A reality check, so I googled “galvanic skin response” and added “Clemson.” up popped the following link:

Home/Clemson University
SHARE
Clemson University
Date: November 2011
Purpose: to work with members of the Measuring Effective Teachers (MET) team to measure engagement physiologically with Galvanic Skin Response (GSR) bracelets which will determine the feasibility and utility of using such devices regularly in schools with students and teachers
Amount: $498,055
Term: 1 year and 2 months
Topic: College-Ready Education
Region Served: Global, North America
Program: United States
Grantee Location: Clemson, South Carolina
Grantee Web site: http://www.clemson.edu

What can I say? Shades of Brave New World.

Which district will be first to put the bracelets on their students and teachers? Will charter school students have to wear them, or only children in public schools? Who will pay for them? Will schools raise money by selling the data to Amazon and Google and other data-mining corporations? Have we lost all common sense?

Diane

I asked my readers if Melinda Gates was right when she said that an effective teacher would get three times the “gains” of an ineffective reader and if you knew the source of this statistic or claim. I had many thoughtful replies. Many people had heard the claim, which was made not only by Melinda Gates but Michelle Rhee. Some attributed it to Eric Hanushek, some to Education Trust, some to William Sanders.

Surely there can be no doubt that some teachers are more successful than others, at least with some children in some years. Can all teachers get the same gains every year? Not so clear.

Imagine if every child in every classroom in the U.S. had an effective teacher every year, as Melinda Gates said would one day be possible due to the work of the Gates Foundation. That would mean that every child would gain 18 months of instruction every year. By the end of eighth grade, every child would be ready to go to college, having gotten the test score gains equivalent to twelve years of schooling. College-readiness by 13 or 14! That would surely be a break-through for our society and would change the nature of college-going.

In the search for the provenance of Melinda Gates’ statement, Gary Rubinstein seems to have cracked the code with his research. Gary teaches math at Stuyvestant High School and has his own blog, as you will see if you open the link. Gary tracked the claim back to a paper by Eric Hanushek in 1992 (which was cited by some other readers as well). His analysis is worth reading. What Rubinstein discovers about this 20-year-old study will surprise you and make you wonder why so many people are citing it today as definitive proof of certain policy ideas. No one offered any evidence that the 1992 study (or whenever it was conducted) has been replicated, so we don’t need to worry about a sudden explosion of 14-year-olds prepared to enter college.

Diane

PS: A reader on Twitter suggests that she would be satisfied if 14-year-olds arrived with appropriate skills and knowledge for their grade:

Margot Durkin ‏@mrsdurkinmuses

,@DianeRavitch re: M Gates: how about we strive to have every 14 year old ready for real high school work?

When Melinda Gates was interviewed on the PBS Newshour on June 4, she said something that surprised me. I will give you the full quote, which I copied from the Newshour website. I was surprised because I never heard that claim, I don’t know whose research she was citing or if it even exists. I checked with Linda Darling-Hammond, who seems to have read every study of teacher effectiveness, and asked her if she knew the source; she said she had never heard this claim and had no idea where Melinda Gates got this information, if it exists.

So, I ask my readers, and I ask you to ask your friends in the academic world, do you have a citation for this statement?

MELINDA GATES: Well, we know from good research that the fundamental thing that makes a difference in the classroom is an effective teacher. An effective teacher in front of a student, that student will make three times the gains in a school year that another student will make.

And so what the foundation feels our job is to do is to make sure we create a system where we can have an effective teacher in every single classroom across the United States.

The second claim is that the foundation has the knowledge to “create a system where we can have an effective teacher in every single classroom across the United States.” Someday, someone might ask whether they have achieved that goal. Right now, I would be content if the Gates Foundation were able to point to a single district in the U.S. where they had achieved that goal.

Diane

Here is a comment from a first-year teacher who knows more than the “reformers” who wrote the laws in Florida.

I can go one better — in my district here in southwestern Florida 50% of my final evaluation for the year will be based upon the test scores of children in grades 4 and 5. I taught 2nd grade this year. This is my first year at this school.So, in effect, half of my ‘effectiveness’ as a teacher is to be determined by test scores from students I’ve NEVER taught and most of whom I’ve NEVER even met.How anyone could keep a straight face and maintain any moral integrity while telling me that this is a ‘fair system’ is beyond my understanding yet this is the program that my betters in the district office produced, the state of Florida approved, and the U.S. Dept. of Education accepted as meeting the requirements of Race to the Top.How could I have added ‘value’ or subtracted ‘value’ to students I’ve never even spoken to or been with in a classroom? Osmosis?He later sent me this correction:Diane, I’m flattered that you chose to highlight my comment. Thanks! Just a slight correction — I’m not a first year teacher, just new to this school. I’ve actually been teaching for 15 years, always in Title I schools.I’m National Board Certified, hold 2 MA’s (one from NYU) and was named Social Studies Teacher of the Year for my district last year.

I fully expect my final rating to be “Needs Improvement” or “Ineffective” though, when the test scores are added in to my ‘value’, since the state saw fit to raise the bar so high for passing and they made the FCAT test far more difficult this year. My principal actually rated me ‘highly effective’ based upon her numerous formal and informal observations and review of my teaching portfolio but that only counts for half so . . . .

Looks like the writing is on the wall and it’s time to start looking for employment outside the school system. That makes me very sad and sick at heart but I don’t see anything changing for the better any time soon. After 2 years of low ratings in Florida now you lose your professional teaching certificate and can be fired at will. Everyone who can is retiring or has retired. Those of us in the middle or just starting out are just stuck.

Where are our professional organizations and unions? Why aren’t they fighting hard to help us? Inquiring minds would like to know.

Can you believe this? A story in the Washington Post reports that kindergarten students in Georgia will be asked to evaluate their teacher’s performance. The five-year-olds’ judgments will help to determine whether their teachers get a bonus or get fired http://www.washingtonpost.com/local/education/student-surveys-may-help-rate-teachers/2012/05/11/gIQAN78uMU_story.html.

Have we lost our minds in this country? At long last, are we totally insane on the subject of teacher evaluation? I know that the Gates Foundation has encouraged the idea that student surveys should be used to judge teachers, along with test scores and other so-called measures. For what it’s worth, I think it is not a good idea. In college, in high school and in middle school, teachers will be wary of asking too much of their students, for fear of losing their favor. If they assign too much reading or if they are tough graders or disciplinarians, their students might retaliate by giving them a low mark.

If teachers must seek their students’ approval, how does that make school better?

To rely on kindergarten students to judge their teachers brings this idea to its lowest possible level. At what point does a bad idea get revealed as sheer idiocy?

Diane

A parent recently wrote an article in the New York Times explaining why he planned to file a Freedom of Information Act suit to demand the release of all test questions.

He is right. Now that the tests have assumed so much importance, the public has a right to know what they were asked.

Now that the tests have such a decisive effect on so many people’s lives, the public has a right to know.

Based on these tests, students will be promoted or will fail.

Based on these tests, students will get into the college of their choice, or will not.

Based on these tests, some teachers will get a bonus, and others will be fired.

Based on these tests, some schools will be closed.

Based on these tests, lives will be changed for better or worse.

Who pays for the tests? The public.

Who is affected by the tests? The public.

Who has a right to know what was asked? The public.

Who has a right to know how many pineapples are on the test? The public.

Who has a right to know how many questions are stupid? The public.

Who has a right to know if there are questions with multiple answers or no answer? The public.

If a person accused of a crime has a right to confront their accuser and hear the evidence, why shouldn’t test-takers have the right to know whether the tests that shaped their fate are reasonable?

Publish them. Let everyone see what is on them. Publishers can write new test questions or they can create a database of released test questions so large that students can dip into them for test preparation.

Or, someday we may regain our wits, and decide to move on to far better forms of assessment, where students actually demonstrate what they know and can do instead of picking a bubble.

Unless, of course, we have become so dumbed down by decades of bubble testing that we can no longer think differently.

Diane