A study commissioned by the Lower Hudson Council of School Superintendents found that the state’s educator evaluation system is flawed in multiple ways and does not produce reliable ratings.

The state’s formula gave less credit to teachers serving disadvantaged students, judged some teachers on the performance of too few students, failed to measure key variables such as student mobility and did not clearly signal how schools can assist teachers or students, the study found.

“Our fears were realized,” said Harrison Superintendent Louis Wool, who was president of the Lower Hudson Council of School Superintendents when the study was started in the spring. “The first round of assessments did not accurately measure the value of teachers whose students are in poverty, in special education or speak limited English. We are concerned that we have spent countless hours and millions and millions of dollars to produce results that are not comparable across the state and do not inform teacher practice or student learning.”

Perhaps it is studies like this that have caused Bill Gates to declare that we won’t know if “this stuff” works for at least a decade. But by the time the decade is over, how many careers will have been destroyed, how many lives ruined by the hunches of Bill Gates and Arne Duncan?