Archives for category: Testing

Computer adaptive assessments are all the rage. They are supposed to be not only cost effective but they allegedly are objective and standardize grading. Also, and not incidentally, they are big business in an age of mass testing.

The idea behind them is that the student answers a question (picks a bubble), and if it is the right answer, gets a question that is slightly harder. If the answer is wrong, the next question is slightly easier. In this way, the computer soon figures out what the student’s level of competence is. Watch for the next round of computer assessments that score student essays. Expect an end to imaginative writing as computers are not programmed to understand what they have never before encountered.

This parent explains why her daughter doesn’t like computer adaptive assessments and how she copes with them. It appears that her daughter has never taken a test that asked her to show what she knows, just to pick the right bubble.

 

My kid doesn’t like online adaptive assessments. She likes knowing there are 50 questions in 40 minutes.  She hates tests that give you many more difficult questions when you answer correctly. The test seems to go on forever.

So, one time she decided to hit buttons randomly and get a bunch wrong. Then the computer spit out fewer, easier questions, and she was able to finish the test at last.

A reader sent the following comments about the online for-profit schooling industry (by the way, that line about “current performance is no prediction of future performance” comes right from the prospectus of investment funds):

Interesting story about the K12 schools performance in Tennessee: http://www.timesfreepress.com/news/2012/aug/31/andy-berke-criticizes-dismal-scores-of-for/?politics

What’s truly stunning is that, according to the article, the K12 schools performed in the bottom 11% of all TN schools tested using the state’s value-added assessment.  As I recall, value-added assessments have been championed by the same reformers who also push for on-lines schools.

K12’s response has been familiar–move the goal posts and change the game.  They claim that current performance is no prediction of future performance–why don’t we who support public education get to use that line?–and their own testing using the private Scranton Performance Series shows they are meeting or beating the Scranton norm group in all categories.   In other words, in their own private world they’re doing just fine. So, why don’t the public schools in TN get to use these tests too?

And they’re making improvements to improve future outcomes.

So, let me get this straight–K12 in TN can’t hack the very performance tests the reformers have shoved down the throats of the public schools.  In response, they get to claim that current performance is no indication of future performance.   But public schools are roundly condemned on the basis of their current performance.  K12 then gets to tout its own private testing results that show–surprise!–K12 is doing just fine, compared to norm among the customers of the private testing service.  But the public schools have to be tested using national and international standardized tests that are not private.  Finally, despite claiming they’re doing just fine in their own little universe, they are working to improve.  Of course, the public schools–that are doing better than K12–are beyond help.

Oh-Kay!

A post described an article in USA Today about the high attrition of teachers in recent years. The article quotes people who say that new young teachers must be comfortable with endless testing because it is all they ever knew. As one person says, these new teachers were 11 years old when NCLB passed. They have lived with test, test, test all their lives as students, so they must be okay with inflicting test, test, test on their students.

This teacher disagrees:

I am a young and inexperienced teacher, I am not afraid to admit it! I yes I did grow up with NCLB and standardized testing, and I guess they are right, I am obsessed with it, I AM OBSESSED WITH GETTING RID OF IT!!!

Deborah Meier comments on a post about efforts in Philadelphia to weaken or eliminate collective bargaining:

INTERESTINGLY, ALMOST NO ONE FEELS OBLIGED to defend their strategies, etc in terms of its impact on a democratic society!  IF, just suppose, it raised test scores we seem prepared to dump democratic norms on the behalf of test scores.  The grand old USA is–might we mention–an experiment in democracy!  (It was not primarily founded on the principles of the market place–that was true, after all, of the decadent European nations we were breaking away from as well.)

In an article in USA Today, a bevy of commentators explain why it may be a good thing that the teaching profession is now getting younger and less experienced.

The article reports:

Recent findings by Richard Ingersoll at the University of Pennsylvania show that as teacher attrition rates have risen, from about 10% to 13% for first-year teachers, schools are having to hire large numbers of new teachers. Between 40% to 50% of those entering the profession now leave within five years in what Ingersoll calls a “constant replenishment of beginners.”

The end result: a more than threefold increase in the sheer number of inexperienced teachers in U.S. schools. In the 1987-88 school year, Ingersoll estimates, there were about 65,000 first-year teachers; by 2007-08, the number had grown to more than 200,000. In the 1987-88 school year, he found, the biggest group of teachers had 15 years of experience. By the 2007-08 school year, the most recent data available, the biggest group of teachers had one year experience.

The brand new teachers, as Susan Fuhrman says, are “very used to standardized testing,” she says. “They’ve grown up with it in some way. Maybe that’s healthy, in that they would be less obsessed with it.”

Fuhrman is president of Teachers College and also a member of the board of directors of Pearson.

Tim Daly, whose organization The New Teacher Project, was founded by Michelle Rhee, loves the idea of all these new teachers. TNTP exists to recruit them. He says that most were 11 years old when NCLB was passed, so they don’t know anything different from standardized testing and being held accountable for raising test scores. For them, it is the norm.

No voice in the article explains why experience matters.

No one asks why the teaching profession is being systematically dismantled.

Apparently having three years under your belt these days makes you a “grizzled veteran.”

Thanks to loyal reader Prof. W. for forwarding this story.

Chicago public schools have been under mayoral control since 1995.

Mayor Daley hired Paul Vallas to reform the schools. He went on to reform the schools in Philadelphia, New Orleans, and Haiti, and now he is reforming schools in Bridgeport while running a national consulting business on reforming schools.

Then Mayor Daley promoted Arne Duncan to reform the schools. Duncan called his reforms “Renaissance 2010.” Before he left for DC in 2009 Duncan opened 100 new schools and closed many neighborhood schools.

Then came Ron Huberman to continue the Daley reforms.

And now Mayor Emanuel carries on in the Daley tradition, having recently instructed his hand-picked school board to close or privatize more schools.

And what’s the upshot of nearly two decades of reform?

“Twenty years of reform efforts and programs targeting low-income families in Chicago Public Schools has only widened the performance gap between white and African-American students, a troubling trend at odds with what has occurred nationally.

Across the city, and spanning three eras of CPS leadership, black elementary school students have lost ground to their white, Latino and Asian classmates in testing proficiency in math and reading, according to a recent analysis by the University of Chicago Consortium on School Research.”

The Consortium report had the following conclusions:

• Graduation rates have improved dramatically, and high school test scores have risen; more
students are graduating without a decline in average academic performance.
• Math scores have improved incrementally in the elementary/middle grades, while
elementary/middle grade reading scores remained fairly flat for two decades.
• Racial gaps in achievement have steadily increased, with white students making slightly more
progress than Latino students, and African American students falling behind all other groups.
• Despite progress, the vast majority of CPS students have academic achievement levels that are
far below where they need to be to graduate ready for college.

Some more quotes from the report:

“Chicago schools are not what they were in 1990. Graduation rates have improved tremendously, and students are more academically prepared than they were two decades ago. ACT scores have risen in recent years, and elementary math scores are almost a grade level above where they were in the early 1990s. However, average test scores remain well below levels that indicate students are likely to succeed in college.

This is not a problem that is unique to Chicago. Nationwide, the typical high school graduate does not perform at college-ready levels. Chicago students do not perform more poorly than students with similar economic and ethnic backgrounds at other schools in Illinois.” p. 78

Over the course of the three eras of school reform, a number of dramatic system-wide initiatives were enacted. But instead of bringing dramatic changes in student achievement, district-wide changes were incremental -when they occurred at all. We can identify many individual schools that made substantial, sometimes dramatic, gains over the last 20 years, but dramatic improvements across an entire system of over 600 schools are more elusive.

Past research at CCSR suggests that that the process of school improvement involves careful attention to building the core organizational supports of schools -leadership, professional capacity, parent/community involvement, school learning climate, and instruction (Bryk, et al., 2010).

Building the organizational capacity of schools takes time and is not easily mandated at the district level. Nevertheless, the extent to which the next era of school reform drives system-wide improvement will likely depend on the extent to which the next generation of reforms attends to local context and the capacity of individual schools throughout the district.” p. 79

It is hard to see how this rate of change will eliminate poverty or close the achievement gaps (which have widened).

And will anyone be held accountable?

A reader in New York City who studies data carefully has analyzed the latest reports from the state accountability system, which identifies the “best” and the “worst” schools. He finds that the most affluent schools will win “rewards,” and the schools that enroll the neediest students are marked for punishment, not for support.

The coming days will see much more detailed analysis of the new New York State accountability system for public schools. Yes, there is yet another system now in place. Gone are the days of “In Need of Improvement” “Corrective Action” and “Restructuring.” Now we have “Focus” (bad) “Priority” (very bad) and “Reward” (good).

What do the just released new lists tell us about education in New York City?

Although denied time and again by our education bureaucrats, these lists show that not enough is being done to support the schools that serve students from underprivileged backgrounds. Many of the districts in NYC (districts 1, 4, 7, 8, 9, 12, 16, 17, 18, 19, 32) had not a single “reward” school.  No surprise, these are some of the poorest districts in the city.

On the other hand, affluent districts ended up with lots of “reward” schools. The two wealthiest districts in NYC  (as measured by the % of students eligible to receive free or reduced price lunch) are 26 in Queens and 31 in Staten Island. Staten Island has only “reward” and no “priority” or “focus” schools.  District 26 in Queens has 6 “reward” schools and 1 “priority” school. The reward schools are all elementary and middle schools that serve local students. The priority school is a high school that serves students from all over the city.

But surely that means that some very poor districts have some excellent “reward” schools? Not really. The “reward” schools in such districts are all specialized schools, either special gifted and talented elementary schools or screened middle schools or high schools that students must test into. In district #10 in the Bronx, the only “reward” schools are the Bronx High School of Science and the High School of American Studies at Lehman. The demographics of these schools do not reflect the demographics of the district. Other such districts include districts 5, 6, 11, and 13.

The lesson: If schools want to get a “reward,” they should screen their students prior to entry.

In fact, in 16 of the 17 New York City High Schools on the “reward” list, students are screened or tested prior to entry. Only a single high school, The Academy of Finance and Enterprise in Queens, on the list is unscreened. Might this school serve as an exemplar for other schools? Not really, because this school appears to screen out students AFTER entry. As the table below shows there is a suspicious pattern of the graduating class size diminishing over time. This has gotten better over the years, perhaps because some of the more challenging students in the neighborhood no longer apply to this school as they know they will be moved out quickly.

Graduation cohort # of students entering 9th grade # of students graduating 12th grade % of students removed from cohort
2010-11 125 103 17.6%
2009-10 123 85 30.9%
2008-09 109 72 34%

A recent story in the New York Post described how the Bronx Health Sciences High School, an “A” rated high school in New York City, expelled numerous students to make their numbers look better. Where do these students go? Maybe they end up in the “priority schools.”

A recent analysis has shown that districts in New York State with priority and focus schools fund schools at much lower levels than districts with schools that are in good standing. That analysis excluded New York City.

An examination of the funding of the “reward” schools in New York City reveals that they receive over 100% of the formula the city uses to calculate how much money to give schools. To place this in context a Daily News article reported that  “The 24 so-called “turnaround schools” — where the city unsuccessfully moved to ax half the staff — are underfunded by more than $30 million combined, more than 10% of their overall current budgets.”

Of course, all 24 turnaround schools are on the ”priority” list. Never mind that they serve the city’s neediest students.  They enroll double the city average of the neediest students with disabilities. It doesn’t matter to the New York City Department of Education that these highly stressed schools have a graduation rate of students with high quality (i.e. Regents or Advanced Regents as opposed to the more basic “local” diploma) diplomas that is better than the average for schools serving similarly situated students. 

The New York City Department of Education penalizes schools that serve students who need the most support. Education bureaucrats are making deliberate decisions to underfund schools that need the most support. The education bureaucrats will blame the schools, the teachers, and the school administrators.

There is one thing we know they won’t do. They will not look at what the data is telling them. They will not figure out what supports students need to succeed. They will not provide the resources and support these students need and deserve. They will not develop a system of school evaluation that is fair. They will not stop sending the most challenging students to only some schools. They will not fund schools fairly. They will not provide schools serving disadvantaged students with additional social workers, guidance counselors, attendance and family workers so that teachers are not expected to play all these roles and teach as well. They will not provide schools with curriculum and programs that have been shown to work for disadvantaged students. They will not support schools and help them improve. Is it because they don’t know how to do these things? Or because they don’t care to?

This is the true civil rights issue of our time. 

Henry Levin, the distinguished economist at Teachers College, has written an important new article in which he explains that test scores are only one dimension of student and national success. The link is only available for four weeks. It is only about 20 pages, so be sure to read it now or soon.

He shows, with extensive documentation, that non-cognitive qualities– like motivation, persistence, the ability to get along with others–are no less important than cognitive qualities and are undervalued in the present climate.

The international race to get higher and higher test scores ignores the non-cognitive dimension. It is a race that will narrow what children learn, what teachers may teach. It is not good for children or societies. It is a race that no one will win.

Here is the abstract:

Ó UNESCO IBE 2012

Abstract Around the world we hear considerable talk about creating world-class schools. Usually the term refers to schools whose students get very high scores on the international comparisons of student achievement such as PISA or TIMSS. The practice of restricting the meaning of exemplary schools to the narrow criterion of achievement scores is usually premised on the view that test scores are closely linked to the provision of a capable labour force and competitive economy. In fact, the measured relationships between test scores and earnings or productivity are modest and explain a relatively small share of the larger link between educational attainment and economic outcomes. What has been omitted from such narrow assessments are the effects that education has on the development of interpersonal and intrapersonal skills and capabilities that affect the quality and productivity of the labour force. This article provides evidence on some of these relationships, on the degree to which the non-cognitive effects of schooling contribute to adult performance, and on the evidence that deliberate school interventions can influence non-cognitive outcomes. It concludes with the view that the quest for world-class schools must encompass a range of human development characteristics that extend considerably beyond test scores. 

A group of 30 organizations associated with corporate reform wrote a letter to Secretary Arne Duncan to insist that he hold teacher education programs accountable for the test scores of the students taught by their graduates.

Groups like Teach for America, StudentsFirst, Democrats for Education Reform (the Wall Street hedge fund managers), The New Teacher Project, various charter chains, Jeb Bush’s rightwing Chiefs for Change and his Foundation for Educational Excellence, and various and sundry groups that love teaching to the test stand together as one.

Their views are in direct opposition to those of the leaders of higher education, who oppose this extension of federal control into their institutions.

Read Gary Rubinstein’s blog about it here, where you will see the full cast of corporate reform characters, many of them funded by the Gates Foundation.

They are certain that what minority students need most is more testing. They want the test scores of the students to determine the career and livelihood of their teachers. And they want the federal government to punish the schools of education that prepared the teachers of these children.

If Duncan takes their advice, he will assume the power to penalize schools of education if the students of their graduates can’t raise their test scores every year.

The vise of standardized testing will tighten around public education.

These people and these organizations are wrong. They are driving American education in a destructive direction. They will reduce children to data points, as the organizations thrive. Wasn’t a decade of NCLB enough for them?

They are on the wrong side of history. They may be flying high now, but their ideas hurt children and ruin the quality of education.

As a historian, I can assure you that the roots of the current “reform” movement are on the far right. Vouchers began with Milton Friedman in 1955; charters began in 1988 with liberal origins, but were quickly adopted by the right as a substitute for vouchers because voters always defeated voucher proposals. The attacks on teachers’ unions are out of the rightwing playbook. The demands for test-based accountability did not originate in the Democratic party. The effort to remove all job protections–seniority, tenure, the right to due process–did not originate with liberal thinkers or policymakers, but can be traced to the Reagan administration and even earlier to rightwing Republicans who never wanted any unions or job protections for workers. The embrace of privatization and for-profit schooling is neither liberal nor Democratic.

How this happened is a long story.

No matter who supports this agenda, it is not bipartisan. It originated in the ideology of  the rightwing extreme of the GOP. Its goal is privatization.

This reader notes the long list of Democrats who have adopted the rightwing GOP agenda:

It’s not just right wing states and politicians that want to harass teachers.

Plenty of Dems are in on the fun.

Senator Michael Bennet of Colorado is a nominal Democrat who never saw a teacher he didn’t look upon with suspicion or a test company he didn’t want to give a contract to.

Mayor Rahm Emanuel is leading the charge in teacher demonization efforts in the Midwest, and I would argue that his anti-union, anti-teacher track record is beginning to rival that of his brethren to the north, Scott Walker and Paul Ryan.

Emanuel is a Democrat in name and once led the DCCC when Dems took back the House of Representatives.

Congressman George Miller, who chairs the House Education Committee, is a Democrat but like Bennet in the Senate, he too never met a teacher he felt could be trusted to teach without “high stakes accountability measures” imposed from afar.

Cory Booker is a Democrat who is currently engaged in the wholesale privatization of the Newark school system.  He’s got buddies in the hedge funds and Wall Street who bankroll him, he’s great friends with Chris Christie and loves Christie’s privatization efforts at the state level and his demonization of teachers and teachers unions in the media.  That won’t stop Booker from running against Christie for governor next year, however, so those of us who live in NJ can expect privatization of the schools no matter who wins – Christie or Booker.

Michelle Rhee, Joel Klein and Michael Bloomberg were all nominal Democrats before they embarked upon their teacher demonization/school privatization agendas as well.

And of course the Democratic politician who has had the most impact in the teacher demonization/school privatization effort is Barack Obama – from Race to the Top to Central Falls, Rhode Island to Race to the Top II: The Municipal Version to Race to the Top III: The District Version, few politicians have been as successful at bringing teacher evaluations tied to test scores and changes to tenure laws or promoting a broad expansion of high stakes testing in every grade in every subject, K-12, as Barack Obama.

I wish it were simply right wingers and Republicans out to harass teachers who were the problem.  Unfortunately, because both parties take money from the same corporate masters, politicians in both parties are out to give those masters what they ultimately want when it comes to public education – a privatized system with busted unions, cheap labor costs, and lots and lots of opportunities to cash in on the latest ed buzz craze (these days that being the Common Core Federal Standards, the tests that are going to be aligned to those standards and the test prep materials that are going to be needed to get students prepared for those tests.)