Archives for category: Research

A new study conducted by Jennifer Heissel, a researcher at Northwestern’s School of Education and Social Policy, concludes that students who study Algebra I online do not perform as well on tests as their peers who learned the subject in traditional classes.

The study was published in the journal Economics of Education Review.

The study exploited a 2011 district policy change in North Carolina that allowed advanced eighth-graders to take Algebra 1 online. Prior to the change, none of the middle school students took Algebra 1; instead they waited until ninth grade to take it in a regular classroom.

North Carolina has developed one of the leading virtual education systems in the country, allowing rural middle school students the chance to take high school courses that would be otherwise unavailable. The virtual Algebra 1 middle school program increased equity in access at a lower cost than a traditional classroom, and most advanced students passed the course.

“However, equity in access does not guarantee equity in outcomes,” Heissel wrote in the study. “Policymakers should carefully weigh these tradeoffs.”

What surprised Heissel most was that the effect was seen in students who normally perform above average.

“Generally, no matter what you throw at high achievers, they end up fine,” Heissel said. “That’s what concerns me: If even the advanced students can’t do well, why would we think it would work well for all?”

Christopher Lubienski reviews two recent voucher studies on behalf of the National Education Policy Center in this post. (The post summarizes the findings and contains links to Lubienski’s report.)

The two studies under review purport to show the success of vouchers. One was prepared by the pro-voucher Friedman Foundation for Educational Choice, whose role is to cheerlead for vouchers. The other comes from the Department of Education Reform at the University of Arkansas. Lubienski concludes that neither proves the success of vouchers.

William J. Mathis has drawn together the research on class size to explain why it matters.

It is costly to reduce class size, but it is very likely the most effective intervention to help students who are struggling.

It also happens to be the single reform that parents want most. When class size was put on the ballot in Florida, it was overwhelmingly approved. Despite numerous attempts by Jeb Bush and his allies to get rid of it, the caps on class size have remained intact.

Reformers disregard the research on class size because they don’t want to spend more money to do what works. They prefer changes in governance, like charter schools, vouchers, mayoral control, state takeovers–anything but reducing class size. They claim that reducing class size benefits unions because it requires more teachers. But the biggest benefit of reducing class size is to the children, who get the attention and time they need to learn.

Linda Darling-Hammond recently created a new institute to study teaching and learning, called the Learning Policy Institute. Given her scholarly background, you can be sure that anything LPI produces will be rigorously researched.

In one of its first research summaries, the LPI concluded that “Teachers Improve As They Gain Experience.”

This would seem to be common-sense, but the corporate reform movement has repeated again and again that teachers improve in the first three years, but then plateau and improve no more after the first three-five years. They use this claim to advocate for Teach for America and other fast-track programs and to ignore the exodus of highly experienced teachers. As a result of this counterintuitive and actually false belief, so-called “reformers” have advocated for and enacted state laws that encourage veteran teachers to leave the profession. For example, North Carolina raised entry salaries for teachers to $35,000 but capped salaries for experienced teachers at $50,000. Florida offers bonuses for new teachers who had high SAT scores in high school (!), but no bonuses to encourage the most experienced teachers to stay in the profession.

Thus, it is of the utmost importance that respected researchers have refuted the claim that teachers do not improve as they gain experience. This is one of the worst canards of the corporate reform movement, and one that is harming the teaching profession and the nation’s children.

Here is a summary of the research report.

Here is the report.

Here is the press release:


Teachers Improve as They Gain Experience

Comprehensive LPI review analyzes 30 studies on the effect of teaching experience on student achievement

Do teachers plateau early in their career or do they continue to grow and improve as they gain experience? It’s a critical question that has implications for local, state, and federal education leaders and policymakers. And it’s the subject of the latest report from the Learning Policy Institute (LPI), Does Teaching Experience Increase Teacher Effectiveness? A Review of the Research.

Based on their analysis of 30 recent, methodologically rigorous studies on the impact of teaching experience on student outcomes, authors Tara Kini and Anne Podolsky find that as teachers gain experience, they are more likely to positively impact student achievement and improve critical behaviors, including attendance. The steepest gains are in the first few years of teaching, but teachers gain in effectiveness throughout their careers, especially when they are in collegial work environments. Experienced teachers also have a positive impact on the performance of their peers.

“This report shows that what is widely accepted as true in the business world—that individuals improve their performance with experience—is also true in teaching,” says LPI Senior Policy Advisor Kini, who co-authored the report.

These findings come at an important time. Nationwide, we’re seeing a “greening” of the teacher workforce. But inexperienced teachers aren’t evenly distributed throughout schools. Black, Latino, American Indian, and Native-Alaskan students are three to four times more likely to attend schools with higher concentrations of first-year teachers than White students. New teachers are also more likely to be concentrated in high-poverty schools.

In addition to a detailed analysis of the research, the report includes recommendations to address these inequities—a requirement under the Every Student Succeeds Act—and offers program and investment strategies to attract, retain, and develop talented teachers who have opportunities to learn and grow throughout their careers.

Read the full report and the research brief, Does Teaching Experience Increase Teacher Effectiveness? A Review of the Research, both of which are available on our website.


###

About The Learning Policy Institute

The Learning Policy Institute conducts and communicates independent high-quality research to improve education. Working with policymakers, researchers, community groups, and others, we seek to advance evidence-based policies that support empowering and equitable learning for each and every child. For more information, please visit http://www.learningpolicyinstitute.org.

Learning Policy Institute
1530 Page Mill Road, Suite 200
Palo Alto, CA 94304

info@learningpolicyinstitute.org

I recently posted a link to a Brookings Brief by Mark Dynarski, which warned that vouchers had not been successful in two states, Louisiana and Indiana. About the same time, the University of Arkansas released a research review that lauded vouchers. Although I did not know Dynarski, I contacted him and asked if he would explain the discrepancy for the readers of the blog. He graciously agreed.

He wrote:

In a recent article for Brookings, I highlighted recent research on vouchers to attend private schools that had found negative effects on student achievement. The same day, May 26, the Wall Street Journal published an editorial pointing to positive effects of school vouchers on student achievement, citing a review of studies published by researchers at the University of Arkansas. You asked if I could help readers understand the discrepancy.

In its reading of the University of Arkansas review, the Wall Street Journal included the review’s findings for voucher programs that operated in the US and programs that operated in Colombia and India. The largest positive effects of vouchers were from the program in Colombia. Education systems are quite different in other countries, however, and findings from Colombia and India have little relevance to debates about vouchers in the US today. If we ask about voucher programs that have operated in the US, the review reports that average effects of those programs is about zero.

The Louisiana and Indiana programs I focused on operated statewide. The negative effects reported for these programs could be a result of private schools being compared to higher-quality public schools in suburban and rural areas. Earlier voucher programs that reported positive results often operated in single cities—Milwaukee, New York City, Dayton, DC—which means studies of them essentially are comparing private schools only to urban public schools.

The Louisiana and Indiana programs also are recent, and my piece notes another possible explanation for their negative effects. Public schools have been under pressure for the last fifteen years to improve student achievement, which may have caused them to up their game. Recent research I cited concluded that public schools have substantially caught up with private schools. The National Assessment of Education Progress reports that private schools still have higher test scores than public schools, but those score differences could arise because of differences between private school students and public school students. The research approaches used in the Louisiana and Indiana studies allow for ‘apples to apples’ comparisons. Essentially the same students are compared in public and private schools and the test-score results favor public schools.

Vouchers will continue to be an important topic for discussion and debate, and we need to be open to new evidence and let our understanding of the world and of education be affected by it. I emphasized in my piece that our historical understanding that private schools perform better than public schools may be flawed. The University of Arkansas review is valuable for synthesizing a large amount of research on vouchers since the nineties into quantitative findings. The recent studies in Louisiana and Indiana are valuable for asking what the effects of vouchers might be today if a state were to begin a program or continue one. That the findings are negative means policymakers should proceed with caution—the relative positions of public and private schools may have changed.

I hope the discussion is useful for your readers, who rightly might feel a sense of whiplash from having different findings about vouchers released on the same day.

Kind regards,

Mark

http://www.brookings.edu/experts/dynarskim?view=bio

I hope the day comes when I will never again type the four-letter word G-R-I-T.

 

But that day has not yet arrived.

 

Here is a meta-analysis of everything that scholars have written about grit. Yes, there actually is a “Grit Literature.”

 

Personally I prefer grits. But this is serious. The National Assessment of Educational Progress has been stampeded into assessing grit on national tests.

 

Surely there are now programs and consultants selling their advice about how to incorporate grit into school lessons.

 

So maybe you might want to look over the meta-analysis, so you can discuss grit in the faculty lounge or at home.

Mark Dynarski of the Brookings Institution has published a research review in which he concluded that public schools definitely have the advantage over private schools that receive vouchers. This is especially good news because rightwing ideologues continue to argue the (non-existent) benefits of vouchers, and because Brookings had become an advocacy platform for school choice since the appointment of George W. Bush’s education research director, Grover Whitehurst to run its education center  (Whitehurst no longer runs the Brown center program at Brookings).

 

Here is the executive summary. Open the link to read the full study.

 

 

Recent research on statewide voucher programs in Louisiana and Indiana has found that public school students that received vouchers to attend private schools subsequently scored lower on reading and math tests compared to similar students that remained in public schools. The magnitudes of the negative impacts were large. These studies used rigorous research designs that allow for strong causal conclusions. And they showed that the results were not explained by the particular tests that were used or the possibility that students receiving vouchers transferred out of above-average public schools.

 

 

Another explanation is that our historical understanding of the superior performance of private schools is no longer accurate. Since the nineties, public schools have been under heavy pressure to improve test scores. Private schools were exempt from these accountability requirements. A recent study showed that public schools closed the score gap with private schools. That study did not look specifically at Louisiana and Indiana, but trends in scores on the National Assessment of Educational Progress for public school students in those states are similar to national trends.

 

 

In education as in medicine, ‘first, do no harm’ is a powerful guiding principle. A case to use taxpayer funds to send children of low-income parents to private schools is based on an expectation that the outcome will be positive. These recent findings point in the other direction. More needs to be known about long-term outcomes from these recently implemented voucher programs to make the case that they are a good investment of public funds. As well, we need to know if private schools would up their game in a scenario in which their performance with voucher students is reported publicly and subject to both regulatory and market accountability.

 

 

The executives at PARCC continue to delete Tweets (and possibly my post about the deletions, which disappeared in the middle of the night of Friday the 13, between 10:46 pm, when it was posted, and 4:45 am, when a reader informed me that it was gone).

 

Julian Vasquez Heilig decided that it would be a useful exercise for his education policy students to study these issues. He posts the disputed posts and challenges his students to examine the issues

 

Here is his assignment.

 

The question:

 

Is the analysis of PARCC tests fair use for research and scholarly purposes?

 

EduShyster interviews Joanne Golann, a doctoral student and researcher in sociology at Princeton who spent 15 months in a no-excuses charter school, studying its culture. After participating daily in the life of the school, interviewing students, teachers, and administrators. She notes that the no-excuses charter is a model of strict obedience and conformity that is widespread and focused on test scores. Teachers impose the model because it assures them control. If they let go, chaos might ensue. They can’t take that risk.

 

EduShyster asked Golann to sum up her findings, and she said:

 

“I found that in trying to prepare students for college, the school failed to teach students the skills and behaviors to help them succeed in college. In a tightly regulated environment, students learned to monitor themselves, hold back their opinions, and defer to authority. These are very different skills than the ones middle-class kids learn—to take initiative, be assertive, and negotiate with authority. Colleges expect students to take charge of their learning and to advocate for themselves. One of the students I talk about in the article learned to restrain herself to get through, to hold herself back and not speak her mind. She ended up winning the most-improved student award in 8th grade for her changed behavior…,

 

 

“If we create an educational marketplace where success is measured by student test scores, perhaps it is not altogether surprising that we end up with a rigid school model that produces these test scores. What we don’t get is a model that teaches students how to speak up or even a model that leaves students feeling like they have had a positive school experience. While charter schools were originally seen as a way to innovate, a way for communities to develop schools that might better fit their students and families, what’s come to dominate the charter field are charter management organizations and this no-excuses model. For example, in Boston, one study found that 71% of the urban charter schools subscribe to the no-excuses model. Of the high-achieving urban charters, almost all are no-excuses schools. They’ve expanded rapidly because of the support of foundations and the US Department of Education. Some $500 million in private foundation money has gone into replicating these schools….

 

EduShyster ended the interview by quoting the last line of Golann’s paper:

 

 

“EduShyster: The last line of your paper is really powerful. In fact, I’d like to take this opportunity to read it aloud so that we can all go forth pondering the essential point you make. *If teachers and administrators committed as much effort to learning about students’ families and neighborhoods as they dedicate to raising test scores or managing behavior, they might discover new ways of instruction and management to get kids to and through college, and perhaps more importantly, prepare them to ‘be the change,’ as one Dream Academy leader described.”

 

 

Three law professors studied the discipline codes at Philadelphia charter schools and concluded that these punitive codes are used to push out students who are “non-compliant or challenging.”

 

The article, which will be published in “The Urban Lawyer,” was written by Susan DeJarnatt,  Temple University – James E. Beasley School of Law; Kerrin C. Wolf, Stockton University; and Mary Kate Kalinich, Temple University – James E. Beasley School of Law.

 

The authors found that: 38% of the Philadelphia charter school codes use the phrase “zero tolerance,” 74% specify offenses for which suspension is mandatory, and 38% of the charter codes mandate expulsion for certain offenses. Approximately three-quarters of charter schools have no-excuses policies in their codes. They learned that a student may be expelled “for repeated failures to recite the school pledge on demand in English by November of the 9th grade year and in Latin by the end of the 10th grade year, for having missing homework, and for failure to upgrade a failed test.” (p. 41) They found that students may be expelled for “failure to disclose on the application that a student is a currently enrolled special education student” (p. 41). One code permits expulsion for “inappropriate facial gestures” (p. 42)

 

You can read the article in full. Here is the abstract.
Exclusionary school discipline can steer students away from educational opportunities and towards the juvenile and criminal justice systems. As many public school systems have turned to exclusionary school discipline practices over the past two decades, they have also increasingly adopted charter schools as alternatives to traditional public schools. This research is examines the student codes of conduct for the charter schools in the School District of Philadelphia to consider the role of their disciplinary practices and the potential effects on charter students.

 

We analyzed every disciplinary code provided to the Philadelphia School District by charter schools within Philadelphia during the 2014-2015 school year. Our goal was to examine the provisions relating to detention, suspension, and expulsion, along with other disciplinary responses, to determine what conduct can result in disciplinary consequences, what responses are available for various types of misbehavior, and whether the code language is clear or ambiguous or even accessible to students or potential students and their parents or caregivers. We conclude that too many of the codes are not well drafted, and too many follow models of punitive discipline that can be used to push out non-compliant or challenging students. Some codes grant almost complete discretion to school administrators to impose punitive discipline for any behavior the administrator deems problematic.

 

We hope that this work will spur future research on implementation of charter school discipline policies to illustrate how charter schools are using their codes. Further, we hope to see the charter sector develop model disciplinary codes that move away from a zero tolerance punitive model towards disciplinary systems based on restorative principles.

 

The question it implicitly poses for the reader is why it makes sense to run two public-funded school systems: one that accepts all students, the other with the power to exclude or expel those it doesn’t want. This question has strong pertinence in Philadelphia where the public school system has been stripped of funding and resources over the past decade, so that the two systems are separate and unequal.