Archives for category: Students

As the mayoral election of 2013 approaches, New York City parents and students are speaking up about what is most important to them. They got hold of an old school bus, painted it blue, and are driving around the city to raise awareness among other parents and students.

The article linked here shows how parents and their children are trying to inform voters and the candidates about their opposition to high-stakes testing and their desire for a well-rounded education, including art and music.

The low point of the article–hilarious really–is when a spokesperson for StudentsFirst, which has no roots in New York City, pooh-poohed the parents’ and students’ concerns:

“Ms. Boyd of Students First New York dismissed the bus trip. “A lot of what they’re doing is political theater, rallying parents around issues that are nuanced and complicated with not a lot of explanation, and then going forward saying, ‘Look, these are parents’ issues,’ ” she said.”

State commissioner of Education John White has outdone himself this time.

He puts forward one goofy plan after another, like sending children to schools that teach creationism and calling it “reform.”

But now he has an even nuttier idea: He wants to tie the funding for the state’s gifted high school students to their test scores. Really. No kidding.

It’s merit pay for kids.

What’s next: Tying funding for poor kids to their “performance?” Cutting their funding if they don’t get high enough test scores?

Currently the state has 10,000 students in gifted programs in high schools.

Under the present formula, they get 1.6 times the allotment as is available for those in general education.

The gifted students would take a cut to 1.3 times the regular students unless they hit the following goals:

Under the BESE-approved MFP plan students would qualify for the aid if:

“Eighth-graders score excellent on their Algebra I end of course test.
Ninth-graders score excellent on their geometry end-of-course test or 3 or higher on an Advanced Placement test, which can be used to qualify for college credit.
10th-graders score 3 or higher on an AP exam.
11th-graders score 3 or higher on an AP exam or 4 or higher on an International Bachelorette course, or IB.”

The savings would be small, but the message to students is that John White will cut their funding if they don’t get the scores he wants.

A few more big ideas like this and John White will turn Louisiana into an international laughing stock.

Unless he has already reached that goal.

The Chicago Public Schools will close about 50 elementary schools. This is the largest mass closure of public schools in U.S. history. The official announcement will be out imminently.

Approximately 90% of the children who will lose their public school are African American.

Ironically, the decision was made public soon after the release of a report saying that school closings did not save money or help children.

Here is the report by Chicago researchers:

A group of 100 or more researchers in Chicago–called CReATE– has been analyzing the issues in that city and reviewing the evidence.

Here is their brief on school closings and how they hurt children and shatter communities:

CReATE Research Brief on School Closures

When a school is closed, the facility is shut down, school staff is displaced, children are sent to other schools, and the community loses a vital resource. If Chicago Public Schools (CPS) follows the city’s Commission on School Utilization March 2013 recommendations, 80 CPS neighborhood schools (13% of the entire system) will be closed, disrupting the lives of nearly 25,000 children. CPS expects that students will need to travel an added 1 to 11⁄2 miles to get to their new schools.

Over the years, CPS has mobilized three different types of arguments to justify school closings:

underperformance, cost savings, and underutilization. We examine each of these here.

Underperforming schools

In the current round of school closures, the Chicago Public Schools has stated that it is not closing schools based on performance, but is looking strictly at the utilization of a facility. However, throughout the 2000s, the predominant justification by CPS for closing schools was the need
to shutter or turn around underperforming schools as measured by standardized test scores and attendance. It is useful to examine the evidence on how these recent school closures impacted student academic performance in Chicago. This can give us insight on what can be expected with the future round of closures.

Students from turnaround or closed CPS schools who moved to academically stronger schools, and/or schools with strong student-teacher relationships, experienced the greatest gains from school closures.1 However, the reality of school closures in the CPS system suggests that students accessing academically stronger schools are the exception, not the rule. A 2009 study by the University of Chicago Consortium on Chicago School Research (CCSR) found that 82% of students from 18 elementary schools closed in Chicago moved from one underperforming school
to another underperforming school, including schools already on probation.2 In a follow up 2012 report, the CCSR determined that 94% of students from closed Chicago schools did not go to “academically strong” new schools.3 According to the 2009 CCSR study, “One year after students left their closed schools, their achievement in reading and math was not significantly different from what we would have expected had their schools not been closed.”4 The authors conclude that, overall, there were no significant positive or negative effects on academic achievement resulting from the closure when students transferred to comparable schools.

On the other hand, a study by Kirshner, Gaertner, and Pozzoboni (2010) contradicts the no-effect findings when examining comparable transition schools.5 The authors found that students who transitioned into new schools following closure scored lower on tests one year after closure; they were at an increased risk of dropping out, as well as an increased risk of not graduating. Interview data from this study suggests closure was viewed negatively by transitioning students and imposed a stigma upon them that followed them into their new schools. The researchers found that test score trends on standardized tests for transfer students declined after the closure was announced.

Test scores for students from the cohort that transferred to other schools continued to decline for two standardized test administrations after the closure announcement.

School closings will also negatively affect the achievement levels for students in the receiving schools. A Michigan State University study found that “while the closing of low-performing schools may generate some achievement gains for displaced students, part of these gains will likely be offset by spillover effects onto receiving schools.” For one thing, closings often lead to increased class sizes and overcrowding in receiving schools. As a result, the pace of instruction is slower and the test scores of both mobile students and non-mobile students tend to be lower in schools with high student mobility rates. One study comparing the curricular pace of stable schools and highly mobile schools in Chicago found that highly mobile schools lagged behind stable schools by one grade level on average.6

In various cities, school closures have led to several negative experiences for displaced students, including a doubling of the likelihood of dropping out of school, increased school violence, lowered likelihood of enrolling in summer school programs in the summer following school closure, higher rates of school-to-school mobility, disrupted peer relationships, and weaker relationships
with adults.7

Closures disrupted relationships students had established with adults and other students at their closed schools, leaving the students with few social and emotional supports to help them adjust to the challenges of the new school.8

Underutilization and cost savings

In the current round of school closures, Chicago Public Schools leaders have changed tack and instead are focused on saving the district money by closing underutilized schools. CPS claims they are facing a $1 billion deficit in their budget for the school year 2013-2014. However, CPS’s past history of budgeting should give caution. Comprehensive Annual Financial Reports from the school years 2011-2012 and 2010-2011 show that CPS has a recent history of overstating their budget troubles. In the 2011-2012 school year, the Chicago Board of Education (BOE) approved a budget with a $214 million deficit. However, CPS ended the school year with a $328 million surplus. And again, the BOE approved a budget anticipating a $245 million deficit for the 2010-2011 school year, but the district ended that school year with a $328 million surplus. In both cases CPS’s budgeting was off by $500 million dollars.9

Nonetheless, CPS estimates that they will save between $500,000 to $800,000 annually for each school closed. According to these estimates, if CPS closes up to 80 schools, it will gain between $40 million and $64 million from savings achieved by avoiding building upkeep and operational expenditures like heat and daily maintenance.10

CPS’s estimates of how much they will save on closures are based on the assumption that CPS can lease, sell or repurpose 50% of the shuttered buildings. CPS is already having difficulty disposing of the schools they have already closed. A Pew report determined that the City of Chicago was only able to sell, lease or repurpose 17 of its closed school buildings between 2005-2012. During that same time, 24 closed school properties remained on the market, constituting 58% of the CPS closed school properties that had originally been placed on the market.11

This is consistent with nationwide trends. Another 2011 Pew report summarizing the research on school closings in six cities showed that school closures did not save the school districts as much money as was hoped. In addition to the inability of these districts to sell or lease their properties, closure-related costs cut further into savings, as districts found themselves paying for closed school site maintenance or demolition, moving services, and support for both displaced students and the schools that received them.12 Closures have many upfront and, in some cases, hidden costs, as a recent audit of the 2008 Washington D.C. school closures conducted by the Office of the D.C. Auditor underscores. The audit determined that instead of saving the district $30 million, as claimed by former schools chancellor Michelle Rhee, the closures actually cost the city $40 million after factoring in the expense of demolishing buildings, removing furnishings, and transporting students. Further, the district lost another. $5 million in federal and state grants as students left the system, many to the charter schools being built in tandem with the closings.13

Chicago Public Schools claims that Chicago’s population loss is the reason why schools are underutilized. CPS officials point to Chicago’s population loss over the last decade (resulting in 144,035 fewer children living in Chicago from 2000 to 2010) as creating 139,000 empty seats in CPS. However, according to a WBEZ analysis of CPS’s Racial/Ethnic Survey data, the school system only reported a loss of 31,500 students during this period.14

Utilization is based on the physical size of a school and the number of students occupying a classroom. The Chicago Board of Education has determined that 30 children in a classroom is the ideal or most efficient class size for Kindergarten through eighth-grade classes. Classrooms under 30 students are deemed underutilized. By these standards, CPS estimates that 50% of its neighborhood schools are underutilized, and nearly 140 are half empty.

It is questionable whether 30 students per class should be the standard for the ideal utilization of a classroom. The Student Teacher Achievement Ratio (STAR) program initiated in Tennessee in the late 1980s has yielded the most comprehensive and credible studies on the impact of class sizes. In the STAR program, students and teachers were randomly assigned to two types of classes: a small class with an average of 15 students or a regular class with an average of 22 students. After four years, researchers determined that the difference of seven students had significant impacts on student achievement. Students from the smaller classes outperformed students from larger classes by the equivalent of three additional months of schooling in the first year.15 Studies of STAR also determined that African American students, lower- income students, and students from urban areas benefitted the most from smaller class sizes.16

Additionally, CPS’s calculations of utilization fail to account for students with disabilities, although in many of the targeted schools 20- 30% of students are challenged by a learning disability. These students require a class size of 10 to 15 students, but the 30-student formula does not take this into consideration.

Relation between closures and charters

Chicago Public Schools and charter schools operators consistently claim that school closures have nothing to do with charter schools and that CPS will not repurpose the closed schools into charter schools. Briefly, charter schools are funded with public money but are privately operated (either by for-profits or non-profits) and therefore are removed from public decision-making processes. Charters are not accountable to the elected Local School Councils made up of teachers, parents and community members Instead, an unelected Board of Directors helms each charter school. Charter schools admit students from across the city and select their students by an application process, test scores, and/or lottery draw. As such, charter schools do not have to admit the local neighborhood children.17 Charter schools also have a history of excluding students with learning disabilities and special needs, expelling students for discipline policy violations at higher rates than CPS, and excluding poor test takers and English Language Learners.18

Advocates of charter schools claim that the lack of union and public involvement allows the schools to innovate and elevate academic performance. This claim does not hold under scrutiny. According to CPS’s own data, an average charter school performs 10 percentile points below comparable (in terms of racial composition and number of students qualifying for Free or Reduced Lunches) traditional schools on reading test scores.19 Charters also consistently underperform by 12 percentile points on reading and 2 percentile points on math test scores relative to comparable public magnet schools.20

There are many reasons to believe that school closures are directly related to the expansion of the charter school system. First, the budget deficit, in part, can be attributed to the costs of expanding the charter school system. In FY 2012, $350 million was budgeted for the Office of New Schools, the office devoted to developing new charter and contract schools. For the upcoming fiscal year, CPS allocated an additional $23 million to fund new charter schools, nearly half of what they estimate they will save if they close 80 neighborhood schools. In addition, the United Neighborhood Organization (UNO) was successful in lobbying the Illinois General Assembly for an additional $35 million to expand their charter school network in 2012, at a time when the state cut over $200 million from the public school budget.

Second, there is a strong local and national trend of converting closed public schools into privately operated charter schools. Forty-two percent of all closed public schools across the U.S. have been turned into charter schools. Chicago parallels that trend, with 40% of its closed public schools converted into privately operated charter schools. 21 Moreover, the reopened charter schools did not necessarily benefit neighborhood children. A study of closed neighborhood schools that were reopened as charter schools in Chicago showed a transformation in the student body attending these reopened schools. The new students tended to be more affluent, with higher prior achievement, and fewer of them had special needs. The schools also served fewer students from the neighborhoods in which the schools were situated. 22

Additionally, charters do not save the district money. CPS compensates organizations for approximately 75% of charter schools’ operational expenses. Charters also receive funds from a combination of state and federal grants, non-profit grants and fund raising. In addition, many of the charter replacement schools lease their school building from the district. When examining the lease agreements between CPS and various charter schools, the Chicago Teachers Union found that CPS leased a significant number of the public buildings to privately operated charter schools for just $1.23

Third, Chicago Public Schools currently has plans to expand their charter system. In 2012, CPS signed the Gates Compact with the Bill and Melinda Gates Foundation (a non-profit that financially supports the expansion of charter schools). As part of the Gates Compact, CPS pledged to open an additional 60 charter schools in the near future. Already CPS has plans to open 13 new charters in 2013, despite their claim that the system is underutilized. If the future location of charter schools mirrors the existing trends, then the new charter schools will be located in the neighborhoods facing traditional public school closures (see below).

Fourth, charter schools have created the conditions under which traditional neighborhood schools are considered underutilized. CPS has allowed charter schools to proliferate and absorb nearly 53,000 children into their system as of 2013, up from just 5,525 students
who attended charter schools in 2000.24 Furthermore, the district added more charter schools to the system at precisely the time it was experiencing declining enrollment. For example, in 2000, CPS had 432,000 students and 597 schools. In the current school year, CPS has 403,000 students and 681 schools. In this way, the proliferation of charter schools is a significant contributor to the underutilization that those CPS schools in danger of closure may be experiencing.25

Finally, the people in charge of the closure process and Chicago Public Schools leadership are supporters of charter school expansion. The current CPS CEO, Barbara Byrd- Bennett, is a Broad Foundation executive coach, training superintendents in the principles of business model
school reform. The Broad Foundation invests millions in transforming schools into more privately controlled entities and seeks to train the next generation of leaders to realize the charter school takeover of the public schools.

A recent memo issued by the Foundation proposes what the Washington Post quotes as “a series of strategic shifts in the foundation’s education programs designed to ‘accelerate’ the pace of ‘disruptive’ and ‘transformational’ change in big city school districts.”26 The Broad Foundation released a 2009 report detailing the political tactics and strategies public officials should employ when conducting mass school closures. We see many of their recommendations implemented in this current round of school closures in Chicago, including: using the language of how a school is designed for X number of children but only Y number are using it; emphasizing declining enrollment; stating that the current use is an inefficient utilization of facilities; and insisting that closures will allow officials to “right-size” the system.27 Additionally, CPS’ communications department acknowledged that the Walton Foundation, founded by the family who owns Wal-Mart, gave CPS a grant for $478,000 to finance the community engagement process around the “utilization crisis.”28

The Walton Foundation is an avid supporter of charter school proliferation, giving $700 million to “choice” schools in a bid to transform public education into a privately controlled domain.

Racial Disparities of School Closings

School closures are especially contentious in Chicago as they disproportionately affect working-class communities of color.29 Since 2001, 98 of the 100 schools being closed or phased out in Chicago have been located in predominantly African American and Latino communities.30 Of the 129 schools CPS identified as underutilized in February 2013, 88% of the students attending these schools are African American, with 103 of the schools composed of a student body that was over 90% African American. Nine of the 129 schools have student bodies that are predominantly Latino.31

Disinvestment in public schools and empty buildings will deepen the hardship confronting neighborhoods already suffering from community disinvestment and may contribute to even further population loss of African Americans in Chicago. For example, WBEZ aggregated data on abandoned properties, city-owned vacant lots, and community area census figures from the city’s data portal site, and mapped them on top of the locations of the schools targeted for potential closure.32 They found that school closures directly correspond to the locations of troubled mortgages, foreclosures, and population loss. Closing neighborhood schools will discourage people from moving back into these disinvested communities. Furthermore, closures may exacerbate tensions between communities and lead to violence. Since 2004, school closures that transfer students to schools outside their immediate neighborhoods have resulted in spikes of violence in and around elementary and high schools.33 We strongly caution policy makers to consider the added stressors that closures bring to these communities.

School closures also disproportionately impact African American teachers. The Chicago Teachers Union reports that African Americans made up nearly 40% of all CPS teachers in the 1990s. By 2012, that proportion was reduced to under 20%.34 In previous rounds of Chicago school closings, 65% of the teachers displaced were African American women.35 A 2012 report by the Consortium
on Chicago School Research on school closings and turnarounds determined that, “The teacher workforce after intervention across all models was more likely to be white, younger, and less experienced, and was more likely to have provisional certification than the teachers who were at those schools before the intervention.”36

Conclusion
At present, the data reviewed in this research brief does not support Chicago Public Schools’ claim that closures are a viable solution to the current issues in the district. Instead, their greatest potential is to inflict deeper harm on African American and Latino/a communities. In addition to the current issues of privatization (via charter school
expansion) and displacement, massive school closings
are poised to continue the legacy of mass displacement, marginalization and isolation of low-income communities of color in Chicago. Contributing to our concern is the revelation by the Chicago Sun-Times that Tom Tyrell, a former Marine colonel whose military credentials include hostage negotiation in the war in Kosovo, has been appointed by CPS as the official in charge of administering school closings. As CReATE, we are charged to pose the following question: If CPS has hired a former military official to administer school closings, what is the assumption of the central office regarding the potential of conflict if the closures are implemented? In so doing, we predict a heavy-handed response from law enforcement if the current closures, which do not even serve their stated purposes, are implemented.

Notes

1 de La Torre, M., & Gwynne, J. (2009). When schools
close: Effects on displaced students in Chicago Public Schools. Chicago, IL: Consortium on Chicago School Research. Accessed at http://ccsr.uchicago.edu/sites/default/files/ publications /CCSRSchoolClosings-Final.pdf; Engberg, J., Epple, D., Gill, B., & Sieg, H. (March, 2011). Closing schools in a shrinking district: Does student performance depend on which schools are closed? Conference presentation at the American Education Finance and Policy Conference, Seattle, Washington. Accessed at http://www.sree.org/ conferences/2011/program/downloads/abstracts/34.pdf.
2 de La Torre & Gwynne, 2009.
3 de la Torre, M., Allensworth, E., Jagesic, S., Sebastian, J.,
Salmonowicz, M., Meyers, C., & Gerdeman, R. D. (2012). Turning around low-performing schools in Chicago. Chicago, IL: University of Chicago Consortium on Chicago School Research and American Institutes for Research.
4 Ibid., p. 2.
5 Kirshner, B., Gaertner, M., & Pozzoboni, K. (2010). Tracing
transitions. Educational Evaluation and Policy Analysis, 32(3), 407-429; Lipman, P. (2011). The new political economy of urban education: Neoliberalism, race, and the right to the city. New York, NY: Routledge.
6 Sunderman, G. L. & Payne, A. (2009). Does closing schools cause educational harm? Information Brief for the Mid- Atlantic Equity Center.
7 Dowdall, E. (2011). Closing public schools in Philadelphia: Lessons from six urban districts. Philadelphia, PA: Pew Charitable Trust Philadelphia Research Initiative. Retrieved from http://www.pewtrusts.org/uploadedFiles/ wwwpewtrustsorg/Reports/Philadelphia_Research_Initiative/ Closing-Public-Schools-Philadelphia.pdf; de La Torre & Gwynne, 2009; Kirshner et. al, 2010; Lipman, 2011.
8 Kirshner et. al, 2010.
9 Lewis, K. (2013, January 28). Extra! Extra! The curious tale of
the CPS “press release” budget [Web log post]. Accessed at http://www.ctunet.com/blog/extra-extra-the-curious-tale-of- the-cps-press-release-budget
10 Lutton, L., & Vevea, B. (2012, December 10). Truth squad: Enrollment down in CPS, but not by much. WBEZ. Accessed at http://www.wbez.org/news/truth-squad-enrollment-down- cps-not-much-104297
Disinvestment in public schools and empty buildings will deepen the hardship confronting neighborhoods already suffering from community disinvestment and may contribute to even further population loss of African Americans in Chicago. For example, WBEZ aggregated data on abandoned properties, city-owned vacant lots, and community area census figures from the city’s data portal site, and mapped them on top of the locations of the schools targeted for potential closure.32 They found that school closures directly correspond to the locations of troubled mortgages, foreclosures, and population loss. Closing neighborhood schools will discourage people from moving back into these disinvested communities. Furthermore, closures may exacerbate tensions between communities and lead to violence. Since 2004, school closures that transfer students to schools outside their immediate neighborhoods have resulted in spikes of violence in and around elementary and high schools.33 We strongly caution policy makers to consider the added stressors that closures bring to these communities.
School closures also disproportionately impact African American teachers. The Chicago Teachers Union reports that African Americans made up nearly 40% of all CPS teachers in the 1990s. By 2012, that proportion was reduced to under 20%.34 In previous rounds of Chicago school closings, 65% of the teachers displaced were African American women.35 A 2012 report by the Consortium
on Chicago School Research on school closings and turnarounds determined that, “The teacher workforce after intervention across all models was more likely to be white, younger, and less experienced, and was more likely to have provisional certification than the teachers who were at those schools before the intervention.”36

Conclusion

At present, the data reviewed in this research brief does not support Chicago Public Schools’ claim that closures are a viable solution to the current issues in the district. Instead, their greatest potential is to inflict deeper harm on African American and Latino/a communities. In addition to the current issues of privatization (via charter school expansion) and displacement, massive school closings
are poised to continue the legacy of mass displacement, marginalization and isolation of low-income communities of color in Chicago. Contributing to our concern is the revelation by the Chicago Sun-Times that Tom Tyrell,
a former Marine colonel whose military credentials include hostage negotiation in the war in Kosovo, has been appointed by CPS as the official in charge of administering school closings. As CReATE, we are charged to pose the following question: If CPS has hired a former military official to administer school closings, what is the assumption of the central office regarding the potential of conflict if the closures are implemented? In so doing, we predict a heavy-handed response from law enforcement if the current closures, which do not even serve their stated purposes, are implemented.

Notes

1 de La Torre, M., & Gwynne, J. (2009). When schools
close: Effects on displaced students in Chicago Public Schools. Chicago, IL: Consortium on Chicago School Research. Accessed at http://ccsr.uchicago.edu/sites/default/files/ publications /CCSRSchoolClosings-Final.pdf; Engberg, J., Epple, D., Gill, B., & Sieg, H. (March, 2011). Closing schools in a shrinking district: Does student performance depend on which schools are closed? Conference presentation at the American Education Finance and Policy Conference, Seattle, Washington. Accessed at http://www.sree.org/ conferences/2011/program/downloads/abstracts/34.pdf.
2 de La Torre & Gwynne, 2009.
3 de la Torre, M., Allensworth, E., Jagesic, S., Sebastian, J.,
Salmonowicz, M., Meyers, C., & Gerdeman, R. D. (2012). Turning around low-performing schools in Chicago. Chicago, IL: University of Chicago Consortium on Chicago School Research and American Institutes for Research.
4 Ibid., p. 2.
5 Kirshner, B., Gaertner, M., & Pozzoboni, K. (2010). Tracing
transitions. Educational Evaluation and Policy Analysis, 32(3), 407-429; Lipman, P. (2011). The new political economy of urban education: Neoliberalism, race, and the right to the city. New York, NY: Routledge.
6 Sunderman, G. L. & Payne, A. (2009). Does closing schools cause educational harm? Information Brief for the Mid- Atlantic Equity Center.
7 Dowdall, E. (2011). Closing public schools in Philadelphia: Lessons from six urban districts. Philadelphia, PA: Pew Charitable Trust Philadelphia Research Initiative. Retrieved from http://www.pewtrusts.org/uploadedFiles/ wwwpewtrustsorg/Reports/Philadelphia_Research_Initiative/ Closing-Public-Schools-Philadelphia.pdf; de La Torre & Gwynne, 2009; Kirshner et. al, 2010; Lipman, 2011.
8 Kirshner et. al, 2010.
9 Lewis, K. (2013, January 28). Extra! Extra! The curious tale of
the CPS “press release” budget [Web log post]. Accessed at http://www.ctunet.com/blog/extra-extra-the-curious-tale-of- the-cps-press-release-budget
10 Lutton, L., & Vevea, B. (2012, December 10). Truth squad: Enrollment down in CPS, but not by much. WBEZ. Accessed at http://www.wbez.org/news/truth-squad-enrollment-down- cps-not-much-104297

11 Dowdall, E., & Warner, S. (2013). Shuttered public schools: The struggle to bring old buildings new life. Philadelphia, PA: The Pew Charitable Trust Philadelphia Research Initiative.
12 Dowdall, E. (2011). Closing public schools in Philadelphia: Lessons from six urban districts. Philadelphia, PA: Pew Charitable Trust Philadelphia Research Initiative. Accessed
at http://www.pewtrusts.org/uploadedFiles/wwwpewtrustsorg/ Reports/Philadelphia_ Research_Initiative/Closing-Public- Schools-Philadelphia.pdf
13 Office of the D.C. Auditor. (2012). Audit of the closure and consolidation of 23 D.C. public schools. September 6.
14 Kattan, W. (2013). Letter to Barbara Byrd-Bennett. Raise Your Hand. Accessed at http://ilraiseyourhand.org/content/ letter-barbara-byrd-bennett
15 Krueger, A. B. (1999). Experimental estimates of education production functions. Quarterly Journal of Economics, 115(2), 497–532.
16 Krueger, 1999; Nye, B., Hedges, L. V., & Konstantopoulos, S. (2000). Do the disadvantaged benefit from the small classes? Evidence from the Tennessee class size experiment. American Journal of Education, 109, 1–26.
17 Vevea, B., Lutton, L., & Karp, S. (2013, January 15).
Map: 40 percent of closed schools now privately run.
Catalyst Chicago. Accessed at http://www.catalyst-chicago. org/news/2013/01/15/20741/map-40-percent-closed-schools- now-privately-run
18 Lipman, 2011.
19 Caref, C., Hainds, S., Hilgendorf, K., Jankov, P., & Russell,
K., (2013). The black and white of education in Chicago’s public schools. Report for the Chicago Teachers Union. Ac cessed at http://www.ctunet.com/blog/the-black-and-white- of-education-in-chicagos-public-schools
20 Ibid.
21 The Pew Charitable Trusts, 2013.
22 de la Torre et al., 2012.
23 Caref et al., 2013.
24 Lutton & Vevea, 2012.
25 As Lutton and Vevea (2012) show, although the City of
Chicago has experienced population loss, a higher percentage of Chicago kids are attending CPS schools: from 69% of all Chicago children attending CPS in 2000 to 79% of all Chicago children attending CPS in 2010.
26 Libby, K., & Karp, S. (2012, August 21). Broad Foundation’s plan to expand influence in school reform. Washington Post. Accessed at http://www.washingtonpost.com/blogs/answer- sheet/post/broad-foundationsplan-to-expand-influence- in-school-reform/2012/08/20/c118e134-eb0a-11e1-b811- 09036bcb182b_blog.html
27 Raise Your Hand. (2013). Right-sizing the district: A page out of the 2009 Broad Foundation Handbook [Web log post]. Accessed at http://ilraiseyourhand.org/node/2363
28 Karp, S. (2013, January 30). For the record: Walton Foundation funds community engagement. Catalyst Chicago. Accessed at http://www.catalyst-chicago.org/ notebook/2013/01/30/20778/record-walton-foundation- funds-community-engagement
29 Fleming, J., Greenlee, A., Gutstein, E., Lipman, P., & Smith, J. (2009). Examining CPS’ plan to close, phase out, consolidate, and turn-around 22 schools (Paper #2). Data and Democracy Project: Investing in Neighborhoods.
Chicago, IL: Collaborative for Equity and Justice in Education, College of Education, University of Illinois Chicago.
30 Caref et al., 2013.
31 Fitzpatrick, L., & Golab, A. (2013, March 6). Black students
most likely to have their school on CPS closure list. Chicago Sun-Times.
32 Ramos, E. (2013, February 18). Which comes first? Closed schools or blighted neighborhoods? WBEZ. Accessed at http://www.wbez.org/news/which-comes-first-closed-schools- or-blighted-neighborhoods-105511
33 Fleming et al., 2009. 34 Caref et al., 2013.
35 Caref et al., 2013.
36 de la Torre et al., 2012.

FOR MORE INFORMATION ON CReATE reports, activities, or membership, please contact createchicago@gmail.com

This briefing paper was prepared by Stephanie Farmer, Isaura Pulido, Pamela J. Konkol, Kate Phillippo, David Stovall and Mike Klonsky.

CReATE

Public education in a democratic society is based on the principle that every child is of equal and incalculable value. This guiding principle requires the fullest development of every member
of our nation. Effective public schools are necessary to enable every member of our nation to reach his or her fullest potential. Schools in a democracy aim to prepare the next generation to
be knowledgeable and informed citizens and residents; to be critical thinkers and creative problem solvers; to be prepared to contribute positively to communities, workplaces, and societies that are characterized by diversity and inequities; and to be healthy, happy, and prepared to support the well-being of others with compassion and courage. The children and youth of Chicago deserve no less.
CReATE, a volunteer group of Chicago-area education researchers, conducts, reviews, and distributes studies to address the needs of our students, parents and schools, and promotes citywide learning and dialogue about educational issues through free public events. CReATE partners with educators, public interest groups and community-based organizations. Our university-based scholars and educational workers are available for comment and discussion on topics raised here and in our policy statement, available online at: http://createchicago.blogspot.com

Tom Sgouros, an engineer, wrote an open letter to the chair of the Rhode Island Department of Education, explaining succinctly why NECAP should not be used as a graduation test. It was not designed for that purpose. It will fail students who deserve to pass.

Anyone who reads and understands this letter will recognize that using NECAP for a graduation test is educational malpractice. If they persist in the face of clear evidence to harm children, they should resign or be fired.

The open letter:

Open Letter About NECAP To Eva Mancuso

By Tom Sgouros on March 14, 2013

Eva Marie Mancuso, Chair,
Rhode Island Board of Education,
Rhode Island Department of Education,
225 Westminster Street,
Providence RI 02903

Dear Ms. Mancuso:

I read with interest in this morning’s news about the Providence School Board’s suggestion to the Board that you not rely on the NECAP test as a graduation requirement. I would like to second that suggestion, and offer some words of explanation that I believe have been largely absent from the debate until now.

The Providence board points out that the NECAP test was “not designed” to be a graduation requirement. That is quite true, but few go on to say why that makes it inappropriate to use as performance threshold for graduating students.

First, a little about me. I have worked as a freelance engineer and policy analyst for 30 years, and both occupations have required me to acquire an expertise in statistics. I speak not as a statistical layman, but as an expert hoping to translate important concepts for people who may not have deep familiarity with p-values and confidence intervals. I do not wish to condescend, but I am afraid that some basic statistical concepts have not been well understood by policy makers in the past, and consequently decisions have been made that are deeply damaging to our students, and to education in Rhode Island generally.

The important point I wish the board members to understand is what exactly is the difference between a test like NECAP, designed to rank schools and students, and a test designed to evaluate student proficiency. The short version: when you design a test like NECAP, test designers ensure that a certain number of students will flunk. What’s more, for the purposes of the test designers, that’s a good thing.

Here’s the longer version. The original goal of NECAP was to evaluate schools, and, to some extent, students within the schools. In order to make a reliable ranking among schools, you need to ensure that the differences between one school and another (or one student and another) is statistically significant. This is simply how you ensure that the rankings are the result of real differences between schools, and not the result of chance.

A traditional test, such as the final exam a teacher might give to her class at the end of the term, will likely enough have a distribution of grades that looks something like the graph below. (I use a class size of 5000 here. This is obviously a lot of students for a single class, but only a fraction of the number who take the NECAP tests.)

Suppose the teacher set the passing grade at 70, then about 4% of her students failed the class. That’s a shame, but it’s not unusual, and those students will have to take the class again or take the test again or whatever. If the goal is to see which of the students in the class have properly understood the material, this is a useful result.

But if the goal was to rank the students’ performance, this result won’t help much. A very large number of students scored between 80 and 84. In the graph, 1200 students, a quarter of the population, have almost the same score, and 6% of them have exactly the same score, 83. How can you rank them?

Furthermore, like any other measurement, a test score has an inherent error. For any individual student, a teacher can have little confidence that a student who scored an 80 didn’t deserve an 84 because of a bad day, a careless mistake, or, worse, someone else’s error: a misunderstood instruction, an incomplete erasure, or a grading mistake. Of course, any errors could also move the score in the other direction.

The problem is that moving a student’s score from 80 to 84 moves the student from the 18th percentile to the 38th, a huge jump. In other words, a test score might rank a student in the 18th percentile, but one can have no confidence that he or she didn’t belong in the 38th — or the 5th. Conversely, a student in the 92d percentile might really belong in the 69th or the 99th, depending on the same four-point error.

The designers of tests understand this, and so try to avoid ranking students based on the results of tests that give distributions like the above. Instead, they try to design tests so the distribution of scores looks more like the one here:

With a test that gives results like this, there are many fewer students in most of the score ranges here. Assuming the same level of error, you can be much more sure that a student who scored in some percentile belongs there, or nearby. With the same four-point error as above, you can be confident — in the statistical sense — that a student who scored in the 18th percentile on this test belongs somewhere in between the 14th and 22d percentiles, a much smaller range. A student in the 92d percentile belongs somewhere between the 89th and 95th percentile.

In other words, if a test designer wants to rank students, or schools, he or she designs the test to spread the scores out. You don’t want scores to be bunched up. This is confirmed by details provided in the technical manuals that document the test design process. For example, in section 5.1 of the NECAP 2011-2012 technical report (“Classical Difficulty and Discrimination Indices”)

“Items that are answered correctly by almost all students provide little information about differences in student abilities, but do indicate knowledge or skills that have been mastered by most students. Similarly, items that are correctly answered by very few students provide little information about differences in student abilities, but may indicate knowledge or skills that have not yet been mastered by most students.”

This section goes on to discuss how the designers evaluate test items for their capacity to discriminate among students, and demonstrates that most of the questions used in the various NECAP tests do exactly that. In other words, very few of the questions are correctly answered by all students. In Appendix F of the 2011-12 manual, you can see some item-level analyses. There, one can read that, of the 22 test questions analyzed, there are no questions on the 11th grade math test correctly answered by more than 80% of students, and only nine out of 22 were correctly answered by more than half the students.

Contrast this with the other kind of test design. In the first graph above, even the students who flunked the test would have answered around 60% of the questions correctly. The NECAP designers would deem those questions to “provide little information about differences in student abilities.” According to this theory of test design, such questions are a waste of time, except to the extent that they might be included to “ensure sufficient content coverage.” Put another way, if all the students in a grade answered all the questions properly, the NECAP designers would consider that test to be flawed and redesign it so that doesn’t happen. Much of the technical manual, especially chapters 5 and 6 (and most of the appendices), are devoted to demonstrating that the NECAP test is not flawed in this way. Again, the NECAP test is specifically designed to flunk a substantial proportion of students who take it, though this is admittedly a crude way to put it.

11th Grade Math Before leaving the subject of students flunking the NECAP tests, it’s worth taking a moment to consider the 11th grade math test specifically. Once the NECAP test was designed, the NECAP designers convened panels of educators to determine the “cut scores” to be used to delineate “proficiency.” The process is described in appendices to the technical manual:

Standard

Grades 5–8, in Appendix D, 2005-06 report
Grade 11, in Appendix F, 2007-08 report
Grades 5 & 8 Writing in Appendix M, 2010-11 report

After consulting these appendices, you will see that — at the time they were chosen — the cut scores for the 11th grade math test put 46.5% of all test takers in the “substantially below proficient” category (see page 19 of Appendix F 2007-08). This is almost four times as many students as were in that category for the 11th grade reading test and more than twice as many for any other NECAP test in the other grades.

There is no reason to think that the discussions among the panels that came up with these cut scores were not sincere, nor to think that the levels chosen not appropriate. However, it is worth noting that the tests occur almost two years before a student’s graduation, and that math education proceeds in a fundamentally different way than reading. That is, anyone who can read at all can make a stab at reading material beyond their grade level, but you can’t solve a quadratic equation halfway.

Rather than providing a measure of student competence on graduation, the test might instead be providing a measurement of the pace of math education in the final two years of high school. The NECAP test designers would doubtless be able to design questions or testing protocols to differentiate between a good student who hasn’t hit the material yet, or a poor student who shouldn’t graduate, but they were not tasked with doing that, and so did not.

Testing

To be quite clear, I am not an opponent of testing, nor even an opponent of high- stakes testing. The current testing regime has produced a backlash against testing in a general way, but this is a case where bad policy has produced bad politics. It’s hard to imagine running something as complex as a school department in the absence of some kind of indicator of how well one is running it. Since educated students are the output, it is crucial to the success of the overall enterprise that we find some way to measure progress in improving that level of education.

Similarly, high-stakes graduation tests are hardly anathema. Over the past half-century, the entire nation of France has done very well with a high-stakes test at high school graduation. Closer to home, the New York State Regents’ tests are a model that many other states would do well to copy. There is nothing wrong with “teaching to the test” when the test is part of a well-designed and interesting curriculum.

However, if evaluation of progress is the goal, and if you want an accurate measurement of how well a school is doing, there is a vast body of evidence available to say that high stakes testing won’t provide that. When there are severe professional consequences for teachers and school administrators whose classes and schools perform badly on tests, you guarantee that the tests will provide only a cloudy indication of a school’s progress. Teaching to the test is only one of the possible sins. School systems across the country have seen cheating scandals, as well as such interesting strategies as manipulating school lunch menus to improve test performance. In other words, raising the stakes of a test almost certainly makes the test a worse indicator of the very things it is supposed to measure.

Furthermore, a sensible evaluation regime would be minimally intrusive, and take only a small amount of time away from instruction. After all, testing time is time during which no instruction happens. But the imposition of high stakes have rendered that nearly impossible, so instead, we have tests that disrupt several weeks of classes in most school districts, not to mention the disruption to the curriculum it has caused.

Unfortunately for the students of Rhode Island, our state has tried to take the easy way out, and use a test designed for evaluation to serve many purposes. Today, the NECAP test affects the careers of students, teachers, and administrators. It is used in a high-stakes way which guarantees that it is an inaccurate indicator of the very things it is supposed to measure. It is used for purposes far beyond its original design, producing perfectly needless pain and heartbreak across the state.

Worst of all, none of this is news to education professionals. They know how to read technical manuals and to sort through statistical exegeses of test results. They know about the harm done to students by cutting electives to focus on improving reading results. They know about the other corners cut to try to improve test results at all costs. They know that we don’t abuse the NECAP test in order to help students. They know we did this strictly to save money.

I urge you and the new education board to reconsider the state’s use — and abuse — of the NECAP test. It could be a valuable tool with which to understand how to improve education in our state. Unfortunately, poor decisions made in the past have done much to undermine that value, to our state’s detriment, and that of all the students in our schools.

Yours sincerely,

Tom Sgouros

Rating: 10.0/10 (2 votes cast)

Related posts:
NECAP Grad Requirement Trumps Good Grades
Students Call On Chafee To Stop High Stakes Tests
Protest High-Stakes Testing Wednesday At State House
Why High Stakes Tests Shouldn’t Grade Students
Why you can’t simply can’t trust Education Reformers with the facts
Posted in Education, Featured | Tagged Education, gist, mancuso, necap, tsgouros | 5 Responses

Tom Sgouros
Tom Sgouros is a freelance engineer, policy analyst, and writer. Reach him at ripr@whatcheer.net. Buy his book, “Ten Things You Don’t Know About Rhode Island” at whatcheer.net
5 responses to “Open Letter About NECAP To Eva Mancuso”

tom_hoffman March 14, 2013 at 10:51 am | Permalink | Log in to reply.
Good work, Tom. I hadn’t dug into how the cut scores were set, but it is plainly obvious from the results across three states that the 11th grade math is just way, way, harder to pass than the rest of the tests.

Rating: 0 (from 0 votes)

Walt48 March 14, 2013 at 2:18 pm | Permalink | Log in to reply.
I am afraid. Why do I think that we now have a Queen Ghidorah that devoured Rhode Island at hand (Raimondo, Gist and Mancuso)?

Bill Daly March 14, 2013 at 3:44 pm | Permalink | Log in to reply.
Tom, thank you for a well reasoned analysis. School Committees throughout the state should follow the example of the Providence School Committee and register their disatisfaction with the statistically flawed NECAP test. As you point out it was never designed by the test developers to serve as a graduation requirement.

leekhat March 15, 2013 at 8:56 am | Permalink | Log in to reply.
A great letter. I did not know some of that information, but, as an educator who is experiencing some of the pain of state ed reform initiatives, I will be educating all who will listen about NECAP test design and it’s intended use. I am also relieved that the Providence School Committee is confronting this issue and also hope that other school committees give this some thought.
Mark Williams
NKHS

Beleaguered Teacher March 17, 2013 at 11:12 am | Permalink | Log in to reply.
Thank you, Mr. Sgouros, for a cogent and coherent explanation. It gives me hope to know that there are individuals out there do who, indeed, “get it”. May I respectfully suggest that you share it with the newspapers, in order to reach a wider audience?

Joy Resmovits reports on Huffington Post that Moody’s rating service is happy about the school closures in Philadelphia. She writes;0:

“School Closures: Good For Wall Street? Philadelphia recently voted to close 23 schools, and a Moody’s analyst thinks that the move, which frees up privately-run charter organizations to set up shop, is a good thing financially. Why? The analyst writes that it shows the district is willing to cut costs even when faced with tremendous opposition. “The SRC has introduced deep expenditure cuts over the past 18 months, reducing a fiscal 2012 deficit of $720 million to $20.5 million through a variety of revenue and expenditure measures that included a 16.7% staff reduction and salary and benefit cuts that generated a combined $466 million in savings,” the analyst writes in a report for bond investors.”

“But as a source notes, the closures and cuts don’t mean that these schools are driving the savings — the district says its plan would save $25 million, just a fraction of the $700 million deficit reduction. So why does the market care about closures?”

Here is a link to the Moody’s story.

What is remarkable is that the discussion is purely about cutting costs and privatization. Not a word about the impact of closings on children, education, families, communities.

Our nation is in deep trouble. All the talk about “reform ” is really about cutting costs while pretending it is “for the kids,” “children first.” At least Moody’s makes no pretense about caring about the kids. Their honesty is refreshing, if cynical.

The Providence Student Union has taken a stand against the NECAP graduation test. Last Saturday, a few dozen local leaders took the test, any said it was too hard for them, and they are nervously waiting for their scores.

When students take action, everything changes!

Here is the news:

“Providence City Council education committee opposes NECAP as graduation requirement”

March 18, 2013
By Linda Borg
PROVIDENCE, R.I. — The City Council’s education committee is asking the Rhode Island Department of Education to abandon using the New England Common Assessment Program as a requirement for high school graduation.

In a resolution to be submitted before the City Council, the committee’s chair, Sam Zurier, calls the state test “unfair” because it doesn’t allow some children “a reasonable chance to succeed, and imposes devastating consequences on many children who,
through no fault of their own, are not ready to achieve the required test scores.”

The letter asks the education department to reconsider the “high-stakes testing” policy, which would take effect with this year’s juniors.

Members of the Providence Student Union persuaded at least 50 adults to take the high school graduation test this Saturday.

One who took it early was State Senator Gayle Goldin. She fears she didn’t do very
well.

This is a stellar example of creative student protest. No one was injured. They are making their point well and getting great media attention.

Students are the main targets and main victims of bad education policy. Across the country, they are taking the lead in defending their right to learn.

Today, students in Colorado will lead their own protest:

 

 

FOR IMMEDIATE RELEASE

WHAT : Students standing up for our education

WHEN : March 14th, 2013 from 11am – 2:30pm

WHERE : West Steps of the Colorado State Capitol

On February 23rd, students gathered to discuss what is wrong with the current education system and how they could get their voices heard. From there, the students developed an action plan to have their voices heard.

We, the students, are standing up for our education. We no longer want to be part of the cookie-cutter system where everyone is taught the same and forced to take a standardized test that we memorize answers to, making us products of the public education assembly line.

In the past few years, the Colorado State Legislature has passed bills to change how our schools are evaluated. In result, schools have been labeled “Turnaround status” or have been shut down. Students have been confined to their desks to learn certain knowledge for the sake of the test, while putting aside classes for life-skills.

Teachers have to comply to the standardized test instead of teaching real-world experiences because if the school has low test scores it could result in them getting fired or their school shutting down. Starting next year, teacher salaries will be tied into students’ results on the TCAP.

March 14th is Defend Public Education Day. Students will participate by walking out of their classes or test on this day to make a stance and get their voices heard. Students will be gathering on the west steps of the Colorado Capitol to begin a peaceful protest to defend our education and ask for a better one. We believe that education should be a democracy not a dictatorship.

We encourage all students, parents, teachers, and citizens to join us as students stand up for our education. This will be the start of a revolutionary time where students will have a say in their educational rights.

For more information:

Alex Kacsh

 

akacsh@students4ourschools.org

720.232.1918

 

Bailey Lammon

brlammon@students4ourschools.org

719.440.2388

 

 

 

I just received this press release. This is a great action by the Providence Student Union.

Governor Chafee, take the test!

State Superintendent Deborah Gist, take the test!

MEDIA ADVISORY

March 13, 2013

CONTACT: Aaron Regunberg | Aaron@ProvidenceStudentUnion.org | 847-809-6039 (cell)

STUDENTS INVITE LEADERS, POLICY MAKERS TO “TAKE THE TEST” –

WOULD THEY GRADUATE UNDER NEW NECAP POLICY?

WHAT: To lend a deeper perspective to the debate over Rhode Island’s new high-stakes testing diploma system, members of the Providence Student Union (PSU) have invited community leaders and policy makers to put themselves in students’ shoes and take a shortened version of the NECAP exam that is now being used as a make-or-break graduation requirement for the state’s young people. Currently 40 state senators, state representatives, city council members, school board members, non-profit directors, lawyers, reporters, and education officials are planning to participate in this student-administered, student-proctored event.

DATE: Saturday, March 16th

WHERE: Knight Memorial Library, 275 Elmwood Avenue, Providence

WHEN: 12:15 p.m. event begins, test-takers start their exams; 1:25 p.m. suggested time for press to arrive to catch the last minutes of test-taking, see a short PSU presentation to the media, and interview test-takers.

The event will have strong visuals. Students and adult participants will be available for interviews.
###

The Providence Student Union is a youth-led student advocacy organization bringing high school students together to ensure youth have a real voice in decisions affecting their education. Learn

Stephanie Rivera is a wonderful student activist in New Jersey. She is a junior at Rutgers and is preparing to be a career educator.

Stephanie is running for the New Brunswick, NJ, school board!

For the past 20 years, every member of the New Brunswick school board was appointed by the same mayor (you can see how that did not work). Next month is the town’s first school board election.

Please help her in any way you can. She is a brave young woman who is passionate about education and we informed. She needs and deserves our help.

This is the notice I received:

“Hi Everyone,

“As some of you already know, I am running for election to the New Brunswick Board of Education. Many of you have already been such a huge help by supporting and spreading the word about my candidacy–thank you.

“Election Day is April 16, and there’s a lot of work to be done between now and then. We’ll be going up against the political establishment of New Brunswick, which until now has been appointing the Board of Education and depriving New Brunswick youth and the community of the justice and quality education they deserve. For the past 20 YEARS, board members have been appointed by the same guy: New Brunswick Mayor Jim Cahill. And unbelievably, this is the first year in New Brunswick’s HISTORY that the Board of Education is ELECTED.

“We have a chance to make history, and I hope you all will join me to be a part of it.

“As many of you are familiar, running a successful campaign requires a lot of effort and a sufficient amount of donations, especially being entirely grassroots. My running mates and I are in need of funds for basic supplies, travel expenses, flyers, and all of the alike. No donation is too small. If funds are tight, that is completely okay–spreading the word and having your support is just as helpful!

“Provided is the link to our donation site, and if you have any questions or concerns whatsoever, please do not hesitate to get in contact with me.

“Thank you all again for your support, and I hope I’ll be able to relay good news come April!

“Donation Site: https://www.wepay.com/donations/557326946