Caroline Grannan demonstrates what a parent activist can accomplish by diligence. Here she writes about her research on KIPP:
  I did the first known research on KIPP attrition in 2007 as an unpaid amateur blogger. I looked at attrition in all the then-nine California KIPP schools based on California Department of Education data. KIPP’s Oakland school had even more astronomical attrition than the other KIPP schools, and when broken down by demographics, the Oakland attrition was even more startling. By the beginning of 8th grade (which was the publicly available figure), almost every African-American boy who has been there in grades 5 or 6 had left the school.

      The Oakland Tribune should have been doing this research, but hmm … its education reporter left to take a job with KIPP. Funny how that happens.

      KIPP’s usual response to the attrition issue is that comparable public schools have comparable attrition. But that’s a lie. I checked a number of comparable Oakland middle schools, and they have no pattern of attrition at all. They have turnover, as low-income families tend to have unstable housing and move a lot, but students cycle in to replace those who cycle out. KIPP, on the other hand, doesn’t replace the students who leave. A study by SRI International that was released the following year (coincidentally) confirmed my findings, showing that the Bay Area KIPP schools “lost” 60% of their students and didn’t replace them. The SRI study added the information that the students who leave are consistently the less successful ones.

      After a happy KIPP parent posted on our local San Francisco Schools listserve that his daughter had “tested into” KIPP San Francisco Bay Academy, I also started the application process at that school for my then-7th-grader, to confirm whether it required a test, which it did.

      KIPP says the test is used to determine the applicant’s academic grade level, not to determine who gets in. But even if that’s true, the test requirement clearly selects for students who are compliant enough to sit for a test (at grades 5 and up, kids are quite capable of refusing); for families and students who aren’t traumatized by tests and feel capable enough to take one; and for families who are motivated enough to go through that multi-step application process. And, of course, the happy KIPP parent clearly felt that his child was admitted based on her test results.

      By the way, when an organization pays a research firm to study it, there is a negotiation process regarding how the results will be reported. (When RAND did a much-ballyhooed study of Edison Schools in the early 2000s, the results were released more than two years behind schedule for that reason.) The client has a fair amount of leverage as the research firm struggles to maintain its integrity. We have no way of knowing what those negotiations between KIPP and Mathematica looked like, but I would bet they got interesting.