A comment came in last night from a KIPP teacher in DC. She provides interesting insight about how charter schools can manufacture high test scores. She asks for advice about the TerraNova tests. Can you help her?
I teach Kindergarten at a “no-excuses” charter school in Washington, D.C. The accounts of cheating on which you report are certainly appalling and unsurprising, but – as you’ve mentioned – they are only the tip of the iceberg. Even if scores were left unaltered, and even if these tests measured knowledge that we as a society deem important, we mustn’t forget that these assessments are so poorly designed that they lack validity or reliability. One telling example: my school has adopted the TerraNova as our indicator of choice. Our status as a DC charter, our funding, our esteem in the reform community and our enrollment all hinge on the TerraNova scores that we report out. Since the start of the school year, administration has drilled staff on the importance of this one test. Teachers are pressured to study copies of last year’s test (legal? ethical?), instructional coaches design unit tests to mirror exactly the questions that appeared on last year’s TerraNova, students are prepped extensively on the importance of filling in only one bubble, and all dialogue about student learning has been framed around what they “need to know for the TerraNova.” Of course none of this is uncommon in schools such as mine. However, today I was informed that this year’s test will be *identical* to last year’s. Apparently the test makers only revise the test every few years. So we are quite literally training our students to answer this one set of questions correctly. And schools across the country do the same thing, resulting in higher and higher scores, despite lower and lower levels of actual knowledge. What sort of game our we playing? It’s like we’re stranded in the desert, racing toward a well of water that turns out to be nothing but a mirage. We as a country need, first of all, to have a national conversation about the purpose of public education; perhaps then we will come to realize that putting all our energy toward scoring well on a meaningless test is doing our children nothing but harm.
On another, related note… Part of the conversation about the meaning and purpose of public education is the status of teachers and the teaching profession. TCRecord recently published a commentary I wrote regarding the failure of teacher preparation programs, the danger of alternative certification, and the need for a respected, professional knowledge base among educators. I hope you’ll check it out: http://www.tcrecord.org/Opinion.asp
Lastly, I haven’t been able to find any information about the TerraNova, its creators, or its reputation. Are you familiar with the test? Do have any data about it?

If Diane Ravitch cannot find info on the TerraNova or its creators, the test must be suspicious at best.
What a shame parents are buying into the exploitation of their children. Private and charter schools are businesses selling you a product. They are no different than any retail store. And much like retail, the price of the product is inflated, the product won’t last very long.
Has anyone noticed that these private and charter schools are like the new relationship for someone who just got divorced. They try to win your love and acceptance (and in this case your money) by appealing to your vulnerability: you child.
LikeLike
Maybe she just hasn’t heard about google yet. I found a lot of information in just seconds.
LikeLike
Really!?
LikeLike
Uh, Diane is just a LITTLE busy–remember, she has NO secretary and NO research assistant! That’s why this blog is so helpful to everyone–we can all do a little grunt work, here.
In any event, I gave the Terra Nova to a Catholic school student who I was seeing as an L.D. Resource Teacher in the 1990’s. It was a good test for an L.D. student, as the student could record the answers directly in the test book (no bubble sheet–circle the answer), and she could look at the question AND answer on the same page (not having to look at 3 different pages is a great advantage for a student w/ADHD, dyslexia, etc.!). I’m not surprised that KIPP or any charter schools would give the T,N. over the state “standardized” Scantron tests (however, I don’t understand how this is legal since, after all, charter schools are public schools, yes?) As I explained, the test is conveniently read all in one booklet, so an education professional can correctly assume that any student would do better on this test, which is easier to read.
However–as it was explained to me when I asked my public school district boss–the publics don’t use Terra Nova because they cost much more (consumable test booklets, and hand/human scoring)
than the putrid Pearsons. At least, this was the case in the 1990s.
One more caveat: yes, most likely, the tests are similar (or the same) from year to year, but even if the “standardized” tests aren’t identical, many of the same ??? are kept, so, if one is using previous tests to prep., you’d still hit on certain of the exact, previous ???. All around, sticky wicket, this testing craze.
I have an idea, however: STOP-THE-TESTING-IN-2013!!! Garfield did it–so can EVERYONE! Start by opting your kids out, parents!
LikeLike
Really. It surprises me a little that someone who claims to be distraught at having to give this test couldn’t figure out how to find any information about the test, creators, or reputation, when it took me all of 15 seconds and I’d never heard of the test before.
Second, it also seems strange that someone joining the staff of a charter school would act surprised at the behavior of the charter school. I’ve found them to be very upfront about their twisted philosophies and expectations. How can people take jobs without having a clue about how their employer operates?
It’s time for teachers to do their research, make sound career choices, and refuse to support the enemy instead of helping to keep them going.
LikeLike
George A., a little dramatic? When people take jobs in charter schools, it is because there are no other jobs to be had. Many people, such as myself, even believe in the vision of their charter. If my students did not come here for a good education, they would be in another neighborhood high school worrying about violence and staying safe instead of their education.
Don’t be so harsh. That was quite a generalization.
LikeLike
@George A. – get lost. Your teacher bashing is bull. Please join us and see if you can last for even 5 years and not end up like the 46% that jump ship.
LikeLike
Provide links to third party reviews not funded by the company please. If you have them…
LikeLike
Phildelphia schools used them for years as district wide tests…low scores paved the way for the state takeover of the district….then the tests were tossed. Mission accomplished.
LikeLike
Terra Nova = McGraw-Hill/CTB. Claimes to be THE NEW STANDARD IN ACHIEVEMENT. http://www.ctb.com/ctb.com/control/productFamilyViewAction?productFamilyId=449&p=products
Just more bubbling and doxology.
LikeLike
More teaching jobs are at stake. Pretty soon we will have less teachers and less jobs.
LikeLike
Not pretty soon. It is already happening.
LikeLike
What a wonderful education these kids are receiving! I wonder if Jonathan would approve?
LikeLike
If you read Dan Koretz’s book “Measuring Up,” you will find that he discusses these issues and convincingly argues that such practices lead to test score pollution. This means the test scores no longer accuraetly indicate what children know and can do. Perhaps this is why students in KIPP, IDEA, Harmony, UPLIFT, and other “high-performing” charters have high scores on state tests, but the students woefully underperform on the SAT and ACT compared to where they should be performing given the state scores. This likely also explains the terrible performance of students from these charters once they enter college. While they appeared prepared, they are not really ready to tackle college coursework–even at relatively easy regional universities.
Even though I have blogged about this (http://fullerlook.wordpress.com/) and sent information to reporters, no mainstream media will cover the issue. They do, however, write puff pieces about charters without any fact checking.
LikeLike
“Measuring Up” is one of my favorite books! I second your recommendation.
Also, I’d suggest checking Buros Mental Measurement Yearbook for information on tests.
LikeLike
See, also, my previous comment. The Terra Nova, a self-contained test, would tend to be easier as opposed to a page-flipping, bubble-filling “standardized” test (w/”Pineapple” ???, several correct answers, no correct answers, & written Reading Comp. ??? scored either by incompetent humans or equally incompetent computers).
LikeLike
A brave soul at KIPP speaking up! Wow!
LikeLike
From a political standpoint, which is ultimately what this is all about, one of the best things that could happen would be for charter school teachers to start pointing out the total bankruptcy of the testing regime. When public school teachers do it, the ed reform echo chamber immediately attacks them as defending their cushy, status quo jobs.
The reality is that charter school parents are also being sold snake oil, told that these school’s test scores equal a quality education.
As awful as this teacher’s story is, we can be heartened if it’s an indication that charter school teachers are starting to wake up to the false narrative they’ve been pitched, which has nothing to do with “putting children first.”
LikeLike
Agreed. Charter teachers and administrators need to blow the whistle. However, we can see how challenging that can be for them. It’s their livelihood at stake.
LikeLike
Diane, The TerraNova test is made by CTB McGraw Hill. This test became a favorite among NY schools over a decade ago in the early days of the NYS testing program (probably because NY contracted with CTB McGraw Hill for the 4th & 8th grade Math and ELA tests). Most districts stopped giving them when the testing program went 3-8. It’s my understanding that this test has not been changed in MANY years, and was aligned/connected to the Stanford Achievement test; which also means that it is in no way shape or form aligned with the current CCSS initiative.
Hope this helps you find out more information.
LikeLike
The TerraNova is put out by CTB McGraw Hill. There seems to be plenty of information available on it. All I did was look it up on Yahoo.
LikeLike
This teacher described EXACTLY what went on during the bulk of my teaching career. For years I complained, “But we’re just invalidating the test” but no one seemed to care. The most egregious example of cheating was the time my eight-year-old son came home with an exact copy of the test for “homework” the day before it was administered. He scored at the 99th percentile that year and everyone else probably did too.
Once I brought my complaint to a state senator with these words, “But everyone is just cheating on these tests” and she responded without missing a beat, “Oh, we know that.”
Now that these tests are “high stakes” it’s only a matter of time before something changes. Either the test will become extremely secure as the SAT is now (but that would be very expensive), or they’ll go back to being for parents’ and teachers’ eyes only, or they’ll be dropped. One thing is for certain: this whole “reform” movement is built on a pack of lies and soon everyone will know.
Thanks to this teacher for speaking up.
LikeLike
Until this past year, Montgomery County (Maryland) Public Schools used TerraNova to test second-graders (my son was tested in it in February 2011). They tested them in math, reading comprehension, and writing comprehension (the last part of which student had zero preparation for). It was used over MAP-M and MAP-R (two other tests the district uses) for second grade, until the new superintendent Joshua Starr came in last year and had the Board of Ed drop this assessment. It served no real purpose, as it was a hold-over assessment that the district had adopted at least a decade earlier, prior to the use of the MSA. The goal of the assessment creators, at least in this case, was to make money from the school district, not to give a coherent indication of student progress.
LikeLike
I believe the father (mother) of the Terra Nova is the California Tests of Basic Skills (CTBS), used by many private schools for admissions back in the day. Terra Nova is no different than any other standardized test, it reports standings among groups of students and almost always follows the standings of other standardized test (that is sores follow income and color). So the problem is not with the Terra Nova, but with standardized tests.
I did read your article on restructuring teacher education and disagree with many of your inclusive statements that compare your program of study to others across the country. Just a few: “My program of study like others across the country……” Yes and there are others across the country that provide what you decry as missing. “Lumps together early childhood and high school level teachers……..” Not many, especially since most states have specific licensing requirements for each level.
I agree, Teacher education programs need continuing scrutiny and enhancing but there are some good ones that prepare teachers who remain in the field, and actually educate students by virtue of teacher self assessment instruments like the Teacher Work Samples, and these are not the alternative programs that promise a quick fix for low-income schools and schools for children of color.
LikeLike
TerraNova has a Wikipedia entry. It’s a norm-referenced test series published by CTB McGraw-Hill.
Teaching them last year’s test, which is identical to this year’s test, means that the kids are likely to know LESS but do better on the test.
Much like Orwell’s 1984 again.
But I thought that all publicly funded schools in DC had to use the DCCAS. No?
LikeLike
I also thought the same. If the charters are allowed to use a test other than the DC-CAS, we will never be able to measure their “effectiveness” and “high-performance” when compared to DCPS.
LikeLike
This teacher hits the nail on the head. Teaching to the test, or teaching THE test, invalidates the test itself. With all of the psychometricians, econometricians, and statisticians raking in the bucks from our state departments, you’d think someone would reveal how this behavior completely makes a mockery of testing. State tests now mean nothing. Principals game, teachers cheat (by teaching to the test or THE test), and it is all smoke and mirrors.
For teachers, it becomes who can teach to the test the best, or have unethical access to the test (via administering as many read-alouds as possible), in order to be viewed as the most competent, effective teacher. This whole thing is laughable.
And I’m sick of the tired argument that principals are supposed to be valid observers in the classroom in order to ensure teachers are producing lessons that generate critical thinking, etc. when their jobs are at stake in the same fashion as teachers (and have been since the NCLB Act). Principals care about ONE thing – high test scores. If a teacher produces high test scores, everything else is moot.
Our whole system hinges on test scores, it doesn’t matter if on paper they only count for 30, 40, or 50% of a teacher’s evaluation.
Why are we doing this to our public school kids?
LikeLike
If you cannot find information on Terra Nova, this might help: http://lmgtfy.com/?q=terra+nova+test
(Yes, that is very snide.)
LikeLike
The inquiry was in the italicized text of the quoted writer, not from Dr. Ravitch.
LikeLike
Thank you, Bill, my italics did not cover the entire letter, which gave the impression that the question was mine (about TerraNova). It was part of the writer’s comment. My error.
LikeLike
We used it in Nashville for years but we don’t since we “won” RTTT money.
LikeLike
This is a very useful and revealing post. As others have said, the terranova has been around a very long time and is a pretty standard off the shelf test. My own quibble with the writer is that test scores for kindergartners through second graders of any kind are ignored by us in the media, and I don’t think anyone looks at them very closely, even parents. Also, this is not a substitute for the DC-CAS. When charter school kids get to 3rd grade they have to take the DC-CAS as kids at the regular public schools do, and at that point reporters like me start noticing the scores. But we wouldn’t bother with the terranova results because we can’t use them to compare schools. Not all schools use that test.
LikeLike
The Terra Nova test has been used for years by Chicago Archdiocese schools.
LikeLike
In Pittsburgh Public Schools, Kindergarten through 2nd grade will take the Terra Nova complete battery 3rd edition reading and math. Yes, kindergarten. My son, in 2nd grade, told me that the Terra Nova prepares kids to take the PSSA in 3rd grade.
LikeLike
Her real name is easy to find just be poking around on this site. Unless she has moved, it doesn’t look like she’s working at a KIPP school, but at another Charter chain.
LikeLike
What is the cost per student for materials and scoring DC CAS and for Terra Nova. Who profits from each. Who lobbies for adoption of these tests in the DC market?
LikeLike
The bigger question that ought to be asked is, “Why on EARTH would anybody subject Kindergarten students to standardized tests?” Anyone who has taught children at this level knows that there can be a vast range of developmental stages affecting the attainment of both skills and content knowledge. The whole concept of testing 5 and 6 year-olds against a standard is ridiculous. How will these tests serve to improve the education of these children? What is the real purpose of this type of testing? Are we under the impression that these tests will inform schools as to which of these Kindergarteners will be successful adults? Let me guess…the Einsteins who dreamed this up are the same ones who put in applications for “ivy league pre-schools” before their progeny are even born, right?
LikeLike
This kind of teaching to the test is very far along a slippery slope of unethical behavior. Not only is it wrong, it means that the test scores are meaningless. It’s known as “test score corruption.” It’s like teaching kids to memorize the eye chart so when tested they can say the kids’ vision is good.
LikeLike
Our Montessori uses TerraNova3 Total Battery. They in no way spend the year teaching to the test. Just wondering people find it irrelevant when if a child scores high enough (95 percentile and up) they qualify for Johns Hopkins University Center for Talented Youth’s international talent search, as well as other gifted programs when the state tests don’t qualify a student. In my own experience when a child scores that high on these tests and does the talent search (in which they take the actual SAT, ACT, or SCAT in 7th grade in a testing center they qualify for gifted. If that particular test is irrelevant why is it one of the only tests that will qualify a child to test internationally into gifted programs when the state tests are considered basically meaningless by these programs?
LikeLike
Also the DoDEA uses TerraNova. Clue me in on why it is that people seem to think it is meaningless. In my experience, it’s been a pretty good indicator of success. I personally am extremely thankful that our Montessori uses it because it has been key to opening so many doors towards freedom of intellectual pursuits for my child.
LikeLike
Wow!!! I find this article and many of the post surprisingly ignorant. Firstly, since the person who posted this comment is obviously a computer user; since they were able to post this comment on the internet. I am very surprised that they do not have the ability to use a search engine. I have done it. It really works; and there are several to choose from. But, I will share this information with all of those who know how to use a computer, but not how to use a search engine. The TerraNova Test is written by McGraw Hill. McGraw Hill is a company that is over 120 years old. They have several publishing divisions in the education business, and makes text books and other learning materials and provide various education services for over almost 100 years. CTB/McGraw-Hill was established in 1926 to “help the teacher help the child.”
Standardized test really are about gaging were a child is for their grade level. These test were initially designed to assist teachers and parents understand a child readiness for the next grade, understand their strengths and weakness. With this information a parent can assist their child in those areas they may have scored lower in, determine if their child is gifted, or provide additional educational stimulation or assistance. This test can also be used to attract parents to a charter, private, prep or public school. All things can be manipulated. The truth is you can train for any type of test. Yes! The cat is out of the bag! You can even train your child for IQ test. You can train your child to be a better tennis player. If there are standard test that are given — you can train for them. Does this mean the child is cheating. No — it means that the administrators and parents are preparing the students to do well on the test. It takes some skill to memorize facts and details. If it didn’t then every student that receives the same preparation at the same school would get the same TerraNova score. But that is not what happens. Each student is different, and each student learns differently. But in this country we test each student the same. That is a fact.
This just seems like a very silly post to me. I have 3 children with special needs, and I look at their TerraNova scores on a yearly basis and in addition to their weekly and quarterly test I formulize what subjects they need more help in. I am also able to plan for how many social activities I will allow them to participate in the next year. i.e. if they were to get weak TerraNova scores across the board — then the following school year maybe we cut back on soccer, cheerleading, gymnastics, piano, karate, Girl/Boy Scouts, swimming — any of the other seemingly never ending amount of social and sports enrichment activities.
Keep in mind — the world supports standardized test. We use them to gage if a person has the basic body of knowledge. We use them in grade school (TerraNova, IOWA, CAT), middle school (example: ACT), high school (examples: PSAT, SAT), College (SAT, LSAT, MCAT, GMAT). In professions: Bar Exam, CPA, CISA, CISM, various networking test — for most professions there are certification test. This does not say tell us that these are great doctors, lawyers, computer professionals, or accountants, but it tells us that supposedly these people studied for this field and acquired a basic level of understanding.
I apologize for any misspellings and grammatical errors — but I am typing quickly and have to get back to my young children.
LikeLike