Archives for category: Testing

I have insisted again and again that the Common Core standards should be field-tested so that we could learn what works and what needs fixing. Here is a comment from a reader describing how Common Core works. I hope we get other reviews from teachers as the standards and tests are rolled out. Teachers, please send your comments if you have implemented the Common Core in your classrooms.
*******************

The teacher writes:

“Next week I will finish my first year teaching the CCSS to Title I primary students, most of whom were ELL and about a third ESE students.

Asked last August by my then principal to take on a “remedial” class of all the students who had failed to meet the end of year requirements of the previous primary grade the year before, I was concerned about the long-term effects on my employment due to VAM but interested in the challenge of helping these struggling children.

My overall assessment of the CCSS for primary grades is that although the standards themselves were not far from my own expectations and traditional teaching style nor were they impossible to use for planning, teaching, and assessment, the stated outcomes were not developmentally appropriate nor realistic and there’s the rub.

Coupling these standards with high stakes testing will lead nowhere but to disaster. I was able to bring the majority of my students to what used to be considered an acceptable part of the continuum for “end of grade” in reading and mathematics. All but 2 of my students made an easily measurable “year’s growth” as determined by 3 separate and different assessments required by my state and district. But they were not at the CCSS determined level. So where does that leave us?

My district created an end-of-year computerized math assessment to pilot with the primary cohort that taught CCSS this year, basing it upon the coming PARC assessments that will be in place in 2 years. Unsurprisingly, most students in the district fell into the middle range of around 50% or below.

Leaving aside the problematic nature of devising some questions for 5 – 7 year olds that were written to trick the students (higher order thinking? please. . . it’s just trickery to these literal-minded little ones) what, exactly, did this assessment do? Did it “prove” that the students had or had not mastered the mathematical standards? Impossible since for many standards there was only one question. Did it “condition” the students to the process of taking online tests? Maybe, if you think that a primary student can understand what that process is or care what it is. Why, exactly, are districts and schools doing this kind of assessment? Can anyone say?

We were encouraged to review the test questions after the fact. My students eagerly dissected the questions and were able to select the correct answers quite readily in the atmosphere of the classroom workshop, which we had used all year, and they were able to articulate their reasoning without issue. So did they “master the standards”, as evidenced in our classroom work routine or did they fail to “master the standards” as measured by the one shot, computerized, multiple choice test? I think we all know the answer the reformers would give despite the fact that I have 10 months of work assembled in portfolios that do show the “mastery” of the standards quite clearly. But those portfolios don’t count, do they?

Reading was no different. Using measures that for the last dozen or so years placed them squarely where they should be at the end of grade but now, due to CCSS decree, says they are way below expectations, tells me what? I already knew quite well, from many years of experience, that children learn to read at different rates and times. CCSS makes no allowance for that at all. They made a year and a half of growth yet they are still considered a half-year behind. Hmmm.

CCSS declare that “students will . . . .” So we are left with a system that reforms by fiat. And students who last year were considered at grade level are suddenly half a year or more behind, simply by declaration of the CCSS authors, with no consideration given to the fact that they weren’t subject to the ruling by fiat levels of success the previous year. How is this declaration and raising of the bar differ in any way from the misguided fiats of NCLB that declared all students would read on grade level by 2014?

The authors and supporters of CCSS are not willing to “weaken” their vision in any way nor are they open to revision, discussion, or compromise so I don’t see how it would be possible to maintain any kind of moratorium to “get things right”. I’m disappointed and saddened that so many professional organizations seem to want to ignore this simple fact and pretend that their calls for moratoria will have any effect at all.

By the way, I’m very proud of my students and I feel that we accomplished more than we set out to do this year, no matter what the CCSS say. My children love science and reading and math and writing and are leaving me with their sense of wonder and excitement about the world and their own learning intact. I wonder myself if that means that I’m the endangered species here? CCSS says “yes”.

This is a terrific article, written by David Patten, an Ohio teacher of history and government.

Patten begins this way:

“I have found it! After little thought and less reflection, I have found the answer to the problems of American public school education. Best of all, my solution will cost no money, save the taxpayers millions of dollars, and produce a well-educated citizenry. The solution is simple: eliminate any and all high-stakes proficiency testing and unleash the power of the teachers to do what they do best — educate our children.”

It gets better and better.

This is David Patten:

“From the moment I was hired to teach history and government in the North Olmsted schools to the moment, years later, when I walked away, I had the audacity to believe that I had been hired for my expertise. I taught the entire range of students, seventh through 12th grades. No matter what the age or ability level, I actually believed that I had something to convey to my students and that I could truly refine thought and inspire learning. And why not? I graduated summa cum laude with a 4.0 GPA in two majors. I was already a published writer and had traveled extensively. Given those brazen assumptions, to me the textbook was a mere afterthought, a reference. State and district curriculums were only skeletons, and I would flesh them out. My students would learn through hundreds of pages of highly detailed learning packets that I wrote. I also created slide shows and, later on, PowerPoints, which dovetailed with the information contained in the packets. These tools formed the basis of class discussions, thus touching all the learning styles. The students read the packets, learned visually and learned orally. It did not stop there. Projects that I created became a hallmark for many of my classes. My students would write historical fiction along with modern and historical position papers. They would participate in “great debates,” their own teaching projects, a historical magazine project and a world geographic magazine project. Last, there were the required reading books. Books such as “Bury My Heart at Wounded Knee,” “Son of the Morning Star,” “The Prince” and “Treblinka” were read and thoroughly analyzed through lengthy class discussions.”

Please read it. You will be glad you did.

.

Great Neck, New York, is a suburban community outside New York City that has long been renowned for its excellent public schools. About 95% of its students graduate high school, and many are admitted to our nation’s finest colleges and universities.

At its meeting last Monday, the Great Neck school board unanimously passed a resolution opposing the state’s over reliance on standardized testing.

For their clarity of vision and their willingness to stand up for their students and for good education, I place the Great Neck Board of Education on the honor roll as champions of good public education.

Here is the resolution, which was read aloud in its entirety at the meeting and sent to the Governor, legislators, the Commissioner of Education, the Chancellor of the Board of Regents, and shared with the media:

June 3, 2013

RESOLUTION REGARDING OVERRELIANCE ON STANDARDIZED TESTING
A CALL TO THE GOVERNOR OF THE STATE OF NEW YORK, THE NEW YORK STATE COMMISSIONER OF EDUCATION, THE NEW YORK STATE BOARD OF REGENTS AND OTHER POLICYMAKERS TO STOP THE OVERRELIANCE ON STANDARDIZED TESTS AS A MEASURE OF STUDENT PERFORMANCE AND PRINCIPAL/TEACHER EFFECTIVENESS.

WHEREAS, every student deserves a quality public education dedicated to preparing engaged citizens, creative and critical thinkers and lifelong learners ready for college and careers; and

WHEREAS, the decline in state aid and support for public schools has forced our district to reduce programs and limited our ability to fully implement new programs mandated by the State such as the Common Core standards thereby creating an uneven rollout of the standards among school districts around the State; and

WHEREAS, while the implementation of the Common Core standards will ultimately help students, teachers and the teaching and learning process, the growing reliance on, and mismanagement of, standardized testing is eroding student learning time, narrowing the curriculum and jeopardizing the rich, meaningful education our students need and deserve; and

WHEREAS, there has been a reliance upon the Common Core standards in the development of state testing despite the fact that students have not been exposed to these standards for a sufficient amount of their school experience; and

WHEREAS, despite the fact that research recommends the use of multiple measures to gauge student performance and teacher effectiveness, the State’s growing reliance on standardized testing is adversely affecting students across all spectrums and the morale of our educators and is further draining already scarce resources; and

WHEREAS, the Federal Elementary and Secondary Education Act’s testing policies fail to appropriately accommodate the unique needs of students with disabilities and English language learners in assessing their academic achievements which results in test scores that do not accurately represent a true measure of the impact of teachers and schools; and

WHEREAS, it is time for policymakers to reconsider the number, duration and appropriate use of standardized tests so that our schools can refocus their efforts on improving student learning outcomes; now, therefore be it

RESOLVED, that we call upon Governor Andrew M. Cuomo, State Education Department Commissioner John B. King, Chancellor of the Board of Regents Merryl Tisch, Chair of the Senate Committee on Education John Flanagan, Senator Jack Martins, Chair of the Assembly Committee on Education Catherine Nolan, Assemblywoman Michelle Schimel and other policymakers to reduce the use of, and overreliance on, standardized testing.

Seattle teachers Jesse Hagopian and Liza Campbell explain here what happened when the teachers at Garfield High School decided to boycott MAP testing. Their courageous action inspired teachers and parents across the nation. The MAP tests were suspended for the high schools but not for K-8.

But the teachers were not acting simply in opposition to this particular test or to all testing. They want something better that will help them help students.

And that is why they are working together to find later natives to the status quo:

“…..it’s not enough to be against the abuses of standardized testing. Parents, students and teachers who want the school system our students deserve must advance a vision of assessment that would actually improve education.

“That is why educators in Seattle established a Teacher Work Group on Assessment of more than 20 teachers to supplement the district’s task force formed to review the MAP. The work group engaged in months of research and recommended “Markers of Quality Assessment” to develop assessments that: reflect actual student knowledge and learning, not just test taking skills; are educational in and of themselves; are free of gender, class and racial bias; are differentiated to meet students’ needs; allow opportunities to go back and improve; undergo regular evaluation and revision by educators.

“The work group on assessment concluded that quality assessments, at their base, must integrate with classroom curriculum, measure student growth toward standards achievement, and take the form of performance tasks. These tasks, taken as a whole, should replace the MAP because they grow from classroom work, are rigorously evaluated and respect true learning.”

As thousands of activists plan to rally in Albany against the stat’s heavy reliance on standardized testing on June 8, many parents and educators are speaking out against Pearson’s field tests. The testing corporation is trying out questions in the state’s classrooms that might be used on future tests, but opponents say “enough is enough.” The students recently completed two weeks of grueling state tests.

One reward of opening the link is that you get to see a picture of Peter DeWitt, one of the state’s best principals and an outspoken opponent of high-stakes testing. DeWitt was recently the target of an effort by the State Education Department to intimidate him. He is one of my heroes. For he steadfast defense of children, he certainly belongs on the honor roll. He is a champion of children, a champion of public education, and a champion of ethics in education,

A third-grade class of children in upstate New York were upset by the Common Core exams.

Their teacher and principal encouraged them to write to the Governor.

Many complained that they didn’t have enough time to finish.

One wrote, “”I know the governor wants us to be ‘college ready,’ but we are only in third grade for heaven sakes.”

Out of the mouths of babes, more wisdom than one hears from the New York State Education Department.

You can find their bureaucratic responses to the children at the end of the article.

We do want our third graders to be college and career ready, don’t we?

Catherine Gewertz reports in Education Week that the new Common Core tests created by the PARCC consortium of states will require up to ten hours, depending on grade level.

Here is the projection:

“The amount of time students will have to complete both the performance-based and end-of-year components in math and English/language arts:
Grade 3: 8 hours
Grades 4-5: 9 hours, 20 minutes
Grades 6-8: 9 hours, 25 minutes
Grades 9-10: 9 hours, 45 minutes
Grades 11-12: 9 hours, 55 minutes”

Reminds me of the song in “Gigi” sung by Maurice Chevalier, “I’m Glad I’m Not Young Anymore.”

But I do worry about my grandchildren.

Amy Prime teaches second grade in Iowa. She writes strong opinion pieces and in this one, she lambastes the Des Moines Register (which publishes her articles) for its most recent editorial blasting the schools. In this case,the newspaper complained that Iowa schools did not have test scores as high as Maryland.

Have Iowa’s test scores “stagnated”? Whence came the belief that they must go up every year, like stock prices?

She writes:

“Even if our scores have “stagnated,” as the Register article asserts, then Iowa teachers should be praised for maintaining such high scores with that added challenge. I’d like to see a feature congratulating teachers for not allowing our kids to slip when we have been forced to deal with larger class sizes, decreased funding, more English-as-a-second-language students, less planning and prep time, the slashing of our music and arts programs, the demoralization of our profession in the media, increased interference from politicians and businessmen, and more.”

Amy challenges the editorial writers to talk to teachers, not to Stanford researchers or people from the governor’s office.

Andrea Gabor, a professor of journalism at Baruch College, describes her experience as a member of a state committee drafting new ELA tests.

The work of this committee was set aside and replaced by the new Common Core tests.

Gabor obtained complete copies of the tests for grades 6-8, and she makes some sage observations.

Please take the time to read her observations.

New York rushed to implement Common Core tests before the curriculum or the professional development were in place.

Gabor found the tests to be culturally monochromatic, using scenarios that would be more familiar to suburban students than to urban students.

And she–an experienced writer of non-fiction–was surprised at the heavy emphasis on non-fiction.

As she notes in her comments, I had seen one form of the fifth grade test and found that its cognitive demand looked about the same as an eighth grade NAEP passages and questions.

At one point, Gabor said she felt that students were “set up for failure.” My feelings too.

A group of distinguished educators addressed a letter to Secretary Arne Duncan that carefully explains how to get excellent teaching. Such an effort would begin by setting a high bar for entry into the profession, continue by establishing an atmosphere of autonomy and professionalism, and grow stronger by enabling teachers to work together and build a vibrant culture of learning and professional development.

The group warned that Race to the Top does not encourage good teaching. It wrote:

“Current education policy, including the Race to the Top law, and especially the practice of evaluating teachers by their students’ performance on high stakes assessments, will likely weaken, rather than strengthen, the teaching profession. Although the current policy may have intuitive appeal, a variety of evidence indicates it will not lead to sustained improvements in teaching and learning over the long term. In fact, it is likely to lead to unproductive teaching practices and poor outcomes, including “narrowing of curricula, teaching to the test, less creative teaching, more superficial and nontransferable learning, more controlling behavior at all levels of power, more withdrawal of effort from at-risk students, and increased dropout rates” (Ryan & Brown, 2005). We are especially concerned that current policy works against the professionalization of teaching, that it reinforces a situation in which teachers do not own or control their profession, that it does not set teaching on a vigorous path of development and sustainable improvement, and that it alienates and demoralizes teachers.”

Read this letter. What it says in plain English is that there is no evidence to support the punitive approach of Race to the Top and evaluating teachers by the tests scores of their students. It says that using extrinsic rewards to elicit changed behavior undermines intrinsic motivation. The education policies of the Bush-Obama era are misguided, ineffectual, and ultimately harmful to teaching and learning,

03 June 2013

Dear Secretary Duncan,

The US National Commission on Mathematics Instruction (USNC/MI) is a committee of the National Academies. Our commission thus advises Congress and the Nation on mathematics teaching, both nationally and internationally. We are writing to you as individuals, whose views reflect our service on the USNC/MI, to share our vision for mathematics teaching and to advocate for policies that will support this vision. We would like mathematics teaching—from PreKindergarten through college and beyond—to become a vigorous, vibrant profession that is designed for continuous improvement.

From our work with educators in other countries we are finding that systems that support teachers’ autonomy and professionalism, set a high bar to entry into the teaching profession, and foster ongoing development within learning communities produce an environment in which teaching and learning thrive. We think that in this country, systems should be developed—or expanded—in which teachers collaborate, examine and discuss their work, use and build on each other’s ideas, and seek to impress their peers with the quality of their methods and ideas. Such an environment could allow for excellence to be achieved and demonstrated in various ways. It would push the teaching field forward, in much the same way as mathematics and science make progress by sharing and building on ideas. It would create vigorous striving in the same way that the sciences do: by the need to impress one’s peers and the possibility of doing so in one’s own way. Of course, the ultimate motivation for teachers is more and deeper learning by students.

We have learned from Chinese teachers that “to learn continually” is a central motto in education, that “superrank” teachers analyze and improve the curriculum, and that testing is viewed as less critical than in the U.S. (U.S. National Commission on Mathematics Instruction, 2010). We have learned from Korean teachers that they have a strong and impressive teacher research culture, and that their system supports and nurtures such a culture.

Evidence in favor of developing systems in which teaching is an autonomous profession with a high bar to entry also comes from Finland, where systemic changes led to improved teaching and learning over the last several decades. While the U.S. has intensified standardized testing and accountability since the 1990s, “Finland at that time emphasized teacher professionalism, school-based curriculum, trust-based educational leadership, and school collaboration through networking.” (Sahlberg, 2011). Indeed, Sahlberg’s main message is that there is another way to improve education systems. This includes improving the teaching force, limiting student testing to a necessary minimum, placing responsibility and trust before accountability, and handing over school- and district-level leadership to education professionals. These are common education policy themes in some of the high performing countries—Finland
among them—in the 2009 International Programme for Student Assessment (PISA) of the OECD… . (Sahlberg, 2011)

Finland’s education system fits with Jal Mehta’s vision, which he contrasts with our own current system:

Teaching requires a professional model, like we have in medicine, law, engineering, accounting, architecture and many other fields. In these professions, consistency of quality is created less by holding individual practitioners accountable and more by building a body of knowledge, carefully training people in that knowledge, requiring them to show expertise before they become licensed, and then using their professions’ standards to guide their work.

By these criteria, American education is a failed profession. There is no widely agreed-upon knowledge base, training is brief or nonexistent, the criteria for passing licensing exams are much lower than in other fields, and there is little continuous professional guidance. (Mehta, 2013)
We believe it is critical for teaching to be a respected profession and we agree with Sahlberg that “[a]s long as the practice of teachers is not trusted and they are not respected as professionals, young talent is unlikely to seek teaching as their lifelong career anywhere. Or if they do, they will leave teaching early because of lack of a respectful professional working environment” (Sahlberg, 2011). We are concerned that—as stated in a teacher’s widely circulated resignation letter—“[w]e have become increasingly evaluation and not knowledge driven” (Strauss, 2013).

The need for professional, collaborative communities of teachers is further supported by findings from research on professional development and school improvement. Research on professional development in the U.S. and internationally indicates that collaborative approaches to professional learning and building strong working relationships among teachers are key components in improving teachers’ practice and student learning (Darling-Hammond et al., 2009, p.5). At the school level, Bryk et al. (2010) found that having a professional community that uses public classroom practice, reflective dialogue, peer collaboration, and collective responsibility for school improvement with a specific focus on student learning is an important indicator for school improvement. Relational trust was found to be essential for organizational change and for sustaining the hard work of school improvement.

Current education policy, including the Race to the Top law, and especially the practice of evaluating teachers by their students’ performance on high stakes assessments, will likely weaken, rather than strengthen, the teaching profession. Although the current policy may have intuitive appeal, a variety of evidence indicates it will not lead to sustained improvements in teaching and learning over the long term. In fact, it is likely to lead to unproductive teaching practices and poor outcomes, including “narrowing of curricula, teaching to the test, less creative teaching, more superficial and nontransferable learning, more controlling behavior at all levels of power, more withdrawal of effort from at-risk students, and increased dropout rates” (Ryan & Brown, 2005). We are especially concerned that current policy works against the professionalization of teaching, that it reinforces a situation in which teachers do not own or control their profession, that it does not set teaching on a vigorous path of development and sustainable improvement, and that it alienates and demoralizes teachers.

Some of the evidence against the practice of evaluating teachers based on high stakes assessments comes from research on motivation. For example:

It is well established that use of salient extrinsic rewards to motivate work behavior can be deleterious to intrinsic motivation and can thus have negative consequences for psychological adjustment, performance on interesting and personally important activities, and citizenship behavior. (Gagne & Deci, 2005)

SDT [self-determination theory] research has found that motivation based on more controlled motives, such as rewards or punishments (external regulations), or self-esteem-based pressures (e.g., ego involvement) is associated with lower quality of learning, lessened persistence, and more negative emotional experience. (Ryan & Brown, 2005)

In their meta-analysis of 128 well-controlled experiments exploring the effects of extrinsic rewards on intrinsic motivation, Deci, Koestner, and Ryan (1999) found a “clear and consistent” picture:
In general, tangible rewards had a significant negative effect on intrinsic motivation for interesting tasks, and this effect showed up with participants ranging from preschool to college, with interesting activities ranging from word games to construction puzzles, and with various rewards ranging from dollar bills to marshmallows. (Deci, Koetsner, & Ryan, 1999)

Teaching is an inherently complex, interesting, and creative activity because it involves knowing ideas and ways of thinking and engaging others with those ideas and ways of thinking. Thus, according to the research on motivation, improving teaching will require work environments that foster intrinsic (or autonomous) motivation. Motivation research further indicates that “the experiences of autonomy, as well as of competence and relatedness, are important for effective performance and psychological health and well-being” (Deci & Ryan, 2008).

We doubt that students’ learning gains will outweigh the negative effects to the teaching profession of test-based accountability. According to the National Research Council’s Committee on Incentives and Test-Based Accountability in Public Education, “the available evidence does not give strong support for the use of test- based incentives to improve education” (National Research Council, 2011, p. 91). Furthermore, The research to date suggests that the benefits of test-based incentive programs over the past two decades have been quite small. Although the available evidence is limited, it is not insignificant. The incentive programs that have been tried have involved a number of different incentive designs and substantial numbers of schools, teachers, and students. We focused on studies that allowed us to draw conclusions about the causal effects of incentive programs and found a significant body of evidence that was carefully constructed. Unfortunately, the guidance offered by this body of evidence is not encouraging about the ability of incentive programs to reliably produce meaningful increases in student achievement—except in mathematics for elementary school students. (National Research Council, 2011)

Looking at the effects of test-based accountability from an international perspective, we also do not find support for such a system:

Are those education systems where competition, choice, and test-based accountability have been the main drivers of educational change showing progress in international comparisons? Using the PISA database to construct such a comparison, a suggestive answer emerges. Most notably, the United States, England, New Zealand, Japan, and some parts of Canada and Australia can be used as benchmarks. … The trend of students’ performance in mathematics in all test-based accountability-policy nations is similar— it is in decline, in cycle after cycle, between 2000 and 2006. (Sahlberg, 2011)

None of the above implies that standardized tests for students are bad or wrong. The issue is how tests are used. Using test results for informational purposes in a trusting, collaborative environment is entirely different from using test results to monitor, evaluate, reward, or punish teachers. In this matter, we would be wise to heed Campbell’s Law and his observations about test scores:
The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor. (Campbell, 1976, 2011, p. 34)

… when test scores become the goal of the teaching process, they both lose their value as indicators of educational status and distort the educational process in undesirable ways. (Campbell, 1976, 2011 p. 35)

Near the end of its report, the National Research Council’s Committee on Incentives and Test-Based Accountability in Public Education stated:

Our recommendations, accordingly, call for policy makers to support experimentation with rigorous evaluation and to allow midcourse correction of policies when evaluation suggests such correction is needed. (National Research Council, 2011) We think that the time has come for a midcourse correction. In Singapore, there is the motto “teach less, learn more;” in the U.S., we need to “test less, learn more.” We have argued that test-based accountability stands to have negative effects on teaching as a profession and that there are better ways to improve teaching. We respectfully urge changes in policy to support a strong and vibrant mathematics teaching profession.

Sincerely,

Sybilla Beckmann, University of Georgia

Janine Remillard, University of Pennsylvania Gail Burrill, Michigan State University

James Barta Utah State University

Myong-Hi (Nina) Kim SUNY College at Old Westbury Roger Howe (NAS), Yale University

Bernard Madison, University of Arkansas, Fayetteville Sara Normington, Catlin Gabel School

James Roznowski Delta College

Patrick (Rick) Scott, New Mexico Higher Education Department Padmanabhan Seshaiyer, George Mason University

References

Bryk, A. S., Sebring, P. B., Allensworth, E., Luppescu, S., & Easton, J. Q. (2010). Organizing Schools for Improvement, Lessons from Chicago. Chicago, IL: The University of Chicago Press.

Campbell, D. (1976, 2011). Assessing the Impact of Planned Social Change. Journal of MultiDisciplinary Evaluation, 7(15), 3 – 43.

Darling-Hammond, L., Wei, R. C., Andree, A., Richardson, N., & Orphanos, S. (2009). Professional Learning in the Learning Profession: A Status Report on Teacher Development in the United States and Abroad. Dallas, TX: National Staff Development Council and The School Redesign Network at Stanford University.

Deci, E. L., Koestner, R., & Ryan, R. (1999). A Meta-Analytic Review of Experiments Examining the Effects of Extrinsic Rewards on Intrinsic Motivation. Psychological Bulletin, 125(6), 627 – 668.

Deci, E. L., & Ryan, R. M. (2008). Facilitating Optimal Motivation and Psychological Well-Being Across Life’s Domains. Canadian Psychology, 49(1), 14 – 23.

Gagne, M., & Deci, E. L. (2005). Self-determination theory and work motivation. Journal of Organizational Behavior, 26, 33- – 362.

Mehta, J. (2013, April 12). Teachers: Will We Ever Learn? New York Times. Retrieved from: http://www.nytimes.com/2013/04/13/opinion/teachers-will-we- ever-learn.html?pagewanted=all&_r=0

National Research Council. (2011). Incentives and Test-Based Accountability in Education. Committee on Incentives and Test-Based Accountability in Public Education, M. Hout and S.W. Elliott, Editors. Board on Testing and Assessment, Division of Behavioral and Social Sciences and Education. Washington, DC: The National Academies Press.

Ryan. R. M., & Brown. K. W. (2005). Legislating competence: The motivational impact of high stakes testing as an educational reform. In C. Dweck & A. E. Elliot (Eds.). Handbook of competence (pp. 354-374) New York: Guilford Press.

Sahlberg, P. (2011). Finnish Lessons: What Can the World Learn from Educational Change in Finland? New York: Teachers College Press.

Strauss, V. (2013, April 6). Teacher’s resignation letter: ‘My profession… no longer exists.’ Washington Post. Retrieved from: http://www.washingtonpost.com/blogs/answer- sheet/wp/2013/04/06/teachers-resignation-letter-my-profession-no- longer-exists/

U.S. National Commission on Mathematics Instruction. (2010). The Teacher Development Continuum in the United States and China: Summary of a Workshop. Ana Ferreras and Steve Olson, Rapporteurs; Ester Sztein, Editor; National Research Council. Washington, DC: The National Academies Press.

Please address correspondence to Sybilla Beckmann, sybilla@math.uga.edu or Department of Mathematics, University of Georgia, Athens, Georgia 30602.