I discovered this wonderful article on Twitter. It was published in 2013, but it remains timely.
Albert Einstein’s great breakthrough came when he put known measures to one side. The notion that time and space were regular and linear was entrenched in science, and had led to an impasse which prevented it from making sense of the universe. By seeing that time and space might flex led to the Theory of Relativity, and led Einstein into a realisation that philosophical steps must be taken if breakthroughs were to be made. This philosophical context for his science led him to see that “not everything that counts can be counted, and not everything that can be counted counts”.
My wife and I recently took our children out of their local primary school to travel in the former Transkei for seven weeks. We thought that this would be a wonderful experience for them, experiencing life on the road in a completely different culture. Their school was programmed to see it differently. Its Ofsted rating could be adversely affected by the absence, and by the prospect of a six-year-old and four-year-old performing slightly less well in their assessments. The scientific culture of measurement risks so narrowing the concept of education that the system becomes unable to see any benefits (which cannot be directly measured) of such a trip.
Social or ‘impact’ investors, such as Panahpur with whom I work, try to achieve their purpose by blending the art of achieving their social goals with the science of managing their funds. They make financial investments for social, as well as financial returns.
The key challenge of doing this is understanding if, and how, the art of achieving social ‘returns’ can be measured in any scientifically robust way.
Successive governments have all but admitted defeat when it comes to the state’s ability to solve certain intractable social problems. There is a general recognition that charities, faith groups and other civil society organisations have an important role in reaching the parts that the statutory social services cannot reach. But to deliver their potential, they require access to capital. Contracting them to provide services has often led to a repeat of the problems of state provision, with a focus on inputs rather than outcomes. All this has led to the emerging world of social impact bonds and payment-by-results (PBR).
We invested in the first social impact bond at HMP Peterborough directly and have invested others subsequently indirectly. PPBR is a popular idea now, which might direct capital to those who can actually solve these problems. If charities and civil society organisations can do what the state cannot and help people to transform their lives, so the argument goes, then let’s pay them when they deliver.
But most charities lack the balance sheet strength to provide services at risk. Which means that PBR leaves private sector providers as the only realistic option. These private sector providers have fiduciary duty to extract all financial value they can from these contracts and return it to shareholders. So PBR contracts can become a proxy for privatisation. The extent of the privatisation of social services resulting from this and other trends is well documented in Social Enterprise UK’s report, ‘The shadow state’ and can be easily seen through the experience of the Work Programme.
All this is complex enough before one brings Einstein into it. But he would recognise that the intractable social problems that increasingly take the lions share of social service budgets can only be solved through the complex, time consuming and uncertain process of human transformation. Dysfunctional and deeply disadvantaged and distressed individuals need to turn their lives around, one by one. Graham Allen MP, through his work on early interventions, has demonstrated that the most cost-efficient interventions will occur during the first three years of an at-risk persons life.
The truth is that, in the context of gnarly social problems, building the link between inputs and outcomes is often impossible. What these social problems require are long term interventions, in the context of an uncertain rehabilitation journey and a chaotic client group. It needs persistence and, ultimately, love. Can one really measure the outcomes of particular interventions? Can a time-bound, tightly contracted and assessed financial confection achieve this deep change?
There is no question that the social impact bonds – for example, with offenders at HMP Peterborough or with children at risk of being taken into care in Essex – offer an exciting new opportunity to create significant positive social change by aligning the state, investors and the taxpayer.
But perhaps we need a deeper discussion, where we have the humility to accept that the relationship between inputs and outcomes of many things that society needs cannot be directly measured. And where we allow ourselves to make the philosophical leap that delivering and measuring social outcomes is not necessarily linear and regular.
Should we do this, we’d be led inexorably to a need to rediscover the notion of common values. Inevitably, in the context of the available evidence and budgets, we need to agree that some things should lead to taxpayer savings through better long term outcomes for the most distressed people in society because they are the right thing to do.
If we can do this, we might be able to direct capital with appropriate rigour to the best placed organisations to deliver long term change. If we cannot, we risk PBR just being the latest in a line of contracting methodologies that fail to address the root causes of our problems. Or, as Einstein might say, we may be doing what we can count but we may well not be doing what actually counts.
James Perry is chief executive at the social investment foundation, Panahpur. James is speaking at the Oxford Jam session If It Can’t Be Measured, It Doesn’t Exist on Thursday (today) at 4pm

Werner Heisenberg, a German physicist, determined that our observations have an effect on the behavior of quanta. Similarly, could it be that our observations and measurement have profound effects on systems. The very act of measuring causes shifts in the feedback system of complex systems……leading to destabilization.
LikeLike
Not only that, Mary, but also Foucault’s concept of “subjectivization” and/or Ian Hacking’s “looping effect” or what I term “internalization”. Human’s interpret and internalize what is being said about and done to them in a self-fulfilling prophesy way. In studies involving humans, the human knows something of what is happening, even in randomized blind trials. I become “disabled” when the authorities declare that I supposedly am. I take that moniker onto myself, many times willingly but not always.
LikeLike
That explains some of the conversations I’ve been hearing!
LikeLike
Are you suggesting that the measuring has led to destabilization?
Many of our communities, complex systems, are certainly destabilized. James Perry has identified the root cause and presents it as a solution: “Should we do this, we’d be led inexorably to a need to rediscover the notion of common values.”
The recent election cycle has shown that we are much better at identifying our disagreements than we are at finding common ground. The British are inclined to accept strong centralization, but the United State of America have always been resistant to central control – that is the Federal System. If we limited the Federal part of the system to those things we have in common, the states would have a better chance of addressing the destabilized portions of their complex systems. Our founding fathers knew that political parties would promote division.
LikeLike
“. . . we are much better at identifying our disagreements than we are at finding common ground.”
Exactly, Fl Teacher!
I and many others (think of the 49% who didn’t vote) who sense that the two main parties have abandoned us, long ago at that, might be best served by a party that emphasized that common ground. Perhaps a new party, The Common Ground Populist Alliance or the Affinity Alliance that focuses on the inherent commonalities of all people, on working together as the humans that we could and should be.
LikeLike
Metrics do not tell the whole story, and they can be misleading. The Obama administration has been obsessed with weighing and measuring “outcomes.” From all accounts of pundits our economy has been humming along with an unemployment rate of under five percent and a modest, but respectable growth rate. The story that the metrics do not tell is more significant. Most of the growth of our economy has gone into the pockets of the 1%. Many people are working multiple jobs for lower wages with fewer benefits. People are tired of watching Wall St making big gains while the perpetrators of our 2008 economic meltdown go unpunished. Most working class people do not benefit from gains on Wall St as many are simply trying to meeting their weekly bills. One comment Hillary made about the election was that they had mismeasured the amount of discontent in the Heartland.
Statistics have been misused to allow corporations to take over public schools. We have witnessed the impact of the “failing schools” narrative. Metrics can be twisted and used to advance a particular agenda, and our charter school misadventure is a perfect example.
Many things in life defy measurement; nor should we try to measure them. When politicians attempt to measure and collect data, we should all ask, “What is the purpose?” Statistics can be misleading. We should approach attempts to weigh and measure with a critical lens and a healthy amount of skepticism.
LikeLike
“The Obama administration has been obsessed with weighing and measuring ‘outcomes.'”
Not only the Obama administration but many of the those whom we rail against, the Gates, Broad, etc. . . have been pushing the “measured outcomes” agenda for many years. His administration seems to take its cues from that type of agenda. And while there isn’t anything inherently wrong with measured outcomes when something can be measured/counted, there are rationo-logical problems along with democratic governance problems when someone on high determines what those supposedly measured outcomes are for everyone else, a la Gates and Broad.
LikeLike
retired teacher: your remarks, and those by Duane Swacker under them, get to the heart of the matter (as I see it)—
It is misleading to simply assert that numbers “say” anything at all that is useful or accurate or helpful, or that the metrics used to generate them are “objective” and “can’t lie” and so on.
Deciding what can be measured, and how to measure, and who does the measuring, and what the results are supposed to be used for, and so on—all require making decisions that include a host of non-numerical value judgments.
In other words, “choice”—what are the choices that were chosen and what are those that were rejected? And why?
Deeply revealing that the heavyweights and enforcers of privatization and charters and vouchers and the like are so enamored with “choice” as a pr slogan and selling point, and so terrified of actually making explicit the reasoning and values and goals behind their “choice” mantra.
Of course, harder to sell corporate education reform when it’s raison d’être is $tudent $ucce$$ and its concomitant swelling of egos and wallets for the few at the expense of the many.
Not a pretty picture. Never was. As a very old and very dead and very Roman guy said:
“For greed all nature is too little.”
Thanks to you both and to everyone else for their contributions to this thread.
😎
LikeLike
Clarification. That very old and very dead and very Roman guy—
Lucius Annaeus Seneca.
But surely that’s just old school scruples that don’t appreciate disruptive innovation and creative disruption and rigged competition in the pursuit of $tudent $ucce$$.
“There is a sufficiency in the world for man’s need but not for man’s greed. ”
Mahatma Gandhi.
Nah. Still true…
😎
LikeLike
Then nothing exists, because nothing can be truly assessed in full.
They need to re-assess their rhetoric. Then shut up. Forever.
LikeLike
“. . . his philosophical context for his science led him to see that “not everything that counts can be counted, and not everything that can be counted counts”.
Einstein is not the originator of that quote. Now maybe he believed something of the sort but the one who originally said that is “William Bruce Cameron instead of Albert Einstein. Cameron’s 1963 text “Informal Sociology: A Casual Introduction to Sociological Thinking” contained the following passage, Boldface has been added to excerpts [WCIS]:
‘It would be nice if all of the data which sociologists require could be enumerated because then we could run them through IBM machines and draw charts as the economists do. However, not everything that can be counted counts, and not everything that counts can be counted’.”
From: http://quoteinvestigator.com/2010/05/26/everything-counts-einstein/
LikeLike
Condemning the school for questioning a seven week vacation seems a bit elitist. But I understand how he’s using his personal issue with the school to prove a point about metrics.
LikeLike
The “payment by results” (PBR) concept has been used by the likes of Gates, Broad, etc. . . except that they demand to know the outcome, which has to be what they want, before even granting any monies. It is a control mechanism to get what they want, many times skirting/refusing to consider social and justice concerns. It’s the ol “Father Knows Best” scenario.
To get a better understanding of how it works I suggest/urge all to read “Policy Patrons: Philanthropy, Education Reform and the Politics of Influence” by Megan E. Tompkins-Strange and “Shadow Elite: How the World’s New Power Brokers Undermine Democracy, Government, and the Free Market” (even though there never has been a free market, ever, I shan’t quibble with the author’s choice in title) by Janine R Wedel.
LikeLike
Hi señor Swacker:
It is funny that the grant from corporate is truly from public money or their LOOTING TAX in LEGALLY loop-hole of legal system.
It is so puzzled to see political correctness in elected governmental officials who happily trade few millions of dollars in bribery for their own individual gain for a return of billions of dollars in public tax fund to corporate.
I have learned to console my conscience that people will pay back for their bad deeds and just leave them alone. I do not condone their bad deeds, but I only can offer the aphorism in “evil will always follow evil” without an escape or any threat.
It has been pleasant to read your recommendation of certain philosopher in your favor, May
LikeLike
And if I may correct one of the author’s thoughts:
“There ARE MANY questionS that the social impact bonds – for example, with offenders at HMP Peterborough or with children at risk of being taken into care in Essex – offer an exciting new opportunity to create significant positive CASH FOR VULTURE INVESTORS by aligning the state, investors and the taxpayer SO THAT THE MONIES FLOW TO SAID INVESTORS.” (MY EMPHASIS/CHANGES)
LikeLike
https://en.m.wikipedia.org/wiki/McNamara_fallacy
LikeLike
First and foremost, social Impact bonds, also called pay-for-success contracts, are financial products sold to investors in the US and elsewhere. Chicago and Utah have preschool programs financed in this way. The last time I checked, the expected return on investment is calculated to be the range of 5% to 7% provided that performance targets are met by the children who are enrolled and by the “providers” who are monitored for compliance with the contract. What matters is academic preparation, read by grade three, and the like for each cohort.
The cost of these contracts include fees to lawyers, auditors, external evaluators of outcomes, and the project managers who hire the people or agencies who actually provide the pre-school programs. These “providers” are now obliged to perform in a manner that pleases the investors. The payments made to the “intermediaries” is not usually disclosed.
Obama put $200 million into SIB incubation projects, most of these at Harvard. I have looked at the calculations for the “savings to taxpayers” that SIBs are supposed to produce. For a look at some of the promoters of SIBs see The Harvard Kennedy School Social Impact Bond Technical Assistance Lab (SIB Lab).
In 2014-15 the Robinhood Foundation had elaborate metrics for calculating the value of preschool at $50,650 per student. In theory, that is the amount that taxpayers would be “saved” by allowing venture capitalists to take over this social program on their terms. The incentives for cherrypicking and fraud are abundant. See some of the calculations for return on investment at https://www.robinhood.org/initiatives/early-childhood
The Utah program is intended to reduce the number of preschool students who require special education services. That is where the cherrypicking begins. From the get-go there are monetary incentives to exclude some children needing special education. For a summary of the Utah contract see http://socialventures.com.au/case-studies/utah-high-quality-preschool-sib/ You will notice that the link is to an Australian website. SIBs are hot financial products.
Meanwhile our local community just passed a tax to support our public schools, including a substantial enlargement of preschool opportunities. The levy had the support of major corporate interests. This is a very bright spot in our otherwise dismal political landscape. Taxpayers are looking forward to a return on investment, but not in the very hard, cold, and limited terms of venture capitalists and quants or payments to high-cost “intermediaries.”
LikeLike
PBR meant a certain type of beer in my hay-hauling days. I understand Pabst has made a comeback of sorts, and I wonder if there is an illogical twist to it, even as there is a perverse logic to the idea that educational outcomes are measurable. Unfortunately, we traveled this path, we diverted from the right way generations ago when teachers accepted the idea of grades. It was at that time that general testing began.
This occurred as universal education began to come to anyone who would have it, in mid-industrial revolution. Recall that Herbert Spencer had applied Darwin to Social interactions, and the idea that we all compete so that the best rule appealed to Europeans (of which, of course, we are a part except for those of us who are native to the Americas). Almost immediately, any fool could see the error in this line of thought, for who could compete with the child of the wealthy? Lester Ward suggested a sort of revised competition model wherein all of us could start out of the same gate. Testing was seen as a way to divide the sheep from the goats.
Along the way, Bloom gave us the idea of identifying the various levels of human competency in his famous taxonomy of behavioral objectives. Once we had that list, subsequent revisions of it led closer and closer to the idea of the PBR. If you can define exactly what every child should know, then testing is possible. The idea that any entity can define what every child should know is totalitarian on its face. The idea that that same entity can identify when the child should know it pulls into that totalitarian society the “identification” concept Duane notes at the top of this discussion. Thus the people who sit near the social bottom identify with that status and eschew the vote itself in a group that comprises over half the voting population.
We must turn back. Let us look for the other forks in the road. Let us admit that students need local history, and, since everybody cannot live in Brooklyn, allow students who live in Bell Buckle (my hometown) to study what they need to know as judged by their teachers. This process will demand that their teachers be competent enough to sift through the ideas they have learned and select the good fruit from the bad. Of course they will disagree, but the disagreement will be local, and the populace will not feel disenfranchised. If those who would argue for me to teach a particular thing in my class want me to teach that thing, let them come and argue with me, that I may know their point of view. It is slow and messy, but it works. What we have been doing since the advent of the competitive model has not been working.
LikeLike
Highschool dropout here.
This is why nothing gets done, I can not even finnish reading most of the posts, tooooo long and say nothing. Stop rewarding unwed mothers, illegal immigrants so we can get number of people down that NEED help.
If you want to FIX something, put some needy people in your house and pay for it blah blahblahbbbbbbllllllaaaahhhhh
LikeLike
To db decopp:
Please do not use any excuse of highs school drop out, BUT you need to ask a question about the conscience in a man who accepts someone to declare to WIPE OUT Public Education = your right to learn whatever your ability allows you and whenever you try to get your foot on the ground at any age and free for all. Please wake up to smell coffee. Bac2basic
LikeLike
db decopp,why are you a high school drop out? You make some pretty big assumptions about the people on this blog. I am trying not to make assumptions about you.
LikeLike
Then why mention it?
LikeLike