In this age of information, math errors can lead to disaster. Nasa’s Mars Orbiter crashed because engineers forgot to convert to metric measurements; and JPMorgan Chase’s “London Whale” venture went bad in part because modellers divided by a sum instead of an average. So, did an Excel coding error destroy the western world’s economies?
The story so far: at the beginning of 2010 two Harvard economists, Carmen Reinhart and Kenneth Rogoff, circulated a paper, Growth in a Time of Debt , that purported to identify a critical "threshold," a tipping point, for government indebtedness. Once debt exceeds 90 per cent of gross domestic product, they claimed, economic growth drops sharply.
Reinhart and Rogoff had credibility thanks to a widely admired earlier book on the history of financial crises, and their timing was impeccable. The paper came out just after Greece went into crisis and played into the desire of many officials to "pivot" from stimulus to austerity. As a result, the paper instantly became famous: it was, and is, surely the most influential economic analysis of recent years.
In fact, Reinhart-Rogoff quickly achieved almost sacred status among self-proclaimed guardians of fiscal responsibility; their tipping-point claim was treated not as a disputed hypothesis but as unquestioned fact. For example, a Washington Post editorial earlier this year warned against any relaxation on the deficit front, because we are "dangerously near the 90 per cent mark that economists regard as a threat to sustainable economic growth". Notice the phrasing: "economists", not "some economists", let alone "some economists, vigorously disputed by other economists with equally good credentials", which was the reality.
For the truth is that Reinhart-Rogoff faced substantial criticism from the start, and the controversy grew over time. Many economists pointed out that a negative correlation between debt and economic performance need not mean high debt causes low growth. It could just as easily be the other way around, with poor economic performance leading to high debt. Indeed, that’s obviously the case for Japan, which went deep into debt only after its growth collapsed in the early 1990s.
Another problem emerged: other researchers, using seemingly comparable data, couldn’t replicate the results. They typically found a correlation between high debt and slow growth – but nothing that looked like a tipping point at 90 per cent or, indeed, any particular level of debt.
Mystery solved
Finally, Reinhart and Rogoff allowed researchers at the University of Massachusetts to look at their original spreadsheet – and the mystery of the irreproducible results was solved. First, they omitted some data. Second, they used unusual and highly questionable statistical procedures; and finally, yes, they made an Excel coding error. Correct these oddities and errors, and you get what other researchers have found: some correlation between high debt and slow growth, with no indication of which is causing which, but no sign at all of that 90 per cent "threshold".
In response, Reinhart and Rogoff have acknowledged the coding error, defended their other decisions and claimed that they never asserted that debt necessarily causes slow growth. That’s a bit disingenuous because they repeatedly insinuated that proposition even if they avoided saying it outright. But, in any case, what really matters isn’t what they meant to say, it’s how their work was read: austerity enthusiasts trumpeted that supposed 90 per cent tipping point as a proven fact and a reason to slash government spending even in the face of mass unemployment.
So the Reinhart-Rogoff fiasco needs to be seen in the broader context of austerity mania: the obviously intense desire of policymakers, politicians and pundits to turn their backs on the unemployed and instead use the economic crisis as an excuse to slash social programs.
What the affair shows is the extent to which austerity has been sold on false pretences. For three years, the turn to austerity has been presented not as a choice but as a necessity. Economic research, austerity advocates insisted, showed that terrible things happen once debt exceeds 90 per cent of GDP. But “economic research” showed no such thing: a couple of economists made that assertion, while many others disagreed. Policymakers abandoned the unemployed and turned to austerity because they wanted to, not because they had to.
So will toppling Reinhart-Rogoff from its pedestal change anything? I’d like to think so. But I predict that the usual suspects will just find another dubious piece of economic analysis to canonise, and the depression will go on and on.