Is Excel the most dangerous piece of software in the world?

Microsoft's calculator is partially to blame for JPMorgan losing $9bn, and a lot more besides.

Is Excel the most dangerous piece of software in the world? Baseline Scenario's James Kwak reports on a little-mentioned aspect of the notorious "London Whale" debacle at JPMorgan, where Bruno Iksil headed a proprietary trading team which made losses of up to $9bn.

It turns out, Kwak writes, that Excel was partly to blame:

To summarize: JPMorgan’s Chief Investment Office needed a new value-at-risk (VaR) model for the synthetic credit portfolio (the one that blew up)… The new model “operated through a series of Excel spreadsheets, which had to be completed manually, by a process of copying and pasting data from one spreadsheet to another”… After the London Whale trade blew up, the Model Review Group discovered that the model had not been automated and found several other errors. Most spectacularly,

“After subtracting the old rate from the new rate, the spreadsheet divided by their sum instead of their average, as the modeler had intended. This error likely had the effect of muting volatility by a factor of two and of lowering the VaR…”

Kwak wonders if the very ease of use that Excel offers — allowing people with no programming experience to knock together what are, in effect, relatively advanced applets — also makes it dangerous to use in most sensitive situations. There's no debug, no audit trail, and no way to test why a spreadsheet returns the value it does. Similarly, training for Excel, where it exists, tends to ignore the importance of elegant and well-designed code, leading to legacy spreadsheets being used with internal workings which are opaque to all but their original creator, who may have left the company 20 years earlier.

The problem is, though, that Excel is the worst way to run a company's software other than all the other ways. The fact that it's capable of being programmed by the people who will end up using it means that it might enable hacked-together code, but it also prevents exactly the sort of corporate bloat which leads to people circumventing their company's software in the first place.

Bill Gates threatens the world with Microsoft Office in 2003. Photograph: Getty Images

Alex Hern is a technology reporter for the Guardian. He was formerly staff writer at the New Statesman. You should follow Alex on Twitter.

Getty
Show Hide image

The tale of Battersea power station shows how affordable housing is lost

Initially, the developers promised 636 affordable homes. Now, they have reduced the number to 386. 

It’s the most predictable trick in the big book of property development. A developer signs an agreement with a local council promising to provide a barely acceptable level of barely affordable housing, then slashes these commitments at the first, second and third signs of trouble. It’s happened all over the country, from Hastings to Cumbria. But it happens most often in London, and most recently of all at Battersea power station, the Thames landmark and long-time London ruin which I wrote about in my 2016 book, Up In Smoke: The Failed Dreams of Battersea Power Station. For decades, the power station was one of London’s most popular buildings but now it represents some of the most depressing aspects of the capital’s attempts at regeneration. Almost in shame, the building itself has started to disappear from view behind a curtain of ugly gold-and-glass apartments aimed squarely at the international rich. The Battersea power station development is costing around £9bn. There will be around 4,200 flats, an office for Apple and a new Tube station. But only 386 of the new flats will be considered affordable

What makes the Battersea power station development worse is the developer’s argument for why there are so few affordable homes, which runs something like this. The bottom is falling out of the luxury homes market because too many are being built, which means developers can no longer afford to build the sort of homes that people actually want. It’s yet another sign of the failure of the housing market to provide what is most needed. But it also highlights the delusion of politicians who still seem to believe that property developers are going to provide the answers to one of the most pressing problems in politics.

A Malaysian consortium acquired the power station in 2012 and initially promised to build 517 affordable units, which then rose to 636. This was pretty meagre, but with four developers having already failed to develop the site, it was enough to satisfy Wandsworth council. By the time I wrote Up In Smoke, this had been reduced back to 565 units – around 15 per cent of the total number of new flats. Now the developers want to build only 386 affordable homes – around 9 per cent of the final residential offering, which includes expensive flats bought by the likes of Sting and Bear Grylls. 

The developers say this is because of escalating costs and the technical challenges of restoring the power station – but it’s also the case that the entire Nine Elms area between Battersea and Vauxhall is experiencing a glut of similar property, which is driving down prices. They want to focus instead on paying for the new Northern Line extension that joins the power station to Kennington. The slashing of affordable housing can be done without need for a new planning application or public consultation by using a “deed of variation”. It also means Mayor Sadiq Khan can’t do much more than write to Wandsworth urging the council to reject the new scheme. There’s little chance of that. Conservative Wandsworth has been committed to a developer-led solution to the power station for three decades and in that time has perfected the art of rolling over, despite several excruciating, and occasionally hilarious, disappointments.

The Battersea power station situation also highlights the sophistry developers will use to excuse any decision. When I interviewed Rob Tincknell, the developer’s chief executive, in 2014, he boasted it was the developer’s commitment to paying for the Northern Line extension (NLE) that was allowing the already limited amount of affordable housing to be built in the first place. Without the NLE, he insisted, they would never be able to build this number of affordable units. “The important point to note is that the NLE project allows the development density in the district of Nine Elms to nearly double,” he said. “Therefore, without the NLE the density at Battersea would be about half and even if there was a higher level of affordable, say 30 per cent, it would be a percentage of a lower figure and therefore the city wouldn’t get any more affordable than they do now.”

Now the argument is reversed. Because the developer has to pay for the transport infrastructure, they can’t afford to build as much affordable housing. Smart hey?

It’s not entirely hopeless. Wandsworth may yet reject the plan, while the developers say they hope to restore the missing 250 units at the end of the build.

But I wouldn’t hold your breath.

This is a version of a blog post which originally appeared here.

0800 7318496