How Michael Gove manipulated education statistics

The Education Secretary's misleading claim that the UK has plummeted down the international league tables.

One of Michael Gove's favourite arguments for his school reforms is that Britain has plummeted down the international education league tables. In June 2011 he told Policy Exchange that the UK had fallen from "4th to 16th place in science; from 7th to 25th place in literacy; and from 8th to 28th in maths" between 2000 and 2009 in the OECD's Programme for International Student Assessment (PISA).

But how reliable are the statistics? In this week's NS, Peter Wilby draws attention to a story that deserves more than attention than it has so far received (no national paper has reported on it). Last month, in response to a letter from David Miliband, Andrew Dilnot, the chair of the UK Statistics Authority, expressed "concern" about the Department for Education's unqualified use of the figures. He noted that the OECD's 2009 report for the UK included the following "important caveat":

Trend comparisons, which are a feature of the PISA 2009 reporting are not reported here because for the United Kingdom it is only possible to compare 2006 and 2009 data. As the PISA 2000 and PISA 2003 samples did not meet the PISA response-rate standards, no trend comparisons are possible for these years.

In other words, Gove should not be comparing results from 2000 with those from 2009. Dilnot wrote: "While I understand that some users of these data would like to make comparisons between the first PISA study in 2000 and the most recent in 2009, the weaknesses relating to the response-rate standard in earlier studies should not be ignored."

He concluded: "These uncertainties and weaknesses are not just a technical footnote; they are themselves an important part of the evidence, and affect interpretation and meaning. League tables and the presentation of international rankings can be statistically problematic, and require clear and careful commentary alongside them."

The statistics chief also noted a review published by the Institute for Education which concluded that "problems with identifying change over time" meant the apparent decline in secondary school pupils' performance should not be treated as a "statistically robust result". The Department for Education is yet to respond.

This isn't the only recent instance of the coalition playing fast and loose with statistics. David Cameron is fond of boasting that "one million" new private sector jobs have been created since the coalition came to power, but, as I've noted before, what he doesn't mention is that 196,000 of these were simply reclassified from the public sector.

After complaining for years about Gordon Brown's manipulation of economic statistics, the coalition came to power promising a new era of transparency. But Gove and Cameron's behaviour suggests it's not prepared to practise what it preached.

Education Secretary Michael Gove was criticised for ignoring "weaknesses" in the statistics. Photoraph: Getty Images.

George Eaton is political editor of the New Statesman.

Photo: Getty
Show Hide image

Hyper-partisan Corbynite websites show how the left can beat the tabloids online

If I were a young Tory looking forward to a long career, I’d be worried.

Despite their best efforts during the election campaign, the Sun, Daily Mail, Telegraph and Express failed to convince voters to give Theresa May a majority, let alone the landslide she craved. Instead, Labour made inroads thanks partly to increased turnout among younger voters who prefer to get their news online and from social networks.

The centre of power in the media has been shifting to the web for years, but during the election we saw just how well a crop of hyper-partisan left-wing news sites are using social media to gain the kind of influence once restricted to the tabloid press.

Writers for sites such as the Canary or Evolve Politics see themselves as activists as much as journalists. That frees them to spin news stories in a way that is highly attuned to the dynamics of social media, provoking strong emotions and allowing them to address their audience like a friend down the pub “telling it how it really is”.

People on Facebook or Twitter use news to tell their friends and the wider world who they are and what they believe in. Sharing the Canary story “Theresa May is trying to override parliamentary democracy to cling to power. But no one’s fooled” is a far more effective signal that you don’t like the Tory government than posting a dry headline about the cancellation of the 2018 Queen’s Speech.

This has long-term implications for the right’s ability to get its message out. Research by BuzzFeed has found that pro-Conservative stories were barely shared during the election campaign. It appears the “shy Tory” factor that skewed opinion polling in previous elections lives on, influencing what people are prepared to post online. If I were a young Tory looking forward to a long career, I’d be worried.

Distorted reality

Television was once the press’s greatest enemy. But its “newspaper reviews” now offer print titles a safe space in which they are treated with a level of respect out of all proportion to their shrinking readership. Surely this must change soon? After all, the Independent sometimes gets a slot (despite having ceased print publication last year) for its digital front page. How is it fair to exclude BuzzFeed News – an organisation that invests in reporting and investigations – and include the Daily Express, with its less-than-prescient weather predictions?

Another problem became apparent during the election. Because the press is so dominated by the right, coverage from the supposedly impartial broadcasters was skewed, as presenters and guests parroted headlines and front-page stories from partisan newspapers. Already, some political programmes, such as BBC1’s The Andrew Marr Show, have experimented with including news from outside Fleet Street. One of the newspaper industry’s most reliable allies is looking for new friends.

Alternative facts

The rise of sites spreading the left-wing gospel across Facebook may be good for Labour but that doesn’t mean it’s good for the public. This was illustrated on 16 June in a post by a relatively new entrant called the Skwawkbox, which claimed that a government “D-notice” – now called a DSMA-notice – might be in place restricting news organisations from reporting on the number of casualties from the Grenfell Tower fire.

The claim was untrue and eventually an update was added to the post, but not before it was widely shared. The man behind the blog (who gives his name in interviews only as “Steve”) insisted that because he had included a couple of caveats, including the word “if” in the text of his article, he was justified in spreading an unsubstantiated rumour. Replacing an irresponsible right-wing tabloid culture in print with equally negligent left-wing news sites online doesn’t feel much like progress.

Blood and bias

Narratives about the corrupt, lying mainstream media (the “MSM” for short) have become more prevalent during the election, and it’s clear they often hit a nerve.

On 17 June, a protest over Theresa May’s deal with the DUP and the Grenfell Tower fire made its way past BBC Broadcasting House, where a small group stopped to chant: “Blood, blood, blood on your hands!” Hours later, in the shadow of the burned-out tower, I heard a young woman complain loudly to her friends about money being used to fly BBC news helicopters when it could have gone to displaced victims.

The BBC cites the accusations of bias it receives from both ends of the political spectrum as evidence that it is resolutely centrist. But while many of its greatest critics would miss the BBC if it goes, the corporation could do a better job of convincing people why it’s worth keeping around.

Grenfell grievances

Early reports of the attack on a Muslim crowd in Finsbury Park on 19 June exhibited a predictably depressing double standard. The perpetrator was a “lone wolf”, and the Mail identified him as “clean-shaven”: phrases it is hard to imagine being used about an Islamist. Yet the media don’t just demonise Muslims in its reporting; they also marginalise them. Coverage of Grenfell contained plenty of references to the churches in this part of west London and its historic black community. Yet Muslims and the relief work carried out by local mosques received comparatively little coverage. Community issues such as Islam’s requirement that the dead are buried swiftly were largely ignored, even though a large number of those killed or made homeless by the fire were Muslim.

I suspect this may have something to do with outdated ideas of what north Kensington is like. But it also must reflect the reality that just 0.4 per cent of UK journalists are Muslim, according to a study by City University in London. The lack of diversity in the media isn’t just a moral issue; it’s one that affects our ability to tell the full story.

This article first appeared in the 22 June 2017 issue of the New Statesman, The zombie PM

0800 7318496