How Michael Gove manipulated education statistics

The Education Secretary's misleading claim that the UK has plummeted down the international league tables.

One of Michael Gove's favourite arguments for his school reforms is that Britain has plummeted down the international education league tables. In June 2011 he told Policy Exchange that the UK had fallen from "4th to 16th place in science; from 7th to 25th place in literacy; and from 8th to 28th in maths" between 2000 and 2009 in the OECD's Programme for International Student Assessment (PISA).

But how reliable are the statistics? In this week's NS, Peter Wilby draws attention to a story that deserves more than attention than it has so far received (no national paper has reported on it). Last month, in response to a letter from David Miliband, Andrew Dilnot, the chair of the UK Statistics Authority, expressed "concern" about the Department for Education's unqualified use of the figures. He noted that the OECD's 2009 report for the UK included the following "important caveat":

Trend comparisons, which are a feature of the PISA 2009 reporting are not reported here because for the United Kingdom it is only possible to compare 2006 and 2009 data. As the PISA 2000 and PISA 2003 samples did not meet the PISA response-rate standards, no trend comparisons are possible for these years.

In other words, Gove should not be comparing results from 2000 with those from 2009. Dilnot wrote: "While I understand that some users of these data would like to make comparisons between the first PISA study in 2000 and the most recent in 2009, the weaknesses relating to the response-rate standard in earlier studies should not be ignored."

He concluded: "These uncertainties and weaknesses are not just a technical footnote; they are themselves an important part of the evidence, and affect interpretation and meaning. League tables and the presentation of international rankings can be statistically problematic, and require clear and careful commentary alongside them."

The statistics chief also noted a review published by the Institute for Education which concluded that "problems with identifying change over time" meant the apparent decline in secondary school pupils' performance should not be treated as a "statistically robust result". The Department for Education is yet to respond.

This isn't the only recent instance of the coalition playing fast and loose with statistics. David Cameron is fond of boasting that "one million" new private sector jobs have been created since the coalition came to power, but, as I've noted before, what he doesn't mention is that 196,000 of these were simply reclassified from the public sector.

After complaining for years about Gordon Brown's manipulation of economic statistics, the coalition came to power promising a new era of transparency. But Gove and Cameron's behaviour suggests it's not prepared to practise what it preached.

Education Secretary Michael Gove was criticised for ignoring "weaknesses" in the statistics. Photoraph: Getty Images.

George Eaton is political editor of the New Statesman.

Ukip's Nigel Farage and Paul Nuttall. Photo: Getty
Show Hide image

Is the general election 2017 the end of Ukip?

Ukip led the way to Brexit, but now the party is on less than 10 per cent in the polls. 

Ukip could be finished. Ukip has only ever had two MPs, but it held an outside influence on politics: without it, we’d probably never have had the EU referendum. But Brexit has turned Ukip into a single-issue party without an issue. Ukip’s sole remaining MP, Douglas Carswell, left the party in March 2017, and told Sky News’ Adam Boulton that there was “no point” to the party anymore. 

Not everyone in Ukip has given up, though: Nigel Farage told Peston on Sunday that Ukip “will survive”, and current leader Paul Nuttall will be contesting a seat this year. But Ukip is standing in fewer constituencies than last time thanks to a shortage of both money and people. Who benefits if Ukip is finished? It’s likely to be the Tories. 

Is Ukip finished? 

What are Ukip's poll ratings?

Ukip’s poll ratings peaked in June 2016 at 16 per cent. Since the leave campaign’s success, that has steadily declined so that Ukip is going into the 2017 general election on 4 per cent, according to the latest polls. If the polls can be trusted, that’s a serious collapse.

Can Ukip get anymore MPs?

In the 2015 general election Ukip contested nearly every seat and got 13 per cent of the vote, making it the third biggest party (although is only returned one MP). Now Ukip is reportedly struggling to find candidates and could stand in as few as 100 seats. Ukip leader Paul Nuttall will stand in Boston and Skegness, but both ex-leader Nigel Farage and donor Arron Banks have ruled themselves out of running this time.

How many members does Ukip have?

Ukip’s membership declined from 45,994 at the 2015 general election to 39,000 in 2016. That’s a worrying sign for any political party, which relies on grassroots memberships to put in the campaigning legwork.

What does Ukip's decline mean for Labour and the Conservatives? 

The rise of Ukip took votes from both the Conservatives and Labour, with a nationalist message that appealed to disaffected voters from both right and left. But the decline of Ukip only seems to be helping the Conservatives. Stephen Bush has written about how in Wales voting Ukip seems to have been a gateway drug for traditional Labour voters who are now backing the mainstream right; so the voters Ukip took from the Conservatives are reverting to the Conservatives, and the ones they took from Labour are transferring to the Conservatives too.

Ukip might be finished as an electoral force, but its influence on the rest of British politics will be felt for many years yet. 

0800 7318496