The Tories' manipulation of education statistics

There is no evidence that reading standards have fallen among school children.

In Saturday's Guardian (Letters, 28 Jan), schools minister Nick Gibb defends the government's view that phonics are the only way to reach children to read. His central justification is that something must be done: "International studies rank England 25th for reading - down from seventh nine years ago."

In the very literal sense, Gibb is correct. In 2000, the OECD’s Programme for International Student Assessment (PISA) placed England in 7th position in its table (p.53). In 2009, it was in the 25th row of a similar table (p. 56).

In any other sense you care to mention, Gibb is entirely wrong , because:

1) Twelve other countries, nominally above England in the 2009 tables, have statistically insignificant higher scores. The National Foundation for Educational Research's summary of the OECD findings is quite explicit about this: "Because of the areas of uncertainty described above, interpretations of very small differences between two sets of results are often meaningless. Were they to be measured again, it could well be that the results would turn out the other way round (p.8)"

2) 31 countries took part in the tests in 2000, and 67 in 2009. Shanghai and Singapore may be nominally above the UK in the 2009 tables but they didn’t take part in the 2006 or earlier surveys. This makes direct comparison between years invalid.

3) The OECD’s warned explicitly (para 2 of this technical note) against comparing earlier PISA results with earlier data, because the very low response rate for earlier years largely invalidated samples.

4) The 2000 and 2003 tests were conducted some months earlier in school year 11 (Nov/Dec) than the 2006/2009 (March-May) ones, as an exception to the international study (to make room for GCSE preparations). As John Jerrim of the Institute of Education has noted, taking the tests around half a school year early makes a very obvious difference: "[I]t is important to understand that between November/December and March‐May of year 11 is likely to be a period when children add substantially to their knowledge of the PISA subjects as it is when pupils are working towards important national exams. Consequently, one should expect the year 11 pupils in the PISA 2000/2003 cohort to out‐perform their peer taking the test in 2006/2009 due to the extra five months they have had at school….."

In short, there is simply no reliable evidence that 15-year-olds in England are any less able to read and understand texts, when compared to their international peers, than they were nine year ago. Yet here we have a government minister using that argument as a key reason for a fundamental and controversial change in which five and six-year-olds are taught.

Now, if this was a result of incompetence on the part of the minister and his department, that would be worrying enough. But what should really concern us is that the Department of Education almost certainly knows perfectly well that its "interpretation" of the OECD data is entirely incorrect, but is determined to carry on peddling its untruths anyway.

The key evidence of this, I suggest, is the way in which Michael Gove himself defended his proposals for a return to 'O' Levels/CSE in parliament on 21 June:

The sad truth is that, if we look at the objective measure of how we have done over the past 15 years, we find that on international league tables our schools fell in reading from 523 to 494 points, in maths from 529 to 492 and in science from 528 to 514.

Here, Gove used the OECD raw scores for 2000 and 2009 rather than the table rankings (the lower scores can largely still be explained by two of the factors above). He almost certainly did this because he and his team realised they had been rumbled by blogs like Though Cowards Flinch with a mind to detail, and by a Guardian editorial of the same day, which said:

Mr Gove.... latches on to data purporting to show English schools plummeting down world rankings. The Institute of Education has meticulously documented all sorts of distortions in these apparently alarming figures, but such calming analysis fails to register. Mr Gove should go away, revise the evidence properly – and prepare for a resit.

Clearly, Gove didn't want to be caught red-handed by Labour members assiduous enough to have read the Guardian that morning. Yet just a month later we have the schools minister writing to the same paper with the very nonsense his boss had been wary of using.

The real tragedy, of course, is not that Guardian readers are being lied to, but that actual educational policy is being developed on the basis of false data. The direct consequence of the pretence that comparative reading standards are plummeting is a emphasis on setting higher targets, as set out by Sir Michael Wilshaw, the Chief Inspector of Schools who, sadly, has been all too complicit in the myth-making. Wilshaw has stated that: "So one of the first questions we need to ask is whether the national end-of-primary-school target of level 4 is sufficiently high to provide an adequate foundation for success at secondary school."

Yet data in the government's own 2010 education white paper suggests that the actual problem policymakers should be facing up to is not low targets, but unequal distributi on of achievement between the upper and lower percentiles compared with other countries (see Exhibit 1.1 in this PIRLS report). By focusing their energies on the creation of fundamentally dishonest headlines, the government and its advisers are actively missing out on data which might actually improve the lives of young people.

Of course, this is not the first time that the government has resorted to the use of dodgy statistics. Chris Grayling has already had his wrists slapped by the UK Statistics Authority for his flagrant abuse of statistics. Now, it even looks as though the government may attemp to explain away its disastrous management of the economy by casting doubt on the reliability of the GDP data collected by the Office for National Statistics, without providing a shred of evidence as to how these dataset might have been considered reliable for so long but are now, so suddenly, suspect.

Overall, a picture is starting to emerge of a government prepared, in its mix of desperation and ideological fervour, to go one step beyond spin. That should keep us on our toes.

"Actual educational policy is being developed on the basis of false data." Photograph: Getty Images.

Paul Cotterill is a blogger for Liberal Conspiracy and Though Cowards Flinch.

Getty
Show Hide image

Theresa May's offer to EU citizens leaves the 3 million with unanswered questions

So many EU citizens, so little time.

Ahead of the Brexit negotiations with the 27 remaining EU countries, the UK government has just published its pledges to EU citizens living in the UK, listing the rights it will guarantee them after Brexit and how it will guarantee them. The headline: all 3 million of the country’s EU citizens will have to apply to a special “settled status” ID card to remain in the UK after it exist the European Union.

After having spent a year in limbo, and in various occasions having been treated by the same UK government as bargaining chips, this offer will leave many EU citizens living in the UK (this journalist included) with more questions than answers.

Indisputably, this is a step forward. But in June 2017 – more than a year since the EU referendum – it is all too little, too late. 

“EU citizens are valued members of their communities here, and we know that UK nationals abroad are viewed in the same way by their host countries.”

These are words the UK’s EU citizens needed to hear a year ago, when they woke up in a country that had just voted Leave, after a referendum campaign that every week felt more focused on immigration.

“EU citizens who came to the UK before the EU Referendum, and before the formal Article 50 process for exiting the EU was triggered, came on the basis that they would be able to settle permanently, if they were able to build a life here. We recognise the need to honour that expectation.”

A year later, after the UK’s Europeans have experienced rising abuse and hate crime, many have left as a result and the ones who chose to stay and apply for permanent residency have seen their applications returned with a letter asking them to “prepare to leave the country”, these words seem dubious at best.

To any EU citizen whose life has been suspended for the past year, this is the very least the British government could offer. It would have sounded a much more sincere offer a year ago.

And it almost happened then: an editorial in the Evening Standard reported last week that Theresa May, then David Cameron’s home secretary, was the reason it didn’t. “Last June, in the days immediately after the referendum, David Cameron wanted to reassure EU citizens they would be allowed to stay,” the editorial reads. “All his Cabinet agreed with that unilateral offer, except his Home Secretary, Mrs May, who insisted on blocking it.” 

"They will need to apply to the Home Office for permission to stay, which will be evidenced through a residence document. This will be a legal requirement but there is also an important practical reason for this. The residence document will enable EU citizens (and their families) living in the UK to demonstrate to third parties (such as employers or providers of public services) that they have permission to continue to live and work legally in the UK."

The government’s offer lacks details in the measures it introduces – namely, how it will implement the registration and allocation of a special ID card for 3 million individuals. This “residence document” will be “a legal requirement” and will “demonstrate to third parties” that EU citizens have “permission to continue to live and work legally in the UK.” It will grant individuals ““settled status” in UK law (indefinite leave to remain pursuant to the Immigration Act 1971)”.

The government has no reliable figure for the EU citizens living in the UK (3 million is an estimation). Even “modernised and kept as smooth as possible”, the administrative procedure may take a while. The Migration Observatory puts the figure at 140 years assuming current procedures are followed; let’s be optimistic and divide by 10, thanks to modernisation. That’s still 14 years, which is an awful lot.

To qualify to receive the settled status, an individual must have been resident in the UK for five years before a specified (although unspecified by the government at this time) date. Those who have not been a continuous UK resident for that long will have to apply for temporary status until they have reached the five years figure, to become eligible to apply for settled status.

That’s an application to be temporarily eligible to apply to be allowed to stay in the UK. Both applications for which the lengths of procedure remain unknown.

Will EU citizens awaiting for their temporary status be able to leave the country before they are registered? Before they have been here five years? How individuals will prove their continuous employment or housing is undisclosed – what about people working freelance? Lodgers? Will proof of housing or employment be enough, or will both be needed?

Among the many other practicalities the government’s offer does not detail is the cost of such a scheme, although it promises to “set fees at a reasonable level” – which means it will definitely not be free to be an EU citizen in the UK (before Brexit, it definitely was.)

And the new ID will replace any previous status held by EU citizens, which means even holders of permanent citizenship will have to reapply.

Remember that 140 years figure? Doesn’t sound so crazy now, does it?

0800 7318496