Why MigrationWatch is wrong — a plea for a more robust debate on immigration

If MigrationWatch wants to be taken seriously, it needs to go back to the statistics textbooks.

Last week, a series of media headlines suggested that immigrants were taking jobs away from British people as the economy enters recovery. These stories were based in part on new ONS statistics, bolstered in some of the papers by reference to a report from MigrationWatch which purported to show that recent immigration to the UK has caused higher unemployment.

I wrote here about why these stories were misleading, and explained that the MigrationWatch report had failed to demonstrate the causal link claimed by the headline on its press release ("Immigration has damaged employment prospects for British workers", MigrationWatch press release, 12 August).

Perhaps it's to be expected that MigrationWatch might play a bit fast and loose with the evidence -- it is a campaign group, after all. But this seems to be becoming a habit: yesterday it published another report, using an even more flawed methodology, to make very strong claims about immigration and youth unemployment. This was duly picked up by the right-wing media -- the Express today repeats this study's claims under the headline "Migrants rob young Britons of jobs", and the Telegraph goes for "13 per cent rise in Neets 'linked to immigration' ".

So here, for the record, are three important methodological reasons why MigrationWatch's claims don't stand up.

1. It is looking at the wrong variables (part 1)

Yesterday's MigrationWatch report on immigration and youth employment made the basic error of comparing the absolute numbers of migrants and young unemployed people between local authorities, rather than migration or youth unemployment as a percentage of local populations. This makes its findings more or less worthless.

It means that, in all likelihood, all it has demonstrated is that different local authorities have different populations (for example, in the 50 local authority areas the report analyses, Manchester has a population of roughly 500,000, while Cambridge has about 120,000 only), and that local authority areas with higher populations have both more migrants and more young unemployed people.

This probably also explains why MigrationWatch finds a much weaker relationship between migration and youth unemployment in London: London boroughs have more evenly-sized populations than the areas that the organisation's analysis focuses on.

2. It is looking at the wrong variables (part 2)

Last week's MigrationWatch report did look at migration and unemployment rates as percentages of local populations, rather than absolute numbers. But it plotted net migration between 2003 and 2009 against levels of unemployment in 2008/2009 -- any basic descriptive analysis should have looked at the change in unemployment in the period in question.

MigrationWatch would like us to think that immigration has caused unemployment to rise, but perhaps migrants have moved into areas that have always had high levels of unemployment, and immigration has had absolutely no impact at all on this. In fact, perhaps the migrants have been part of an economic renaissance in those areas and unemployment has fallen. The MigrationWatch report can tell us nothing about any of this, because it looks only at unemployment levels in 2008/2009, not changes in unemployment.

In fact, plot MigrationWatch's own 2003-2009 immigration measure in "high immigration" areas against changes in unemployment between 2003/2004 and 2008/2009, and you see that the relationship it claims to find between migration and unemployment disappears. In fact, we might even suggest that it is reversed -- the chart below (analogous to Figure 3 in last week's MigrationWatch report) could be taken to show that higher immigration is associated with lower increases in unemployment (coefficient = -0.2).

Migration

If I was working with the MigrationWatch model, I would now issue a press release saying: "Immigration reduces unemployment: for every 1,000 immigrants moving into these areas, unemployment was reduced by 200, on average. The government should therefore increase immigration in order to tackle worklessness."

I'm not doing this, because the chart above shows no such thing. If we excluded a couple of outliers it would show no relationship at all; and at best it shows correlation, not causation. This is MigrationWatch's third major methodological mistake.

3. The reports show (if anything) correlation, not causation

Both MigrationWatch reports show, at best, correlation, not causation. But the organisation makes strong causal claims on the basis of their analysis -- that immigration causes unemployment, and that reducing immigration would help to reduce unemployment. Last week Andrew Green used one of the reports to claim that

. . . this demonstrates that the "open-door" policies of the past decade have had a damaging effect on the employment, and therefore the standard of living, of UK-born workers in the areas most affected.

And yesterday, he said that: "Many factors contribute to youth unemployment but this research suggests that immigration is a significant factor in areas of high immigration. The case for getting immigration down to sensible levels, as the government has promised, gets stronger by the day."

Oddly, MigrationWatch now seems aware of this limitation of its methodology (perhaps someone attached to the organisation has read my paper, or Monday's column in the Guardian from Gary Younge), and indeed it admitted as much in yesterday's report (and associated press release) when it said:

These findings are based upon correlation analysis which does not, by itself, provide evidence of any causal relationship . . .

But it can't stop itself making unfounded claims. The report continues directly:

. . . but the findings nonetheless are highly indicative of the relationships between youth unemployment and migration.

Overall, the key findings are that:

  • The relationship between immigration and youth unemployment is positive and significant in the 50 local authorities in England with the highest rates of migration in the period 2003-2009, and in London.
  • The relationship becomes stronger and more adverse the higher the rate of immigration. In a sample of those local authorities outside London with the highest rate of immigration, the relationship is very strong (correlation of 0.9), and shows that, on average, for every 1,000 immigrants into these areas, the number of young unemployed rises by around 900.

The relationship MigrationWatch showed in yesterday's report may be positive (though, as noted above, it is looking at the wrong variables, which makes the results more or less irrelevant), but it isn't significant (in the statistical sense), and the group certainly hasn't demonstrated that an additional 1,000 immigrants arriving in any area caused 900 more young people to be unemployed.

I set out some more detail on this point, and some alternative interpretations of the findings from last week, in a paper published this week. To demonstrate that immigration has caused unemployment, MigrationWatch would have needed to conduct some econometric modelling, controlling for a range of other factors and establishing statistically significant results.

In fact, a number of studies have already done this. They are summed up in a paper by my colleagues Maria Latorre and Howard Reed:

In short, the best available UK microeconomic evidence on the effects of migration on employment finds either no effect at all, or very small negative effects.

This conclusion is also supported by a wide range of research in other OECD countries.

None of this is to say that immigration has never had an impact on employment -- indeed, it seems likely that it has had impacts in some areas of the UK, and perhaps for young people in particular. In general, however, the claim that migration causes increased unemployment is not supported by the evidence, and is definitely not proved by either of the MigrationWatch reports.

Poor-quality evidence harms the debate

If MigrationWatch wants to engage seriously on the question of migration and employment, it needs to go back to its statistics textbooks. I don't agree with it, but I'd like to engage in debate about its arguments, rather than its research methodologies.

This is, in effect, a plea for MigrationWatch to up its game -- if it finds any real evidence that migration has harmed employment in the UK, we all need to know about it. It is also worth remembering that this isn't just some intellectual or rhetorical exercise; important questions of government policy (and the lives of real people) are affected by the public mood that MigrationWatch helps to generate.

But this article is written much more in sorrow than in anger. Nick Clegg said this week that it is important to make sure that the immigration system "has people's confidence and trust and they know it works". The first step towards this objective is to have an open and robust public debate about immigration; but that debate can happen only on the basis of a shared understanding of certain basic facts, and of what constitutes valid evidence.

Sadly, MigrationWatch's contributions in the past week confuse, rather than enlighten.

Sarah Mulley is a senior research fellow at the Institute for Public Policy Research (IPPR).

Sarah Mulley is associate director at IPPR.

Photo: Getty
Show Hide image

The campaign to keep Britain in Europe must be based on hope, not fear

Together we can show the world a generous, outward-facing Britain we can all be proud of.

Today the Liberal Democrats launched our national campaign to keep Britain in Europe. With the polls showing the outcome of this referendum is on a knife-edge, our party is determined to play a decisive role in this once in a generation fight. This will not be an easy campaign. But it is one we will relish as the UK's most outward-looking and internationalist party. Together in Europe the UK has delivered peace, created the world’s largest free trade area and given the British people the opportunity to live, work and travel freely across the continent. Now is the time to build on these achievements, not throw them all away.

Already we are hearing fear-mongering from both sides in this heated debate. On the one hand, Ukip and the feuding Leave campaigns have shamelessly seized on the events in Cologne at New Year to claim that British women will be at risk if the UK stays in Europe. On the other, David Cameron claims that the refugees he derides as a "bunch of migrants" in Calais will all descend on the other side of the Channel the minute Britain leaves the EU. The British public deserve better than this. Rather than constant mud-slinging and politicising of the world's biggest humanitarian crisis since the Second World War, we need a frank and honest debate about what is really at stake. Most importantly this should be a positive campaign, one that is fought on hope and not on fear. As we have a seen in Scotland, a referendum won through scare tactics alone risks winning the battle but losing the war.

The voice of business and civil society, from scientists and the police to environmental charities, have a crucial role to play in explaining how being in the EU benefits the British economy and enhances people's everyday lives. All those who believe in Britain's EU membership must not be afraid to speak out and make the positive case why being in Europe makes us more prosperous, stable and secure. Because at its heart this debate is not just about facts and figures, it is about what kind of country we want to be.

The Leave campaigns cannot agree what they believe in. Some want the UK to be an offshore, deregulated tax haven, others advocate a protectionist, mean-hearted country that shuts it doors to the world. As with so many populist movements, from Putin to Trump, they are defined not by what they are for but what they are against. Their failure to come up with a credible vision for our country's future is not patriotic, it is irresponsible.

This leaves the field open to put forward a united vision of Britain's place in Europe and the world. Liberal Democrats are clear what we believe in: an open, inclusive and tolerant nation that stands tall in the world and doesn't hide from it. We are not uncritical of the EU's institutions. Indeed as Liberals, we fiercely believe that power must be devolved to the lowest possible level, empowering communities and individuals wherever possible to make decisions for themselves. But we recognise that staying in Europe is the best way to find the solutions to the problems that don't stop at borders, rather than leaving them to our children and grandchildren. We believe Britain must put itself at the heart of our continent's future and shape a more effective and more accountable Europe, focused on responding to major global challenges we face.

Together in Europe we can build a strong and prosperous future, from pioneering research into life-saving new medicines to tackling climate change and fighting international crime. Together we can provide hope for the desperate and spread the peace we now take for granted to the rest of the world. And together we can show the world a generous, outward-facing Britain we can all be proud of. So if you agree then join the Liberal Democrat campaign today, to remain in together, and to stand up for the type of Britain you think we should be.