The DWP's bogus psychometric tests are dystopian, but randomised trials aren't the problem

The solution is more trials, not fewer.

The DWP is under fire for mandating benefit claimants to carry out bogus psychometric tests. The Guardian's Shiv Malik reports:

The test called My Strengths, devised by Downing Street's behavioural insights or "nudge" unit, has been exposed by bloggers as a sham with results having no relation to the answers given.

Some of the 48 statements on the DWP test include: "I never go out of my way to visit museums," and: "I have not created anything of beauty in the last year." People are asked to grade their answers from "very much like me" to "very much unlike me".

When those being tested complete the official online questionnaire, they are assigned a set of five positive "strengths" including "love of learning" and "curiosity" and "originality".

However, those taking the supposed psychological survey have found that by clicking on the same answer repeatedly, users will get the same set of personality results as those entering a completely opposite set of answers.

The aim behind the "test" is apparently to prevent the claimants with motivating statements about themselves, in an effort to encourage them to find work. The behavioural insight team itself describes the process as:

Building psychological resilience and wellbeing for those who are still claiming after 8 weeks through ‘expressive writing’ and strengths identification.

But it's worth being clear about why "My Strengths" is so unpleasant. The problem with it is that unemployed people are being lied to in an effort to psychologically manipulate them into a mental state where they will do what the Government want. That sounds like a sentence from a dystopian future, but it's a fairly straight description of what is happening.

But Steve Walker, the blogger who broke the story, goes further, attacking the test because it's part of a government trial.

Walker writes that the trial breaches principals established by the EU's body for co-ordinating R&D which state that the medical rule of informed consent "remains valid for any other kind of research".

Principles aren't laws, so there's not a legal case to answer here; but even if we're just arguing morality, establishing medical-grade requirements of informed consent in social research would be a terrible idea.

The rise of randomised controlled trials (and, to a lesser extent, randomised trials and controlled trials – not everything can be both randomised and controlled) in social research is one of the most promising trends of the last decade. It's good not only because it can increase our knowledge of how to fight social problems in employment, education and crime, but because it's barely different from what's being done anyway.

Most providers of the government's work programme – which involves more than just the unpaid mandatory labour that has made it infamous –  have neither the staff, time or money to offer every service to every person who comes through their doors. When they're trying to decide who gets to go on the CV workshops and who doesn't, the obvious thing to do is to chart which groups improve the most when given the workshops. This is doubly true if you don't actually know whether CV workshops help or harm; keeping a good eye on the results is invaluable.

When it comes to trials, the biggest crime of the BIT isn't that they did them, but that they didn't do them enough. As a report from December shows, the team aggregated together three completely different changes:

  1. Making sure every customer talks about getting back to work on their first day (not after 2 weeks) by cutting down and reorganising processes;
  2. Introducing stretching commitment devices which focus on what the job seeker will do for the whole of the next fortnight. This replaces the present system where advisors ask if job seekers have done three job search activities in each of the previous two weeks;
  3. Building psychological resilience and wellbeing for those who are still claiming after 8 weeks through ‘expressive writing’ and strengths identification.

Overall, apparently, "job seekers in the treatment group are 15-20 per cent more likely than those in the control group to be off benefits 13 weeks after signing on" – but the trial is so badly designed that we can't see which of these treatments helped the most. It could well be the case that the My Strengths test actually hindered jobseekers, but the effect was hidden by the benefits of "cutting down and reorganising processes".

The government needs to behave ethically when dealing with its citizens, and that goes whether or not it is done in the framework of a formal trial. But if it does try a new ethical way of helping jobseekers, the last thing we want to do is discourage it from measuring the results.

Alex Hern is a technology reporter for the Guardian. He was formerly staff writer at the New Statesman. You should follow Alex on Twitter.

Photo: Getty Images
Show Hide image

What's to be done about racial inequality?

David Cameron's words on equal opportunities are to be welcomed - now for some action, says Sunder Katwala.

David Cameron made the strongest, clearest and most high profile statement about ethnic inequalities and the need to tackle discrimination ever yet offered by a British Prime Minister in his leader’s speech to the Conservative Party conference in Manchester.
“Picture this. You’ve graduated with a good degree. You send out your CV far and wide. But you get rejection after rejection. What’s wrong? It’s not the qualifications or the previous experience. It’s just two words at the top: first name, surname. Do you know that in our country today: even if they have exactly the same qualifications, people with white-sounding names are nearly twice as likely to get call backs for jobs than people with ethnic-sounding names? … That, in 21st century Britain, is disgraceful. We can talk all we want about opportunity, but it’s meaningless unless people are really judged equally”, said Cameron.
While the proof of the pudding will be in the eating, this was a powerfully argued Prime Ministerial intervention – and a particularly well-timed one, for three reasons.

Firstly, the Prime Minister was able to root his case in an all-but-universally accepted appeal for equal opportunities. It will always prove more difficult in practice to put political energy and resources behind efforts to remedy discrimination against a minority of the population unless a convincing fairness case is made that values cherished across our whole society are at stake. Cameron’s argument, that any party which tells itself that it is the party of the ‘fair chance’ and ‘the equal shot’ must have a response when there is such clear evidence of discrimination, should prove persuasive to a Conservative Party that has not seen race inequalities as its natural territory. Cameron argued that the same principles should animate responses to discrimination when it comes to race, gender and social class. Put like that, wanting job interviews to be fair – by eradicating conscious and unconscious patterns of bias wherever possible – would strike most Britons as offering as clear a case of the values of fair play as wanting the best baker to win the Great British Bake-Off on television.
Secondly, Cameron’s intervention comes at a potential "tipping point" moment for fair opportunities across ethnic groups. Traditionally, ethnic discrimination has been discussed primarily through the lens of its impact on the most marginalised. Certainly, persistent gaps in the criminal justice system, mental health provision and unemployment rates remain stark for some minority groups. What has been less noticed is the emergence of a much more complex pattern of opportunity and disadvantage – not least as a consequence of significant ethnic minority progress.

Most strikingly of all, in educational outcomes, historic attainment gaps between ethnic minorities and their white British peers have disappeared over the last decade. In the aggregate, ethnic minorities get better GCSE results on average. Ethnic minority Britons are more likely, not less likely, to be university graduates than their fellow citizens. 

As a result of that progress, Cameron’s intervention comes at a moment of significant potential – but significant risk too. Britain’s ethnic minorities are the youngest and fastest-growing sections of British society. If that educational progress translates into economic success, it will make a significant contribution to the "Great British Take-Off" that the Prime Minister envisions. But if that does not happen, with educational convergence combined with current ‘ethnic penalties’ in employment and income persisting, then that potential could well curdle into frustration that the British promise of equal opportunities is not being kept.  Cameron also mirrored his own language in committing himself to both a ‘fight against extremism’ and a ‘fight against discrimination’: while those are distinct challenges and causes, actively pursuing both tracks simultaneously has the potential, at least, depolarise some debates about responses to extremism  - and so to help deepen the broad social coalitions we need for a more cohesive society too.

Thirdly, Cameron’s challenge could mark an important deepening in the political competition between the major parties on race issues. Many have been struck by the increase in political attention on the centre-right to race issues over the last five to ten years. The focus has been on the politics of representation. By increasing the number of non-white Conservative MPs from two to seventeen since 2005, Cameron has sent a powerful signal that Labour’s traditional claim to be ‘the party of ethnic minorities’ would now be contested. Cameron was again able to celebrate in Manchester several ways in which his Cabinet and Parliamentary benches demonstrate many successful journeys of migrant and minority integration in British society. That might perhaps help to ease the fears, about integration being impossible in an era of higher immigration, which the Home Secretary had articulated the previous day.

So symbolism can matter. But facial diversity is not enough. The politics of ethnic minority opportunity needs to be about more than visits to gurdwaras, diversity nights at the party conference fringes and unveiling statues of Mahatma Gandhi in Parliament Square. Jeremy Corbyn’s first speech as Labour leader did include one brief celebratory reference to Britain’s ethnic diversity – “as I travelled the country during the leadership campaign it was wonderful to see the diversity of all the people in our country” – and to Labour bringing in more black, Asian and ethnic minority members - but it did not include any substantial content on discrimination. Tim Farron acknowledged during his leadership campaign that the Liberal Democrats have struggled to get to the starting-line on race and diversity at all. The opposition parties too will no doubt now be challenged to match not just the Prime Minister’s rhetorical commitment to challenging inequalities but also to propose how it could be done in practice.

Non-white Britons expect substance, not just symbolism from all of the parties on race inequalites.  Survation’s large survey of ethnic minority voters for British Future showed the Conservatives winning more ethnic minority support than ever before – but just 29 per cent of non-white respondents were confident that the Conservatives are committed to treating people of every ethnic background equally, while 54 per cent said this of Labour. Respondents were twice as likely to say that the Conservatives needto do more to reach out – and the Prime Minister would seem to be committed to showing that he has got that message.  Moreover, there is evidence that ethnic inclusion could be important in broadening a party’s appeal to other younger, urban and more liberal white voters too – which is why it made sense for this issue to form part of a broader attempt by David Cameron to colonise the broad centre of British politics in his Manchester speech.

But the case for caution is that there has been limited policy attention to ethnic inequalities under the last two governments. Restaurateur Iqbal Wahhab decided to give up his role chairing an ethnic minority taskforce for successive governments, unconvinced there was a political commitment to do much more than convene a talking shop. Lib Dem equalities minister Lynne Featherstone did push the CV discrimination issue – but many Conservatives were sceptical. Cameron’s new commitment may face similar challenges from those whose instinct is to worry that more attention to discrimination or bias in the jobs market will mean more red tape for business.

Labour had a separate race inequalities manifesto in 2015, outside of its main election manifesto, while the Conservative manifesto did not contain significant commitments to racial inequality. The mid-campaign launch in Croydon of a series of race equality pledges showed an increasing awareness of the growing importance of ethnic minority votes - though the fact that they all involved aiming for increases of 20 per cent by 2020 gave them a slightly back-of-the-envelope feel. 

Prime Ministerial commitments have an important agenda-setting function. A generation ago the Stephen Lawrence case opened the eyes of middle England to racist violence and police failures, particularly through the Daily Mail’s persistent challenging of those injustices. A Conservative Prime Minister’s words could similarly make a big difference in the mainstreaming of the issue of inequalities of opportunity. What action should follow words? Between now and next year’s party conference season, that must will now be the test for this Conservative government – and for their political opponents too. 

Sunder Katwala is director of British Future and former general secretary of the Fabian Society.