The DWP's bogus psychometric tests are dystopian, but randomised trials aren't the problem

The solution is more trials, not fewer.

The DWP is under fire for mandating benefit claimants to carry out bogus psychometric tests. The Guardian's Shiv Malik reports:

The test called My Strengths, devised by Downing Street's behavioural insights or "nudge" unit, has been exposed by bloggers as a sham with results having no relation to the answers given.

Some of the 48 statements on the DWP test include: "I never go out of my way to visit museums," and: "I have not created anything of beauty in the last year." People are asked to grade their answers from "very much like me" to "very much unlike me".

When those being tested complete the official online questionnaire, they are assigned a set of five positive "strengths" including "love of learning" and "curiosity" and "originality".

However, those taking the supposed psychological survey have found that by clicking on the same answer repeatedly, users will get the same set of personality results as those entering a completely opposite set of answers.

The aim behind the "test" is apparently to prevent the claimants with motivating statements about themselves, in an effort to encourage them to find work. The behavioural insight team itself describes the process as:

Building psychological resilience and wellbeing for those who are still claiming after 8 weeks through ‘expressive writing’ and strengths identification.

But it's worth being clear about why "My Strengths" is so unpleasant. The problem with it is that unemployed people are being lied to in an effort to psychologically manipulate them into a mental state where they will do what the Government want. That sounds like a sentence from a dystopian future, but it's a fairly straight description of what is happening.

But Steve Walker, the blogger who broke the story, goes further, attacking the test because it's part of a government trial.

Walker writes that the trial breaches principals established by the EU's body for co-ordinating R&D which state that the medical rule of informed consent "remains valid for any other kind of research".

Principles aren't laws, so there's not a legal case to answer here; but even if we're just arguing morality, establishing medical-grade requirements of informed consent in social research would be a terrible idea.

The rise of randomised controlled trials (and, to a lesser extent, randomised trials and controlled trials – not everything can be both randomised and controlled) in social research is one of the most promising trends of the last decade. It's good not only because it can increase our knowledge of how to fight social problems in employment, education and crime, but because it's barely different from what's being done anyway.

Most providers of the government's work programme – which involves more than just the unpaid mandatory labour that has made it infamous –  have neither the staff, time or money to offer every service to every person who comes through their doors. When they're trying to decide who gets to go on the CV workshops and who doesn't, the obvious thing to do is to chart which groups improve the most when given the workshops. This is doubly true if you don't actually know whether CV workshops help or harm; keeping a good eye on the results is invaluable.

When it comes to trials, the biggest crime of the BIT isn't that they did them, but that they didn't do them enough. As a report from December shows, the team aggregated together three completely different changes:

  1. Making sure every customer talks about getting back to work on their first day (not after 2 weeks) by cutting down and reorganising processes;
  2. Introducing stretching commitment devices which focus on what the job seeker will do for the whole of the next fortnight. This replaces the present system where advisors ask if job seekers have done three job search activities in each of the previous two weeks;
  3. Building psychological resilience and wellbeing for those who are still claiming after 8 weeks through ‘expressive writing’ and strengths identification.

Overall, apparently, "job seekers in the treatment group are 15-20 per cent more likely than those in the control group to be off benefits 13 weeks after signing on" – but the trial is so badly designed that we can't see which of these treatments helped the most. It could well be the case that the My Strengths test actually hindered jobseekers, but the effect was hidden by the benefits of "cutting down and reorganising processes".

The government needs to behave ethically when dealing with its citizens, and that goes whether or not it is done in the framework of a formal trial. But if it does try a new ethical way of helping jobseekers, the last thing we want to do is discourage it from measuring the results.

Alex Hern is a technology reporter for the Guardian. He was formerly staff writer at the New Statesman. You should follow Alex on Twitter.

Getty
Show Hide image

The World Cup you’ve never heard of, where the teams have no state

At the Conifa world cup – this year hosted by the Autonomous Republic of Abkhazia – ethnic groups, diaspora communities and disputed territories will battle for footballing glory.

Football's European Championship and the Olympics are set to dominate the back pages over the next few months. How will Team GB fare in Rio? Will the zika virus stop the tournament even going ahead? Will the WAGS prove to be a distraction for the Three Lions? And can Roy Hodgson guide England to a long-awaited trophy?

But before the sprinters are in their blocks or a ball has been kicked, there's a world cup taking place.

Only this world cup is, well, a bit different. There's no Brazil, no damaged metatarsals to speak of, and no Germany to break hearts in a penalty shootout.  There’s been no sign of football’s rotten underbelly rearing its head at this world cup either. No murmurs of the ugly corruption which has plagued Fifa in recent years. Nor any suggestion that handbags have been exchanged for hosting rights.

This biennial, unsung world cup is not being overseen by Fifa however, but rather by Conifa (Confederation of Independent Football Associations), the governing body for those nations discredited by Fifa. Among its member nations are ethnic groups, diaspora communities or disputed territories with varying degrees of autonomy. Due to their contested status, many of the nations are unable to gain recognition from Fifa. As a consequence they cannot compete in tournaments sanctioned by the best-known footballing governing body, and that’s where Conifa provides a raison d’être.

“We give a voice to the unheard”, says Conifa’s General Secretary, Sascha Düerkop, whose world cup kicks off in the Autonomous Republic of Abkhazia at the end of this week.

“We are proud to give our members a forum where they can put themselves on the map.

“From that we hope to give back in the long run and invest in the football infrastructure in our member nations to help them grow.”

The two week footballing celebration starts with an opening ceremony before Kurdistan and Székely Land kick off the tournament. It follows on from 2014’s maiden competition which saw The County of Nice avenging a group stage defeat to Ellan Vannin from the Isle of Man, to take the spoils in the final via a penalty shoot-out.  There were some blowout scores of note however, with South Ossetia smashing Darfur 20-0 and Kurdistan beating the Tamils 9-0 at the event which took place in Östersund, Sweden. Neither of the finalists will be returning to the tournament – throwing down the gauntlet to another twelve teams. 

This, the second Conifa world cup, is testament to the ever-expanding global footprint of the tournament. Abkhazia will welcome sides from four continents – including Western Armenia, the Chagos Islands, United Koreans in Japan and Somaliland.

Despite the “minor” status of the countries taking part, a smattering of professional talent lends credibility to the event. Panjab can call on the experience of ex-Accrington Stanley man Rikki Bains at the heart of their defence, and the coaching savoir-faire of former Tranmere star Reuben Hazell from the dugout. Morten Gamst Pedersen, who turned out for Blackburn Rovers over 300 times and was once a Norwegian international, will lead the Sapmi people. The hosts complete the list of teams to aiming to get their hands on silverware along with Padania, Northern Cyprus, and Raetia.

A quick glance down said list, and it’s hard to ignore the fact that most of the nations competing have strong political associations – be that through war, genocide, displacement or discrimination. The Chagos Islands is one such example. An archipelago in the Indian Ocean, Chagos’ indigenous population was uprooted by the British government in the 1960s to make way for one of the United States' most strategically important military bases – Diego Garcia.

Ever since, they've been campaigning for the right to return. Their side, based in Crawley, has crowdfunded the trip to the tournament. Yet most of its members have never stepped foot on the islands they call home, and which they will now represent. Kurdistan’s efforts to establish an independent state have been well-highlighted, even more so given the last few years of conflict in the Middle East. The hosts too, broke away from Georgia in the 1990s and depend on the financial clout of Russia to prop up their government.

Despite that, Düerkop insists that the event is one which focuses on action on the pitch rather than off it. 

“Many of the nations are politically interested, but we are non-political,” he says. 

“Some of our members are less well-known in the modern world. They have been forgotten, excluded from the global community or simply are ‘unpopular’ for their political positions.

“We are humanitarians and the sides play football to show their existence – nothing more, nothing less.”

The unknown and almost novel status of the tournament flatters to deceive as Conifa’s world cup boasts a broadcast deal, two large stadiums and a plush opening ceremony. Its aim in the long run, however, is to develop into a global competition, and one which is content to sit below Fifa.

“We are happy to be the second biggest football organisation,” admits Düerkop.

“In the future we hope to have women’s and youth tournaments as well as futsal and beach soccer.”

“Our aim is to advertise the beauty and uniqueness of each nation.”

“But the most important purpose is to give those nations that are not members of the global football community a home.”

George Weah, the first African winner of Fifa World Player of the Year award remarked how “football gives a suffering people joy”.

And after speaking to Düerkop there’s certainly a feeling that for those on the game’s periphery, Conifa’s world cup has an allure which offers a shared sense of belonging.

It certainly seems light years away from the glitz and glamour of WAGs and corruption scandals. And that's because it is.

But maybe in a small way, this little-known tournament might restore some of beauty lost by the once “beautiful game”.