The DWP's bogus psychometric tests are dystopian, but randomised trials aren't the problem

The solution is more trials, not fewer.

The DWP is under fire for mandating benefit claimants to carry out bogus psychometric tests. The Guardian's Shiv Malik reports:

The test called My Strengths, devised by Downing Street's behavioural insights or "nudge" unit, has been exposed by bloggers as a sham with results having no relation to the answers given.

Some of the 48 statements on the DWP test include: "I never go out of my way to visit museums," and: "I have not created anything of beauty in the last year." People are asked to grade their answers from "very much like me" to "very much unlike me".

When those being tested complete the official online questionnaire, they are assigned a set of five positive "strengths" including "love of learning" and "curiosity" and "originality".

However, those taking the supposed psychological survey have found that by clicking on the same answer repeatedly, users will get the same set of personality results as those entering a completely opposite set of answers.

The aim behind the "test" is apparently to prevent the claimants with motivating statements about themselves, in an effort to encourage them to find work. The behavioural insight team itself describes the process as:

Building psychological resilience and wellbeing for those who are still claiming after 8 weeks through ‘expressive writing’ and strengths identification.

But it's worth being clear about why "My Strengths" is so unpleasant. The problem with it is that unemployed people are being lied to in an effort to psychologically manipulate them into a mental state where they will do what the Government want. That sounds like a sentence from a dystopian future, but it's a fairly straight description of what is happening.

But Steve Walker, the blogger who broke the story, goes further, attacking the test because it's part of a government trial.

Walker writes that the trial breaches principals established by the EU's body for co-ordinating R&D which state that the medical rule of informed consent "remains valid for any other kind of research".

Principles aren't laws, so there's not a legal case to answer here; but even if we're just arguing morality, establishing medical-grade requirements of informed consent in social research would be a terrible idea.

The rise of randomised controlled trials (and, to a lesser extent, randomised trials and controlled trials – not everything can be both randomised and controlled) in social research is one of the most promising trends of the last decade. It's good not only because it can increase our knowledge of how to fight social problems in employment, education and crime, but because it's barely different from what's being done anyway.

Most providers of the government's work programme – which involves more than just the unpaid mandatory labour that has made it infamous –  have neither the staff, time or money to offer every service to every person who comes through their doors. When they're trying to decide who gets to go on the CV workshops and who doesn't, the obvious thing to do is to chart which groups improve the most when given the workshops. This is doubly true if you don't actually know whether CV workshops help or harm; keeping a good eye on the results is invaluable.

When it comes to trials, the biggest crime of the BIT isn't that they did them, but that they didn't do them enough. As a report from December shows, the team aggregated together three completely different changes:

  1. Making sure every customer talks about getting back to work on their first day (not after 2 weeks) by cutting down and reorganising processes;
  2. Introducing stretching commitment devices which focus on what the job seeker will do for the whole of the next fortnight. This replaces the present system where advisors ask if job seekers have done three job search activities in each of the previous two weeks;
  3. Building psychological resilience and wellbeing for those who are still claiming after 8 weeks through ‘expressive writing’ and strengths identification.

Overall, apparently, "job seekers in the treatment group are 15-20 per cent more likely than those in the control group to be off benefits 13 weeks after signing on" – but the trial is so badly designed that we can't see which of these treatments helped the most. It could well be the case that the My Strengths test actually hindered jobseekers, but the effect was hidden by the benefits of "cutting down and reorganising processes".

The government needs to behave ethically when dealing with its citizens, and that goes whether or not it is done in the framework of a formal trial. But if it does try a new ethical way of helping jobseekers, the last thing we want to do is discourage it from measuring the results.

Alex Hern is a technology reporter for the Guardian. He was formerly staff writer at the New Statesman. You should follow Alex on Twitter.

Getty
Show Hide image

The most terrifying thing about Donald Trump's speech? What he didn't say

No politician uses official speeches to put across their most controversial ideas. But Donald Trump's are not hard to find. 

As Donald Trump took the podium on a cold Washington day to deliver his inauguration speech, the world held its breath. Viewers hunched over televisions or internet streaming services watched Trump mouth “thank you” to the camera, no doubt wondering how he could possibly live up to his deranged late-night Twitter persona. In newsrooms across America, reporters unsure when they might next get access to a president who seems to delight in denying them the right to ask questions got ready to parse his words for any clue as to what was to come. Some, deciding they couldn’t bear to watch, studiously busied themselves with other things.

But when the moment came, Trump’s speech was uncharacteristically professional – at least compared to his previous performances. The fractured, repetitive grammar that marks many of his off-the-cuff statements was missing, and so, too, were most of his most controversial policy ideas.

Trump told the crowd that his presidency would “determine the course of America, and the world, for many, many years to come” before expressing his gratefulness to President Barack Obama and Michelle Obama for their “gracious aid” during the transition. “They have been magnificent," Trump said, before leading applause of thanks from the crowd.

If this opening was innocent enough, however, it all changed in the next breath. The new president moved quickly to the “historic movement”, “the likes of which the world has never seen before”, that elected him President. Following the small-state rhetoric of his campaign, Trump promised to take power from the “establishment” and restore it to the American people. “This moment," he told them, “Is your moment. It belongs to you.”

A good deal of the speech was given over to re-iterating his nationalist positions while also making repeated references to the key issues – “Islamic terrorism” and families – that remain points of commonality within the fractured Republican GOP.

The loss of business to overseas producers was blamed for “destroying our jobs”. “Protection," Trump said, “Will lead to great strength." He promised to end what he called the “American carnage” caused by drugs and crime.

“From this day forward," Trump said, “It’s going to be only America first."

There was plenty in the speech, then, that should worry viewers, particularly if you read Trump’s promises to make America “unstoppable” so it can “win” again in light of his recent tweets about China

But it was the things Trump didn't mention that should worry us most. Trump, we know, doesn’t use official channels to communicate his most troubling ideas. From bizarre television interviews to his upsetting and offensive rallies and, of course, the infamous tweets, the new President is inclined to fling his thoughts into the world as and when he sees fit, not on the occasions when he’s required to address the nation (see, also, his anodyne acceptance speech).

It’s important to remember that Trump’s administration wins when it makes itself seem as innocent as possible. During the speech, I was reminded of my colleague Helen Lewis’ recent thoughts on the “gaslighter-in-chief”, reflecting on Trump’s lying claim that he never mocked a disabled reporter. “Now we can see," she wrote, “A false narrative being built in real time, tweet by tweet."

Saying things that are untrue isn’t the only way of lying – it is also possible to lie by omission.

There has been much discussion as to whether Trump will soften after he becomes president. All the things this speech did not mention were designed to keep us guessing about many of the President’s most controversial promises.

Trump did not mention his proposed ban on Muslims entering the US, nor the wall he insists he will erect between America and Mexico (which he maintains the latter will pay for). He maintained a polite coolness towards the former President and avoiding any discussion of alleged cuts to anti-domestic violence programs and abortion regulations. Why? Trump wanted to leave viewers unsure as to whether he actually intends to carry through on his election rhetoric.

To understand what Trump is capable of, therefore, it is best not to look to his speeches on a global stage, but to the promises he makes to his allies. So when the President’s personal website still insists he will build a wall, end catch-and-release, suspend immigration from “terror-prone regions” “where adequate screening cannot occur”; when, despite saying he understands only 3 per cent of Planned Parenthood services relate to abortion and that “millions” of women are helped by their cancer screening, he plans to defund Planned Parenthood; when the president says he will remove gun-free zones around schools “on his first day” - believe him.  

Stephanie Boland is digital assistant at the New Statesman. She tweets at @stephanieboland