The DWP's bogus psychometric tests are dystopian, but randomised trials aren't the problem

The solution is more trials, not fewer.

The DWP is under fire for mandating benefit claimants to carry out bogus psychometric tests. The Guardian's Shiv Malik reports:

The test called My Strengths, devised by Downing Street's behavioural insights or "nudge" unit, has been exposed by bloggers as a sham with results having no relation to the answers given.

Some of the 48 statements on the DWP test include: "I never go out of my way to visit museums," and: "I have not created anything of beauty in the last year." People are asked to grade their answers from "very much like me" to "very much unlike me".

When those being tested complete the official online questionnaire, they are assigned a set of five positive "strengths" including "love of learning" and "curiosity" and "originality".

However, those taking the supposed psychological survey have found that by clicking on the same answer repeatedly, users will get the same set of personality results as those entering a completely opposite set of answers.

The aim behind the "test" is apparently to prevent the claimants with motivating statements about themselves, in an effort to encourage them to find work. The behavioural insight team itself describes the process as:

Building psychological resilience and wellbeing for those who are still claiming after 8 weeks through ‘expressive writing’ and strengths identification.

But it's worth being clear about why "My Strengths" is so unpleasant. The problem with it is that unemployed people are being lied to in an effort to psychologically manipulate them into a mental state where they will do what the Government want. That sounds like a sentence from a dystopian future, but it's a fairly straight description of what is happening.

But Steve Walker, the blogger who broke the story, goes further, attacking the test because it's part of a government trial.

Walker writes that the trial breaches principals established by the EU's body for co-ordinating R&D which state that the medical rule of informed consent "remains valid for any other kind of research".

Principles aren't laws, so there's not a legal case to answer here; but even if we're just arguing morality, establishing medical-grade requirements of informed consent in social research would be a terrible idea.

The rise of randomised controlled trials (and, to a lesser extent, randomised trials and controlled trials – not everything can be both randomised and controlled) in social research is one of the most promising trends of the last decade. It's good not only because it can increase our knowledge of how to fight social problems in employment, education and crime, but because it's barely different from what's being done anyway.

Most providers of the government's work programme – which involves more than just the unpaid mandatory labour that has made it infamous –  have neither the staff, time or money to offer every service to every person who comes through their doors. When they're trying to decide who gets to go on the CV workshops and who doesn't, the obvious thing to do is to chart which groups improve the most when given the workshops. This is doubly true if you don't actually know whether CV workshops help or harm; keeping a good eye on the results is invaluable.

When it comes to trials, the biggest crime of the BIT isn't that they did them, but that they didn't do them enough. As a report from December shows, the team aggregated together three completely different changes:

  1. Making sure every customer talks about getting back to work on their first day (not after 2 weeks) by cutting down and reorganising processes;
  2. Introducing stretching commitment devices which focus on what the job seeker will do for the whole of the next fortnight. This replaces the present system where advisors ask if job seekers have done three job search activities in each of the previous two weeks;
  3. Building psychological resilience and wellbeing for those who are still claiming after 8 weeks through ‘expressive writing’ and strengths identification.

Overall, apparently, "job seekers in the treatment group are 15-20 per cent more likely than those in the control group to be off benefits 13 weeks after signing on" – but the trial is so badly designed that we can't see which of these treatments helped the most. It could well be the case that the My Strengths test actually hindered jobseekers, but the effect was hidden by the benefits of "cutting down and reorganising processes".

The government needs to behave ethically when dealing with its citizens, and that goes whether or not it is done in the framework of a formal trial. But if it does try a new ethical way of helping jobseekers, the last thing we want to do is discourage it from measuring the results.

Alex Hern is a technology reporter for the Guardian. He was formerly staff writer at the New Statesman. You should follow Alex on Twitter.

Getty
Show Hide image

The joy of only winning once: why England should be proud of 1966

We feel the glory of that triumphant moment, 50 years ago, all the more because of all the other occasions when we have failed to win.

There’s a phrase in football that I really hate. It used to be “Thirty years of hurt”. Each time the England team crashes out of a major tournament it gets regurgitated with extra years added. Rather predictably, when England lost to Iceland in Euro 2016, it became “Fifty years of hurt”. We’ve never won the European Championship and in 17 attempts to win the World Cup we have only won once. I’m going to tell you why that’s a record to cherish.

I was seven in 1966. Our telly was broken so I had to watch the World Cup final with a neighbour. I sat squeezed on my friend Colin’s settee as his dad cheered on England with phrases like “Sock it to them Bobby”, as old fashioned now as a football rattle. When England took the lead for the second time I remember thinking, what will it feel like, when we English are actually Champions of the World. Not long after I knew. It felt good.

Wembley Stadium, 30 July 1966, was our only ever World Cup win. But let’s imagine what it would be like if, as with our rivals, we’d won it many times? Brazil have been World Champions on five occasions, Germany four, and Italy four. Most England fans would be “over the moon” if they could boast a similarly glorious record. They’re wrong. I believe it’s wonderful that we’ve only triumphed once. We all share that one single powerful memory. Sometimes in life less is definitely more.

Something extraordinary has happened. Few of us are even old enough to remember, but somehow, we all know everything that happened that day. Even if you care little about the beautiful game, I’m going to bet that you can recall as many as five iconic moments from 50 years ago. You will have clearly in your mind the BBC commentator Kenneth Wolstenholme’s famous lines, as Geoff Hurst tore down the pitch to score his hat-trick: “Some people are on the pitch. They think it’s all over. It is now”. And it was. 4 - 2 to England against West Germany. Thirty minutes earlier the Germans had equalised in the dying moments of the second half to take the game to extra time.

More drama we all share: Geoff Hurst’s second goal. Or the goal that wasn’t, as technology has since, I think, conclusively proved. The shot that crashed off the cross bar and did or didn’t cross the line. Of course, even if you weren’t alive at the time, you will know that the linesman, one Tofiq Bakhramov, from Azerbaijan (often incorrectly referred to as “Russian”) could speak not a word of English, signalled it as a goal.

Then there’s the England Captain, the oh-so-young and handsome Bobby Moore. The very embodiment of the era. You can picture him now wiping his muddy hands on his white shorts before he shakes hands with a youthful Queen Elizabeth. Later you see him lifted aloft by his team mates holding the small golden Jules Rimet trophy.

How incredible, how simply marvellous that as a nation we share such golden memories. How sad for the Brazilians and Germans. Their more numerous triumphs are dissipated through the generations. In those countries each generation will remember each victory but not with the intensity with which we English still celebrate 1966. It’s as if sex was best the first time. The first cut is the deepest.

On Colin’s dad’s TV the pictures were black and white and so were the flags. Recently I looked at the full colour Pathe newsreel of the game. It’s the red, white and blue of the Union Jack that dominates. The red cross of Saint George didn’t really come into prominence until the Nineties. The left don’t like flags much, unless they’re “deepest red”. Certainly not the Union Flag. It smacks of imperialism perhaps. In 1966 we didn’t seem to know if we were English or British. Maybe there was, and still is, something admirable and casual about not knowing who we are or what is our proper flag. 

Twelve years later I’m in Cuba at the “World Festival of Youth” – the only occasion I’ve represented my country. It was my chance to march into a stadium under my nation’s flag. Sadly, it never happened as my fellow delegates argued for hours over what, if any, flag we British should walk behind. The delegation leaders – you will have heard of them now, but they were young and unknown then – Peter Mandelson, Trevor Phillips and Charles Clarke, had to find a way out of this impasse. In the end, each delegation walked into the stadium behind their flag, except the British. Poor Mandelson stood alone for hours holding Union Jack, sweltering in the tropical sun. No other country seemed to have a problem with their flag. I guess theirs speak of revolution; ours of colonialism.

On Saturday 30 July BBC Radio 2 will commemorate the 50th anniversary of the 1966 World Cup Final, live from Wembley Arena. Such a celebration is only possible because on 16 occasions we failed to win that trophy. Let’s banish this idea of “Fifty years of hurt” once and for all and embrace the joy of only winning once.

Phil Jones edits the Jeremy Vine Show on BBC Radio 2. On Saturday 30 July the station celebrates the 50th anniversary of the 1966 World Cup Final live from Wembley Arena, telling the story of football’s most famous match, minute by minuteTickets are available from: www.wc66.org