The DWP's bogus psychometric tests are dystopian, but randomised trials aren't the problem

The solution is more trials, not fewer.

The DWP is under fire for mandating benefit claimants to carry out bogus psychometric tests. The Guardian's Shiv Malik reports:

The test called My Strengths, devised by Downing Street's behavioural insights or "nudge" unit, has been exposed by bloggers as a sham with results having no relation to the answers given.

Some of the 48 statements on the DWP test include: "I never go out of my way to visit museums," and: "I have not created anything of beauty in the last year." People are asked to grade their answers from "very much like me" to "very much unlike me".

When those being tested complete the official online questionnaire, they are assigned a set of five positive "strengths" including "love of learning" and "curiosity" and "originality".

However, those taking the supposed psychological survey have found that by clicking on the same answer repeatedly, users will get the same set of personality results as those entering a completely opposite set of answers.

The aim behind the "test" is apparently to prevent the claimants with motivating statements about themselves, in an effort to encourage them to find work. The behavioural insight team itself describes the process as:

Building psychological resilience and wellbeing for those who are still claiming after 8 weeks through ‘expressive writing’ and strengths identification.

But it's worth being clear about why "My Strengths" is so unpleasant. The problem with it is that unemployed people are being lied to in an effort to psychologically manipulate them into a mental state where they will do what the Government want. That sounds like a sentence from a dystopian future, but it's a fairly straight description of what is happening.

But Steve Walker, the blogger who broke the story, goes further, attacking the test because it's part of a government trial.

Walker writes that the trial breaches principals established by the EU's body for co-ordinating R&D which state that the medical rule of informed consent "remains valid for any other kind of research".

Principles aren't laws, so there's not a legal case to answer here; but even if we're just arguing morality, establishing medical-grade requirements of informed consent in social research would be a terrible idea.

The rise of randomised controlled trials (and, to a lesser extent, randomised trials and controlled trials – not everything can be both randomised and controlled) in social research is one of the most promising trends of the last decade. It's good not only because it can increase our knowledge of how to fight social problems in employment, education and crime, but because it's barely different from what's being done anyway.

Most providers of the government's work programme – which involves more than just the unpaid mandatory labour that has made it infamous –  have neither the staff, time or money to offer every service to every person who comes through their doors. When they're trying to decide who gets to go on the CV workshops and who doesn't, the obvious thing to do is to chart which groups improve the most when given the workshops. This is doubly true if you don't actually know whether CV workshops help or harm; keeping a good eye on the results is invaluable.

When it comes to trials, the biggest crime of the BIT isn't that they did them, but that they didn't do them enough. As a report from December shows, the team aggregated together three completely different changes:

  1. Making sure every customer talks about getting back to work on their first day (not after 2 weeks) by cutting down and reorganising processes;
  2. Introducing stretching commitment devices which focus on what the job seeker will do for the whole of the next fortnight. This replaces the present system where advisors ask if job seekers have done three job search activities in each of the previous two weeks;
  3. Building psychological resilience and wellbeing for those who are still claiming after 8 weeks through ‘expressive writing’ and strengths identification.

Overall, apparently, "job seekers in the treatment group are 15-20 per cent more likely than those in the control group to be off benefits 13 weeks after signing on" – but the trial is so badly designed that we can't see which of these treatments helped the most. It could well be the case that the My Strengths test actually hindered jobseekers, but the effect was hidden by the benefits of "cutting down and reorganising processes".

The government needs to behave ethically when dealing with its citizens, and that goes whether or not it is done in the framework of a formal trial. But if it does try a new ethical way of helping jobseekers, the last thing we want to do is discourage it from measuring the results.

Alex Hern is a technology reporter for the Guardian. He was formerly staff writer at the New Statesman. You should follow Alex on Twitter.

Getty
Show Hide image

Air pollution: 5 steps to vanquishing an invisible killer

A new report looks at the economics of air pollution. 

110, 150, 520... These chilling statistics are the number of deaths attributable to particulate air pollution for the cities of Southampton, Nottingham and Birmingham in 2010 respectively. Or how about 40,000 - that is the total number of UK deaths per year that are attributable the combined effects of particulate matter (PM2.5) and Nitrogen Oxides (NOx).

This situation sucks, to say the very least. But while there are no dramatic images to stir up action, these deaths are preventable and we know their cause. Road traffic is the worst culprit. Traffic is responsible for 80 per cent of NOx on high pollution roads, with diesel engines contributing the bulk of the problem.

Now a new report by ResPublica has compiled a list of ways that city councils around the UK can help. The report argues that: “The onus is on cities to create plans that can meet the health and economic challenge within a short time-frame, and identify what they need from national government to do so.”

This is a diplomatic way of saying that current government action on the subject does not go far enough – and that cities must help prod them into gear. That includes poking holes in the government’s proposed plans for new “Clean Air Zones”.

Here are just five of the ways the report suggests letting the light in and the pollution out:

1. Clean up the draft Clean Air Zones framework

Last October, the government set out its draft plans for new Clean Air Zones in the UK’s five most polluted cities, Birmingham, Derby, Leeds, Nottingham and Southampton (excluding London - where other plans are afoot). These zones will charge “polluting” vehicles to enter and can be implemented with varying levels of intensity, with three options that include cars and one that does not.

But the report argues that there is still too much potential for polluters to play dirty with the rules. Car-charging zones must be mandatory for all cities that breach the current EU standards, the report argues (not just the suggested five). Otherwise national operators who own fleets of vehicles could simply relocate outdated buses or taxis to places where they don’t have to pay.  

Different vehicles should fall under the same rules, the report added. Otherwise, taking your car rather than the bus could suddenly seem like the cost-saving option.

2. Vouchers to vouch-safe the project’s success

The government is exploring a scrappage scheme for diesel cars, to help get the worst and oldest polluting vehicles off the road. But as the report points out, blanket scrappage could simply put a whole load of new fossil-fuel cars on the road.

Instead, ResPublica suggests using the revenue from the Clean Air Zone charges, plus hiked vehicle registration fees, to create “Pollution Reduction Vouchers”.

Low-income households with older cars, that would be liable to charging, could then use the vouchers to help secure alternative transport, buy a new and compliant car, or retrofit their existing vehicle with new technology.

3. Extend Vehicle Excise Duty

Vehicle Excise Duty is currently only tiered by how much CO2 pollution a car creates for the first year. After that it becomes a flat rate for all cars under £40,000. The report suggests changing this so that the most polluting vehicles for CO2, NOx and PM2.5 continue to pay higher rates throughout their life span.

For ClientEarth CEO James Thornton, changes to vehicle excise duty are key to moving people onto cleaner modes of transport: “We need a network of clean air zones to keep the most polluting diesel vehicles from the most polluted parts of our towns and cities and incentives such as a targeted scrappage scheme and changes to vehicle excise duty to move people onto cleaner modes of transport.”

4. Repurposed car parks

You would think city bosses would want less cars in the centre of town. But while less cars is good news for oxygen-breathers, it is bad news for city budgets reliant on parking charges. But using car parks to tap into new revenue from property development and joint ventures could help cities reverse this thinking.

5. Prioritise public awareness

Charge zones can be understandably unpopular. In 2008, a referendum in Manchester defeated the idea of congestion charging. So a big effort is needed to raise public awareness of the health crisis our roads have caused. Metro mayors should outline pollution plans in their manifestos, the report suggests. And cities can take advantage of their existing assets. For example in London there are plans to use electronics in the Underground to update travellers on the air pollution levels.

***

Change is already in the air. Southampton has used money from the Local Sustainable Travel Fund to run a successful messaging campaign. And in 2011 Nottingham City Council became the first city to implement a Workplace Parking levy – a scheme which has raised £35.3m to help extend its tram system, upgrade the station and purchase electric buses.

But many more “air necessities” are needed before we can forget about pollution’s worry and its strife.  

 

India Bourke is an environment writer and editorial assistant at the New Statesman.