View all newsletters
Sign up to our newsletters

Support 110 years of independent journalism.

  1. Politics
  2. The Staggers
11 December 2017updated 12 Dec 2017 12:38pm

Labour are ahead! No, the Tories are ahead! Do opinion polls matter?

There’s a good case for “no”, opinion polls are useless, at least this far out from a general election. 

By Stephen Bush

Choose your narrative: despite their various difficulties, the Conservatives are only one or two points behind Labour in the polls. The party will surely be back to winning ways once it [insert commentator’s hobby horse conclusion here].

Alternatively, Survation, the only pollster to call the result within the margin of error, shows Labour are eight points ahead. The Conservatives are surely doomed, in a validation for [insert commentator’s preferred politician here].

However, I don’t think that voting intention is particularly useful, certainly not this far out and perhaps not at all.

We know that for a variety of reasons – changing work patterns, different uses of phones, the difficulty of reaching non-political respondents – that it is getting harder and harder to do voting intention correctly. 

That’s one reason why Populus has stopped doing voting intention entirely and several other pollsters privately agree that modelling, such as that done privately by Populus for the Scottish Conservatives at the last election, or YouGov’s model which correctly predicted the 2017 election result, is where the action will increasingly be in elections to come.

Select and enter your email address Your weekly guide to the best writing on ideas, politics, books and culture every Saturday. The best way to sign up for The Saturday Read is via saturdayread.substack.com The New Statesman's quick and essential guide to the news and politics of the day. The best way to sign up for Morning Call is via morningcall.substack.com Our Thursday ideas newsletter, delving into philosophy, criticism, and intellectual history. The best way to sign up for The Salvo is via thesalvo.substack.com Stay up to date with NS events, subscription offers & updates. Weekly analysis of the shift to a new economy from the New Statesman's Spotlight on Policy team. The best way to sign up for The Green Transition is via spotlightonpolicy.substack.com
  • Administration / Office
  • Arts and Culture
  • Board Member
  • Business / Corporate Services
  • Client / Customer Services
  • Communications
  • Construction, Works, Engineering
  • Education, Curriculum and Teaching
  • Environment, Conservation and NRM
  • Facility / Grounds Management and Maintenance
  • Finance Management
  • Health - Medical and Nursing Management
  • HR, Training and Organisational Development
  • Information and Communications Technology
  • Information Services, Statistics, Records, Archives
  • Infrastructure Management - Transport, Utilities
  • Legal Officers and Practitioners
  • Librarians and Library Management
  • Management
  • Marketing
  • OH&S, Risk Management
  • Operations Management
  • Planning, Policy, Strategy
  • Printing, Design, Publishing, Web
  • Projects, Programs and Advisors
  • Property, Assets and Fleet Management
  • Public Relations and Media
  • Purchasing and Procurement
  • Quality Management
  • Science and Technical Research and Development
  • Security and Law Enforcement
  • Service Delivery
  • Sport and Recreation
  • Travel, Accommodation, Tourism
  • Wellbeing, Community / Social Services
Visit our privacy Policy for more information about our services, how New Statesman Media Group may use, process and share your personal data, including information on your rights in respect of your personal data and how you can unsubscribe from future marketing communications.
THANK YOU

Although one of the repeated errors that pundits, including me, tend to make at elections is refighting the last war, you might – if nothing else because it’s good to have a system, trust Survation if you really want to trust one, as they got the last one right, or trust the average because that has a better overall success rate than any one pollster.

However, despite the fact they got it right, I don’t think Survation are exempt from the secular problems with voting intention. Indeed, their “correct” polls pre-election all exhibited similar problems to other companies under the hood. Their 5 June poll had too many people down as “certain to vote”, and all three polls understated Labour’s advantage among Remain voters in the election itself.

The industry problem is that they are finding it hard to talk to the right people. Occasionally, talking to the wrong people will get you the “right” result but it doesn’t mean that the methods aren’t flawed. If you polled the offices of the Spectator and the New Statesman, you would get a big Tory vote, a big Labour vote and a Liberal Democrat rump: but that doesn’t mean this is a reliable way of predicting elections.  

That Survation doesn’t appear to be exempt from the problem (and polling too many of the politically motivated almost certainly accounts for the underestimation of Labour’s performance among Remainers) means that I am not persuaded that we should expect it to be any more or less accurate than other pollsters at the next election, whenever it may be.

In addition, as I’ve explained before, the trouble pollsters have this far out is it’s a bit like asking if you want red or white wine. The context may change depending on how expensive the wine is, what the food being served is, and so on. Pollsters have the added problem that they are asking not what wine you want tonight or even next week but in five years’ time.

It’s probably better to focus on what polls can reliably tell us, which is how different demographics are moving: we know from the 2017 election that the Conservatives have a problem with the young, social liberals of all types and socially liberal Remainers in particular, while Labour has a problem with the old, the socially conservative, and socially conservative Leavers in particular. We know that to win the next election, both parties need to protect their most vulnerable flank and advance into the others’ territory. And there is plenty of information in polls, modelling, and indeed in local council election results about that in particular, without worrying much about what voting intention alone is saying, particularly this far from an election.

Content from our partners
The promise of prevention
How Labour hopes to make the UK a leader in green energy
Is now the time to rethink health and care for older people? With Age UK

Select and enter your email address Your weekly guide to the best writing on ideas, politics, books and culture every Saturday. The best way to sign up for The Saturday Read is via saturdayread.substack.com The New Statesman's quick and essential guide to the news and politics of the day. The best way to sign up for Morning Call is via morningcall.substack.com Our Thursday ideas newsletter, delving into philosophy, criticism, and intellectual history. The best way to sign up for The Salvo is via thesalvo.substack.com Stay up to date with NS events, subscription offers & updates. Weekly analysis of the shift to a new economy from the New Statesman's Spotlight on Policy team. The best way to sign up for The Green Transition is via spotlightonpolicy.substack.com
  • Administration / Office
  • Arts and Culture
  • Board Member
  • Business / Corporate Services
  • Client / Customer Services
  • Communications
  • Construction, Works, Engineering
  • Education, Curriculum and Teaching
  • Environment, Conservation and NRM
  • Facility / Grounds Management and Maintenance
  • Finance Management
  • Health - Medical and Nursing Management
  • HR, Training and Organisational Development
  • Information and Communications Technology
  • Information Services, Statistics, Records, Archives
  • Infrastructure Management - Transport, Utilities
  • Legal Officers and Practitioners
  • Librarians and Library Management
  • Management
  • Marketing
  • OH&S, Risk Management
  • Operations Management
  • Planning, Policy, Strategy
  • Printing, Design, Publishing, Web
  • Projects, Programs and Advisors
  • Property, Assets and Fleet Management
  • Public Relations and Media
  • Purchasing and Procurement
  • Quality Management
  • Science and Technical Research and Development
  • Security and Law Enforcement
  • Service Delivery
  • Sport and Recreation
  • Travel, Accommodation, Tourism
  • Wellbeing, Community / Social Services
Visit our privacy Policy for more information about our services, how New Statesman Media Group may use, process and share your personal data, including information on your rights in respect of your personal data and how you can unsubscribe from future marketing communications.
THANK YOU