Support 100 years of independent journalism.

  1. Politics
  2. The Staggers
2 January 2019

Are the “People’s Vote” polls loaded? No, says Peter Kellner

A look at the questions reveals otherwise. 

By Peter Kellner

Stephen Bush accuses the People’s Vote campaign of asking “deliberately loaded questions” about Brexit without offering any evidence for his charge. This is not surprising for there is no such evidence.

Bush compares two findings from different YouGov polls of Labour Party members, one funded by the Economic and Social Research Council, the other by the People’s Vote Campaign. (Respondents are not told the identity of the client: all they see are the questions themselves.)

In fact, there are three questions that can be compared: two from the ESRC survey, one from the People’s Vote survey. Bush omits the third question; had he done so, his case would have been undermined.

Here are the three questions, whose wording Bush failed to provide, together with the percentages of Labour Party members giving a pro-referendum response:

ESRC 1 (cited by Bush): Do you think Labour should or should not fully support holding a new referendum on Brexit? (72 per cent yes)

Sign up for The New Statesman’s newsletters Tick the boxes of the newsletters you would like to receive. Quick and essential guide to domestic and global politics from the New Statesman's politics team. The New Statesman’s global affairs newsletter, every Monday and Friday. The best of the New Statesman, delivered to your inbox every weekday morning. The New Statesman’s weekly environment email on the politics, business and culture of the climate and nature crises - in your inbox every Thursday. A handy, three-minute glance at the week ahead in companies, markets, regulation and investment, landing in your inbox every Monday morning. Our weekly culture newsletter – from books and art to pop culture and memes – sent every Friday. A weekly round-up of some of the best articles featured in the most recent issue of the New Statesman, sent each Saturday. A weekly dig into the New Statesman’s archive of over 100 years of stellar and influential journalism, sent each Wednesday. Sign up to receive information regarding NS events, subscription offers & product updates.

ESRC 2 (not cited by Bush): Imagine that Parliament eventually votes to reject Mrs May’s proposed Brexit deal… Would you support or oppose holding a referendum on the deal if Parliament voted to reject the proposed Brexit deal? (79 per cent yes)

People’s Vote poll: When the negotiations with the European Union about Brexit are complete, would you support or oppose a public vote on the outcome? (86 per cent yes) 

Had Bush actually provided the wording of all three questions, his readers would have seen:

  1. None of the questions is “loaded”, deliberately or otherwise. This is not surprising: YouGov has its own reputation to defend, and rightly insists on unbiased questions.
  2. The three questions are in fact different: one is about how Labour should act, one about a respondents’ own views on a referendum on the Withdrawal Agreement, and one (posed some weeks earlier) about a public vote when the negotiations are complete. It’s as if one question had been: do you like oranges?; another: do you like apples?; a third, do you like pears?
  3. The striking thing is not how different the responses are, but how similar. In each case, if we exclude don’t knows (as is normal in reporting voting intention polls), pro-referendum responses reach 80 per cent or more, and outnumber anti-referendum responses by at least four-to-one. By any standards, these are conclusive margins.

All this is in the public domain: YouGov, applying transparency rules that I helped to write some years ago, reports the full wording of, and data from, these Brexit surveys. Had Bush been as equally transparent, he would have revealed the weakness of his case. Was his a “deliberately loaded” blog? You may very well think so; I couldn’t possibly comment.

Note: Stephen responded to these criticisms here.