View all newsletters
Sign up to our newsletters

Support 110 years of independent journalism.

  1. Science & Tech
5 June 2014updated 24 Jun 2021 1:00pm

US Secret Service seeks Twitter sarcasm detector

The US Secret Service is seeking some help with its online snooping, and needs a company that can detect sarcasm online - because you need to be able to distinguish between "I love Al Qaeda" and "I love Al Qaeda". Good luck with that, pals! 

By Sophie McBain

“How do I look?”

“Great.”

Without the benefit of other clues, this conversation could have gone any number of ways. Perhaps Ed Miliband was consulting Justine on his latest portrait with a bacon sandwich. And even then, who knows, maybe Miliband’s wife really loves his bacon buttie face. The English language is so delightfully, confusingly rich in meaning that “great” can mean anything from “wonderful” to “mediocre” to “awful”.  

Which brings me to a great piece of news. The US Secret Service is looking to commission a Twitter sarcasm detector to improve its online social media surveillance. It is inviting analytics firms to bid for a five-year contract to monitor and analyse online trends and sentiment, and one of its requirements is the ability to “detect sarcasm and false positives” – presumably because when scanning the web for potential threats to national security, you don’t want to deploy police to the home of the tweeter who could “totally kill for a bacon sandwich right now.” (We know who you are.)  And you need to be able to distinguish between “I love Al Qaeda” and “I love Al Qaeda”.

Humans are not actually very good at detecting sentiment in written language. Consider, for instance, that for over 500 years, scholars have tried to improve the way in which irony is expressed on paper – including by developing several irony marks, from backwards question marks to squiggly exclamation marks (more on which here).

Select and enter your email address Your weekly guide to the best writing on ideas, politics, books and culture every Saturday. The best way to sign up for The Saturday Read is via saturdayread.substack.com The New Statesman's quick and essential guide to the news and politics of the day. The best way to sign up for Morning Call is via morningcall.substack.com Our Thursday ideas newsletter, delving into philosophy, criticism, and intellectual history. The best way to sign up for The Salvo is via thesalvo.substack.com Stay up to date with NS events, subscription offers & updates. Weekly analysis of the shift to a new economy from the New Statesman's Spotlight on Policy team. The best way to sign up for The Green Transition is via spotlightonpolicy.substack.com
  • Administration / Office
  • Arts and Culture
  • Board Member
  • Business / Corporate Services
  • Client / Customer Services
  • Communications
  • Construction, Works, Engineering
  • Education, Curriculum and Teaching
  • Environment, Conservation and NRM
  • Facility / Grounds Management and Maintenance
  • Finance Management
  • Health - Medical and Nursing Management
  • HR, Training and Organisational Development
  • Information and Communications Technology
  • Information Services, Statistics, Records, Archives
  • Infrastructure Management - Transport, Utilities
  • Legal Officers and Practitioners
  • Librarians and Library Management
  • Management
  • Marketing
  • OH&S, Risk Management
  • Operations Management
  • Planning, Policy, Strategy
  • Printing, Design, Publishing, Web
  • Projects, Programs and Advisors
  • Property, Assets and Fleet Management
  • Public Relations and Media
  • Purchasing and Procurement
  • Quality Management
  • Science and Technical Research and Development
  • Security and Law Enforcement
  • Service Delivery
  • Sport and Recreation
  • Travel, Accommodation, Tourism
  • Wellbeing, Community / Social Services
Visit our privacy Policy for more information about our services, how New Statesman Media Group may use, process and share your personal data, including information on your rights in respect of your personal data and how you can unsubscribe from future marketing communications.
THANK YOU

Because tweets and text messages are too short to give much context, there is an even greater potential for misunderstanding. The emoticon might have helped a little, and yet over the years, a billion sentiments have been furnished with a winky face.wink

According to one study published in 2005 in the Journal of Personality and Social Psychology, respondents had a 50/50 chance of correctly judging the tone of an email – although they thought they were right 90 per cent of the time. 

Still, the Secret Service can take heart. A number of attempts to develop computerised sarcasm detectors appear to have slightly better odds of being correct than the humans in the above study. In 2010, scientists at the Hebrew University in Jerusalem reported they had developed an algorithm to judge sarcasm that had a 77 per cent success rate at identifying snark in Amazon reviews. The French company Spotter claims to have an 80 per cent success rate at identifying sentiment correctly, and can work in 29 different languages. Its clients include the EU Commission, the Home Office and the Dubai Courts. Perhaps they will be offering their skills to the US as we speak.

If this new information on government surveillance gives you the heebie-jeebies, there is some cause for optimism. The US Secret Services computer technology might not be as advanced as you feared – as the BBC points out, the Secret Service requests that the software be compatible with Internet Explorer 8, a web browser released over five years ago. Good luck with it all, guys!

Content from our partners
The promise of prevention
How Labour hopes to make the UK a leader in green energy
Is now the time to rethink health and care for older people? With Age UK

Select and enter your email address Your weekly guide to the best writing on ideas, politics, books and culture every Saturday. The best way to sign up for The Saturday Read is via saturdayread.substack.com The New Statesman's quick and essential guide to the news and politics of the day. The best way to sign up for Morning Call is via morningcall.substack.com Our Thursday ideas newsletter, delving into philosophy, criticism, and intellectual history. The best way to sign up for The Salvo is via thesalvo.substack.com Stay up to date with NS events, subscription offers & updates. Weekly analysis of the shift to a new economy from the New Statesman's Spotlight on Policy team. The best way to sign up for The Green Transition is via spotlightonpolicy.substack.com
  • Administration / Office
  • Arts and Culture
  • Board Member
  • Business / Corporate Services
  • Client / Customer Services
  • Communications
  • Construction, Works, Engineering
  • Education, Curriculum and Teaching
  • Environment, Conservation and NRM
  • Facility / Grounds Management and Maintenance
  • Finance Management
  • Health - Medical and Nursing Management
  • HR, Training and Organisational Development
  • Information and Communications Technology
  • Information Services, Statistics, Records, Archives
  • Infrastructure Management - Transport, Utilities
  • Legal Officers and Practitioners
  • Librarians and Library Management
  • Management
  • Marketing
  • OH&S, Risk Management
  • Operations Management
  • Planning, Policy, Strategy
  • Printing, Design, Publishing, Web
  • Projects, Programs and Advisors
  • Property, Assets and Fleet Management
  • Public Relations and Media
  • Purchasing and Procurement
  • Quality Management
  • Science and Technical Research and Development
  • Security and Law Enforcement
  • Service Delivery
  • Sport and Recreation
  • Travel, Accommodation, Tourism
  • Wellbeing, Community / Social Services
Visit our privacy Policy for more information about our services, how New Statesman Media Group may use, process and share your personal data, including information on your rights in respect of your personal data and how you can unsubscribe from future marketing communications.
THANK YOU