Why brain-teasers don't work

Martha Gill's Irrational Animals column.

Question: Beulah died in the Appalachians while Craig died at sea. Everyone was much happier with Craig’s death. Why? Answer: Beulah and Craig were both hurricanes.

Irritating, isn’t it? Brain-teaser questions are all irritating. It’s not that the answers are hard, just that they’re set in a context you’d have to be odd to anticipate. They’re the verbal equivalent of the game where you offer someone a high-five only to slap them in the face, or of dating men in London. Only a hyperalert psychopath could expect to get it right.

But ever since Microsoft decided to use brain-teasers in recruitment interviews back in the 1990s they’ve been spreading like gas in a hermetically sealed kitchen from which you have exactly nine minutes to escape. Tech firms use them; banks use them; Oxbridge has always used them.

They don’t work for hirers, though. They also actively discourage good candidates and have long-term ramifications for a company’s ability to recruit, according to research that came out in October. After putting 360 participants through the mill, Chris Wright of San Francisco State University found that otherwise qualified workers are put off interviews that use brain-teaser questions because they see them as unfair and setting them up for failure.

More than that, Wright found, interviewers don’t know what to do with the answers. The questions are often open-ended with no clear solution, so employers are often impressed with how a retort sounds, rather than what it includes. With open-ended brain-teasers – “Is this a question?” – it’s the smart-arse “Only if this is an answer” that gets points, though I wouldn’t be surprised if the similar “Is your mum a question?” and “Is your face a question?” scored just as high. In Wright’s study, interviewers did a much better job of working out a participant’s skill level after hearing answers to conventional rather than puzzle problems.

In his book Thinking, Fast and Slow the psychologist Daniel Kahneman lists a few puzzles that it’s hard to get right. Here’s one: a bat and ball cost $1.10. The bat costs $1 more than the ball. How much does the ball cost? The answer most people give is ten cents: “intuitive, appealing, and wrong”. That would make the bat $1.10 ($1 more than the ball) and the total $1.20. The answer is five cents.

Not too difficult to work out, in the end, so why do people get it wrong? Kahneman says that it’s a question of motivation. Some people are simply lazy and some are, by nature, “engaged. More alert, more intellectually active, less willing to be satisfied with superficially attractive  answers, more sceptical about their intuitions.”

But I would go further. Some people are expecting to be asked a brain-teaser question and are trying to impress the questioner, and others are simply trying to end the encounter politely so they can get to the bar. If you’re in the latter category, what the brain-teasers are testing is your sensitivity to context. If you’re sensitive enough, you get the answers wrong. Of course you do. The questioner is indicating left. Why would you ordinarily turn right? It would be a monumental waste of energy to expect the unexpected all the time. Thank goodness most of us don’t.

Infant protégé? Photograph: Getty Images

Martha Gill writes the weekly Irrational Animals column. You can follow her on Twitter here: @Martha_Gill.

This article first appeared in the 05 November 2012 issue of the New Statesman, What if Romney wins?

Getty
Show Hide image

Fark.com’s censorship story is a striking insight into Google’s unchecked power

The founder of the community-driven website claims its advertising revenue was cut off for five weeks.

When Microsoft launched its new search engine Bing in 2009, it wasted no time in trying to get the word out. By striking a deal with the producers of the American teen drama Gossip Girl, it made a range of beautiful characters utter the words “Bing it!” in a way that fell clumsily on the audience’s ears. By the early Noughties, “search it” had already been universally replaced by the words “Google it”, a phrase that had become so ubiquitous that anything else sounded odd.

A screenshot from Gossip Girl, via ildarabbit.wordpress.com

Like Hoover and Tupperware before it, Google’s brand name has now become a generic term.

Yet only recently have concerns about Google’s pervasiveness received mainstream attention. Last month, The Observer ran a story about Google’s auto-fill pulling up the suggested question of “Are Jews evil?” and giving hate speech prominence in the first page of search results. Within a day, Google had altered the autocomplete results.

Though the company’s response may seem promising, it is important to remember that Google isn’t just a search engine (Google’s parent company, Alphabet, has too many subdivisions to mention). Google AdSense is an online advertising service that allows many websites to profit from hosting advertisements on its pages, including the New Statesman itself. Yesterday, Drew Curtis, the founder of the internet news aggregator Fark.com, shared a story about his experiences with the service.

Under the headline “Google farked us over”, Curtis wrote:

“This past October we suffered a huge financial hit because Google mistakenly identified an image that was posted in our comments section over half a decade ago as an underage adult image – which is a felony by the way. Our ads were turned off for almost five weeks – completely and totally their mistake – and they refuse to make it right.”

The image was of a fully-clothed actress who was an adult at the time, yet Curtis claims Google flagged it because of “a small pedo bear logo” – a meme used to mock paedophiles online. More troubling than Google’s decision, however, is the difficulty that Curtis had contacting the company and resolving the issue, a process which he claims took five weeks. He wrote:

“During this five week period where our ads were shut off, every single interaction with Google Policy took between one to five days. One example: Google Policy told us they shut our ads off due to an image. Without telling us where it was. When I immediately responded and asked them where it was, the response took three more days.”

Curtis claims that other sites have had these issues but are too afraid of Google to speak out publicly. A Google spokesperson says: "We constantly review publishers for compliance with our AdSense policies and take action in the event of violations. If publishers want to appeal or learn more about actions taken with respect to their account, they can find information at the help centre here.”

Fark.com has lost revenue because of Google’s decision, according to Curtis, who sent out a plea for new subscribers to help it “get back on track”. It is easy to see how a smaller website could have been ruined in a similar scenario.


The offending image, via Fark

Google’s decision was not sinister, and it is obviously important that it tackles things that violate its policies. The lack of transparency around such decisions, and the difficulty getting in touch with Google, are troubling, however, as much of the media relies on the AdSense service to exist.

Even if Google doesn’t actively abuse this power, it is disturbing that it has the means by which to strangle any online publication, and worrying that smaller organisations can have problems getting in contact with it to solve any issues. In light of the recent news about Google's search results, the picture painted becomes more even troubling.

Update, 13/01/17:

Another Google spokesperson got in touch to provide the following statement: “We have an existing set of publisher policies that govern where Google ads may be placed in order to protect users from harmful, misleading or inappropriate content.  We enforce these policies vigorously, and taking action may include suspending ads on their site. Publishers can appeal these actions.”

Amelia Tait is a technology and digital culture writer at the New Statesman.