Can a dating site tell if you're a secret racist?

How the OkCupid website, started by four Harvard geeks, used statistics to unearth its users’ secret

When it comes to love and sex, how do you find out what people really feel, rather than what they say they do? Well, there are easier ways, but you could always start a dating website. Every time a user responds to a message, or clicks on a profile, she is telling you who she finds attractive, and who she's interested in starting a relationship with. Multiply that by a million or more and you have one hell of a database to plunder for insights.

That's what OkCupid did. Four Harvard graduates - Chris Coyne, Max Krohn, Christian Rudder and Sam Yagan - started the dating website in 2004. They'd previously run thespark.com, which offered personality quizzes such as the Purity Test (sample questions: "Have you ever fantasised about a family member? Have you ever fantasised about your own member?"), and decided to take the same slant with their dating venture. OkCupid users answer some, lots or occasionally all of the 4,000 questions written by the site or submitted by others about what they are looking for in a partner. They also give feedback on how useful the question was and how much weight they would give to the answer when setting up a date. That allows every candidate to create their own algorithm - the mathematical "secret sauce" that finds you matches.

While the site users were clicking away, trying to find someone to go for a drink with on Friday night, the founders were busy crunching their data. In June 2009 the first blog post popped up on OkTrends. "Since we went online in 2004, we've collected an enormous amount of data on human interactions," it said. "This blog was started as a way to share some of the things we've learned about people."

And boy, did they discover some interesting things. Some findings were quirky: that users of both genders added two inches on average to their height - even though shorter women got more messages. Or that using ur instead of you're or your in a first approach shrank the reply rate from 32 per cent to around 6 per cent.

In October 2009 a post titled "How Your Race Affects the Messages You Get" appeared. "We've processed the messaging habits of over a million people and are about to basically prove that, despite what you might've heard from the Obama campaign and organic cereal commercials, racism is alive and well," Rudder wrote. "It would be awesome if the other major online dating players would go out on a limb and release their own race data, too. I can't imagine they will: multimillion-dollar enterprises rarely like to admit the people paying them those millions act like turds."

Rudder showed that the percentages of matches were roughly even across all races. But white men got the most responses from almost all ethnic groups; white, Asian and Hispanic women preferred them to the exclusion of everyone else. Black women, on the other hand, get a bum deal - even though they reply more often than any other group to messages from every race, including their own, their messages get by far the fewest replies. "Essentially every race - including other blacks - singles them out for the cold shoulder," Rudder wrote.

He contrasted users' actions with their words: only 6 per cent overall said that interracial marriage was a bad idea, and 38 per cent that they would "strongly prefer" to date someone of their own racial background. (Among white users it was 45 per cent and among non-whites, 20.)

After that, the blog tackled such taboos as rape fantasies (these are deemed much more acceptable in Nevada than in New England, and in Lithuania than actual England) and even questioned the extent to which bisexuality exists. Noting that 80 per cent of self-identified bisexuals were interested in only one gender, Rudder concluded: "This suggests that bisexuality is often either a hedge for gay people or a label adopted by straights to appear more sexually adventurous to their (straight) matches."

Strange combinations

Last April, however, postings on the blog abruptly stopped. What happened? As the OkCupid number-crunchers would say, correlation does not imply causation, but it's hard to feel it wasn't anything to do with the site being acquired for $50m in February by its paid-for rival match.com. Was it intending to suffocate its free competitor? When I asked Yagan, the OkCupid chief executive, he said the blog would return but refused to be drawn further.

Then again, running a dating site exposes you to bits of humanity that maybe are best hidden. OkCupid was rare in making its data public, but our hidden prejudices and preferences are clearly well known to those in the industry. When I emailed Markus Frind, founder of Plenty of Fish, to ask about his rivals at OkCupid he said his matching system was better, because "we look at trends or patterns in couples . . . A female doctor is never going to date a carpenter. There are many, many combinations of relationships that will never happen or are very unstable." And he had the data to prove it.

What OkCupid showed was that, when it comes to choosing our partners, none of us is as progressive as we think. Perhaps the world is a better place for not revealing our deepest, darkest secrets?

True love: A neon sign by artist Chris Bracey. Photograph: Getty Images

Helen Lewis is deputy editor of the New Statesman. She has presented BBC Radio 4’s Week in Westminster and is a regular panellist on BBC1’s Sunday Politics.

This article first appeared in the 12 March 2012 issue of the New Statesman, The weaker sex

Getty
Show Hide image

David Osland: “Corbyn is actually Labour’s only chance”

The veteran Labour activist on the release of his new pamphlet, How to Select or Reselect Your MP, which lays out the current Labour party rules for reselecting an MP.

Veteran left-wing Labour activist David Osland, a member of the national committee of the Labour Representation Committee and a former news editor of left magazine Tribune, has written a pamphlet intended for Labour members, explaining how the process of selecting Labour MPs works.

Published by Spokesman Books next week (advance copies are available at Nottingham’s Five Leaves bookshop), the short guide, entitled “How to Select or Reselect Your MP”, is entertaining and well-written, and its introduction, which goes into reasoning for selecting a new MP and some strategy, as well as its historical appendix, make it interesting reading even for those who are not members of the Labour party. Although I am a constituency Labour party secretary (writing here in an expressly personal capacity), I am still learning the Party’s complex rulebook; I passed this new guide to a local rules-boffin member, who is an avowed Owen Smith supporter, to evaluate whether its description of procedures is accurate. “It’s actually quite a useful pamphlet,” he said, although he had a few minor quibbles.

Osland, who calls himself a “strong, but not uncritical” Corbyn supporter, carefully admonishes readers not to embark on a campaign of mass deselections, but to get involved and active in their local branches, and to think carefully about Labour’s election fortunes; safe seats might be better candidates for a reselection campaign than Labour marginals. After a weak performance by Owen Smith in last night’s Glasgow debate and a call for Jeremy Corbyn to toughen up against opponents by ex Norwich MP Ian Gibson, an old ally, this pamphlet – named after a 1981 work by ex-Tribune editor Chris Mullin, who would later go on to be a junior minister under Blai – seems incredibly timely.

I spoke to Osland on the telephone yesterday.

Why did you decide to put this pamphlet together now?

I think it’s certainly an idea that’s circulating in the Labour left, after the experience with Corbyn as leader, and the reaction of the right. It’s a debate that people have hinted at; people like Rhea Wolfson have said that we need to be having a conversation about it, and I’d like to kickstart that conversation here.

For me personally it’s been a lifelong fascination – I was politically formed in the early Eighties, when mandatory reselection was Bennite orthodoxy and I’ve never personally altered my belief in that. I accept that the situation has changed, so what the Labour left is calling for at the moment, so I see this as a sensible contribution to the debate.

I wonder why selection and reselection are such an important focus? One could ask, isn’t it better to meet with sitting MPs and see if one can persuade them?

I’m not calling for the “deselect this person, deselect that person” rhetoric that you sometimes see on Twitter; you shouldn’t deselect an MP purely because they disagree with Corbyn, in a fair-minded way, but it’s fair to ask what are guys who are found to be be beating their wives or crossing picket lines doing sitting as our MPs? Where Labour MPs publicly have threatened to leave the party, as some have been doing, perhaps they don’t value their Labour involvement.

So to you it’s very much not a broad tool, but a tool to be used a specific way, such as when an MP has engaged in misconduct?

I think you do have to take it case by case. It would be silly to deselect the lot, as some people argue.

In terms of bringing the party to the left, or reforming party democracy, what role do you think reselection plays?

It’s a basic matter of accountability, isn’t it? People are standing as Labour candidates – they should have the confidence and backing of their constituency parties.

Do you think what it means to be a Labour member has changed since Corbyn?

Of course the Labour party has changed in the past year, as anyone who was around in the Blair, Brown, Miliband era will tell you. It’s a completely transformed party.

Will there be a strong reaction to the release of this pamphlet from Corbyn’s opponents?

Because the main aim is to set out the rules as they stand, I don’t see how there can be – if you want to use the rules, this is how to go about it. I explicitly spelled out that it’s a level playing field – if your Corbyn supporting MP doesn’t meet the expectations of the constituency party, then she or he is just as subject to a challenge.

What do you think of the new spate of suspensions and exclusions of some people who have just joined the party, and of other people, including Ronnie Draper, the General Secretary of the Bakers’ Union, who have been around for many years?

It’s clear that the Labour party machinery is playing hardball in this election, right from the start, with the freeze date and in the way they set up the registered supporters scheme, with the £25 buy in – they’re doing everything they can to influence this election unfairly. Whether they will succeed is an open question – they will if they can get away with it.

I’ve been seeing comments on social media from people who seem quite disheartened on the Corbyn side, who feel that there’s a chance that Smith might win through a war of attrition.

Looks like a Corbyn win to me, but the gerrymandering is so extensive that a Smith win isn’t ruled out.

You’ve been in the party for quite a few years, do you think there are echoes of past events, like the push for Bennite candidates and the takeover from Foot by Kinnock?

I was around last time – it was dirty and nasty at times. Despite the narrative being put out by the Labour right that it was all about Militant bully boys and intimidation by the left, my experience as a young Bennite in Tower Hamlets Labour Party, a very old traditional right wing Labour party, the intimidation was going the other way. It was an ugly time – physical threats, people shaping up to each other at meetings. It was nasty. Its nasty in a different way now, in a social media way. Can you compare the two? Some foul things happened in that time – perhaps worse in terms of physical intimidation – but you didn’t have the social media.

There are people who say the Labour Party is poised for a split – here in Plymouth (where we don’t have a Labour MP), I’m seeing comments from both sides that emphasise that after this leadership election we need to unite to fight the Tories. What do you think will happen?

I really hope a split can be avoided, but we’re a long way down the road towards a split. The sheer extent of the bad blood – the fact that the right have been openly talking about it – a number of newspaper articles about them lining up backing from wealthy donors, operating separately as a parliamentary group, then they pretend that butter wouldn’t melt in their mouths, and that they’re not talking about a split. Of course they are. Can we stop the kamikazes from doing what they’re plotting to do? I don’t know, I hope so.

How would we stop them?

We can’t, can we? If they have the financial backing, if they lose this leadership contest, there’s no doubt that some will try. I’m old enough to remember the launch of the SDP, let’s not rule it out happening again.

We’ve talked mostly about the membership. But is Corbynism a strategy to win elections?

With the new electoral registration rules already introduced, the coming boundary changes, and the loss of Scotland thanks to decades of New Labour neglect, it will be uphill struggle for Labour to win in 2020 or whenever the next election is, under any leadership.

I still think Corbyn is Labour’s best chance. Any form of continuity leadership from the past would see the Midlands and north fall to Ukip in the same way Scotland fell to the SNP. Corbyn is actually Labour’s only chance.

Margaret Corvid is a writer, activist and professional dominatrix living in the south west.