The console camera of the future could track your movements through walls

MIT researchers have developed a camera that can build 3D models of users throughout a house - a potential game controller of the future.

The newest generation of consoles is going to get us used to being constantly watched by cameras in our living rooms. This might not be how Microsoft would put it, but that’s what the effect of an always-on Kinect will be. People have been penalised for swearing, at themselves, in their own living rooms:

To clarify, that’s a man getting an in-game penalty in NBA 2k14 because he swore outside of the game. Other games have been found to have similar features. Players can toggle the game’s listening-in on or off, but the important point here is that it’s incredibly creepy, and it’s the default, by choice of the developers. The console offers that function, so games will use it.

Let’s look forward, then, to what we might see in the generation after this one. We’re probably going to have cameras that track us through walls. Researchers at the MIT Computer Science and Artificial Intelligence Lab (CSAIL) have developed a system called “WiTrack” that uses radio waves to build 3D images of game players as they move throughout their home, even when they’re in other rooms.

It builds on an earlier system called “WiVi”, developed by some of the same researchers, that was a rough system for tracking people using the Wi-Fi on a typical smartphone. It works based on quite a simple, but clever, insight - the radio waves that a Wi-Fi device emits, like a smartphone or router, are deflected and reflected by objects they come across in just the same way that the radio waves used in radar systems do.

The resolution of Wi-Vi was pretty unimpressive - it could pretty much only tell you if something was moving closer towards you or further away - but it was an exciting idea. At the time, it was suggested that it could be used in hostage situations to figure out where people were inside buildings, or used by rescue teams to find those trapped beneath rubble in the aftermath of an earthquake.

WiTrack, conversely, uses its own radio waves instead of Wi-Fi, meaning it can build up full 3D models of its immediate environment. Here’s more info from MIT:

WiTrack operates by tracking specialized radio signals reflected off a person’s body to pinpoint location and movement. The system uses multiple antennas: one for transmitting signals and three for receiving. The system then builds a geometric model of the user’s location by transmitting signals between the antennas and using the reflections off a person’s body to estimate the distance between the antennas and the user. WiTrack is able to locate motion with significantly increased accuracy, as opposed to tracking devices that rely on wireless signals, according to Adib.

“Because of the limited bandwidth, you cannot get very high location accuracy using WiFi signals,” Adib says. “WiTrack transmits a very low-power radio signal, 100 times smaller than WiFi and 1,000 times smaller than what your cell phone can transmit. But the signal is structured in a particular way to measure the time from when the signal was transmitted until the reflections come back. WiTrack has a geometric model that maps reflection delays to the exact location of the person. The model can also eliminate reflections off walls and furniture to allow us to focus on tracking human motion.”

If that's not enough, there's a video that walks through how it works:

Gamers can look forward, in theory, to a future Kinect-like system with WiTrack capability that can track them throughout their homes. You could lead a squad of soldiers into your kitchen, make a sandwich, and head back to the action in the living room. Or, more usefully, it could be deployed in care homes to detect when elderly patients fall.

It is also, as a bit of technology that can literally see through walls, quite creepy. Imagine the privacy headache that could arise if everyone in a block of flats could see through into their neighbours’ homes, and imagine the paranoia that people would have that the NSA was keeping watch on them (especially considering that we now know that governments have infiltrated games like World of Warcraft).

It's still hard to see quite how this technology could be rolled out in a consumer setting, but give it time and there are probably hints of what's yet to come here.

A researcher using the WiTrack system. (Image: MIT)

Ian Steadman is a staff science and technology writer at the New Statesman. He is on Twitter as @iansteadman.

Show Hide image

The attack on Les Bleus was an attack on the soul of France - that's why Euro 2016 must go ahead

As a continent reels politically from the refugee crisis and emotionally from the Paris attacks, football must find a new, confident voice.

After the Paris attacks, the great Bill Shankly’s words have rarely been so tested: “Some people believe football is a matter of life and death. I am very disappointed with that attitude. I can assure you, it is much, much more important than that.”

As bombers detonated their suicide belts outside the Stade de France, French and German football fans cheered what they thought were fireworks. They were unaware that it was the opening salvo in a night of barbarity. One of the bombers had a ticket for the game but, mercifully, was turned back at the turnstile. Had his bomb gone off inside the stadium, the immediate loss of life, plus the panicked stampede and two more suicide bombers lying in wait outside for escaping fans, could have produced a death toll higher than at Hillsborough, Bradford, Heysel or either of the Ibrox ­stadium disasters.

The French intelligence services have yet to conclude publicly whether the attacks were timed to coincide with the prestigious friendly or whether the crowd of 80,000 was simply another target of bloodthirsty convenience on an already preordained date. Either way, there’s no mistaking that an attack on Les Bleus was an attack on the soul of France. In the aftermath, the Germany-Netherlands friendly game was called off and Belgian football went into lockdown.

How should British football respond? To those who think that the sport is just 22 players kicking a ball around a field, this may seem a peculiar question. But ever since the tail end of the 19th century, when football escaped from its self-enforced ghettoisation in Britain’s public schools, it has had a greater purpose.

More than any other sport, football has been intertwined with politics. As Harold Wilson said: “It’s a way of life . . . a religion.” When President Rowhani of Iran wanted to bolster his image as a new kind of leader, he didn’t deliver a speech but tweeted a picture of himself wearing an Iranian football top, watching a match. Franco’s dictatorship clung to the all-conquering Real Madrid and punished FC Barcelona. On Robben Island, ANC prisoners idolised Billy Bremner of Leeds United and successfully demanded the right to play football.

In October, one of the biggest protests against the closure of the north-east’s steelworks was from 10,000 Middlesbrough fans at Old Trafford. When Catalans challenged hikes in transport costs, they boycotted public transport from the Camp Nou. The biggest “Refugees Welcome” signs in Europe weren’t produced by governments but by fans of the Bundesliga champions, ­Bayern Munich.

So while the singing of the Marseillaise at the England-France match at Wembley was a “hairs on the back of the neck” moment, most of us understand that it’s not enough. What is less well known is that this wasn’t the first time that one of the world’s few genuinely inspiring anthems has been performed in earnest in British football. A century ago, bands took to the pitch to play patriotic British, French and Russian music – not out of altruism but military necessity. The British army was under intense pressure at Ypres and urgently needed new volunteers. The War Office turned to football.

For many, the journey to Loos, Flanders and the Somme started with a routine visit to cheer on their local team. Their sport transported them from a home football field to their foreign killing fields. Many clubs, including Everton, held military training on their pitches, while Manchester City’s then stadium, Hyde Road, became a 300-horse stable. Hundreds of players died serving in the Football Battalion.

But for too long our national sport reflected Britain’s lack of ease with diversity. From the 1920s, the religious sectarianism that poisoned the west of Scotland was allowed to fester in Glasgow’s football. The sport’s tolerance of recreational racism became widespread. Outside stadiums, right-wing extremists sold their propaganda while, inside, black players were vilified – even by their own supporters. Football’s racism corroded its heart and was rationalised in its head: it was allowed on the pitch, cele­brated on the terraces and accepted in the boardroom and far too many changing rooms.

And now, as a continent reels politically from the refugee crisis and emotionally from the Paris attacks, football must find a new, confident voice. The sport and its fans cannot sit on the subs’ bench at a time like this.

In a nation where only one in five male workers joins a trade union, football is a rare regular collective experience. It is more authentic than click-and-connect social media communities. Despite high ticket prices, football offers the one place where thousands of working-class men, including many politically disenchanted young men, come together in a common cause.

British football has long since jettisoned its ambivalence regarding racism. But for organised extreme right-wingers, Islamophobia fills the space vacated by the anti-Irish “No Surrender” tendency on the sport’s fringes. Although the number of top-flight British Muslim players is infinitesimally small, the streets of Bradford, Blackburn and Birmingham teem with young British Muslims kicking a football. More clubs can harness their power to inspire and increase their ­involvement in community counter-­radicalisation strategies. Clubs should also take the lead by having zero tolerance for Islamophobia, training stewards and backing fans who stand up to fellow supporters.

And, finally, the European Championships, for which all the home nations bar Scotland have qualified, must go ahead in France next summer. There’s no liberté in cancelling. In the name of fraternité, let’s all back France as our second team. Allez les Bleus!

Jim Murphy is the former Labour MP for East Renfrewshire and leader of Scottish Labour 2014-15.

This article first appeared in the 26 November 2015 issue of the New Statesman, Terror vs the State