The console camera of the future could track your movements through walls

MIT researchers have developed a camera that can build 3D models of users throughout a house - a potential game controller of the future.

The newest generation of consoles is going to get us used to being constantly watched by cameras in our living rooms. This might not be how Microsoft would put it, but that’s what the effect of an always-on Kinect will be. People have been penalised for swearing, at themselves, in their own living rooms:

To clarify, that’s a man getting an in-game penalty in NBA 2k14 because he swore outside of the game. Other games have been found to have similar features. Players can toggle the game’s listening-in on or off, but the important point here is that it’s incredibly creepy, and it’s the default, by choice of the developers. The console offers that function, so games will use it.

Let’s look forward, then, to what we might see in the generation after this one. We’re probably going to have cameras that track us through walls. Researchers at the MIT Computer Science and Artificial Intelligence Lab (CSAIL) have developed a system called “WiTrack” that uses radio waves to build 3D images of game players as they move throughout their home, even when they’re in other rooms.

It builds on an earlier system called “WiVi”, developed by some of the same researchers, that was a rough system for tracking people using the Wi-Fi on a typical smartphone. It works based on quite a simple, but clever, insight - the radio waves that a Wi-Fi device emits, like a smartphone or router, are deflected and reflected by objects they come across in just the same way that the radio waves used in radar systems do.

The resolution of Wi-Vi was pretty unimpressive - it could pretty much only tell you if something was moving closer towards you or further away - but it was an exciting idea. At the time, it was suggested that it could be used in hostage situations to figure out where people were inside buildings, or used by rescue teams to find those trapped beneath rubble in the aftermath of an earthquake.

WiTrack, conversely, uses its own radio waves instead of Wi-Fi, meaning it can build up full 3D models of its immediate environment. Here’s more info from MIT:

WiTrack operates by tracking specialized radio signals reflected off a person’s body to pinpoint location and movement. The system uses multiple antennas: one for transmitting signals and three for receiving. The system then builds a geometric model of the user’s location by transmitting signals between the antennas and using the reflections off a person’s body to estimate the distance between the antennas and the user. WiTrack is able to locate motion with significantly increased accuracy, as opposed to tracking devices that rely on wireless signals, according to Adib.

“Because of the limited bandwidth, you cannot get very high location accuracy using WiFi signals,” Adib says. “WiTrack transmits a very low-power radio signal, 100 times smaller than WiFi and 1,000 times smaller than what your cell phone can transmit. But the signal is structured in a particular way to measure the time from when the signal was transmitted until the reflections come back. WiTrack has a geometric model that maps reflection delays to the exact location of the person. The model can also eliminate reflections off walls and furniture to allow us to focus on tracking human motion.”

If that's not enough, there's a video that walks through how it works:

Gamers can look forward, in theory, to a future Kinect-like system with WiTrack capability that can track them throughout their homes. You could lead a squad of soldiers into your kitchen, make a sandwich, and head back to the action in the living room. Or, more usefully, it could be deployed in care homes to detect when elderly patients fall.

It is also, as a bit of technology that can literally see through walls, quite creepy. Imagine the privacy headache that could arise if everyone in a block of flats could see through into their neighbours’ homes, and imagine the paranoia that people would have that the NSA was keeping watch on them (especially considering that we now know that governments have infiltrated games like World of Warcraft).

It's still hard to see quite how this technology could be rolled out in a consumer setting, but give it time and there are probably hints of what's yet to come here.

A researcher using the WiTrack system. (Image: MIT)

Ian Steadman is a staff science and technology writer at the New Statesman. He is on Twitter as @iansteadman.

Harry Potter and the Cursed Child
Show Hide image

New Harry Potter and the Cursed Child pictures: an analysis

What do the new cast photos tell us about what we can expect from the Harry Potter play?

With the first public performance only a week away, the team behind Harry Potter and the Cursed Child have released the first in costume cast photos of three of its stars: Harry, Ginny and their son, Albus.

But what do the new pictures tell us about what we can expect from the play? Here’s your annotated guide.

Harry

Harry is suited up like the civil servant we know he has become. When we left him at the end of book seven, he was working for the Ministry of Magic: JK Rowling has since revealed he became the youngest head of the Auror Office at 26, and the play description calls Harry “an overworked employee of the Ministry”. Jamie Parker’s costume suggests a blend of the traditional establishment with Harry’s rebelliousness and familiarity with danger.

Parker told Pottermore of the costume, “He’s wearing a suit because he’s a Ministry man, but he’s not just a bloke in a suit, that’s way too anonymous.”

Ginny

Ginny looks like a mix of the cool girl we know and love, blended with her mother, and a little something else. She has a perfect journalist’s bob (Ginny became a Quidditch reporter after a career as a professional player), paired with a “gorgeous, hand-knitted jumper” reminiscent of the Weasley’s Christmas sweaters. In silhouette, she might look like her mum with an edgier haircut, but with (literally) cooler colours and fabrics.

Actress Poppy Miller said the costume matches Ginny’s personality: “Kind and cool, exactly as I imagined her.”

Albus

Albus’s costume is perhaps more interesting for what it hides than what it reveals – we are given no suggestion of what house he might be sorted into at Hogwarts. This is particularly interesting knowing Albus’s nerves about being sorted: the final book ended with him asking his father, “What if I’m in Slytherin?”. Rowling writes, “The whisper was for his father alone, and Harry knew that only the moment of departure could have forced Albus to reveal how great and sincere that fear was.”

Actor Sam Clemmett said, “This is what Albus wears at the start of the show. I had the idea he was wearing James’s – his older brother’s – hand-me-downs. So I wanted him to feel quite uncomfortable, and be able to play with his clothes.”

His oversized second-hand clothes also emphasise how important the role of family inheritance will be in the play. The only reminder of Albus’s older siblings, they call to mind both his Weasley heritage (Ginny and her siblings were teased for their hand-me-down robes) and the enormous legacy of his father. The play description notes, “While Harry grapples with a past that refuses to stay where it belongs, his youngest son Albus must struggle with the weight of a family legacy he never wanted.”

Family portrait

Again, this group picture is interesting for absences – there are no Potter siblings here, further suggesting that Albus will be the main focus of this new story. It also continues to place an emphasis on family through the generations – if Albus donned a pair of specs, this could easily be a picture of James, Lily and Harry. Even the posture is reminiscent of the Mirror of Erised shot from the first movie.

An intriguing hint at what next week’s play might hold for audiences.

Anna Leszkiewicz is a pop culture writer at the New Statesman.