You can pin applications to one side of the screen while continuing to use others by saying, for example, "Xbox, snap Internet Explorer." The browser moves to the side, and you can continue to watch TV or play a game on most of the screen. When one app is pinned, you switch between them by saying "Xbox switch." "Xbox, unsnap" is the reverse command.
It also recognizes the names of games and other things; you can say "Xbox, return to Forza Motorsport 5" and it will take you back to the Turn 10 racing title.
We also used the Xbox One's game DVR functionality.
The console constantly records the last five minutes of gameplay, and saying "Xbox, record that" automatically creates a 30-second clip that you can then edit by saying "Xbox, go to upload."
You can trim a clip down, though right now it's impossible to break out of the time constraints the console sets. You can't record more than five minutes at a time, for example. And unfortunately you can't upload the clip to YouTube, only to Xbox Live.
However when you're editing gameplay footage you can simultaneously record commentary video through Kinect and upload the two together with a picture-in-picture effect. Everything is easy and intuitive.
Kinect, vastly improved over the Xbox 360 version, is good at detecting people now. During a Skype call, for example, the image will zoom, pan and tilt to keep speakers' faces in the frame. It's all done digitally; the sensor never moves. When someone leaves the frame the Kinect camera will re-focus and zoom on whoever remains. If someone enters the frame, it zooms out to encompass them as well.
"Today, one of the ultimate enemies of gamers is the fact that they have to change inputs on the TV," Piñero told us. The Xbox One's HDMI-in port is meant to eliminate that problem once and for all, especially if it's the only game console you use.
The new Kinect itself is an IR blaster that literally sends signals bouncing around the room and off players to reach the cable box and change the channel. That's also how the Xbox can adjust the volume on the TV or on separate AV receivers.
But HDMI-in is what makes the Xbox OneGuide possible. OneGuide, activated with the easy-to-remember command "Xbox, OneGuide," is like your cable company's channel guide, only cleaner, more customizable, and controlled by Kinect.
To change the channel, you simply call out "Xbox, go to Comedy Central" or "Xbox, go to MSNBC." In fact - and this applies across the entire Xbox One system - Kinect will recognize any words displayed in green on the screen at any time as voice commands, and in OneGuide that includes channel and program names.
From the OneGuide, you can also make favorites lists that are customized for each users' profile and see something new called app channels, which are curated selections of content, such as trending clips or popular movies, from apps like Hulu Plus.
Those of you outside the US will have to wait a bit longer for this feature, and we've been told it won't arrive in the UK until 2014.
Making it work
Piñero discussed other features that weren't yet available for us to try out, like fantasy football and fitness features. He also dished on "media achievements" that unlock when you watch, say, 10 movies in one weekend, or when you start a new TV show (though they won't add to your gamerscore, because "Gamerscore is sacred," as Piñero said).
We also didn't get to check out the Xbox One's Twitch integration.
But our concerns with the Xbox One are mainly for people with more complicated living room set-ups than a cable box, an Xbox One and a TV.
Thanks to the Kinect's IR blasting capabilities, the Xbox One is also designed to work with an AV receiver for external speakers. But what about users who currently have different devices connected to different audio devices, or users who like to switch from external speakers to a high-quality audio headset when their roommates go to bed?
For example, a user might currently have an Xbox 360 connected to external speakers through an optical cable, but the cable box might be sending sound to the TV through an HDMI or component cable. If the cable box is routed through the Xbox One using HDMI, and the Xbox One's audio is connected to an AV receiver via optical, will all sound come through the external speakers now?
Piñero said various set-ups will work, but we fear the more complicated your living room is the more difficulty you might have in getting the Xbox One to control it all.
We'll know more by the time our full Xbox One review is published, so keep an eye out. More answers await.
In the meantime, Microsoft has put up a 12-minute video demonstrating the whole thing in action. Impressive.