As well as announcing a next-gen Steam Machine and Steam Controller, Valve has confirmed plans to once again head into the world of VR headset hardware with Steam Frame, its follow up to 2019’s Valve Index.
In an interview with IGN conducted ahead of today’s big reveal, Valve hardware and software engineer Jeremy Selan and hardware engineer Gabe Rowe explain why the company is releasing a new VR headset now, what it’s capable of, and what it thinks of the state of VR right now.
And if you’d like to know more about the next-gen Steam Machine and Steam Controller, check out our interview with Valve on both devices here.
IGN: So the first thing I want to ask is why dip back into VR, going from the Valve Index to now the Steam Frame?
Jeremy Selan: I’d like to draw an analogy to where Steam Deck was, right? If you think back to the original Steam Machine way back when, we threw that out there, we learned a lot from that experiment, but then the technology, we learned a lot that we had to go back and do more work, and that’s how Proton came into being. That’s how we knew we had to simplify the ability of partners to put content on the device. And by the time all that work had been done and ready, it sort of came to fruition for the Steam Deck. I think it’s a very analogous thought process for this device.
So the Steam Frame draws upon a lot of the technology from Valve Index and that VR catalog, but it also… we had to wait until the computing technology was on the headset for us to have not just a good streaming experience, but we wanted SteamOS and ARM and all of that support, which is the ability to allow us to play content locally, we wanted those all to come together to be able to create a device that really breaks those boundaries and lets you do both.
One of the real superpowers for this device is to not have to choose before you put it on whether you want to play VR or non-VR content. So I love the Index, I love my Steam Deck, but I would very often have to think before I picked up one of those devices, am I interested in playing a VR game? Okay, go to the room with a VR system. Or do I want to pick up my Steam Deck and play that catalog? With the Steam Frame, you don’t have to make that trade off. You just put it on, you have your Steam catalog in front of you and you can just browse through it and see what you feel like doing. And so for us, the reason we’re doing it now is because we can finally create that lower friction experience that really lets you think about being able to enjoy that full catalog in a different way.
Gabe Rowe: And I think one of the things that also goes into that is when we think about the streaming experience from the PC, the PC obviously can run your entire Steam catalog. So we wanted to make that streaming experience as seamless as possible. So you’re looking at your Steam catalog in front of you on your headset on the Steam Frame, and you can easily choose if you want to play a game streamed from your PC, both 2D games and VR games. And so that process right there, once again, the friction is super, super low and you can basically say, I want to be able to play local content, I want to play streamed content, and you really don’t have to be taking the headset off, putting it back on, and that friction is as low as we could get it.
Jeremy Selan: We would’ve loved to have built this device five years ago, but the technology just wasn’t there for us. We really had to wait until all of the compute and the form factor — that’s only recently become possible and that’s why now is the time for us to build this device.
Steam Frame Images
IGN: Tell me a little bit more about the wireless dongle that you have, the ultra low latency.
Jeremy Selan: So we have three things together that create a really great streaming experience. The first one is the dongle. So people might be familiar with streaming and they might be familiar with some of the challenges and gotchas involved with streaming. I think people, when they think about streaming, they might think about the cloud where you have some computers at a nearby data center and then they send that information across the internet and they send that information across your home’s Wi-Fi, and when it finally hits your device, there are certain challenges enjoying that type of content.
With the included wireless link we take all of that out of the equation. We have a direct connection between the headset talking to your PC or your laptop where you don’t even have to think about it. It’s designed to be plug and play. You plug it into your device. Steam just directly makes that connection and you don’t have to think about when you hit the play button, whether it’s on your local device or whether it’s streaming.
We’ve also done one other thing in conjunction with that, which is the eye tracking in the headset. We do a new technology, we’re calling it ‘foveated streaming.’ A lot of customers might be familiar with foveated rendering, where you spend more of the PC’s computability to render the pixels where you’re looking. This is not that, but it is similar in spirit to that, but applied at the transport layer. So we call it foveated streaming where we send the highest quality information, essentially full fidelity for the area you’re directly looking at, and then the rest of the scene is sent at lower fidelity. And that trade-off gives us a much higher effective bandwidth. So say for example, the foveated area is one tenth of the size of the frame, you can think about it as an effective 10x multiplier in bandwidth and quality improvement you get from that. So those two things together are really three things, which are what led us to have a streaming experience we’re really proud of and that we think everyone will be able to enjoy.
IGN: Why engineer the foveated streaming instead of just packaging in a more powerful antenna?
Jeremy Selan: It’s not just about the antenna, it’s about all of the trade-offs, right? So there’s only some number of channels in the spectrum. There’s always errors that happen. So you do things like forward error correction. There’s always trade-offs, and so you are really balancing bandwidth, robustness and latency because of retries and things like that. And there’s no magic bullet. There’s no magic solution. So us being able at the system layer to introduce this multiplier, this 10x factor really just gave us link budget for free in being to spend that. So even if we made it a more powerful radio or a more powerful link, I would still want to bring this technology and apply it in this case because it just makes things better.
IGN: Can we get some of the ideas behind the design decisions here?
Gabe Rowe: The same team that’s working on Steam Frame, we all worked on Index, so we definitely have the history of all of the different VR headsets that have been made over the last 10 years. And so we’ve put on a lot of headsets on our faces and we’ve said, okay, how can we make our own headset that really does a really holistic job where we say, okay, let’s put as low of a weight as we possibly can on the person’s face, let’s get the battery someplace else — let’s put it in the back — let’s put the charging port, the type-C port in the back so that if you happen to be using an additional battery in your pocket, for example, that cable would be in the back. We have the facial interface that’s as soft as we possibly can. We’ve iterated like crazy to make that as comfortable as possible.
We’ve made the audio that’s built in on the sides of the head strap as high quality as possible. We’re always trying to shave weight, make the eye tubes as small as possible. We’re basically just constantly wanting to make the device as lightweight, as comfortable as possible so that when somebody puts the device on their head, they immediately feel comfortable and they’re thinking, okay, what content do I want to enjoy right now? What game do I want to open? And they’re not thinking, man, this thing is uncomfortable.
And so there’s a huge focus on comfort. And then within that saying, okay, what performance can we squeeze out of the chip that’s in here? How much battery life can we get? And then having that ability to have a very high performance wireless link to your PC. So we have a very high-end radio that’s on device. We have a very high-end SOC that’s in there as well. So all of these things altogether are really basically saying, within this package, how can we get a really high performance device that feels good on your face and that you’re going to be happy to put on and not be immediately thinking, man, I really don’t want be wearing this thing right now. So that’s a huge, huge thinking process.
Jeremy Selan: I think one of the consistent threads throughout all of the Valve hardware projects is that we use the devices ourselves a lot. So I know in some more traditional types of hardware organizations, you might have a team that’s responsible for the battery and another team that’s responsible for the processor and another team that’s responsible for the software, and they’re very dedicated independent teams. But one of the challenges with that type of organization is that it’s sometimes hard for that feedback to make it across and to be acted upon.
And similar to our game teams where — I don’t know if people are familiar with how our game teams work, but they’re a very ad hoc organization where you sit by who you’re working with and anyone could give feedback on any system — Valve hardware works exactly the same way. So if I’m wearing the headset every day writing software or working on the user interface and I have feedback about the weight in the front and exactly how it fits, I walk over 20 feet, I tell that to the designer, and then I’ll have a new version the next day.
I think all of us acting as real users and playtesting these things every day, as well as being so closely tied to the interdisciplinary engineering where you can just literally walk across the hall and talk to someone who’s working on a radically different part of this design has just allowed us to turn the crank really quickly and go through a whole bunch of iterations. That’s one of the reasons I think we are uniquely able on small teams to do such awesome devices.
IGN: For folks watching this who might want to just get a lay of the land in terms of things like resolution, FOV, refresh rate and the integrated cameras and how that works for tracking…
Jeremy Selan: Sure. Yeah, so the FOV is up to 115 degrees. They’re pancake optics, so people are familiar with those from other top tier premium devices. That pancake optical design is a folded optic system where it has both refraction and reflection, and that allows you to have a very compact small form factor, which really helps the ergonomics, as well as still getting sharpness edge to edge over that up to 115 degree FOV. The panels are 2160 by 2160 per eye. They’re LCD. They allow for refresh rates from 72 hertz up to 120 hertz, and then 144 is allowed as well with… we call it experimental mode. Exactly the same as Index, actually.
We have integrated cameras. There’s four monochrome cameras on the exterior doing tracking. They’re specifically designed to be very good at tracking, as well as very good at doing that in low light. They pair with integrated IR illuminators, which allow you to track in certain environments in complete darkness. We also have two cameras on the inside for eye tracking, which as we discussed, is a large advantage for streaming. Just to talk about the APU (Accelerated Processing Unit), we also have 16 gigabytes of RAM that’s standard. And then the processor…
Gabe Rowe: Yeah, the processor is a Snapdragon 8 Gen 3, also known as the 8650 platform. And that is a very, very capable processor right now that combines a ton of things as far as being able to talk to all of the different peripherals as well as the very high performance wireless solution. All of it goes together with essentially running SteamOS now on ARM. And what’s really cool about that is that allows us to bring together a whole bunch of different ecosystems onto one device, both on the VR side, the non-VR side, whether it’s streamed, running content locally.
And we also have 256GB as the base SKU for storage, a 1TB option. And we also have an SD card slot. And the SD card slot would allow you to plug in one terabyte, two terabyte SD cards, and that’s something where you could even take, for example, your SD card from a Steam Deck and plug it directly into the headset, and now you have your games running right there. Another interesting detail there would be, we do have the camera expansion port on front that has two different modes: a high-speed camera interface, as well as a PCIe (Peripheral Component Interconnect Express) port. So a lot of interesting modularity and functionality there.
IGN: I know you guys are building a piece of hardware, but I imagine you have some thoughts on the current state of VR games and kind of want to ask your thoughts and feelings on VR now and where you want it to go in the future.
Jeremy Selan: There have been a lot of awesome games that have come out in the last few years, so I think we’re really excited about where it’s at and even going forward. I think going forward, one of my favorite thoughts is that VR feels like a little bit of a segregated island from non-VR gaming. I know on Steam very often you think about it as, there’s VR users and non-VR users. But when we look at the playtime data, what we see is it’s blended a lot more than that. A lot of the people who play VR also play non-VR content, and that’s one of the major decision factors in us deciding to come to market with this type of product.
Wesley is Director, News at IGN. Find him on Twitter at @wyp100. You can reach Wesley at wesley_yinpoole@ign.com or confidentially at wyp100@proton.me.
