Oculus VR’s Jason Rubin says designing VR titles is the toughest learning curve in games

Jason Rubin is a 30-year veteran of video games and the cofounder of Naughty Dog, the maker of the Crash Bandicoot series and many of the world’s best-selling titles. He sold Naughty Dog to Sony in 2001, and left in 2004. Then he moved into the world of startups, creating comics and an Internet business. He also had a brief, ill-fated stint as president of THQ before it went bankrupt in 2013.

But now he’s back as the head of worldwide studios at Oculus VR, which Facebook bought for $2 billion. Rubin says that he saw a demo and was sold on the potential for virtual reality to provide amazing, immersive experiences for gamers.

Yet he also believes that making VR right is the “single biggest learning curve” in all of his years making games. He believes that game developers have to dive in, experiment, and even fail a few times to have a shot at the financial “gold rush” that will happen if VR truly becomes a mass market.

Rubin talked about his views on VR — and whether he’ll make a VR game himself — in a fireside chat with Geoff Keighley, the creator of video game award show The Game Awards, at our GamesBeat 2015 conference. Here’s an edited transcript of the fireside chat.

Above: Jason Rubin of Oculus VR and Geoff Keighley of The Game Awards at GamesBeat 2015.

Image Credit: Michael O'Donnell/VentureBeat

GamesBeat: You came back to games for Oculus.

Jason Rubin: Once a developer, always a developer, right?

GamesBeat: You and I over the years have always talked about what it would take to get you back into games. You had ideas for games you wanted to make, but you didn’t make, after you left Naughty Dog. Let me ask you about the idea of VR in general. What was the moment for you, after working so many years on games, that you first put on VR? Were you an instant believer?

Rubin: Absolutely. Brendan Iribe called me down. He’s the CEO of Oculus. He said, “You need to see this thing.” I went in assuming I wouldn’t be that impressed. I’ve seen a lot of technology over the years. But I put it on and I was an instant believer. I got into games to make worlds. I walked out of Star Wars at seven years old and wanted to be George Lucas. I think every game maker has wanted to create worlds. After 20 years of creating flat experiences, I got—Not tired of it, but I had done the same thing long enough that I wanted to take some time off. Seeing VR and the ability to create a world that you’re completely immersed in was what got me excited to get back into games on a full-time basis.

GamesBeat: Back then they weren’t interactive, right? It was just being able to look around. That level of immersion was enough to excite you about what gameplay could eventually be?

Rubin: Yeah. The promise is there. People talk about presence. It’s one of those wishy-washy terms that no one’s really defined. But there’s a moment in the demo I got a year and a half ago now, almost two years ago, where you’re at the edge of a building. I’ve given that demo now hundreds of times. I stepped off the building, but it took a conscious decision to override my instincts not to. Nine out of 10 people or more, I can’t coach them to step off the virtual building. You say, “Look, you’re in a room. You were in a room 15 minutes ago. You know you’re not really on a building. We would never kill you. I’m gonna hold your hand in the real world. Just take a step forward.” Most people say, “I get it. But I’m not gonna do it. I can’t.” Even though it’s not interactive — no long-term gameplay, no compulsion loop, no feeling of achievement, all those things games will bring to it – I knew at that moment that if I can make you afraid to walk forward, I can make see you anything. I can make you believe you’re in another universe

GamesBeat: What’s your role at Oculus now? You were a developer first. You like making games. There are lots of interesting people at Oculus, but your role at Oculus Studios — you’re making and funding first-party games at Oculus?

Rubin: My title is head of studios. I’m in charge of all of what we call the lighthouse titles that Oculus is funding and working on. We have a production group. We’re trying to share best practices among many developers and explore the infinite possibilities that VR brings 10 or 20 titles at a time. We’ll figure out what works and what doesn’t work. VR is a unique challenge. When I started making Crash Bandicoot, Andy and I decided we would make a character action game work in 3D. Most people don’t realize how big a challenge that was. It hadn’t really been done up to that point. A lot of what Mario and Sonic and Donkey Kong Country relied on in terms of precision jumping and everything else just doesn’t translate into 3D. You can’t judge distance, especially because it was a blend of 2D and 3D. It wasn’t stereo. It was just polygons rendered on a screen. It took us a year of R&D to get to the point where we created Crash. A lot of what we did was determined by the hardware we were dealing with.

Crash is mostly an in and out game, whereas our competitor Mr. Miyamoto created a game where you run around much more freely. The reason for the difference is simple. He decided he wanted an analog stick and released the first analog stick. We were stuck with an old-school digital pad. We did in-out-left-right because that’s what we were given. This challenge reminds me a lot of that, but amplified. Everything you do, you can’t rely on what you learned in the past. Everything has to be discovered anew. For the first time, you have the ability to make someone feel uncomfortable in VR. That’s much bandied about, as if it would somehow be a barrier for VR. It’s not a barrier. It’s a challenge, but there are so many things you can do outside of that realm, outside of this space in which you feel uncomfortable, that it’s really a question of filling that space and then moving in around the edges.

How do we make a character action game in 3D? How do we move that character action game into VR? Very similar. I got that feeling that I hadn’t had since Crash Bandicoot – discovering the new. That made it exciting for me, made it worth doing. And I get to work on many projects, as opposed to just one as a developer. I’m a producer, so I get to dip my head in and out and work on many projects. It’s amazing, seeing the tiny inventions that people come up with. Sniper rifles don’t work well in VR. Imagine your vision is suddenly magnified 10 times. You wouldn’t be able to walk. High Voltage, working on a game called Damage Course, solved that problem and did it in a way that doesn’t make you uncomfortable. We’re moving into all these little areas where people say, “You can’t do that kind of game.” We’ll figure it out. It’ll be different, but we’ll figure out how to get there.

Above: Ping pong in VR

Image Credit: Oculus

GamesBeat: How much of your stuff right now is experimental versus actual products that you know you want to eventually bring to market?

Rubin: Most of what we’re doing is products. Michael Abrash gave a speech at Facebook Connect about the future of VR. He was saying how far we have to go, and how each challenge from inner ear to eye to smell—All of these things about VR have their own challenges. We don’t know how long it’s going to take. We’re working toward it. It’s a long journey.

I live in the opposite world. I go to a developer and say, “You want to do a sports game? I want to do a sports game. Here’s your budget. Here’s your timeline. We don’t know how the hell this is going to work, but I want football, baseball, basketball, hockey. Go.” And then we have to backfill into that. Amazingly, we’ve been able to do that. We’ve shown hockey. We’ve shown football on the screen. It’s amazing. You’re a quarterback. You pass the ball and then you become the receiver and catch the ball. It’s very centered around making products, getting to products.

GamesBeat: For a lot of people here who may be in development or in companies related to VR, we’ve seen an explosion of investment in VR. A lot of people may be wondering what the addressable market is going to be. Oculus can afford to forward invest in some of these games and not necessarily think about the P&L right off. But when you think of the go-to-market strategy for games and developers, a lot of people are jumping in right now. Does the math work in terms of how many people have to work on these games for how long relative to how many headsets will be out there in a year or two?

Rubin: I thought that the challenge in my job when I started would be convincing developers to make this leap. I’ve gone at it in two ways. The first way is to say, “Remember when touch games first came out and people said it would never work?” A lot of the industry just ignored it, but a few developers decided to jump in at a time when nobody knew if there was a business there. Some of them became Rovio. Some of them were early enough that they had that hit that became massive. There was a lot of trial and error at Rovio, a lot of failed games before they hit Angry Birds. What they learned gave them the ability to get there. We’re now into multiple generations of learning and getting ahead. This is the single largest learning curve I’ve ever seen in games.

Naughty Dog just celebrated its 30th anniversary, so I’ve been at least 30 years in the games industry, and this is the single largest challenge. It also feels like an inevitability to everyone that uses it. If you believe this is inevitable, and if you believe this is a hard challenge, getting in early and failing a few times – perhaps financially failing a little bit, struggling, making sure you make ends meet – is the best way to give yourself a shot at the next gold rush in the industry. The gold rush is not there anymore in mobile, at least from my perspective. It’s very hard to get there. So that’s one way.

People have been very accepting of that concept. The second way I’ve won hearts and minds is just putting them in VR. The minute you do that, they want to do it. The most important indication of the success of VR, to me, has been the fact that every single developer I’ve signed at Oculus has asked me to do a second title. They’ve either signed or they’re pitching to do a second title. Many developers, some of them well-known developers, have said, “Listen. We’re winding down our other contracts over time. We’re all in on VR.” Not a single developer I’ve worked with has said, “After this game I’ll go back to doing something else.” It’s incredibly compelling. If all the developers we’re working with buy in, it’s going to create the content that brings the audience.

Above: Jason Rubin and Geoff Keighley talk about designing for VR at GamesBeat 2015.

Image Credit: Michael O'Donnell/VentureBeat

GamesBeat: Are you going to get into VR yourself? Will we see a Jason Rubin game?

Rubin: I’m happy doing what I’m doing now. I consider all of them my children, but I raise them from afar. I don’t know. Who knows? But right now I’m really happy jumping from project to project and helping solve the little problems as they move toward launch.

GamesBeat: You mentioned the mobile gold rush may be over, but there’s an interesting conversation to be had about mobile VR versus the Rift. Gear VR is out there. What’s your view of at least the first way a mass market is going to experience VR? Is it going to be through mobile or a headset like the Rift?

Rubin: Oculus’s answer is that we believe in both, clearly. We have our partnership with Samsung and we’re working very closely with them on Gear VR. We’re excited about that product. The $99 price point announced a couple of weeks ago is an incredibly compelling addition to a phone you already have to get you into VR. It provides a really cool experience that surprises most people who put it on. They say, “Wow, this is absolutely amazing.” On the other end of the spectrum we have the Rift. It provides this experience that’s unforgettable. Everyone who puts it on remembers the first time they put it on. It’s hard to say how VR pans out. But I would say, right now, mobile is starting at lower-end and moving up. Rift is starting at the high end and moving toward the middle. Somewhere in the future we end up with the perfect device at the right price point that has a broad enough market to become a huge success. How that exactly plays out I don’t know.

GamesBeat: The Rift is obviously not just the headset. You need a great computer to run it. There are barriers to entry there. That’s why I think the mobile experience — it’s pretty compelling. When you’re thinking about studios and games, where are developers going? Are they building games that work on both? Do they have to bet on one or the other?

Rubin: Sometimes you show the developer the Rift and they say, “This is unbelievable.” But then they put on the Gear VR and they say, “This is where I want to work. This is the future.” At other times you give a developer the Rift and Gear VR and they absolutely just want to work on Rift. That’s a developer preference.

GamesBeat: Are you doing games that will be on both?

Rubin: There are definitely games that are on both. The fundamental difference between the two is that there is no positional tracking on the mobile device right now. It has three degrees of freedom. You can look around and see in any direction, but as you move forward, backward, left, or right, it doesn’t register that change. If you were to stand up and run forward in your game, the whole world comes with you on Gear VR, whereas you will run into whatever you’re running at on Rift. That fundamentally changes some games. Some games don’t work on one or the other. HeroBound and HeroBound 2, these third-person dungeon crawlers we did, work great on both.

Above: Samsung Gear VR with Oculus tech

Image Credit: Dean Takahashi

GamesBeat: When you think of studios and where you’re placing your bets moving forward — I know you’ve worked with a lot of developers. What are some of the titles you’re working on or the types of experiences you want to build?

Rubin: We’re trying to run the gamut. We have a lot of games we call tabletop, for lack of a better word. RTS and MOBA would fall into that. There’s a weird feeling like when you were a kid and playing with toys, when you’re playing a game and looking down like a giant on a tabletop. It’s incredibly compelling. You feel like it’s your little universe you’re building. We have third-person character action games – Edge of Nowhere from Insomniac, Lucky’s Tale from Playful, a bunch of others that remain unannounced – that are incredibly cool. The challenge there is, you tend to focus on the characters.

We’re trying to invent ways to get the player to actually look around, because the power of VR is having this giant universe to look around in at any given point. But third-person games have worked well. Chronos is another one we’ve announced, which is fantastic. Then we have first-person adventures. Onto that you have to layer input devices. Everything we’ve just talked about is headsets. Our touch controller gives you an incredible ability to put your hands into space and reach out and see them. You can point and thumbs-up and do things like that. Another thing to say, by the way, is that Facebook believes in social. Facebook owns Oculus. There’s a strong belief that social is going to be a huge part of VR’s future.

We have demos right now where I can point over there and you’ll turn around and look at what I’m pointing at, even though we could be on different continents looking in different directions. It all just works with the 3D sound and 3D visuals. We can play ping-pong across giant chasms. It feels like I’m standing in front of you. The second presence moment I experienced after walking off the building was the first time I went into what we call Toy Box, which is a multiplayer demo where you do nothing but pick up and mess with stuff. There’s no game in it. I’m a floating blue head, you’re a floating blue head, and we have floating blue hands. There’s just hands and a head.

If I walk at you, you will get that feeling of human fight or flight. What is this person doing? Why are they coming at me? Do I need to do something? No other medium, no matter how—I watched Jurassic World last night on my flight. No matter how that dinosaur gets up to the TV, it’s still just a dinosaur on the TV. When you see things in VR come at you, you get that feeling. Even though I’m a floating blue head that’s nothing to do with me, you’ll recognize my body motions. You’ll recognize me as human. You’ll react to me as if I was human. We’re doing a lot with the touch controllers and social interactions.

GamesBeat: When you say this, you paint an amazing picture of VR and how impressive it is. When you look at the traditional games business, is VR just going to wipe out the traditional console game? Is everything going to be in VR? Or will VR just be something that’s cool for short session experiences, and I’ll still want to sit down and play Grand Theft Auto like I used to?

Rubin: The short session experience I’m not sure is a truth. There are things I’ve done for many hours without having a problem. What I will say is, there are some things we’re really good at doing in 2D games. 30 years of Naughty Dog has created titles that are not all of a sudden going to go away. A lot of those titles won’t work in VR because of the locomotion issues and comfort issues.

I still want to play those games. VR does an incredibly good job of letting me play those games on a 70-inch television with the best sound system in the world sitting next to a friend. Nobody in VR space says, “We’re going to wipe out every other kind of game.” You don’t hear that. No one at Oculus says that this is the end of anything. We think that it amplifies and improves everything that’s out there. We announced the Netflix app. Netflix is awesome in VR. It’s a gigantic screen that most people can’t afford to have in their house. On a plane, if you download your movies, it’s a great way to zone out in coach.

Above: Jason Rubin, the head of worldwide studios at Oculus VR, is hooked on VR.

Image Credit: Michael O'Donnell/VentureBeat

GamesBeat: Those traditional 2D games will still exist, but you think everyone will be viewing it in VR?

Rubin: Maybe not everyone. But I have a two-and-a-half-year-old daughter. I happen to love the Grand Theft Auto franchise. I can play it in front of her if I have a headset on. When I was going to college and I was stone broke, we were three people sharing a tiny TV. I can put on an Oculus headset, plug it into my laptop, and I’m sitting in an amazing room watching TV, again, with friends who are not in the room, avatars of my friends. I can tune out my roommates. They’re not there anymore. We have an Xbox integration that plays through Rift. It’s amazingly good.

It’s a great way to play. When I grew up, we would play Mario Kart next to each other on the sofa. We’ve lost the trash-talking, right? We’ve lost the ability to look over and laugh at somebody. Trust me when I tell you, even though you’re an avatar – you’re playing a gnome and I’m a flaming chicken – when I look at you and I laugh, you get that. “He just laughed at me.” You feel that. Going back to the Mario Kart party, even though we’re not in the same room, is incredibly compelling. I think it makes everything better.