As the cinematics lead for Call of Duty: Black Ops II, Adam Rosas has a tough job. Rosas (pictured below) had to use current-generation console technology to create convincing facial expressions and performances for the characters in the game such as Frank Woods. The end result are some highly realistic animated characters who have believable face-to-face conversations in the title’s movie-like sequences that take place in between gameplay scenes.
[aditude-amp id="flyingcarpet" targeting='{"env":"staging","page_type":"article","post_id":421189,"post_type":"story","post_chan":"none","tags":null,"ai":false,"category":"none","all_categories":"games,","session":"B"}']
It started with motion-capture of actors such as James Burns who plays the character called Woods. That takes place in a big sound-proof warehouse where actors perform in front of scores of super-high-resolution infrared cameras that pick up every movement. The actor has a special suit on with reflective markers covering every part of the body. The actor’s face has a mesh of wired sensors on his face which allow the capture of subtle face muscle movements. The system is similar to what was used with Call of Duty: Black Ops, but it is more refined in this second installment.
“We knew we had to bring the fidelity higher, something that takes us higher and lower,” Rosas said.
The actor has microphones on his head that pick up every breath, grunt, and yell that he makes.
“The goal is to pick up natural motion,” Rosas said in an interview with GamesBeat.”This is not an artist’s interpretation of what the performance should be. We work with actors to bring emotion to a scene. The markers on the actor’s face are in positions so they capture muscle clusters like the mouth or the side of the eyes. It adds so much more life to what we are trying to bring in terms of our storytelling abilities.”
The performance capture is converted into digital form and then automatically converted into an animated 3D image that the animators can work with. (That process is automatic now, but it used to take a week and a half). Rosas said the hardest thing to get right is the movement of a character’s mouth. Capturing the lip-synch is adequate. But fully capturing the movement of a person’s lips is very hard.
“When you look at the raw data, you see issues around the mouth,” Rosas said.
[aditude-amp id="medium1" targeting='{"env":"staging","page_type":"article","post_id":421189,"post_type":"story","post_chan":"none","tags":null,"ai":false,"category":"none","all_categories":"games,","session":"B"}']
Rosas said that the team could use reflective make-up as created by Mova‘s motion-capture team. But he said Mova’s technology works only with faces, but the Treyarch team needed to capture not only an actor’s facial expressions, but their entire body movements as well. They also wanted to be able to take a performance and apply it to a character whose face was different from the actor’s.
“When you capture it all together, it looks more authentic,” Rosas said.
There are times when you’re speaking, for instance, when your lips become very thin. Other times, they become puffy or fat. The rest of the facial muscles move in tandem. Your nose may scrunch and your eyes may squint. The artists have to hand-draw the final parts of the lips to make sure they look realistic. That’s how the cinematics team can capture an emotional character scene up close.
[aditude-amp id="medium2" targeting='{"env":"staging","page_type":"article","post_id":421189,"post_type":"story","post_chan":"none","tags":null,"ai":false,"category":"none","all_categories":"games,","session":"B"}']
The same motion-capture equipment worked for animating horses. In one scene, the soldiers have to hop onto horses to go after the bad guys. To create the cinematic, Rosas’ team had to capture a performance with an actor riding a real horse.
“It was a very scary proposition,” Rosas said. “Not many game productions have captured a horse.”
But the people were still the toughest problem.
“In terms of emotional connections with the player, we feel we have it now,” Rosas said. “We’re very excited about where we are going with this.”
[aditude-amp id="medium3" targeting='{"env":"staging","page_type":"article","post_id":421189,"post_type":"story","post_chan":"none","tags":null,"ai":false,"category":"none","all_categories":"games,","session":"B"}']
Check out our other coverage of Call of Duty: Black Ops II:
- First trailer released
- Treyarch unveils Black Ops II, a.k.a. Attack of the Drones
- Treyarch studio head Mark Lamia on taking design risks (interview)
- It’s not the same old 3D graphics
- Creating the sounds of future wars
