Facial capture in Virtual Production

Facial capture is a Performance Capture term in filmmaking. In virtual production, the nuances of this term take on special meaning. Here, we break down the definition to give you a starting point.

View the full Virtual Production Glossary here »

Basic Definition:

What is Facial capture in virtual production?

Facial capture is a vital part of performance capture, which has become increasingly popular in virtual production. It involves using head-mounted cameras or other methods to record an actor's facial expressions and movements. When done correctly, facial capture allows filmmakers to accurately capture an actor's emotions and bring characters to life with realism not achievable through traditional animation techniques.

Software such as Faceware, iClone 7. Pro, Motion LIVE and FACE are used for facial capture. This software captures data from actors’ faces and transfers it into 3D models, allowing animators to apply those same expressions onto their digital creations. Correctly capturing an actor’s facial features and movements is essential to creating convincing performances in virtual production. If these features are missing or incorrect, the result will be a flat and unconvincing character. 

Facial capture can be used in many ways within virtual production. For instance, it can be used to create realistic computer-generated human characters that look like real people without relying on physical make-up or prosthetics. Additionally, facial capture technology can also be used to animate animals and objects, such as vehicles, giving them more lifelike qualities than could be achieved using traditional animation techniques alone.

A good example of successful facial capture can be seen in the 2019. film Avengers: Endgame. The directors used motion capture technology to recreate Robert Downey Jr.'s exact facial movements, expressions and mannerisms to create a believable digital version of Iron Man. The results were incredibly realistic, with RDJ himself saying, "I'm looking at this thing going 'that looks a helluva lot like me'". 

On the other hand, bad facial capture can lead to an unnatural movement that ruins any sense of realism and makes viewers aware they're watching a CGI character instead of a living person. An infamous example of poor facial capture was seen in Disney's live-action remake of Aladdin (2019). In one scene, Will Smith’s Genie character displayed unnaturally stiff and jerky facial movements - something audiences immediately picked up on, resulting in heavy criticism from both critics and fans alike.