Eye Tracking is a Virtual Production term in filmmaking. In virtual production, the nuances of this term take on special meaning. Here, we break down the definition to give you a starting point.
View the full Virtual Production Glossary here »
Eye tracking is an essential component of virtual production, particularly when it comes to capturing facial expressions. It refers to the capture of eye movements and gaze, which are crucial for getting accurate representations of emotions on screen. Eye tracking provides filmmakers with detailed insights into what their actors or characters are seeing in a given scene.
Software like EyeMate, iMotions, and SMI Eye Tracking are all commonly used for facial capture projects that involve eye tracking. These tools allow users to view visualizations of how viewers interact with content, providing valuable information about attention points and even fatigue levels during filming. In essence, these software solutions enable filmmakers to understand and track the eye movements of their actors, which is invaluable for creating realistic performances.
Having correct eye tracking is important for virtual production because it helps create believable scenes. For example, if an actor’s eyes move from one side of the frame to another too quickly, this can look unnatural or out of place. On the other hand, if the actor's eyes remain still while looking at something off-screen, then it could make it appear as though they're thinking deeply about something. Proper eye tracking enables filmmakers to bring subtle nuances to their work that help deliver more authentic results.
A great example of good eye tracking in filmmaking can be seen in Steven Spielberg’s Jurassic Park (1993). During the iconic T-Rex scene, the camera slowly pans up to reveal the dinosaur coming closer and closer towards the children inside the car. As this happens, we see small yet distinct changes in the child’s eye movement – all of which add tension and suspense to the scene. This level of detail would not have been possible without carefully calibrated eye-tracking software.
On the flip side, bad eye tracking can take away from a film’s overall quality. An example of this can be seen in the popular TV show The Walking Dead (2010–present). Throughout much of its run, some actors appeared stiff and robotic due to poor eye tracking throughout certain episodes. This led many fans to accuse the show of relying heavily on computer-generated imagery (CGI) over actual footage – a problem easily avoided with proper calibration of eye tracking.