Tracking in Virtual Production

Tracking is a Tracking term in filmmaking. In virtual production, the nuances of this term take on special meaning. Here, we break down the definition to give you a starting point.

View the full Virtual Production Glossary here »

Basic Definition:

What is Tracking in virtual production?

Tracking is a powerful tool used in virtual production that determines the position and orientation of cameras or other objects relative to their scenes. This vital technology helps bridge the gap between the physical and digital worlds, allowing for immersive experiences both on-screen and off. 

Tracking allows filmmakers to achieve shots and camera angles that were previously impossible. It does this by precisely tracking the camera's motion as it moves around its environment, capturing data points and making adjustments along the way. By combining this information with CGI elements and visual effects, filmmakers are able to create seamless transitions from reality to fantasy within one single shot.

There are several types of tracking software available, including Optical Motion Capture (OMC), Markerless Tracking, 6Dof Tracking, Matchmoving, and more. Each method has its own advantages and disadvantages, depending on what type of project you’re working on. For example, OMC tracks specific markers placed on an object or person and can be used to recreate realistic movement. Whereas markerless tracking uses optical flow algorithms to track camera motion without needing any physical markers. 

In addition to software, there are also various hardware components required for tracking. These include specialized cameras such as VR/AR cameras, LED walls, infrared cameras, high-speed recording systems, and many others. All these elements work together to capture precise movements and accurately recreate them digitally.

Movies that require extensive use of tracking tend to be complex action sequences involving VFX or 3D animation. From Marvels blockbusters like The Avengers and Black Panther to ambitious indie films like Underwater – all of these productions have relied heavily on advanced tracking technologies to bring their stories to life.

The art of tracking is constantly evolving, providing ever more innovative ways of merging physical and digital space. As new hardware and software emerge, filmmakers will continue to push boundaries and explore imaginative ways of using this powerful tool.