Virtual Video Production

Raymond and Partners — tech story

Michaja Nahele Zipperer
Raymond and Partners
2 min readNov 23, 2022

--

We produced several videos here at Raymond and Partners over the past year and have used more of the Virtual Production technology within each project.
The benefits of using real-time software and being able to see where the action is happening during a video shoot are enormous. But what does a virtual production mean?

What is Virtual Production

That’s easy to say. In virtual production, you use the possibility to mix live footage and computer graphics at the same time. But also to get real-time feedback and make decisions about VFX and animations on set.

Therefore we use the help of plugins and real-time software. The help of real-time computer graphics already influences our decisions for the further process of production during the shoot.
As real-time software, we are using Unreal Engine 5. This software uses new technologies called Nanite and Lumen. Nanite is a virtualized micropolygon geometry system that helps artists to create worlds with tremendous amounts of geometric detail. It works by intelligently streaming and processing only the detail you can perceive and no more. Lumen renders diffuse interreflection with infinite bounces and indirect specular reflections in large and detailed environments all that at scales ranging from millimeters to kilometers.

Virtual Cameras

With the help of virtual camera trackers, it’s possible to import the cameraman’s camera movement live into Unreal Engine for a direct preview of the final image. So you can quickly decide which camera movement functions well and which doesn’t.

Compositing and Editing

With the imported camera, the only thing that remains is to render out the scene and then use it to combine the real recorded and the rendered footage into one image. This step is called compositing. But once that’s all accomplished, only 50% of the final video is done. Now it’s up to editing and grading the final image to tell the desired story.

--

--