NVIDIA Omniverse Machinima: What it is for and How to Use it

During the GeForce RTX 30 Series graphics card launch presentation on September 1, 2020, the NVIDIA CEO introduced the new NVIDIA Omniverse Machinima technology, showing a demo video. In this article we are going to tell you in depth what this technology is, what it is for and how you can use it.

Machinima is a term that comes from machine (Machine) and cinema (Cinema), and is used to describe the use of computer graphics engines in real time to create a film production. This is the definition but what is really the technology presented by NVIDIA?

NVIDIA Omniverse Machinima

A little history about “Machinima”

These “stories” are typically made by reusing video game assets to generate animated movies that are then shared on the Internet. The creators have been producing these types of stories since the 1980s using content from a combination of games, assets and 3D effects.

This medium gained popularity throughout the 1990s with the advent of gamer-created ” Quake movies ” built from game sequences in id Software’s hit titles Doom and Quake. Machinima thus expanded to the main media, and has been used in all kinds of productions, from TV series to advertising. Nearly three decades since its inception, Machinima’s content has had tens of billions of views.

Creating rich and engaging content from Machinima has long been a challenge for creators due to the limited resources of the games and their animation tools. Added to this is the difficulty of producing narrative-based animations from this approach due to limitations in creating credible movements.

For all these reasons, now NVIDIA has created Omniverse Machinima, an environment that incorporates Artificial Intelligence technology and RTX rendering to the process to generate a set of tools with unprecedented capabilities, allowing to create stories in real time in an easier and much more successful way. .

NVIDIA Omniverse Machinima, what is it and what is it for?

According to NVIDIA, Omniverse Machinima enables gamers around the world to easily master the art of storytelling through the use of 3D objects, animated by the brand’s AI technologies.

As we discussed before, it was introduced for the first time on September 1, 2020 by the CEO of NVIDIA during the presentation of the RTX 30 Series, where they already showed the first demonstration of its potential.

Through NVIDIA Omniverse, creators can import compatible game assets or most third-party asset libraries to the platform. Creators can then automatically animate the characters they want using an AI-based pose estimator and their webcam footage. Character faces can be brought to life with just a voice recording using NVIDIA’s new Audio2Face technology , and reality is effortlessly recreated with high-fidelity physics such as physically very accurate particles, fluids and materials.

After scenes are mixed, replayed, and composited, path-tracing rendering technology is enabled with just one mouse click for the highest fidelity possible final output, thanks to Omniverse RTX Renderer .

NVIDIA Omniverse Machinima

The Omniverse Machinima demo presented at the launch of the GeForce RTX 30 series showcased the application’s ability to bring together assets from different sources. The preview included scenes from the popular game Mount & Blade II: Bannerlord from TaleWorlds Entertainment and third-party resources from Turbosquid. The NVIDIA makers combined files for the initial design and then used NVIDIA PhysX and Flow to add realistic smoke and fire.

With AI Pose Estimator and Audio2Face from NVIDIA they managed to drive a new character animation and the final voice for the scene. Each of these elements was mixed with Omniverse Machinima and delivered in stunning quality thanks to RTX rendering with integrated path tracing.

NVIDIA Omniverse is an open platform built for virtual collaboration and simulation. Provides a universal design tool asset exchange with a real-time photorealistic path tracing-based viewer; the engine is designed to be physically accurate, simulating the light, physics, materials and intelligence of the characters automatically. With Omniverse, creators, designers, and even engineers can accelerate their workflows with one-click interoperability between leading software tools and seamless collaboration in a simulated, interactive world.

Gamers interested in NVIDIA Omniverse Machinima can now take a behind-the-scenes look at the app and sign up for the Beta phase starting in October 2020.