Nvidia showcases new AI-powered development tools at Unreal Fest

As Unreal Fest Seattle 2024 gets fully underway, NVIDIA has announced the release of new on-device plugins for NVIDIA ACE in Unreal Engine 5, streamlining the creation and deployment of AI-powered MetaHuman characters on Windows PCs.

For starters, the Audio2Face 3D Plugin is now available for both Unreal Engine 5 and Autodesk Maya. This tool enables AI-powered facial animations and lip syncing. It works by analysing audio, and then generating animations to best match what the character is expressing.

Then Nemotron-Mini 4B Instruct Plugin and Retrieval Augmented Generation (RAG) Plugin are also now available for Unreal Engine 5. These two tools provide response generation for interactive character dialogue and supply contextual information to enhance character interactions.

Finally, Nvidia has also announced that Epic's Unreal Pixel Streaming technology now supports Nvidia ACE, allowing developers to stream high-fidelity MetaHuman characters via Web Real-Time Communication. This is designed to help developers with bringing AI-powered digital humans to games and applications, with low-latency and minimal memory usage on Windows PCs.

Developers will be able to apply for early access to download the Unreal Engine 5 renderer microservice with support for the Animation Graph microservice and Linux OS. The Maya ACE plugin is available to download on GitHub.

KitGuru Says: What do you think of Nvidia's latest developer tool updates?

Become a Patron!