Summary
Recently,Nvidiashowcased its generative AI-based digital human technologies that can create dynamic, lifelike characters for use in games and other applications. With help from participating studios,Nvidiashowed demos that leveraged these AI technologies to create immersive interactions with computer-generated avatars.
Digital human technologies is an umbrella term that includes Nvidia’s Avatar Cloud Engine (ACE), NeMo, and RTX tech. Among them, ACE facilitates speech recognition and animation tasks, NeMo revolves around natural language processing, andRTX technologyis what enables devs to render high-fidelity models. Over the past few years, Nvidia has continued working on these technologies and sometimes shown them in action at events.
At GDC 2024, an Unreal Engine 5-baseddemo from Inworld AI and NvidiaCovert Protocolshowcased modular NPCs that adapt themselves with respect to the player’s actions – making sure each player experiences a unique playthrough. This demo uses Nvidia’s microservices to detect player voice input and animate NPC dialogues. Additionally, this dynamic NPC behavior is influenced by a character’s personality, emotional state, and the context of the interaction with the player.
Besides game demos, other possible real-world uses ofNvidia’s digital human technologieswere shown at another recent event, GTC 2024. First off, Hippocratic AI revealed a look at a digital healthcare agent designed for handling specific tasks, such as care coordination and post-discharge management. It relies on Nvidia’s ACE, Audio2Face, Omniverse Streamer Client, and more technologies for the same. On top of that, UneeQ’s collaborative work on a digital avatar for customer service needs, which uses Nvidia’s tech and Synanim ML, also took the stage with a demo.
Games Will Soon Use Nvidia’s Generative AI Technologies
Among the big names,Ubisoft gamesmay feature generative AI-fueled NPCs in the future. It shared three tech demos of NEO NPCs, its own variation of dynamic characters built using Inworld AI and Nvidia technologies. Bloom and Iron, the NEO NPCs reflected their conversation memory, contextual awareness, methodical decision-making, among other things in these demos.
Apart from that, there are announced games that will leverage thesegenerative AI technologies to engage players.World of Jade Dynastyfrom Perfect World Games is set to use Nvidia’s Audio2Face technology to produce accurate lip-syncing for new languages. Adding to the list, this technology will also be used to create accurate facial animations forUnawakeby RealityArts Studio and Toplitz Productions. As Nvidia’s generative AI technologies pick up pace, more titles could adopt the same. It will be interesting to see to which degree the development pipeline will be optimized with these changes taking place.
NVIDIA GeForce RTX 3090 Founders Edition
Benefiting from NVIDIA’s Ampere technology, the GeForce RTX 3090 is one of the first graphics cards capable of pushing 60 fps or higher at 8k resolutions. With more ray tracing and tensor cores, the RTX 3090 is a beast of a GPU for anything from gaming to intensive video editing. The 24 GB of memory in this graphics card allows professionals to reach their creative peaks, while NVLink maximizes the combined horsepower of CPU and GPUs.
NVIDIA GeForce RTX 4090 Founders Edition
NVIDIA’s top-of-the-line GPU, the GeForce RTX 4090 Founders Edition, contains 16,384 CUDA Cores. It can support up to 8K gaming and allows for actual, smooth ray-tracing gameplay. The Founders Edition card is also an excellent GPU variant in terms of cooling, VRMs, and value.
