Revolutionizing Digital Humans with NVIDIA’s ACE Generative AI Microservices
NVIDIA has unveiled its ACE generative AI microservices, a suite that aims to fast track the development of lifelike digital humans. This breakthrough technology, as reported by NVIDIA Newsroom, is set to transform various sectors, including gaming, healthcare, and customer service.
Expanding Capabilities with ACE
The ACE (Avatar Creation Engine) microservices suite comes equipped with a range of tools that facilitate the creation and animation of realistic digital humans. These cutting-edge technologies are now readily available for cloud deployment, with early access being granted for RTX AI PCs. Notable companies like Dell Technologies, ServiceNow, and Perfect World Games have already begun incorporating ACE into their operations.
- NVIDIA Riva: Automatic speech recognition (ASR), text-to-speech (TTS), and neural machine translation (NMT).
- NVIDIA Nemotron: Language understanding and contextual response generation.
- NVIDIA Audio2Face: Realistic facial animation based on audio tracks.
- NVIDIA Omniverse RTX: Real-time, path-traced realistic skin and hair rendering.
Future Technologies on the Horizon
In addition to the current offerings, NVIDIA has teased upcoming technologies such as NVIDIA Audio2Gesture, which generates body gestures based on audio cues, and NVIDIA Nemotron-3 4.5B, a compact language model tailored for low-latency, on-device RTX AI PC inference.
According to Jensen Huang, founder, and CEO of NVIDIA, “Digital humans will revolutionize industries. Breakthroughs in multi-modal large language models and neural graphics, delivered by NVIDIA ACE to our ecosystem of developers, are bringing us closer to a future of intent-driven computing.”
ACE in Action
Having initially provided ACE as NIM (NVIDIA Inference Model) microservices for developers to operate in data centers, NVIDIA is now expanding this service to over 100 million RTX AI PCs and laptops. The new AI Inference Manager SDK simplifies the deployment of ACE on PCs by preconfiguring them with the necessary AI models and dependencies.
During COMPUTEX, NVIDIA showcased an enhanced version of the Covert Protocol tech demo created in partnership with Inworld AI. This demo enables players to engage with digital-human NPCs through conversational language to accomplish missions.
Industry Adoption and Future Prospects
Pioneering companies like Aww Inc., Inventec, and Perfect World Games have embraced ACE technologies. Aww Inc. is set to leverage ACE Audio2Face microservices for real-time animation of its virtual celebrity, Imma. Perfect World Games plans to integrate ACE into its mythological wilderness tech demo, Legends, allowing players to interact with multilingual AI NPCs.
Inventec is integrating ACE to enhance its healthcare AI agent within the VRSTATE platform, offering a more immersive virtual consultation experience. ServiceNow demonstrated ACE NIM in a generative AI service agent demo for its Now Assist Gen AI Experience, showcasing its potential to enhance customer and employee interactions.
Innovations at COMPUTEX 2024
At COMPUTEX 2024, NVIDIA’s art teams leveraged generative AI tools built on ACE to create a “digital Jensen” avatar. This multilingual avatar, featuring Huang’s distinct voice and style, was generated using ElevenLabs’ AI speech and voice technology in Mandarin Chinese and English.
The ACE NIM microservices, including Riva and Audio2Face, are now in production, bolstering NVIDIA AI Enterprise software to offer developers enterprise-class support. Early access to ACE NIM microservices running on RTX AI PCs is also available.
Hot Take
Immerse yourself in the world of NVIDIA’s ACE generative AI microservices and witness the transformative power they hold for industries such as gaming, healthcare, and customer service. Stay ahead of the curve by exploring the cutting-edge technologies driving the future of digital human interactions.
By
By
By