NVIDIA Showcases Groundbreaking Generative AI at SIGGRAPH 2024
NVIDIA researchers have demonstrated the impressive capabilities of real-time generative AI in creating immersive 3D environments. During a live demo at SIGGRAPH 2024’s Real-Time Live event, they showcased how NVIDIA Edify, a multimodal architecture for visual generative AI, can rapidly build detailed 3D landscapes.
Accelerating 3D World-Building
The demonstration, held at one of the premier sessions of the prestigious graphics conference, highlighted how an AI agent powered by NVIDIA Edify could construct and edit a desert landscape from scratch in just five minutes. This technology acts as an assistant to artists, significantly reducing the time required for ideation and the generation of custom secondary assets that would otherwise be sourced from repositories.
- Rapid Landscape Creation
- An AI agent using NVIDIA Edify can build a detailed 3D environment in minutes.
- Reduces ideation time and streamlines asset generation.
- Enhanced Artist Productivity
- Empowers 3D artists to quickly generate background assets and HDRi environments.
- Allows artists to focus on creativity by automating repetitive tasks.
From Idea to 3D Scene
Creating a full 3D scene is typically a complex and time-consuming task. However, with the support of AI agents, creative teams can quickly bring concepts to life and continue iterating to achieve the desired look. In the Real-Time Live demo, researchers used an AI agent to instruct an NVIDIA Edify-powered model to generate dozens of 3D assets, including cacti, rocks, and a bull’s skull, with previews produced in seconds.
- Complex Scene Creation Made Easy
- AI agents assist in generating 3D assets and scene layouts for quick visualization.
- Allows for rapid iteration and creative exploration.
- Adaptive Creative Process
- Demonstrates the AI agent’s flexibility in accommodating design changes on-the-fly.
- Rapid generation of assets for seamless scene rendering.
NVIDIA Edify’s Impressive Functionality
NVIDIA Edify models assist creators in focusing on hero assets while accelerating the creation of background environments and objects using AI-powered scene generation tools. The Real-Time Live demo featured two Edify models:
- Edify 3D: Generates ready-to-edit 3D meshes from text or image prompts, producing previews, including rotating animations, in seconds to help creators rapidly prototype.
- Edify 360 HDRi: Uses text or image prompts to generate up to 16K high-dynamic range images (HDRi) of nature landscapes for use as backgrounds and scene lighting.
Industry Adoption and Integration
At SIGGRAPH, NVIDIA announced that leading creative content companies are utilizing NVIDIA Edify-powered tools to enhance productivity with generative AI. Shutterstock has launched a commercial beta of its Generative 3D service, enabling creators to quickly prototype and generate 3D assets using text or image prompts. The service’s 360 HDRi generator, based on Edify, has also entered early access.
- Industry Acceptance
- Leading content companies leveraging NVIDIA Edify for enhanced productivity.
- Shutterstock and Getty Images integrating Edify-powered tools for quicker asset creation.
- Omniverse Compatibility
- Edify models seamlessly integrate with Omniverse USD Composer for scene modification.
- Allows for easy manipulation of assets and lighting within scenes.
By
By
By
By