The groundbreaking Omniverse Cloud API enables developers to seamlessly stream interactive industrial digital twins into Apple Vision Pro.
NVIDIA is bringing enterprise-level digital twins based on OpenUSD to Apple Vision Pro. At the GTC conference, NVIDIA announced the launch of a new software framework built on the Omniverse Cloud API. Developers can easily send their generalized scene descriptions (OpenUSD) from their content creation applications to the NVIDIA Graphics Delivery Network (GDN). GDN is a global network of graphics-ready data centers that streams advanced 3D experiences to Apple Vision Pro.
At this global AI conference, NVIDIA demonstrated a physically accurate interactive automotive digital twin, which can be streamed in full fidelity to the high-resolution display of Apple Vision Pro. In the demonstration, a designer wearing Vision Pro used a car configurator application developed on the Omniverse platform by CGI studio Katana. The designer could switch between various car paints and decor options, even exploring the interior of the car. By blending realistic 3D environments with the physical world, the powerful capabilities of spatial computing were fully utilized.
The spatial computing brings powerful features of RTX enterprise-level cloud rendering technology. Spatial computing has become a powerful technology that enables immersive experiences and seamless interactions between people, products, processes, and physical spaces. Industrial use cases require the ability to run at high frame rates on ultra-high-resolution displays and powerful sensors to create realistic manufacturing experiences.
This new workflow based on Omniverse combines the groundbreaking high-resolution display of Apple Vision Pro with NVIDIA's powerful RTX cloud rendering technology, providing a spatial computing experience with just devices and network connections.
This cloud-based approach seamlessly streams physically-based real-time rendering to Apple Vision Pro, providing high-fidelity visual effects without compromising the details of large-scale engineering fidelity datasets.
Mike Rockwell, Vice President of Apple's Visual Products division, said, "By combining Apple Vision Pro's groundbreaking ultra-high-resolution display with the realistic rendering of OpenUSD content streamed from NVIDIA's accelerated computing, there is a tremendous opportunity for immersive experiences. Spatial computing will redefine how designers and developers create captivating digital content, ushering in a new era of creativity and interaction."
Rev Lebaredian, Vice President of Simulation at NVIDIA, said, "Apple Vision Pro is the first wireless device that allows enterprise customers to work without constraints. We look forward to our customers having access to these outstanding tools."
The workflow also introduces hybrid rendering, a pioneering technology that combines local and remote rendering on the device. Users can render fully interactive experiences in a single application using stream from GDN's Omniverse RTX renderer, through Apple's native SwiftUI and Reality Kit.
NVIDIA GDN offers services in over 130 regions worldwide, leveraging NVIDIA's global cloud-to-edge streaming infrastructure to provide smooth, high-fidelity interactive experiences. By offloading heavy computational tasks to GDN, users can handle demanding rendering use cases without worrying about the size or complexity of datasets.
Optimizing spatial computing workloads in various use cases The Omniverse-based workflow demonstrates a wide range of potential applications. For example, designers can use this technology to view 3D data in full fidelity without compromising quality or model details. This means that designers can interact with credible simulations that look and behave exactly like actual products. This also opens up new channels and opportunities for e-commerce experiences.
In industrial environments, factory planners can view complete engineering factory datasets and interact with them. This can help them optimize workflows and identify potential bottlenecks.
NVIDIA is building relevant functionalities for developers and independent software vendors to seamlessly interact with their existing data in applications on Apple Vision Pro.
Learn more about NVIDIA Omniverse and GDN.
