With the recent advancements in generative AI and vision foundational models, VLMs present a new wave of visual computing wherein the models are capable of highly sophisticated perception and deep contextual understanding. These intelligent solutions offer a promising means of enhancing semantic comprehension in XR settings. By integrating VLMs, developers can significantly improve how XR��
]]>
Recently announced at MWC Barcelona, developers can now stream augmented reality (AR) experiences built with NVIDIA Omniverse to the Apple iPad. Omniverse, a platform for real-time collaboration and simulation, enables developers to create and stream detailed datasets with high visual quality. Built on Universal Scene Description (OpenUSD), Omniverse enables seamless compatibility across 3D tools��
]]>
Explore the future of extended reality, and learn how spatial computing is changing the future of immersive development and industry workflows.
]]>
Spatial computing experiences are transforming how we interact with data, connecting the physical and digital worlds through technologies like extended reality (XR) and digital twins. These advancements are enabling more intuitive and immersive ways to analyze and understand complex datasets. This post explains how developers can now engage with Universal Scene Description (OpenUSD)-based��
]]>
Today��s immersive extended reality (XR) devices require heavy optics and displays to be secured with head straps, a necessity that adds bulk and presents a social barrier. In the envisioned future, head straps will not be required. Over the past few years, NVIDIA Research has been researching how to develop smaller and lighter XR glasses in collaboration with the Computational Imaging Group at��
]]>
Developers and enterprises can now deploy lifelike virtual and mixed reality experiences with Varjo��s latest XR-4 series headsets, which are integrated with NVIDIA technologies. These XR headsets match the resolution that the human eye can see, providing users with realistic visual fidelity and performance. The latest XR-4 series headsets support NVIDIA Omniverse and are powered by NVIDIA��
]]>
NVIDIA is providing developers with an advanced platform to create scalable, branded, custom extended reality (XR) products with the new NVIDIA CloudXR Suite. Built on a new architecture, NVIDIA CloudXR Suite is a major step forward in scaling the XR ecosystem. It provides a platform for developers, professionals, and enterprise teams to flexibly orchestrate and scale XR workloads across��
]]>
The latest release of NVIDIA Omniverse delivers an exciting collection of new features based on Omniverse Kit 105, making it easier than ever for developers to get started building 3D simulation tools and workflows. Built on Universal Scene Description, known as OpenUSD, and NVIDIA RTX and AI technologies, Omniverse enables you to create advanced, real-time 3D simulation applications for��
]]>
Precisely reproducing VR experiences is critical to many workflows, yet it is extremely challenging. But VR testing is critical for many teams, especially when they��re looking to troubleshoot a VR experience, or want to gain more insights into what customers see when they put on the headset. Chaos Enscape is using NVIDIA VR Capture and Replay (VCR) to streamline their VR build tests by��
]]>
Project Mellon is a lightweight Python package capable of harnessing the heavyweight power of speech AI (NVIDIA Riva) and large language models (LLMs) (NVIDIA NeMo service) to simplify user interactions in immersive environments. NVIDIA announced at NVIDIA GTC 2023 that developers can start testing Project Mellon to explore creating hands-free extended reality (XR) experiences controlled by��
]]>
During GTC 2023, NVIDIA announced the latest release of NVIDIA CloudXR that enables you to customize this SDK for your applications and customers, and scale extended reality (XR) deployment across the cloud, 5G Mobile Compute Edge (MEC), and corporate networks. NVIDIA CloudXR 4.0 introduces new APIs that deliver enhanced flexibility for server and client application development.
]]>
When it comes to creating immersive, virtual environments, users want the experience to look as realistic and lifelike as possible. And while AIO headsets provide mobility and freedom for VR users, the headsets don��t always have enough power to render photorealistic scenes with accurate physics and lighting. Using the cloud and professional GPUs, you can generate realistic graphics for��
]]>
]]>
Users can now produce 3D virtual worlds at human scale with the new Omniverse XR App available in beta from the NVIDIA Omniverse launcher. At Computex this week, NVIDIA announced new releases and expansions to the collaborative graphic platform��s growing ecosystem, including the beta release of Omniverse XR. With this Omniverse app, creators and developers can drop into 3D scenes in VR and AR��
]]>
Since the launch of NVIDIA CloudXR, we have received positive feedback and wide adoption of the SDK. Developers have been busy building solutions that take advantage of remote data center hardware powered by NVIDIA GPUs to render full-fidelity XR experiences remotely. With CloudXR, you can deliver these experiences to low-powered, off-the-shelf consumer devices streaming on networks anywhere in��
]]>
The current distribution of extended reality (XR) experiences is limited to desktop setups and local workstations, which contain the high-end GPUs necessary to meet computing requirements. For XR solutions to scale past their currently limited user base and support higher-end functionality such as AI services integration and on-demand collaboration, we need a purpose-built platform.
]]>
Given how prevalent streaming technologies are today, it is easy to forget that on-demand, globally available applications used to be considered a radical idea. But as the popularity of AR and VR grows, the race is on to push streaming even further. With the demand for realistic content and consumer-grade hardware comes a critical challenge: How to build applications that look good on any device��
]]>
Creating immersive applications with high-fidelity 3D graphics has never been more accessible thanks to recent advances in extended reality (XR) hardware and software. Despite this growth, developing augmented reality (AR) and virtual reality (VR) applications still come with challenges: By using NVIDIA CloudXR alongside Amazon NICE DCV streaming protocols, you can use on-demand compute��
]]>
Whether building immersive theatrical experiences or virtual training solutions, XR development continues to push the limits of both content and device performance. Often, this means having to compromise on either fidelity or mobility. But with the NVIDIA CloudXR streaming solution, this is no longer the case. This month at NVIDIA GTC, HTC announced the release of an NVIDIA CloudXR client to��
]]>
Extended reality (XR) has changed the way we enjoy entertainment, interact with friends, and get our jobs done. NVIDIA continues to be on the forefront of delivering groundbreaking solutions for augmented reality (AR) and virtual reality (VR), and you can experience it all at NVIDIA GTC, which runs from November 8 �C 11. This year, GTC features several sessions covering topics across��
]]>
NVIDIA CloudXR is now publicly available through the Google Cloud Marketplace with NVIDIA RTX Virtual Workstations as a Virtual Machine Image (VMI). CloudXR on Google Cloud makes high-quality XR experiences more accessible. Cloud-based streaming customers are no longer constrained by a physical tether or external VR tracking system. Built on NVIDIA RTX technology, CloudXR enables users to��
]]>
NVIDIA and VMware are helping enterprises take XR streaming to the cloud with the announcement of Workspace ONE XR Hub, which includes an integration with NVIDIA CloudXR for accessing their highest quality XR experiences. Now in open beta, Workspace ONE XR Hub with CloudXR will allow users to quickly and more securely access complex virtual and augmented environments, scenes��
]]>
NVIDIA CloudXR is coming to NVIDIA RTX Virtual Workstation instances on Google Cloud. Built on NVIDIA RTX GPUs, NVIDIA CloudXR enables streaming of immersive AR, VR, or mixed reality experiences from anywhere. Organizations can easily set up and scale immersive experiences from any location, to any VR or AR device. By streaming from Google Cloud, XR users can securely access data from��
]]>
NVIDIA CloudXR is an SDK that enables you to implement real-time GPU rendering and streaming of rich VR, AR, and XR applications on remote servers, including the cloud. Applications can connect and stream remotely on low-powered VR devices or tablets where normally they wouldn��t function properly. However, even when the underlying application executes on a remote NVIDIA CloudXR server��
]]>
The NVIDIA CloudXR 3.0 release provides bidirectional audio support to enhance collaboration in immersive environments. Previously, XR users had limited freedom of movement because they were tethered by a cable to a workstation, which made it difficult to collaborate with stakeholders in other locations. CloudXR now makes it possible to stream high-quality XR experiences to untethered��
]]>
NVIDIA technology has powered some of the most stunning extended reality experiences across all industries. This year at GTC, several sessions showcased how the latest advancements are driving the future of XR �� and all of these sessions are now available on NVIDIA On-Demand. From real-time ray tracing, to streaming from the cloud, find out more about the breakthroughs that are helping��
]]>
Recently, at GTC21, the NVIDIA CloudXR team ran a Connect with Experts session about the CloudXR SDK. We shared how CloudXR can deliver limitless virtual and augmented reality over networks (including 5G) to low cost, low-powered headsets and devices, all while maintaining the high-quality experience traditionally reserved for high-end headsets that are plugged into high-performance computers.
]]>
NVIDIA is raising the bar for XR streaming. Announced today, the NVIDIA CloudXR platform will be available on NVIDIA GPU-powered virtual machine instances on Azure. NVIDIA CloudXR is built on NVIDIA RTX GPUs to enable streaming of immersive AR, VR or mixed reality experiences from anywhere. By streaming from the cloud, enterprises can easily set up and scale immersive experiences from any��
]]>
The upcoming NVIDIA CloudXR 2.1 release will deliver support for Apple iOS AR devices, including iPads and iPhones. Built on NVIDIA RTX technology, CloudXR is an advanced streaming technology that delivers VR and AR across 5G and Wi-Fi networks.XR users no longer need to be physically tethered to a high-performance computer to experience rich, immersive environments. The CloudXR SDK runs on��
]]>
NVIDIA CloudXR is now publicly available through the AWS Marketplace as an Amazon Machine Image (AMI). Streaming from the cloud provides new opportunities for XR access and portability. NVIDIA CloudXR provides users with an advanced XR technology that brings deeply immersive graphics to any OpenVR application. With CloudXR on AWS, users can stream rich XR experiences wherever they are.
]]>
The recent webinar shares how NVIDIA CloudXR can be used to deliver limitless virtual and augmented reality over networks (including 5G) to low cost, low-powered headsets and devices �� while maintaining the high-quality experience traditionally reserved for high-end headsets that are plugged into high-performance computers. At the end of this webinar, we hosted a Q&A session with our guest��
]]>
Many people believed delivering extended reality (XR) experiences from cloud computing systems was impossible until now. Join our webinar to learn how NVIDIA CloudXR can be used to deliver limitless virtual and augmented reality over networks (including 5G) to low cost, low-powered headsets and devices��while maintaining the high-quality experience traditionally reserved for high-end headsets that��
]]>