1. [Extended Reality](/xr) XR-AI # NVIDIA XR AI Deploy enterprise-grade AI agents that see, understand, and augment your hands-on workforce. Now available in public beta. [Try Now](https://github.com/NVIDIA/xr-ai "Notify Me")[Get in Touch](https://developer.nvidia.com/xr-ai-feedback "Notify Me") * * * ## What Is NVIDIA XR AI? NVIDIA XR AI brings enterprise AI agents out from the desk to hands-on work. It connects XR devices—such as lightweight AR/AI glasses or head-mounted displays—to your organization’s full computational power, enabling spatially aware, intelligent agents to operate seamlessly across cloud, data center, workstation, and edge deployments. By integrating your XR infrastructure with NVIDIA GPU resources, NVIDIA XR AI unlocks real-time AI that empowers developers to create agents that can find, guide, verify, and capture in real-world complex enterprise environments.​​ With [NVIDIA NeMo™ Agent Toolkit](https://docs.nvidia.com/nemo/agent-toolkit/latest/index.html), developers can automate front-line workflows, rapidly build conversational agents, and incorporate cutting-edge vision-language models like [NVIDIA Cosmos](https://www.nvidia.com/en-us/ai/cosmos/)™ for multimodal contextual understanding—enabling AI that sees, listens, and responds intelligently within physical spaces. This delivers practical solutions across manufacturing, healthcare, and beyond, including voice-assisted support, real-time procedure guidance, and immersive application control. NVIDIA XR AI transforms enterprise XR by enabling professionals to work faster and smarter, enhancing operational safety, and giving organizations complete control over how and where their AI is deployed, with full support for privacy and performance. [Get Started](https://github.com/NVIDIA/xr-ai) * * * ## Key Features ![icon representing workflows](https://developer.download.nvidia.com/images/xr-ai/xr-ai-voice-support.jpg) ### Voice Support on the Front Line NVIDIA XR AI enables a hands-free voice assistant that utilizes the device’s camera, paired with a powerful VLM, such as NVIDIA Cosmos, for enhanced contextual awareness. ![icon representing workflows](https://developer.download.nvidia.com/images/xr-ai/xr-ai-procedure-guidance.jpg) ### Real-Time Procedure Guidance NVIDIA XR AI provides context-aware, step-by-step guidance for operational training and following protocols. ![icon representing workflows](https://developer.download.nvidia.com/images/xr-ai/xr-ai-immersive-application-control-.jpg) ### Immersive Application Control NVIDIA XR AI "understands" the enterprise application’s scene and capabilities, empowering the user to control the application through natural speech. * * * ## Use Cases ![icon representing workflows](https://developer.download.nvidia.com/images/xr-ai/m48-workflow-256px-blk.svg) ### Standard Operating Procedure Monitoring and Guidance ![Assembly Line Instructions and Monitoring in Manufacturing](https://developer.download.nvidia.com/images/xr-ai/robot-assembly-manufacturing.svg) ### Assembly Line Instructions and Monitoring in Manufacturing ![Assistance in Healthcare and Emergency Response](https://developer.download.nvidia.com/images/xr-ai/medical-ct-mri-scan.svg) ### Assistance in Healthcare and Emergency Response ![Visually Guided Process Training](https://developer.download.nvidia.com/images/xr-ai/m48-robot-mimic-256px-blk.svg) ### Visually Guided Process Training ![nventory Management and Navigation](https://developer.download.nvidia.com/images/xr-ai/robot-warehouse.svg) ### Inventory Management and Navigation * * * ## Partner Example ![NVIDIA XR AI provides real-time, hands-free AI guidance to gene-editing researchers using VITURE AR glasses](https://developer.download.nvidia.com/images/xr-ai/nvidia-xr-ai.jpg) Image credit: Stanford University - Cong Lab At Stanford University's School of Medicine, researchers in Dr. Le Cong’s and Dr. Mengdi Wang's lab are pioneering XR-AI integration for laboratory science through multiple breakthrough systems in collaboration with NVIDIA and VITURE. [LabOS](https://arxiv.org/abs/2510.14861) enables AI to see what scientists see through smart glasses and supports real-time experimentation, while CRISPR-GPT provides AI-guided gene editing, enabling researchers to achieve successful knockouts and epigenetic modifications on first attempts using LabOS-powered smart glasses with NVIDIA's XR AI libraries. Building on these successes, the Stanford and Princeton groups behind LabOS are launching LabSuperVision (LSV) in close collaboration with NVIDIA—a benchmark for AI+XR in lab-driven science —and are calling on academic research groups to contribute to this exciting ecosystem. * * * ## Learning Library Tech Blog Building AI Agents for AR Glasses and XR Devices With NVIDIA XR AI **NVIDIA XR AI** Learn how to build XR AI agents that connect live camera, microphone, and device streams with visual grounding, voice AI, enterprise tools, agent orchestration, and NVIDIA CloudXR™-rendered spatial content. Blog NVIDIA XR AI Brings Agents to AR Glasses **NVIDIA XR AI** NVIDIA XR AI is now available in public beta, giving developers a framework for building multimodal AI agents for AR glasses and XR devices. ## Get started on NVIDIA XR AI in public beta. [Try Now](https://github.com/NVIDIA/xr-ai "Get Notified")[Get in Touch](https://developer.nvidia.com/xr-ai-feedback "Get Notified")