Qualcomm Integrates AI in Extended Reality Platform
Qualcomm Technologies, Inc. has introduced the Qualcomm Snapdragon XR1 extended reality (XR) platform that offers mainstream users high-quality XR experiences to enable original equipment manufacturers (OEMs) develop mainstream devices. The XR1 platform is optimized for augmented reality (AR) experiences with artificial intelligence (AI) capabilities offering better interactivity, power consumption, and thermal efficiency.
"As technology evolves and consumer demand grows, we envision XR devices playing a wider variety of roles in consumers' and workers' daily lives," said Alex Katouzian, Senior Vice President and General Manager, Mobile Business Unit, Qualcomm Technologies. "By integrating powerful visuals, high-fidelity audio, and rich interactive experiences, XR1 will help create a new era of high-quality, mainstream XR devices for consumers."
XR1 integrates Qualcomm Technologies' heterogeneous compute architecture, including the ARM-based multicore central processing unit (CPU), vector processor, graphics processing unit (GPU) and Qualcomm AI Engine. Other key features include an advanced XR software service layer, machine learning, the Snapdragon XR Software Development Kit (SDK) and Qualcomm Technologies connectivity and security technologies.
The XR1 platform also provides an AI engine for on-device processing. This engine provides customers the ability to process AI-use cases and run high performing, power efficient machine learning based computer vision algorithms that can help with key AR use cases like better pose prediction, object classification, among others.
The XR1 platform will enable consumers to be immersed in their favorite movies, programs and sports by supporting ultra high-definition 4K video resolution at up to 60fps for high-quality VR HMDs. New dedicated hardware and software algorithms within its Qualcomm Spectra Image Signal Processor (ISP) can help significantly reduce unwanted noise from snapshots producing a substantially improved final picture in high-quality AR headsets.
The integrated display processor provides a range of display options with hardware accelerated composition, dual-display support, 3D overlays and support for leading graphics Application Programming Interfaces (API), including OpenGL, OpenCL and Vulkan. The platform also features advanced vision processing capabilities fundamental for technologies like Visual Inertial Odometry (VIO), which lets users move around in the virtual world or interact with augmented objects in an AR experience.
The XR1 platform uses Qualcomm Technologies 3D Audio Suite, Qualcomm Aqstic Audio Technologies, and Qualcomm aptX Audio for high-fidelity audio experiences and "always-on, always-listening" voice assistance as well as Bluetooth playback. XR1's head-related transfer functions (HRTF) enable users' ears to synthesize binaural sound that feels like it comes from a specific point in space.
With three- and six-degrees of freedom head tracking and controller capabilities for XR devices, XR1 opens a whole new XR playground for mainstream users, letting them not only move freely in the virtual world like never before but also interact and play within it. An integrated sensor hub and optimized sensor fusion abilities allows users to experience rich interactions with motion to photon latencies well below the scientifically required 20msec.