--- title: HMD UX testing – Introducing absolute tracking of XR content | OptoFidelity description: HMD UX testing is needed for improving the HMD consumer experience. OptoFidelity is the leading HMD performance and HMD UX testing solution provider. image: https://www.optofidelity.com/hubfs/Products/BUDDY/Buddy-banner.png --- [Skip to content](https://www.optofidelity.com/insights/blogs/hmd-ux-testing-introducing-absolute-tracking-of-xr-content#h1) [OptoFidelity ![OptoFidelity logo](https://www.optofidelity.com/hubfs/raw_assets/public/optofidelity-theme/assets/images/logo.svg) ](https://www.optofidelity.com/en/?hsLang=en) Toggle menu - [ Products ](https://www.optofidelity.com/insights/blogs/hmd-ux-testing-introducing-absolute-tracking-of-xr-content#) - AR/VR/MR Testing [ AR/VR/MR Testing ](https://www.optofidelity.com/en/ar-vr-testing?hsLang=en) Improve the quality of your waveguides and smart glasses with precise test systems - AR/VR products [ Production MTF ](https://www.optofidelity.com/production-mtf?hsLang=en) High-Resolution Automated Waveguide Image Quality Measurement System [ Production IQ ](https://www.optofidelity.com/production-iq?hsLang=en) Automated Waveguide Image Quality Measurement for AR Waveguide Manufacturing [ WG-IQ ](https://www.optofidelity.com/en/products/wg-iq?hsLang=en) Fully automated waveguide image quality measurement system [ WG-GAT ](https://www.optofidelity.com/en/products/wg-gat?hsLang=en) High-accuracy diffractometer for AR waveguide characterization [ BUDDY ](https://www.optofidelity.com/en/products/buddy?hsLang=en) Performance testing system for AR/VR/MR glasses [ Services & support ](https://www.optofidelity.com/en/service-and-support?hsLang=en) Learn more about our services and support. Login to our Customer Portal - Other [ Touch & HMI Testing ](https://www.optofidelity.com/en/touch-and-hmi-testing?hsLang=en) Solutions for human machine interface functional and performance testing​ [ Custom Offering ](https://www.optofidelity.com/en/high-end-system-integration?hsLang=en) System Integration & Metrology for Nano-Optics and Smart Electronics - [ Use Cases ](https://www.optofidelity.com/en/use-cases?hsLang=en) - [ References ](https://www.optofidelity.com/en/references?hsLang=en) - [ Insights ](https://www.optofidelity.com/insights/blogs/hmd-ux-testing-introducing-absolute-tracking-of-xr-content#) - [ All Insights ](https://www.optofidelity.com/insights?hsLang=en) Discover our latest news and insights on advancements in optical metrology - [ White Papers ](https://www.optofidelity.com/insights/whitepapers?hsLang=en) Learn about OptoFidelity's white papers - [ Webinars ](https://www.optofidelity.com/insights/webinars?hsLang=en) Watch OptoFidelity webinars on demand - [ Company ](https://www.optofidelity.com/insights/blogs/hmd-ux-testing-introducing-absolute-tracking-of-xr-content#) - [ About us ](https://www.optofidelity.com/company/about-us?hsLang=en) Read more about OptoFidelity, People and History - [ Careers ](https://www.optofidelity.com/en/company/careers?hsLang=en) Are you ready to get Optomized™? Advance your career with OptoFidelity and check our open positions. - [Contact us](https://www.optofidelity.com/en/contact-us?hsLang=en) - Open search Close search This is a search field with an auto-suggest feature attached. - There are no suggestions because the search field is empty. 1. [OptoFidelity](https://www.optofidelity.com/?hsLang=en) 2. [Insights](https://www.optofidelity.com/insights?hsLang=en) 3. [Blogs](https://www.optofidelity.com/insights/blogs) 4. HMD UX testing – Introducing absolute tracking of XR content ![](https://www.optofidelity.com/hs-fs/hubfs/Products/BUDDY/Buddy-banner.png?width=959&name=Buddy-banner.png) Blogs # HMD UX testing – Introducing absolute tracking of XR content 24 January 2019 Maturity of AR/VR/MR devices is improving significantly during 2019. In order to offer seamless UX for consumers, more comprehensive testing methods are needed. A novel content tracking method for AR/VR/MR testing purposes is introduced by OptoFidelity, the leading test solution provider for HMD UX testing. In 2019, we can expect a wealth of exciting virtual and augmented reality devices arriving: for example, Oculus is going to release the [standalone Quest headset](https://www.oculus.com/quest/), and Nreal raised [$15M of funding](https://venturebeat.com/2019/01/07/nreal-raises-15-million-and-shows-off-its-3-ounce-mixed-reality-smart-glasses/) to produce a sunglass-sized AR headset. In CES 2019, there were almost a hundred exhibitors in the AR/VR Gaming category. Quick development of the new technology gives rise to the need to verify performance in product development as a part of continuous integration. This post focuses on measuring head tracking accuracy, which is comprised of many measurable elements: drifting, jitter, motion-to-photon latency, cross-axis coupling… you name it! Kick-start for HMD UX testing was done in 2017, when OptoFidelity's first offering [BUDDY-1](https://www.youtube.com/watch?v=mnP8UeRJbaE), previously known as VR Multimeter was launched. BUDDY-1 is a solution for benchmarking the motion-to-photon latency with one degree of freedom. Our BUDDY testers are equipped with a smart camera which captures and analyzes the frames displayed on the headset. BUDDY-1 tracks the [optical flow ](https://en.wikipedia.org/wiki/Optical_flow)of a target pattern placed in the virtual world and compares that to the physical rotation angle over time, yielding motion-to-photon time. BUDDY-1 is a good work horse for basic motion-to-photon latency measurement e.g. to catch some fatal performance regressions. Since the introduction of BUDDY-1, the VR/AR headset technology has advanced a lot. As well we have received a lot of feedback from our customers, how they would like to measure HMD UX and what would they expect from HMD UX testing solutions. To respond to increasingly complex testing needs, we came up with BUDDY-3 which is designed to measure head tracking accuracy with three rotational degrees of freedom. ![Target_texture_for_optical_measurement](https://www.optofidelity.com/hs-fs/hubfs/blog-images/Target_texture_for_optical_measurement.png?width=220&name=Target_texture_for_optical_measurement.png) *An illustration of the BUDDY-1 target texture and optical flow between consecutive frames.* Since the introduction of BUDDY-1, the VR/AR headset technology has advanced a lot. As well we have received a lot of feedback from our customers, how they would like to measure HMD UX and what would they expect from HMD UX testing solutions. To respond to increasingly complex testing needs, we came up with BUDDY-3 which is designed to measure head tracking accuracy with three rotational degrees of freedom. For BUDDY-3, we invented a new kind of a test content: a so-called marker constellation, which is a sphere covered with markers. In this test content, the virtual camera is at the origin of the sphere – wherever the user looks, several of these markers are seen. This allows us to detect the complete three-dimensional orientation of the virtual content from a single frame shown on the headset display, with no dependence on previous frames. This method enables the measurement of drifting, jitter, motion-to-photon latency and other tracking inaccuracies on all three rotational axes – well beyond the capabilities of BUDDY-1 and the optical flow -based measurement. ![3D_target_pattern_for_optical_position_tracking](https://www.optofidelity.com/hs-fs/hubfs/blog-images/3D_target_pattern_for_optical_position_tracking.png?width=643&name=3D_target_pattern_for_optical_position_tracking.png) *Left: illustration of the marker constellation from the outside. The virtual observer is in the center of the sphere. Right: constellation on the headset display, as seen by BUDDY-3’s camera.* The markers are circles with an embedded binary code which makes them identifiable. Their design is reminiscent of [ShotCode markers](https://en.wikipedia.org/wiki/ShotCode), which are intended as a barcode replacement. The smart camera first detects 2D coordinates of the marker center points and decodes the binary codes. Then, the 2D coordinates are mapped to the original 3D marker coordinates. From these 2D-3D point pairs, it is possible to calculate the 3D orientation of the content and present it as yaw, pitch and roll angles in the results. This problem is mathematically akin to the [Perspective-N-Point](https://en.wikipedia.org/wiki/Perspective-n-Point) problem, and thus similar methods apply here. ![Yaw_axis_with_optical_tracking](https://www.optofidelity.com/hs-fs/hubfs/blog-images/Yaw_axis_with_optical_tracking.png?width=614&name=Yaw_axis_with_optical_tracking.png) *Yaw angle of VR content and BUDDY-3 head over a forty-second period. The robot head rotates back and forth along the yaw axis (horizontally). After several of these rotations, the difference between the robot and content angles starts to increase due to drifting of the head tracking.* From the absolute tracking data, we get a fine-grained picture of the head tracking behavior and content motions over time. In the yaw angle plot above, drifting of the content can be immediately recognized – the content yaw angle does not return to the starting angle after completing the motion sequence, but is left at a slightly different value by a few degrees. Similar robot vs. content angle plots are also acquired for the two other angles, pitch and roll. Drifting is very distracting for the user at its worst – the content may move slowly on its own or just not return in the original position after turning the head. Various technical challenges cause drifting. For simple mobile devices with few sensors, the magnetometer is interfered by surrounding metal. For sophisticated devices with cameras and [inside-out tracking](https://xinreality.com/wiki/Inside-out_tracking), different, possibly reflective materials in the surrounding space pose a problem. Getting the devices working consistently in every living room is a real challenge for the manufacturers to tackle. Here our testers help by providing repeatable motions and objective measurement data. There are many more phenomena that can be seen from the data produced by BUDDY-3: motion-to-photon latency and jitter among others. We are eager to help our customers find the defects and make their devices better. And there is more to come in HMD UX testing. While the [OptoFidelity™ BUDDY](https://www.optofidelity.com/en/products/buddy?hsLang=en) testers aim at **temporal** measurements, we also have a solution for **spatial** measurements: for testing headset display (near eye display testing) and optics in the production line, check Display Inspection and calibration. Written by ### OptoFidelity ## Read more insights The insights include news, articles, white papers and more. Keep up to date with all AR/VR/MR metrology insights from OptoFidelity insights by [subscribing to our newsletter](https://www.optofidelity.com/insights/blogs/hmd-ux-testing-introducing-absolute-tracking-of-xr-content#colophon). [![](https://www.optofidelity.com/hs-fs/hubfs/1747738133416-1.jpg?width=535&name=1747738133416-1.jpg) Blogs ### Light Views: Examining Industry Developments at Japan’s OPIE 2025 ](https://www.optofidelity.com/insights/blogs/light-views-examining-industry-developments-at-japans-opie-2025?hsLang=en) [![](https://www.optofidelity.com/hs-fs/hubfs/Products/FUSION/FUSION-inside-5.jpg?width=535&name=FUSION-inside-5.jpg) Blogs ### Automated Audio Testing in Pre-Owned Phones: Ensuring Quality ](https://www.optofidelity.com/insights/blogs/automated-audio-testing-in-pre-owned-phones-ensuring-quality?hsLang=en) [![](https://www.optofidelity.com/hs-fs/hubfs/Doosan%2Bforce%20finger%203.png?width=535&name=Doosan%2Bforce%20finger%203.png) Blogs ### Haptic Testing Explained: Measuring Touch Feedback for Devices ](https://www.optofidelity.com/insights/blogs/haptic-testing-explained-measuring-touch-feedback-for-devices?hsLang=en) ## Get in touch to learn more about our test systems. We're happy to answer any inquiries. ![Optofidelity logo](https://www.optofidelity.com/hubfs/raw_assets/public/optofidelity-theme/assets/images/logo.svg) ## Company - [Media](https://www.optofidelity.com/media?hsLang=en) - [Patents](https://www.optofidelity.com/patents?hsLang=en) - [Quality Management](https://www.optofidelity.com/quality-management?hsLang=en) - [Whistleblowing Channel](https://www.optofidelity.com/whistleblowing?hsLang=en) - [Privacy Policy and Cookie Settings](https://www.optofidelity.com/privacy-policy-and-cookie-settings?hsLang=en) ## Follow us - [LinkedIn](https://www.linkedin.com/company/optofidelity/) - [X](https://twitter.com/optofidelity) - [Facebook](https://www.facebook.com/OptoFidelity/) - [YouTube](https://www.youtube.com/user/OptoFidelity) ## Subscribe to our newsletter © OptoFidelity