Best practices for conducting user testing for an AR product require three testing protocols that no other product category needs: spatial anchoring accuracy testing (does the AR content stay where the user placed it?), real-world environment variability testing (does the AR experience work in different lighting, surfaces, and spaces?), and occlusion testing (does AR content correctly appear behind real-world objects when it should?).
AR usability testing that happens only in a controlled lab environment produces results that do not transfer to the diverse real-world conditions where AR products are actually used. The protocols below ensure your testing captures the variability that makes AR both powerful and fragile.
Protocol 1: Environment Variability Testing
AR performance depends heavily on the physical environment. A product that works perfectly in your office under controlled lighting may fail in a customer's warehouse under fluorescent lights or outdoors on a cloudy day.
Testing environments to include:
- Indoor, well-lit (bright overhead fluorescent or daylight)
- Indoor, low light (dim ambient, single lamp)
- Outdoor, bright sunlight
- Outdoor, overcast (flat, low-contrast lighting)
- High-texture surfaces (wood grain, patterned carpet)
- Low-texture surfaces (white walls, plain floors)
Per-environment metrics to record:
- World anchor detection time (how quickly does the AR anchor to a real-world surface?)
- Anchor stability score (does the AR content drift over 30 seconds without user movement?)
- Content persistence accuracy (when user walks away and returns, does content reappear in the correct position?)
Protocol 2: Spatial Anchoring Accuracy Testing
Spatial anchoring is the AR-specific quality dimension that most determines user trust. If a user places a virtual object on a table and it slides off or floats, trust collapses immediately.
Spatial anchoring test tasks:
- "Place this virtual object on the surface in front of you and step back 5 meters. Walk back to the object — is it where you left it?"
- "Place this object on the edge of the table. Does it sit correctly on the surface, or does it hover or clip through?"
- "Place two objects 1 meter apart. Do they maintain their relative distance as you move around them?"
Anchoring accuracy metrics:
- Position drift after 30 seconds: acceptable threshold is <2cm for precision applications, <10cm for casual applications
- Reappearance accuracy: when user returns to a placed object after 60+ seconds, positional error should be <5cm
According to Lenny Rachitsky's writing on spatial computing product research, the single most differentiating quality signal in AR usability testing is anchoring persistence after user movement — users who see AR objects drift or jump when they move report 3x lower confidence in the product's reliability and are 4x less likely to use it in a real workflow.
Protocol 3: Occlusion and Depth Testing
Occlusion is the AR feature that creates visual realism — a virtual object that appears correctly behind a real-world table leg reads as "real" to the user. Failed occlusion (virtual objects floating in front of everything, regardless of depth) breaks immersion and reduces trust.
Occlusion test tasks:
- "Place this virtual object partially behind this physical object — does it appear correctly hidden by the physical object?"
- "Move this virtual object to a position behind a piece of furniture — does it disappear as expected?"
Depth cue evaluation:
- Correct shadow casting (does the virtual object cast a shadow consistent with the ambient lighting?)
- Scale consistency (does the virtual object appear the correct size at different distances?)
Inclusive Testing for AR
AR interaction design makes assumptions about users' physical abilities that must be tested explicitly:
- Reach and dexterity: Interaction zones should be accessible without requiring extreme arm extension
- Standing vs. seated use: Test AR experiences with seated participants for accessibility validation
- Visual acuity variation: Test with participants who wear glasses (lens glare can reduce AR legibility)
According to Shreyas Doshi on Lenny's Podcast, the AR products with the highest enterprise adoption rates are those that design for the broadest range of users from the start — accessibility constraints discovered in production (an AR interface that only works standing) are far more expensive to fix than those found in early-stage user testing.
Session Design
Do not use think-aloud during spatial AR interaction tasks for the same reason as VR: narrating disrupts natural head and body movement that the AR system uses for tracking.
Modified session protocol:
- Observe spatial interactions silently
- Ask debrief questions after each task: "What were you trying to accomplish?" and "Did it work as you expected?"
- Use video recording from a second camera (not just screen capture of the AR view) to capture the user's physical movements and body language
FAQ
Q: What are the best practices for user testing an AR product? A: Test in multiple real-world environments (not just a lab), measure spatial anchoring accuracy with quantitative position drift thresholds, test occlusion correctness, observe spatial interactions silently using post-task debrief instead of think-aloud, and include accessibility testing for sitting users and glasses wearers.
Q: How do you measure spatial anchoring accuracy in AR user testing? A: Measure position drift after 30 seconds (acceptable threshold is 2cm for precision applications, 10cm for casual use), and reappearance accuracy after the user moves away and returns (positional error under 5cm).
Q: Why is environment variability testing critical for AR products? A: AR performance depends heavily on physical environment lighting, surface texture, and contrast. A product that works in a controlled lab may fail in a customer's warehouse, outdoors, or in low-light conditions, making multi-environment testing essential.
Q: What is occlusion testing in AR user testing? A: Testing whether virtual AR content correctly appears behind real-world objects when it should. Failed occlusion (objects floating in front of everything) breaks visual realism and reduces user trust in the AR experience.
Q: How do you make AR user testing accessible? A: Test with seated participants for accessibility validation, include users who wear glasses to test for lens glare effects on AR legibility, and verify that all interaction zones are reachable without extreme arm extension.
HowTo: Conduct User Testing for an AR Product
- Test in at least four environments: indoor well-lit, indoor low-light, outdoor bright sun, and outdoor overcast, recording anchor detection time and content persistence accuracy in each
- Measure spatial anchoring accuracy quantitatively using position drift after 30 seconds and reappearance accuracy after user movement, comparing results against your application's acceptable threshold
- Test occlusion correctness by asking users to place AR content behind physical objects and evaluating whether it appears correctly hidden as expected
- Replace think-aloud with post-task debrief for spatial interaction tasks, recording the user's physical movements with a second camera from a wider angle
- Include seated participants and glasses wearers in all test sessions to validate accessibility of interaction zones and AR legibility under different visual conditions