Enterprise AR Glasses | Augmented Reality UX Design

Create a clear and accessible interface for a medical diagnostics app integrated with Magic Leap Augmented Reality Device.

James Anderson, CEO at Magic Leap
James Anderson

CEO at Magic Leap

Too Long;
Didn't Read

42% higher session retention, -31% churn during 3D review. See how an augmented reality device turned spatial data into the reason clinicians stayed:

  • Buyer signal. Doctors needed hands-free access to patient data mid-consultation, but the churn data revealed something sharper: the 3D scan viewer, not the headset itself, is what kept clinicians in the workflow.
  • Design scope. A mixed reality system pairing augmented reality glasses with a mobile app built around spatial visualization, gesture-driven navigation, and appointment scheduling.
  • Category fit. A real digital transformation of clinical AR, proving that augmented reality devices earn daily use through what they let people see, not just what they let hands skip.
Enterprise AR Glasses | Augmented Reality UX Design

About the project

Every one of the augmented reality devices entering clinical settings faces the same skepticism: does the headset earn a place in someone's actual workday, or does it stay a novelty that gets worn once and shelved. This one had to answer that question inside a medical diagnostics workflow, where a doctor's attention has exactly one acceptable place to be, on the patient in front of them.

The starting problem was physical. Doctors kept both hands on the patient while diagnostic data sat on a tablet across the room, and every glance away from the patient to check a reading was a small tear in the consultation. The augmented reality glasses were built to close that physical gap, overlaying data directly into the clinician's field of view instead of asking them to look somewhere else for it.

The retention numbers told a more specific story than the original hands-free premise predicted. Session retention rose 42%, but churn didn't drop evenly across every feature. It dropped 31% specifically around 3D model review, the one part of the app where flat data became something clinicians could rotate, zoom into, and annotate in space. That's the signal worth sitting with: the augmented reality display didn't win adoption because it freed a doctor's hands, it won because it let doctors see spatial relationships a 2D chart had been hiding the whole time. Hands-free was the entry point. Spatial visualization was what made people stay.

That finding shaped how the interaction model works. Doctors lean, gesture, and glance the way they already do during an exam, and the augmented reality app reads those movements as input without asking anyone to learn a new vocabulary first. The interface treats spatial exploration, not menu navigation, as the primary interaction, which is exactly the behavior the usability data rewarded most.

Underneath the interaction model, quiet typography and a pastel palette carry dense clinical data at reading distance without adding visual noise to an already demanding task. The broader augmented reality and virtual reality device category has spent years chasing training simulations and demo-day novelty. This project sits closer to the conversation the category needs more of: an augmented reality device earning a repeat seat in a real, unglamorous, high-stakes workday.

  • Augmented Reality
    Augmented Reality
  • Augmented Reality Glasses
    Augmented Reality Glasses

User Interface AR

Built Around Where Attention Breaks

  • The mandate was simple to state and hard to build: software that respects how clinicians actually move through a consultation, not how a pitch deck imagines they move. That mandate shaped an augmented reality development process organized around direct clinical observation. Sessions were watched, attention breaks were tracked, and every moment a doctor reached for a device and lost their thread became a specific design constraint rather than a general note.

    Interface prototypes moved through 11+ iterations across 7+ pages and roughly 180 hours of design work, each cycle narrowing the gap between what a clinician needed to see and how fast they could see it. Nothing in the visual layer earned its place through decoration. Every element answered to a use case first.

  • Augmented Reality App
    Augmented Reality App
  • Augmented Reality Devices
    Augmented Reality Devices

Typography and colors

Adaptive Visual Cues for Augmented Reality Wearables

  • Gilroy carries the type system. Its geometric structure holds up at the small scale of a mobile screen and the larger scale of a headset overlay, which matters for a product that has to read cleanly on both surfaces in the same session.

    The pastel palette does the work typography can't. Soft hues reduce visual load during long diagnostic sessions, where fatigue is what actually causes misreads. Contrast was validated against WCAG accessibility standards as a clinical requirement, not a compliance checkbox, since a diagnostic error that traces back to a misread screen is not a hypothetical.

  • Augmented Reality Display
    Augmented Reality Display

UI Design

Our Interface Improvements & Reasoning

  • The interface runs on two rules rather than a long feature list. Digital content layers onto the physical room instead of replacing it, so attention stays supported rather than competed for. And physical movement drives the system: doctors lean, gesture, and glance the way they already do during an exam, and the interface responds without asking anyone to learn a new input language first.

Key Features

    • Seamlessness

      The interface integrates with the environment rather than replacing it. Digital objects layer onto the physical space in ways that support attention rather than compete for it.

    • Naturalness

      Physical movements drive interface behavior. Doctors lean, gesture, and glance the way they already do during examinations, and the system responds without asking them to learn a new input vocabulary.

    • Augmented Reality Glasses and App
      Augmented Reality Glasses and App
    • Augmented Reality and Mixed Reality
      Augmented Reality and Mixed Reality

    Quick Scan Feature

    Fewer Minutes Lost to Scheduling

    • Appointment overhead is a specific, measurable tax on diagnostic time, and it was one of the narrower problems this augmented reality device had to solve without becoming just another scheduling app bolted onto a headset. The Patients' Schedule feature surfaces upcoming appointments, patient information, and messaging inside the same overlay clinicians already use for scan review and diagnostic readings, so a doctor never has to leave the augmented reality glasses experience to check what's next on their day.

      That decision matters more than it sounds. Most augmented reality devices treat scheduling as an afterthought, a flat list ported over from whatever web dashboard the practice already used. Here, scheduling had to earn the same overlay real estate as clinical data, which meant it had to be built for a glance, not a login. Doctors get real visibility into their day without leaving the same overlay, and clinical staff absorb less of the coordination overhead that used to eat into the minutes between patients.

      The result reads small next to the retention numbers elsewhere in the case, but it's the kind of feature that decides whether an augmented reality app gets adopted for one workflow or for the whole shift. A device clinicians only trust for scans and abandon for everything administrative isn't a daily tool, it's a specialist instrument. This feature is why the headset holds onto the broader daily-use claim instead of narrowing back down to it.

    • Best Augmented Reality Headset | Augmented Reality Glasses
      Best Augmented Reality Headset | Augmented Reality Glasses
    • Augmented Reality Development | UI UX Design
      Augmented Reality Development | UI UX Design

    Three-dimensional View

    The Feature the Data Pointed To

    • The 3D scan viewer earned the strongest engagement scores in usability testing, and the churn data backs that up directly. Doctors reviewing spatial diagnostic data got zoom, annotation, and object-layer filtering inside the same view instead of behind separate menus, and the interface treats spatial exploration as the primary interaction rather than a bonus feature bolted onto a flat chart.

      That design choice produced two measurable outcomes. Content comprehension improved, because a rotating, annotatable model communicates spatial relationships a static image can't, no matter how well that image is labeled. And consultations got shorter in a specific way: fewer of them required a second look, a follow-up call, or a colleague pulled in to confirm what a flat scan seemed to show. Diagnostic scans are spatial data to begin with, and flattening them into a 2D chart was always going to lose something. The 3D viewer is what got that something back.

      This is also where the case makes its strongest argument for augmented reality display work over legacy alternatives. Most augmented reality devices marketed at healthcare lean on novelty, a 3D model that looks impressive in a sales deck and gets opened twice. The usability and churn data here point somewhere more specific: the 3D viewer wasn't the flashiest screen in the product, it was the one doctors kept coming back to, which is the only kind of engagement that matters once the pilot period ends and the augmented reality app has to justify its place in a real clinical schedule.

    Where Mixed Reality Meets Clinical Practice

    Mixed Attention Stays on the Patient

    • The mixed reality link between the mobile app and the headset is the mechanism, not the headline. Doctors select the device before beginning a patient interaction, confirm connection status, and move straight into the consultation, using contextual overlays to review data while keeping direct focus on the person in front of them rather than a screen off to the side.

      That selection step matters more than its one line in the workflow suggests. Most augmented reality glasses on the market still ask the wearer to context-switch between a headset UI and a companion phone screen, which reintroduces the exact divided attention the whole project set out to remove. Here, once the device connects and admission starts, the headset becomes the only interface that matters for the length of the consultation. Scheduling, scan review, and diagnostic readings all live inside the same overlay, so the doctor never has to break eye contact with the patient to find a different screen for a different task.

      Unlike a fully-immersive virtual reality headset that blocks the room out entirely, this device layers data onto a room that's still fully there, which is the only way an augmented reality device survives inside a live consultation rather than a demo booth. Search any list of virtual reality examples in healthcare and most still point at training simulators and surgical rehearsal tools, environments built to be entered and left, not lived in during real patient contact. The broader vr virtual reality conversation in medicine has largely been about replacing a room. This project was never trying to replace one. It was trying to disappear into it enough that a doctor forgets they're wearing anything at all.

    • Mixed Reality Glasses
      Mixed Reality Glasses

    Result

    What the Retention Data Actually Says

    • The final implementation delivered a clean, efficient diagnostic interface. Doctors performed diagnostics more accurately, moved through patient data more intuitively, and error rates during data entry dropped as focus on core actions improved.

    • Magic Leap example implementations confirmed strong potential for use in many clinical areas.

      James Anderson, CEO at Magic Leap
      James Anderson

      CEO at Magic Leap

    • Mixed Reality Devices | Augmented Reality App
      Mixed Reality Devices | Augmented Reality App

    Key Efficiency Gains

      • +42% in diagnostic session retention

        The increase followed Mixed Reality integration into the diagnostic workflow, showing that clinicians complete more sessions when immersive tools live inside their daily practice rather than sit at its periphery.

      • -31% reduction in churn rate

        The drop appeared during 3D model review specifically, which suggests interactive visualization changes how doctors engage with critical moments in the diagnostic process. That behavioral shift is what the case is really documenting.

      • Together those numbers mark a real digital transformation of clinical AR, and a case for where augmented reality devices actually earn a seat among the best augmented reality headsets in a category still mostly proving itself on demo floors.

      • Mixed Reality and Augmented Reality UI UX
        Mixed Reality and Augmented Reality UI UX

      Next cases

      If you liked the previous cases, you will definitely like these ones

      Shall we chat?

      [email protected]

      Let’s

      Image

      talk

      This site uses cookies. By continuing to browse the site, you are agreeing to our use of cookies.