Augmented Reality in Surgery: Applications, Benefits, and Challenges (2026)

Augmented reality is changing how surgeons plan procedures, navigate anatomy, and train the next generation of surgical specialists. The core clinical promise is clear: instead of translating between a flat monitor image and three-dimensional anatomy while operating, AR systems overlay imaging data directly onto the surgeon's view of the patient - keeping the information in the surgical field where the attention needs to be. This shift in information architecture reduces cognitive load, improves spatial awareness, and in specific applications has been shown to improve implant placement accuracy and reduce procedural time.

This guide covers the main ways AR is used in surgical settings in 2026 - from image-guided navigation and head-worn displays in the operating room to preoperative planning visualization and surgical resident training. It covers the FDA-cleared AR surgical tools currently available, the clinical evidence supporting each application, and the real challenges - sterility, registration accuracy, latency, and surgeon adoption - that continue to constrain broader deployment.

AR in surgery spans a wide range of applications and maturity levels. Some systems, like AccuVein's vein visualization device deployed in tens of millions of patient procedures, are well-established clinical tools. Others, like head-worn AR displays for real-time intraoperative guidance, are in early commercial deployment with limited but growing clinical evidence. This guide covers both, with attention to which claims are grounded in regulatory clearance and published data versus which are at earlier stages of development.

Image-Guided Surgery and Surgical Navigation

Image-guided surgery uses imaging data - CT, MRI, ultrasound, or fluoroscopy - to provide the surgical team with real-time information about patient anatomy during a procedure. Traditional surgical navigation systems display this data on wall-mounted monitors, requiring the surgeon to repeatedly divert attention from the operative field to correlate a 2D screen image with three-dimensional anatomy. AR surgical navigation addresses this by overlaying navigation data directly onto the surgeon's view, reducing the attention cost of that correlation. The core technology relies on registration - aligning the preoperative imaging data with the patient's actual anatomy in the operating room - which remains one of the central technical challenges in intraoperative AR.

Stryker's Mako robotic system uses CT-based preoperative planning combined with intraoperative AR guidance and haptic boundary feedback to assist surgeons in total knee, hip, and partial knee replacement procedures. The system overlays the planned implant trajectory onto real-time intraoperative tracking data, providing visual and tactile cues to guide bone preparation within the pre-defined safe zone. Mako has been used in over 1.5 million robotic-assisted joint replacement procedures globally and has peer-reviewed evidence showing improved implant positioning accuracy compared to conventional instrumented technique. Brainlab provides surgical navigation systems across neurosurgery, spine, and orthopedics installed in over 6,500 hospitals globally, with digital OR integration that connects imaging data, navigation tracking, and device status into a unified intraoperative workflow.

• Mako robotic system used in over 1.5 million joint replacement procedures with peer-reviewed evidence of improved implant positioning accuracy
• Brainlab surgical navigation is deployed in over 6,500 hospitals across neurosurgery, spine, and orthopedic applications
• Image registration - aligning preoperative imaging with intraoperative patient anatomy - is the central technical challenge in navigation AR accuracy
• Real-time intraoperative fluoroscopy can be reduced or replaced by registered CT-based AR navigation in certain spinal and orthopedic procedures

Head-Worn AR Displays in the Operating Room

Head-worn AR displays take surgical navigation a step further by placing imaging overlays directly in the surgeon's line of sight through a wearable headset, rather than requiring the surgeon to look toward a secondary monitor. The clinical rationale is that keeping visual information within the surgeon's primary attention zone - the operative field - reduces the cognitive disruption of information-seeking behavior during the procedure. Neurosurgery, spine surgery, and minimally invasive procedures where precise instrument trajectory matters are the primary applications.

Proprio's AEOS system uses light-field camera arrays and AI image processing to generate real-time 3D visualization of the spinal surgical field without requiring the surgeon to wear a headset - the visualization is projected into the surgical view through an integrated display system. AEOS is FDA 510(k) cleared and offers a pathway to reduce intraoperative fluoroscopy use and the associated radiation exposure to patient and surgical team. SentiAR has built a Microsoft HoloLens-based system that overlays live cardiac electrophysiology mapping data as a hologram during catheter ablation procedures, reducing the physician's need to look away from the patient to wall-mounted EP mapping monitors. Early clinical evaluations of SentiAR have shown measurable reductions in physician head-turning events during complex arrhythmia ablation cases.

• Proprio AEOS is FDA 510(k) cleared for intraoperative visualization in spine surgery and reduces fluoroscopy radiation exposure
• SentiAR overlays live cardiac EP mapping data as a holographic display during catheter ablation, reducing physician head-turning in complex arrhythmia cases
• Head-worn AR display systems must address sterility through draping or barrier systems, adding workflow steps not required with wall-mounted monitors
• Display latency in head-worn OR systems must be sufficiently low that the overlay accurately represents current patient anatomy during movement

Surgical Planning and Preoperative Visualization

Preoperative surgical planning using 3D AR visualization is one of the most mature and widely adopted applications of AR in surgical settings. Patient DICOM data from CT and MRI scans is converted into interactive three-dimensional anatomical models that surgeons can manipulate, annotate, and measure before the day of surgery. This gives surgeons a spatial understanding of individual patient anatomy that reviewing two-dimensional slice images on a standard PACS monitor cannot provide with equivalent fidelity.

Medivis developed SurgicalAR, which allows surgeons to load patient DICOM data, reconstruct patient-specific 3D anatomical models, and manipulate them in a spatial computing headset - including Apple Vision Pro - before and during procedures. Surgical Theater's Precision VR platform is deployed at Cleveland Clinic, NYU Langone, and Cedars-Sinai for neurosurgical and spine preoperative planning, with peer-reviewed research published in neurosurgery literature before Apple Vision Pro launched establishing clinical credibility for the rehearsal approach. The company walks surgical teams and patients through reconstructed anatomy in 3D, improving team preparation and patient understanding of complex procedures before consent. Materialise provides FDA-cleared patient-specific surgical planning software and manufactures custom cutting guides and implants matched to individual patient anatomy, used at hundreds of hospitals for craniofacial, orthopedic oncology, and cardiovascular procedures.

• Medivis SurgicalAR allows patient-specific DICOM-to-3D reconstruction viewable in Apple Vision Pro for preoperative planning and review
• Surgical Theater Precision VR is deployed at Cleveland Clinic, NYU Langone, and Cedars-Sinai with published neurosurgery literature supporting the rehearsal approach
• Materialise holds FDA clearances for patient-specific planning software and manufactures custom cutting guides matched to individual patient anatomy
• 3D preoperative models improve surgical team preparation and patient comprehension of complex procedures before consent conversations

Augmented Reality for Surgical Training

Surgical training is a high-value AR application because the cost, logistical constraints, and ethical considerations of cadaver and mannequin-based simulation are significant. AR surgical training allows residents to practice operative steps with virtual instruments and anatomy, receive immediate performance feedback, and repeat procedures at volume without consuming physical simulation resources. fundamental XR (formerly FundamentalVR, rebranded 2024) provides haptic-enhanced surgical simulation that extends to Apple Vision Pro, allowing residents to practice orthopedic and general surgical techniques with hand-tracking interaction. The platform is deployed in NHS surgical training programs and university medical schools across Europe.

Osso VR is the most widely deployed AR and VR surgical training platform for medical device companies, used by Stryker, Zimmer Biomet, and Smith+Nephew to train surgeons on new implant systems and robotic surgical orientation before they perform the procedure in the operating room. The company has published peer-reviewed research validating its training efficacy for new surgical technique onboarding versus traditional cadaver lab training, and its platform generates objective surgeon performance data that medical device companies use to track training program completion and competency benchmarks. Apple Vision Pro integration across Osso VR enables natural hand-based interaction with virtual instruments - a significant improvement over controller-based VR interaction for procedural training applications.

• fundamental XR provides haptic-enhanced surgical training with Apple Vision Pro integration, deployed in NHS residency programs and European medical schools
• Osso VR is used by Stryker, Zimmer Biomet, and Smith+Nephew for surgeon onboarding to new implant systems with published training efficacy data
• AR training platforms generate objective performance data on surgical technique that cadaver labs cannot capture and cannot track over time
• Hand-tracking interaction on Apple Vision Pro improves procedural realism for surgical training versus controller-based VR headsets

FDA-Cleared AR Surgical Tools

FDA-cleared AR tools for surgical use span several categories and product types. The xvision Spine System, developed by Augmedics and sold to VB Spine LLC in April 2026, was the first FDA-cleared head-worn AR navigation platform to project holographic CT-based patient anatomy directly into the surgeon's field of view during open and minimally invasive spine surgery, and continues to be commercialized under VB Spine LLC. Proprio's AEOS system received FDA 510(k) clearance for intraoperative visualization in spinal procedures. AccuVein's AV500 handheld AR vein visualization device is FDA-cleared and has been used in over 10 million patient procedures across more than 3,000 hospitals globally - the most widely deployed cleared AR device in healthcare by procedure volume.

Medivis has pursued FDA clearance for its SurgicalAR surgical planning application. Stryker's Mako robotic system, which incorporates AR visualization and haptic boundary guidance components, holds FDA clearances for total knee replacement, total hip replacement, and partial knee replacement. Materialise holds multiple FDA clearances for its patient-specific surgical planning software and guide manufacturing systems. It is important to note that FDA clearance covers specific products for specific indications - a cleared AR surgical system for spine navigation is not cleared for cardiac surgery, and clearance status should be verified with the manufacturer for any specific clinical use decision.

• xvision Spine System (now VB Spine LLC) was the first FDA-cleared head-worn AR navigation projecting holographic CT anatomy during spine surgery
• AccuVein AV500 is FDA-cleared and deployed in 3,000+ hospitals with 10+ million patient procedures - the highest-volume cleared AR medical device
• Stryker Mako holds FDA clearances across total knee, total hip, and partial knee replacement with AR guidance components
• FDA clearance is indication-specific - a cleared spine AR system is not cleared for other surgical applications without separate authorization

Challenges: Sterility, Latency, and Surgeon Adoption

The three most significant technical barriers to broader intraoperative AR adoption are sterility compliance, registration accuracy, and display latency. Operating rooms maintain strict sterile fields, and head-worn AR devices cannot be autoclaved. Consumer and enterprise AR headsets require sterile draping or barrier systems when used near the operative field, adding setup time and cost. Devices not inside the sterile field must remain at sufficient distance to avoid contamination risk, which limits their viewing angle for the surgeon. Some OR-integrated AR systems address this by placing cameras and processing outside the sterile field and projecting information into the surgical view through other means.

Registration accuracy - the precision with which the AR overlay maps to actual patient anatomy in real time - degrades with patient movement, soft tissue shift, and changes in patient position during the procedure. Rigid bone structures maintain registration better than soft tissue, which is why spinal and orthopedic bone navigation has advanced further than soft tissue abdominal or thoracic applications. Latency between imaging data capture and overlay display must be low enough that the visual information accurately represents current anatomy - any meaningful delay renders the overlay misleading during dynamic procedural phases. Surgeon adoption faces a different challenge: experienced surgeons have compensatory techniques for existing navigation limitations, and the workflow change required to adopt AR navigation systems carries a learning curve that reduces efficiency in the near term before improving it.

• Head-worn AR devices require sterile draping or barrier systems in the OR, adding setup complexity and compliance requirements
• Registration accuracy degrades with patient movement and soft tissue shift - bone-anchored navigation maintains accuracy better than soft tissue applications
• Display latency must be minimal for AR overlays to accurately represent current anatomy during dynamic operative phases
• Experienced surgeon adoption requires workflow change and a near-term efficiency reduction before performance gains are realized - a known barrier to technology uptake in surgical settings

Frequently Asked Questions

Which AR surgical navigation systems have FDA clearance?

Several AR surgical systems have received FDA clearance or authorization as of 2026. Proprio's AEOS system is FDA 510(k) cleared for intraoperative visualization in spinal procedures. The xvision Spine System, originally developed by Augmedics and sold to VB Spine LLC in April 2026, was the first FDA-cleared head-worn AR navigation platform to project holographic CT anatomy directly into the surgeon's field of view during spine surgery. Stryker's Mako robotic system, which includes AR-guided intraoperative visualization components, is FDA-cleared for total knee, total hip, and partial knee replacement. Medivis holds FDA clearance for its SurgicalAR surgical planning application. AccuVein's AV500 vein visualization device is FDA-cleared and used in over 3,000 hospitals. Regulatory status changes as products receive new clearances or as cleared products are acquired or modified - verify current status directly with manufacturers for clinical procurement decisions.

How does AR improve surgical precision?

AR improves surgical precision through several mechanisms. Intraoperative navigation AR overlays preoperative imaging data - CT, MRI, or fluoroscopy - onto the surgeon's view of the patient, reducing the mental work required to correlate a 2D monitor image with three-dimensional anatomy while operating. Head-worn AR displays keep this information in the surgeon's direct line of sight, eliminating the attention cost of repeatedly looking away from the patient to a wall-mounted screen. For implant placement, AR-guided systems like Mako provide real-time boundary guidance that constrains tool movement to the planned implant zone, reducing the deviation between planned and actual implant position. Patient-specific 3D anatomical models viewed in AR during preoperative planning improve the surgeon's spatial understanding of individual anatomy before any incision is made.

What are the main challenges preventing wider AR adoption in surgery?

The main barriers are sterility, latency, registration accuracy, and surgeon adoption. Sterility is a fundamental constraint - head-worn AR devices cannot be autoclaved, requiring sterile draping or barrier systems in the operative field, and must comply with OR infection control protocols that add complexity. Latency between imaging data and the AR overlay must be low enough that the visual information matches the current patient anatomy during dynamic procedures - any meaningful delay makes the overlay misleading rather than helpful. Registration accuracy - the precision with which the virtual overlay maps to actual patient anatomy - degrades with patient movement and soft tissue shifts during the procedure. Finally, surgeon adoption requires workflow change and training investment, and many experienced surgeons have developed compensatory techniques for existing navigation limitations that reduce their perceived need for AR-based solutions.

What is the difference between AR surgical navigation and robotic-assisted surgery?

AR surgical navigation and robotic-assisted surgery are distinct technologies that can operate independently or together. AR surgical navigation provides visual information - overlaying imaging data, implant trajectories, or anatomical landmarks onto the surgeon's view - but the surgeon controls all instrument movement directly. The AR system informs but does not physically constrain or actuate the instruments. Robotic-assisted surgery systems like the da Vinci or Mako add a physical control layer: the robot actuates the instruments, filters out hand tremor, scales the surgeon's movements, or enforces physical boundaries on tool motion within a pre-planned safe zone. Some systems combine both: Mako uses preoperative AR planning and provides intraoperative haptic and visual boundary guidance while the robotic arm physically constrains bone cutting to the planned zone. AR can be implemented without robotics; robotics can be implemented without AR; but the combination provides both visualization and physical execution control.