Innovative AI and Extended Reality System Enhances Surgical Training for Residents

Mount Sinai researchers have created an AI-powered system using extended reality headsets to teach complex surgical procedures without instructors, demonstrating high success rates and potential to transform surgical education.
Researchers at Mount Sinai Hospital have developed a groundbreaking AI-powered training system that utilizes extended-reality (XR) headsets to teach complex surgical procedures without the need for an instructor's physical presence. In a recent study published in the Journal of Medical Extended Reality, 17 surgical trainees successfully learned and performed a partial nephrectomy—a procedure to remove a cancerous kidney tissue—using this innovative approach. The system employs a deep learning model linked to a specialized XR headset that streams real-time surgical instructions and visual feedback, allowing trainees to practice intricate tasks with guided support. The trainees used a 3D-printed kidney phantom modeled from real patient CT scans, filled with water-based polymers to replicate tissue, providing a realistic training environment. Throughout the procedure, the system's first-person camera monitors the user, assesses performance, and offers corrective prompts to ensure accuracy. This method addresses a significant challenge in surgical education—namely, the scarcity of experienced proctors—by effectively substituting human instructors with AI-driven guidance. The results showed that all participants achieved surgical success with an impressive accuracy rate of 99.9%. Dr. Nelson Stone, the study's lead author and a Clinical Professor of Urology at Icahn School of Medicine, emphasized that this technology could streamline skill acquisition, reduce training costs, and improve surgical proficiency outside the operating room, ultimately enhancing patient safety. The team plans to further develop this technology by creating more complex, procedural-wide training models using AI, with the goal to standardize and democratize surgical education in the future. The promising outcomes suggest that autonomous AI systems could revolutionize medical training, leading to a highly skilled future generation of surgeons and better treatment outcomes for patients.
Stay Updated with Mia's Feed
Get the latest health & wellness insights delivered straight to your inbox.
Related Articles
Large-Scale Study Finds No Advantage in Auditory Processing Among Musicians
A large-scale study reveals that musical training does not enhance early neural processing of sounds, challenging previous beliefs and emphasizing the importance of rigorous scientific research.
Availability of Nasal Spray Flu Vaccine for At-Home Use in the United States
A new at-home nasal spray flu vaccine, FluMist, is now available in select states, offering a convenient way to receive the annual flu shot without visiting a healthcare facility. Approved for self-administration, this innovation aims to boost vaccination rates and improve public health during flu season.
Study Finds Women with Alzheimer’s Have Lower Levels of Healthy Fats
New research shows women with Alzheimer’s have lower levels of healthy fats, especially omega-3s, pointing to potential dietary strategies for prevention and management.
Innovative Soft Robots Target Kidney Stones for Minimally Invasive Treatment
Scientists have developed soft, magnetically-guided robots that can dissolve kidney stones from within the urinary tract, promising a faster and less invasive treatment option. This innovative technology could reduce reliance on surgery and improve patient outcomes.



