Tomorrow's Cure: How holograms and VR improve surgery

Medical Innovation

Tomorrow’s Cure: How holograms and VR improve surgery

By
Joel Streed

August 7, 2024

The first mixed reality navigated shoulder replacement surgery in the United States took place in early 2024. Specialized technologies were used to create a customized life-size hologram of the patient’s joint and plan the position of the replacement implants. On this week’s Tomorrow’s Cure episode, learn how mixed reality improves surgical precision and may reduce complications and improve the patient’s recovery.

Experts featured include the surgeon who performed this very first surgery, Dr. Joaquin Sanchez-Sotelo, Division Chair, Shoulder and Elbow Surgery at Mayo Clinic; and Jean Chaoui, Vice President of Clinical Applications and Solutions, Digital, Robotics and Enabling Technologies at Stryker.

"Extended reality is the umbrella term that covers augmented reality, virtual reality and mixed reality. Virtual reality is very simple. It's when we speak about a fully simulated environment, everything is created by the computer," explains Chaoui. "Augmented reality is when you start with the real environment and then you can project additional elements, 3D models on the device. So, this is what we call augmented reality. Then mixed reality, it's a mix of both. So, you have the digital side of the environment, you have virtual objects, digital information. But also, you would still have the real environment or real components in that environment."

Gaming technology, including virtual reality, augmented reality and mixed reality, are playing a significant role in orthopedic surgery. Computer software creates a 3D image of the body that can be viewed and manipulated by doctors with VR headsets during surgery. The innovative technology is allowing surgeons to operate more efficiently and with greater precision.

"I tell my patients it's almost like as I can see through your skin. So, I look at your body, I can look at your bones, and then there is a digital replica of your skin," says Dr. Sanchez-Sotelo. "I can tell the computer, 'where is your bone in this space?' And that will allow me to place the parts, the prostheses or the components of replacement exactly where they belong."

To learn more, check out the new episode of Tomorrow's Cure wherever you get your podcasts. To learn more about Tomorrow's Cure and see a complete list of episodes and featured experts, visit tomorrowscure.com.

Mayo Clinic Minute: What is augmented reality spine surgery?