University of Minnesota uses virtual reality to save conjoined twins

During an 18-year career in medicine, Dr. Daniel Saltzman — the chief of pediatric surgery at University of Minnesota Masonic Children's Hospital — has grown accustomed to looking at X-rays as if they were imperfect road maps of the human body.

He compares this exercise to looking at a one-dimensional traffic map on your smartphone and thinking about that image in three-dimensional terms in your mind.

Like any other road map, an X-ray image is an incomplete reduction of reality that can misrepresent challenges or include distortions, which explains why, even in 2017, high-stake surgeries can involve a shocking degree of guesswork and improvisation.

"That's why medicine is still an art as much as a science," Saltzman told the Washington Post.

For decades, increasingly sophisticated imaging techniques have allowed doctors to peer into the human body before they cut it open, reducing uncertainty and helping them prepare for complicated procedures. Now, advances in virtual reality may flip that dynamic on its head, allowing doctors to confront the unknown before they even enter the body.

The latest evidence of this revolutionary shift in health care is the successful separation of two conjoined newborn sisters in Minnesota. Until their separation in May at 3 months old, Paisleigh and Paislyn Martinez were attached from their lower chest to their belly buttons — a condition known as thoraco-omphalopagus. Both babies survived the dangerous, nine-hour procedure, a development that Saltzman and other surgeons involved link directly to their use of virtual reality before surgery.

"It felt like I was working in the future," Saltzman said. "It was extraordinarily exhilarating."

Separating them is always a risky procedure, but the University of Maryland Medical Center notes that twins "joined at the sacrum at the base of the spine have a 68 percent chance of successful separation, whereas, in cases of twins with conjoined hearts at the ventricular (pumping chamber) level, there are no known survivors." In the latter case, the hearts are completely joined.

Experts said they were unaware of any other example of virtual reality being used to prepare for the separation of twins partially conjoined at the heart.

Dr. Anthony Azakie — chief of pediatric cardiac surgery and co-director of the Heart Center at the University of Minnesota Masonic Children's Hospital — called the university's procedure a "once-in-a-lifetime event."

Using goggle-like virtual reality headsets a month before surgery, Saltzman, Azakie and their team were able to explore a 3-D model of the twins' hearts, virtually embedding themselves inside the walnut-sized organs as if the infant's anatomy had been blown up to the size of a living room.

"It's completely surreal and the resolution is unbelievable," Azakie said. "The details are absolutely superb."

That defect meant that the lives of both babies were in jeopardy and doctors would have to conduct the surgery several months early, before the twins were as robust and healthy as doctors had hoped they'd be.

Standing inside the 3-D rendering of the infants' hearts, the challenge before the physicians was daunting. They realized that improperly severing that connection could lead to the twins bleeding to death. They needed to find a way to navigate around the connection that didn't damage each delicate organ.

Doctors said the ease of the virtual interaction helped the team arrive at a simple yet elegant solution, which they drew on a whiteboard moments later. The surgeons decided to flip the babies around on the operating table so that the procedure occurred from the opposite angle. In the end, doctors said, the straightforward solution to a complicated quandary may have saved the twins' lives.

"In our line of work — especially in pediatric cardiac surgery — it's important that one is able to think on their feet and plan for the unexpected," Azakie said. "The imaging helped us prepare by developing an approach in the event that we came across something we didn't expect.

"It was like the Oculus Rift of pediatric heart surgery."

To create the virtual model of the infants' hearts, Saltzman and Azakie and other team members partnered with the U's Earl E. Bakken Medical Devices Center, where experts used software to turn MRIs and CT scans from both infants into a detailed virtual model. The U's Visible Heart Lab also created a 3-D printed model of the hearts using a printer purchased online for $300.

Bethany Tourek, a Ph.D. candidate in the U's Department of Mechanical Engineering, said watching the medical team experience the virtual heart for the first time was a seminal moment. "My favorite part was actually watching these four medical doctors standing inside this screen and being in complete silence at first," Tourek said. "You could just see them thinking and processing and taking it all in for the first time. It was a wonderful experience."

Two months after their separation, the twins are still recovering, but doctors say that they'll lead healthy, independent lives, with a scar on their chests the only evidence that they were ever conjoined.

Doctors said they expect the 3-D modeling and imaging used to see the twins' anatomy to ripple beyond procedures involving conjoined twins. "Separating these infants was no small feat," Saltzman said. "The fact that we got to do it using virtual reality for direct patient care makes that feat truly incredible."