Case Study

Revolutionising medical education through xR innovation

Image guided procedures in mixed reality

The problem

Medical students need to be trained for increasingly complex procedures – without compromising patient safety

Computed tomography (CT) guided interventions are taught across the world mostly using a traditional mentored approach on real patients.

Virtual reality and augmented reality simulations present a clear opportunity to create an environment where medical students can practice and make mistakes without real-world consequences. In order to prepare them for real-world practice, however, the tools and feedback generated by the xR technologies deployed need to very accurately simulate the procedure as if performed on a real patient.

Solution

Along with our partners at Imperial College London, we developed a replica of a CT guided intervention using a bespoke software application and xR environment

The set up included an augmented reality head mounted display (ARHMD) — the Microsoft HoloLens — and a mock biopsy phantom for tactile feedback

Students were able to use real medical devices in an accurate simulation, carrying out the procedure as often as required to develop their skills, without concerns for patient safety or exposure to radiation from a real CT

The application was trialed by senior international radiologists and radiology registrars in training, with a structured feedback questionnaire evaluating face validity and technical aspects

Students use real needles and ablation devices in the xR environment on virtual patients, generated using CT datasets

A mock biopsy phantom, using agar jelly, provides tactile feedback

A mesh of this virtual patient is projected into the field of view of the operator

A virtual CT slice generated on voice command to provide placement accuracy feedback

Impact

HoloLens Radiology in action at Imperial College London

Thinking, feeling, doing AND learning 

  • The simulation can be used to demonstrate the workings of medical tools/needles

  • It is a flexible, lightweight set-up, and there is no need for a CT scanner

  • The system allowed demonstration of medical procedures, with full accuracy in mixed reality mode and virtual reality mode

  • The complexity of cases can be tailored to address the training level demands

  • This trial was able to prove that simulating a CT-guided procedure using augmented reality is possible, and could be an effective training tool for clinical practical skills.

"Introducing this technology means we can test students' ability to spatially orientate themselves… It really elevates the quality of our assessment and encourages far deeper understanding"

Dr Amir Sam, Department of Medicine, Imperial College London

"Students, as well as teachers, who have trialled this new assessment have had overwhelmingly positive reactions… They have also commented on how much fun it is to use"

Adam Misky, Student Fellow, Imperial College London

More case studies

Augmenting UK clinical placement access with the University of Leeds and NHSe

Pilot rollout of a University of Nottingham programme for students in Myanmar

Imperial College London, University of Leiden and the Helix Digital Hub at the University of Leeds