Advanced Medical Displays: A Literature Review of Augmented Reality
Tobias Sielhorst, Marco Feuerstein, Nassir Navab
The impressive development of medical imaging technology during the last decades provided physicians with an increasing amount of patient specific anatomical and functional data. In addition, the increasing use of non-ionizing real-time imaging, in particular ultrasound and optical imaging, during surgical procedures created the need for design and development of new visualization and display technology allowing physicians to take full advantage of rich sources of heterogeneous preoperative and intraoperative data. During 90’s, medical augmented reality was proposed as a paradigm bringing new visualization and interaction solutions into perspective. This paper not only reviews the related literature but also establishes the relationship between subsets of this body of work in medical augmented reality. It finally discusses the remaining challenges for this young and active multidisciplinary research community.
- Noted long history of field of augmented reality
- Noted relevance of the Microsoft HoloLens
- Noted how limiting computation ability was in the development of the field
- Noted how technology has improved beyond limits explained in the paper, such as having shutter-frame glasses without cables
- Importance of calibration
- Motion sickness, seen the effect first-hand with the Oculus Rift
- First hand experience in Ian's research. Registration of virtual models has to be very accurate before an AR system can be introduced into an operating room. Also, reducing the time and difficulty of calibration and registration is important for casual users
- Ian notes from observations during research that the ability of modern medical instruments to gather data is still beyond the ability of augmented reality to visualize this data, so advances in AR would substantially increase the benefit of other existing technologies