Apple vision pro for intraoperative 3D tumor visualization and surgical guidance

This thesis investigates the feasibility of using the Apple Vision Pro (AVP) mixed-reality headset for visualizing and localizing brain tumors during neurosurgical procedures. A complete workflow was developed to overlay a CT-derived 3D tumor model onto a patient-specific head surface mesh obtained using LiDAR scanning and machine-learning–based object tracking. A 3D-printed head phantom with an embedded tumor target enabled quantitative evaluation of reconstruction fidelity and spatial anchoring accuracy. Results show that AVP can generate a consistent surface mesh of the head and maintain stable alignment of the tumor overlay under typical motion, with deviations increasing primarily in high-curvature anatomical regions or during sudden movements. Although not yet a replacement for conventional stereotactic navigation, the system demonstrates clinically promising accuracy for superficial tumor visualization and preoperative planning. These findings highlight the potential of mixed reality as an intuitive, hands-free tool for neurosurgical guidance and outline key areas for future improvement, including automated registration and enhanced tracking robustness.

Name thesis:degree_name

M.S.

Level thesis:degree_level

Thesis

Discipline thesis:degree_discipline

Electrical & Computer Engr

Grantor

University of Illinois Urbana-Champaign

Year dc:date

2025

Author dc:creator

• Zhang, Zekai

Contributors dc:contributor

• Gruev, Viktor

• Apple Vision Pro, Tumor Imaging

Statement dc:rights

• Copyright 2025 Zekai Zhang

Language dc:language

en

Handle dc:identifier

https://hdl.handle.net/2142/132714

OAI identifier oai:identifier

oai:www.ideals.illinois.edu:2142/132714