iSurgARy: A mobile augmented reality solution for ventriculostomy in resource-limited settings

Zahra Asadi1superscript1{}^{1^{*}}start_FLOATSUPERSCRIPT 1 start_POSTSUPERSCRIPT ∗ end_POSTSUPERSCRIPT end_FLOATSUPERSCRIPT    Joshua Pardillo Castillo1superscript1{}^{1^{*}}start_FLOATSUPERSCRIPT 1 start_POSTSUPERSCRIPT ∗ end_POSTSUPERSCRIPT end_FLOATSUPERSCRIPT    Mehrdad Asadi1    David S. Sinclair2    Marta Kersten-Oertel1 1Gina Cody School of Engineering and Computer Science, Concordia University, Montreal, QC, Canada
2Departments of Neurology and Neurosurgery, Montreal Neurological Institute & Hospital, McGill University, Montreal, QC, Canada
Abstract

Global disparities in neurosurgical care necessitate innovations addressing affordability and accuracy, particularly for critical procedures like ventriculostomy. This intervention, vital for managing life-threatening intracranial pressure increases, is associated with catheter misplacement rates exceeding 30% when using a freehand technique. Such misplacements hold severe consequences including haemorrhage, infection, prolonged hospital stays, and even morbidity and mortality. To address this issue, we present a novel, stand-alone mobile-based augmented reality system (iSurgARy) aimed at significantly improving ventriculostomy accuracy, particularly in resource-limited settings such as those in low- and middle-income countries. iSurgARy uses landmark based registration by taking advantage of Light Detection and Ranging (LiDaR) to allow for accurate surgical guidance. To evaluate iSurgARy, we conducted a two-phase user study. Initially, we assessed usability and learnability with novice participants using the System Usability Scale (SUS), incorporating their feedback to refine the application. In the second phase, we engaged human-computer interaction (HCI) and clinical domain experts to evaluate our application, measuring Root Mean Square Error (RMSE), System Usability Scale (SUS) and NASA Task Load Index (TLX) metrics to assess accuracy usability, and cognitive workload, respectively.

keywords:
VentriculostomyLow-CostAugmented Reality Neurosurgery Mobile ComputingResource-limited Settings
**footnotetext: The first author and second author are co-first authors.

1 Introduction

Ventriculostomy, a common neurosurgical procedure, establishes a drainage pathway for cerebrospinal fluid (CSF) from the brain ventricles to a collection and monitoring system at bedside. This intervention aims to relieve excessive intracranial pressure within the skull caused by obstructed CSF flow. The need for ventriculostomy arises when various pathological processes such as hemorrhages (e.g., aneurysms and vascular malformations), head trauma, tumours, spina bifida, hydrocephalus, or congenital issues block or impede normal CSF flow, CSF production, or its absorption. A recent global study found that traumatic brain injury (TBI) and the presence of hydrocephalus accounts for 45% and 7%, respectively, of all cases admitted for acute neurosurgical care. [21].

Placement of an external ventricular catheter (ventriculostomy) involves drilling a small hole in the skull and carefully inserting a thin, flexible catheter into the ventricle. Pre-operative CT scans along with well-known external cranial landmarks are typically used to guide placement for optimal accuracy. Relying solely on external landmarks in emergency situations can lead to misplacement in over 30% of cases, and can potentially cause unwanted bleeding, inaccurate pressure readings, and ineffective drainage. These complications can also lead to longer hospital stays and increase in mortality [23, 26].

Image-guided neurosurgery (IGNS) improves any ventriculostomy procedure accuracy through use of pre-operative CT and MRI scans to provide real-time reference and spatial guidance, but its widespread use faces several challenges. The cost of acquiring these systems, ranging from USD 650,000 to over 900,000, can be a major barrier for many institutions [34].Furthermore, effectively operating IGNS systems requires the expertise of specialized technicians skilled in planning and systems setup. Additionally, the bulky nature of the equipment, including the workstation and tracking camera, limits its use to large operating rooms, making it difficult to use these systems in other tighter settings like emergency rooms, wards, and ICUs (Intensive Care Units). These challenges limit IGNS use in low- and middle-income countries (LMICs) and remote communities. Additionally, a technician-intensive system is limited to elective and not emergency procedures.

Indeed, geographic disparities for timely and inexpensive EVD (External Ventricular Drain) placement exist. For example, Sub-Saharan Africa reports a much higher rate of infant hydrocephalus compared to other regions, with 750 new cases per 100,000 births compared to approximately 110 cases in Europe and the USA [20]. This disparity in disease prevalence and access to advanced technology creates a concerning disparity in the quality of care between the resource-constrained settings with those high-resource settings. Our aim is to narrow this gap by developing a solution that is affordable, easily deployable, has a small footprint, and requires minimal expertise, making it suitable for use in LMICs, remote communities, and other resource-limited settings.

To address the challenges faced in translating surgical innovations into clinical practice  [37], we focus on designing a ventriculostomy guidance system through co-design with neurosurgeons and a focus on user experience. By applying user-centered design practices, we aim to create a system that aligns with both technological advances and the practical needs of surgeons, ensuring its usability and successful integration into daily surgical practice in resource-limited settings. Specifically, we present iSurgARy, a mobile system designed to operate exclusively on iPhones or iPads. iSurgARy leverages LiDAR for precise patient tracking, complemented by augmented reality (AR) for procedural guidance.

2 Related Works

Neurosurgical procedures are constantly evolving with the integration of innovative technologies such as robotics, mixed and virtual reality, 3D printing and intraoperative imaging methods. Hong et al. [27] introduced a mobile AR navigation system (MARNS) for precise transverse-sigmoid sinus junction location determination during retrosigmoid craniotomy. It demonstrates efficacy with a mean matching error of 2.88 mm (SD ± 0.69 mm), a positioning time of 279.71 seconds (SD ± 27.29 seconds), and was found to maintain bone flap integrity in 86.7% of cases. In another study, de Almeida et al. [19] addressed the cost and complexity of traditional neuronavigation systems. Their research presents a mobile-based AR solution for localizing points or landmarks on the scalp surface. In laboratory testing with a 3D phantom under optimal conditions, the system achieved an accuracy of 2.6 mm (SD ± 1.6 mm). Gorkem et al. [25] investigated a 3D-printed marker-based AR system for intracranial tumor segmentation. It demonstrated high precision (0.5 to 3.5 mm targeting error), clinical feasibility, and cost-effectiveness, highlighting its potential for real-world application. In a separate study, Léger et al. proposed MARIN, an iPad-based AR neuronavigation system [32], as well as NousNav [31], a low-cost and an open-source neuronagivation system, as a solution for use in low-resource settings. NousNav uses low-cost off-the-shelf components, can be easily built for  6k USD, features an intuitive interface and easy intraoperative control, and is robust and modular, making it a promising candidate for wider accessibility.

For ventriculostomy in particular, several mixed reality systems have been proposed to improve accuracy. Azimi et al., [16] developed an automated registration and trajectory planning system for ventriculostomy where a pointer equipped with a Vuforia marker was used for landmark-based registration. They achieved a 37% improvement in accuracy for tip placement compared to manual registration methods, with a pointer tip-to-target distance of 10.96mm10.96𝑚𝑚10.96mm10.96 italic_m italic_m. In a similar study by Schneider et al. [38], the authors used AR for ventriculostomy. They attached a Vuforia marker to the patient’s head to guide the projection of 3D ventricle models onto the skull. A game controller was employed to align the holograms with the patient. Their system achieved a success rate of 68.2% for ventriculostomy, with an average deviation of 5.2 mm from the planned trajectory. A subgroup showed significant improvement in results and precision after repeated attempts, suggesting a learning curve for using the AR system. The use of a rigid needle is assumed in AR-assisted medical procedures. Lin et al. [33] explored the limitations of this approach. They developed a system utilizing the HoloLens to display segmented ventricles and the desired catheter trajectory, achieving a target registration error of 4.34±1.63plus-or-minus4.341.634.34\pm 1.634.34 ± 1.63 mm and reducing catheter passes from 2.33±0.98plus-or-minus2.330.982.33\pm 0.982.33 ± 0.98 to 1.07±0.258plus-or-minus1.070.2581.07\pm 0.2581.07 ± 0.258 times. However, this method does not account for needle deflection, which can lead to inaccuracies. As highlighted in their study, incorporating real-time deflection data into AR systems could further improve precision in needle procedures. To improve freehand ventriculostomy accuracy, Ansari et al. [35] developed VentroAR, a HoloLens-based AR system. This system guides surgeons in locating ventricles, aiming to reduce the risk of complications associated with misplaced catheters. In a user study with 15 novices, VentroAR achieved an average gesture-based registration accuracy of 10.75mm10.75𝑚𝑚10.75mm10.75 italic_m italic_m and a targeting accuracy of 10.64mm10.64𝑚𝑚10.64mm10.64 italic_m italic_m. While promising in terms of workflow and ease of use, the authors acknowledge the need for further accuracy improvements before clinical adoption. For a more comprehensive examination of mixed reality in ventriculostomy, readers are directed to the 2024 review by Alizadeh et al. [14].

Although tablet and smartphone systems have been developed for neurosurgery, to the best of our knowledge, they all either require external tracking systems, markers, or tags. Dogan et al. [22] (2024) used a smartphone for neurosurgery but had issues with repeated manual “failed registrations”. Santos et al. [24] developed a smartphone app to be used with a compass for neurosurgery procedures, yet their system required skin makers. De Almeida et al [19] developed a smartphone system, however their focus was on looking at the impact of lighting on registration. Furthermore, they used non-pro iPhones and thus were unable to take advantage of LiDAR for registration. MARIN [32] uses an iPad yet requires the use of an external optical tracker. In comparison to these works, iSurgARy is novel as it requires the use of only a smartphone, uses LiDAR, and does not require additional trackers or markers on the patient. This simplifies the workflow in emergency and low-resource settings.

3 Methodology

iSurgARy was developed to be a small-footprint, low-cost image-guided neurosurgery (IGNS) system suitable for use in resource-limited and emergency settings. To achieve this, iSurgARy features a simple user interface (UI) designed to allow clinicians to easily select anatomical landmarks on the patient using the touch screen of mobile devices. These selected landmarks are then used in a rigid registration process to map the patient to their pre-operative scans.

Once the registration process is complete, the clinician can visualize the ventricles (in the case of ventriculostomy) or other relevant 3D models (such as the cerebral vacsculature) in AR. This visualization aids in guiding the clinician to optimal EVD placement. Additionally, the catheter tracking tool enhances the clinician’s spatial understanding of the distance between the catheter tip and the ventricles (see Figure 1).

Refer to caption
Figure 1: iSurgARy general workflow. (From left to right): (1) The ‘acquire’ button sets a reference landmark and displays a red sphere to visualize its placement in AR. Above, we display all landmarks from a head top point of view (2) The system displays the 3D model of the ventricles in AR with the registration’s RMSE. The process of selecting landmarks more accurately can be repeated until the user is satisfied with the RMSE. (3) The entry point placement feature enables the user to choose the catheter entry point on the surface of the head. We display the top view of Kocher’s point, a common entry point for ventriculostomy. (4) The catheter tracking feature tracks a QR code image and renders the tip of the catheter in AR. The insertion of the catheter through the entry point from a head top point of view is shown.

3.1 Development

The current iSurgARy prototype utilizes an iPhone 15 Pro (MTUA3VC/A) running iOS 17.4 as the primary device. However, the application is also compatible with iPad Pro tablets that house the LiDAR sensor, offering greater flexibility in its use. Development is conducted within XCode Version 15.2 (15C500b) on a MacBook Air 15-inch, M2, 2023 with MacOS 14.3 (23D56), 16GB memory, and 1TB SSD. Additionally, a 3D-printed head phantom, designed for MRN system development and testing in neurosurgery, is used for alignment with corresponding digital ventricle and artery segments[36]. iSurgARy was built for iOS using the Swift [11] and C++[6] programming languages. It leverages Apple’s ARKit[28] and RealityKit[10] frameworks to track and assign anatomical landmarks to 3D anchors and visualize the AR 3D model. The UI was implemented with SwiftUI[12], while the asynchronous events are managed by the Combine framework[7]. For unit conversion compatible with ARKit and transform matrix computation, Accelerate framework is utilized. On the C++ side, the iterative closest point algorithm (ItCP) and its helper functions rely on the Eigen library[8] and standard libraries like cmath, algorithm, and limits.

3.2 Workflow

In the following section, we describe the user experience and workflow of using iSurgARy. Technical details about the tracking and registration implementation follow in the next sections.

The application features a user-friendly interface designed for effortless registration and navigation. Users will load patient CT scans and select specific points on the scan for both landmark registration and surgical targeting. For instance, users can choose Koscher’s point for burr hole localization and catheter targeting and may move the target entry point as deemed appropriate if there is cortical and ventricular distortion from blood or other space occupying lesions.

The app guides clinicians to place seven key anatomical landmarks on the patient, commonly used for patient-to-image registration in IGNS: the right tragus, the right outer canthus, the right inner canthus, the nose bridge, the left inner canthus, the left outer canthus, and the left tragus.

During the registration process, the interface displays a text field at the top of the screen indicating the current landmark to target. A target cursor is centrally displayed on screen to aid in precise targeting. The right side of the interface contains an ‘acquire’ button to confirm landmark placement relative to the center target cursor. When the user presses the ‘acquire’ button, a red spherical AR object is rendered on the device’s camera feed at the aimed landmark. Once landmark placement is made, the user can either use the ‘delete’ button to remove the AR landmark reference or choose a different anatomical target by using the ‘next’ navigation buttons. The process of landmark placement for each target, guided by the text field at the top of the screen, is repeated until all seven key anatomical landmarks have been placed. The user can also navigate backwards and choose a previous anatomical target by using the ‘back’ button. Technical details on landmark placement are discussed in Section 3.4. Once all landmarks are placed, the ‘register’ button aligns the landmarks to the AR model using an iterative closest point algorithm (ItCP), described in Section LABEL:registration. When the program completes registration, an AR view of the patient’s internal structures for guidance is generated and the RMSE of the alignment is displayed at the top of the screen. If the user is dissatisfied with the alignment, they can easily re-select some or all of the anatomical landmarks for a more precise registration. If satisfied, the ‘confirm’ button proceeds to the next phase.

In the EVD entry point placement phase, an entry point button enables the placement of a target for burr hole localization. If an entry point target is misplaced, a ‘delete’ button allows the user to remove the saved entry point location and re-select an entry-point. After saving the entry point location and navigating to the next phase, using the ‘next’ button, the target registration error (TRE) is displayed in the text field at the top of the screen (if the entry point was chosen on the pre-operative CT).

Catheter tracking is done using 2D image detection. Specifically, when the catheter tracking tool is within the camera frame, an AR view of a straight line is overlaid on the catheter from the QR code to the catheter tip, aiding in depth assessment during catheter insertion into the patient. Lastly, a ‘reset’ button is available to remove all seven landmark targets placed by the user, providing a fast and convenient way to redo all landmarks, and reset the interface to the initial target stage where the user is asked to place the first landmark, the right tragus.

The interface allows clinicians to move around the patient from different angles, improving their 3D spatial awareness of internal structures by providing a better understanding of distance and direction between the catheter tip and the ventricle.

Refer to caption
Figure 2: Left: Neurosurgeon performing registration by selecting the left tragus landmark. Right: Visualization of internal ventricular structure in AR and simulation of catheter insertion.

3.3 Patient-to-Image Registration

For registration, i.e. mapping of patient space to image space, iterative closest point (ItCP) [39] was used. ItCP aligns the landmarks placed in AR and the predefined landmarks from the patient’s CT scan. Our ItCP implementation processes coordinates of both AR-placed landmarks and predefined landmarks, producing a scale factor, a rotation matrix, and the RMSE.

To visualize the aligned internal structures in AR, the 3D model is anchored at the centroid of the AR landmarks, with its origin as the mean of the predefined landmarks. The scale factor derived from the ItCP process is applied to the loaded 3D model. The rotation matrix is then used to adjust the orientation of the 3D model ensuring optimal alignment of the landmarks.

3.4 Augmented Reality Visualization

Traditional IGNS systems present navigation information on a computer outside the sterile operating region. This requires the surgeon to shift their gaze away from the patient and surgical field for guidance information and mentally map it to the patient’s anatomy. This process can be time-consuming, cognitively demanding, and prone to error [29, 15]. Furthermore, it results in a disconnect between where the surgeon is working and where they are looking for guidance. This constant shifting of attention can negatively influence the successful completion of a surgical task [30].

To address these issues, we use AR to superimpose the patient’s ventricular anatomy onto the head and track the tip of the catheter. In iSurgARy, ARKit provides world tracking capabilities, utilizing the devices’ camera and motion sensors to monitor its position and orientation in the real world[4]. In an ARKit ARSession[5], feature points are detected within the camera’s image space and used to represent key details of the real-world environment. These feature points are then compiled into an ARPointCloud, which is a collection of 3D coordinates in the world space that ARKit uses for various tracking tasks. This point cloud is crucial for continuously updating fixed anchor points in the environment that serve as reference frames for placing and tracking virtual objects in real-time as the camera moves. ARKit uses this data to ensure that virtual content remains accurately positioned and aligned with the physical world across each frame. Additionally, the housed LiDAR scanner enhances depth tracking and anchor placement precision, we access the depth data using ARDepthData[2]. When the user presses the ‘acquire’ button for placing a landmark, we use ARCamera[1] to capture the position and orientation of the camera, and we use ARDepthData to determine the distance between the device and the subject being targeted. From this, we compute the spatial coordinates of the landmarks from each capture and pass it into the ItCP algorithm in order to align our 3D model to the real-world environment. RealityKit is employed to render the 3D content, such as the virtual 3D spheres for the placed landmarks and the 3D model of the ventricles. To track the tip of the catheter, we pass a QR code image as a reference image to the detectionImages property of the world-tracking configuration[9]. When the ARsession recognizes the QR code reference image, an ARImageAnchor[3] is added to the detected image. Once detected, a rectangular AR object is rendered from the detected image extending to the tip of the catheter as shown in rightmost image of Figure  1.

4 User Study

To evaluate the iSurgARy app in a laboratory setting, we conducted a two-phase user study. The first phase involved a preliminary study with novice participants, focusing on assessing the usability and learnability of the app. Feedback from this phase was used to refine the application. In the second phase, we engaged clinical and HCI experts to evaluate usability and performance. This phase included measuring RMSE to assess accuracy, SUS for system usability and the NASA TLX to evaluate cognitive workload.

4.1 Novice User Study

For the novice study, we had 10 university participants (5 female and 5 male) who were graduate students in engineering and science fields. They performed landmark registration and patient tracking and completed the SUS[17] to provide feedback on the app’s usability. We started with a brief introduction of the app to each participant. We explained that the accuracy of task completion was not the primary concern. Instead, the focus was on how easily the participants could follow the app instructions and navigate the user interface to complete the tasks. This approach ensured that we received meaningful feedback on the usability and learnability of the app, allowing us to identify and address any issues.

Refer to caption
Figure 3: Participant uses the aim cursor positioned at the center of the screen to select landmarks.

4.2 HCI/Clinical Domain Expert Study

In the second phase of our evaluation, we focused on assessing both the usability and learnability of iSurgARy, as well as its accuracy and cognitive load when used by domain knowledge users. This study involved 11 participants, including nurses, clinicians, and HCI experts. The demographics and backgrounds of these domain experts are presented in Table 1. We had a gender split of almost 50%, with the following backgrounds:

  • A neurosurgeon with over 25 years of experience

  • A clinician with a Master’s degree focused on IGNS

  • Three nurses working at a neurological institute, including two with OR/ER experience and one nurse manager

  • Three HCI researchers

  • One HCI and mobile app developer

  • One IGNS researcher/developer

All participants had relevant or related experience, ensuring the feedback we received was well-informed and applicable to real-world scenarios. The study concluded by collecting qualitative feedback on the app’s usability. This feedback guided further improvements in the application’s design.

Table 1: Expert Participants’ Demographics and Background
Demographics Number Percentage
Age (years) n = 11
 18 - 24 1 9.1%
 25 - 34 5 45.5%
 35 - 44 4 36.4%
 65+ 1 9.1%
Gender n = 11
 Male 6 54.5%
 Female 5 45.5%
Expertise n = 11
 HCI Experts 5 45.5%
 Clinical Domain Experts 6 54.5%
Education n = 11
 Bachelor’s Degree 2 18.2%
 Professional Degree 2 18.2%
 Master’s Degree 4 36.4%
 Doctorate 3 27.3%
Years in Field n = 11
 1 year 2 18.2%
 2 - 6 years 4 36.4%
 6 - 15 years 4 36.4%
 30+ years 1 9.1%

5 Results

5.1 Novice User Study

For system usability, we used the SUS, a questionnaire employed to evaluate the usability of products and services. The results of the SUS are presented in Table 2. The average SUS was 81.52% indicating an easy-to-use system (Note: The average SUS score is 68% and scores up to 70% are considered good). Furthermore, comments from the participants indicated that they felt the system was easy to learn, understand and use.

Table 2: Novice User Study: The 10 questions of the System Usability Scale (SUS) with the average score from 1 (strongly disagree) to 5 (strongly agree). Rows in green correspond to positive statements, whereas rows in white correspond to negative statements.
System Usability Scale for Novice User Study Average
I think that I would like to use this system frequently. 4.3
I found this system unnecessarily complex. 1.4
I thought this system was easy to use. 4.4
I think I would need help to use this system. 2.5
I found the various functions in this system were well integrated. 4.2
I thought there was too much inconsistency in this system. 2.1
I would imagine that most people would learn to use this system very quickly. 4.7
I found this system very cumbersome/awkward to use. 1.36
I felt very confident using this system. 3.82
I needed to learn a lot of things before I could get going with this system. 1.45
Mean ±plus-or-minus\pm± SD 81.52 ±plus-or-minus\pm± 0.4

5.2 HCI/Clinical Domain Expert Study

For evaluating system usability in our second study, we used SUS, the results of which are summarized in Table 3. The average SUS was 80.95%, indicating that the system was perceived as easy to use by our expert domain knowledge participants.

Table 3: Expert User Study:The 10 questions of the System Usability Scale (SUS) with the average score from 1 (strongly disagree) to 5 (strongly agree). Rows in green correspond to positive statements, whereas rows in white correspond to negative statements.
System Usability Scale for Expert User Study Average
I think that I would like to use this system frequently. 4.36
I found this system unnecessarily complex. 1.36
I thought this system was easy to use. 4.27
I think I would need help to use this system. 1.82
I found the various functions in this system were well integrated. 4.55
I thought there was too much inconsistency in this system. 1.55
I would imagine that most people would learn to use this system very quickly. 4.73
I found this system very cumbersome/awkward to use. 2.1
I felt very confident using this system. 3.5
I needed to learn a lot of things before I could get going with this system. 2.2
Mean ±plus-or-minus\pm± SD 80.95 ±plus-or-minus\pm± 0.4

The NASA Task Load Index (NASA TLX) was used to assess the subjective workload experienced by participants. The mean scores (with standard deviations) for the dimensions were as follows: Mental Demand, 7.17 (±4.04); Physical Demand, 7.5 (±4.19); Temporal Demand, 5.67 (±3.60); Performance, 16.33 (±3.17); Effort, 7.33 (±4.38); and Frustration, 5.33 (±4.03) (see Figure 4). Among these dimensions, performance had the highest mean score, suggesting that participants felt they had to work hard to get a good level of performance, in this case a low RMSE. The overall workload, based on the NASA TLX scores is 41.1 on a 100-point scale suggesting a moderate workload. The variability in standard deviations across the dimensions reflects differing levels of consensus among participants regarding their experience.

Refer to caption
Figure 4: NASA TLX Scores for each dimension of workload.

In terms of accuracy, on average, we found an RMSE of 2.54mm±0.46plus-or-minus2.54𝑚𝑚0.462.54mm\pm 0.462.54 italic_m italic_m ± 0.46. These findings align with previous works [19, 27]. Furthermore, according to our experts as the ventricles are a large target, an RMSE of < 5 mm is generally acceptable.

5.2.1 Qualitative Feedback

To ensure the application’s scope aligned with the needs of neurosurgeons, we collaborated closely with them during the development process. One of the neurosurgeons who participated in our expert user study provided particularly encouraging feedback. Comments included: "Wow. I think you have the gist of it. Simple and quick registration and very responsive tracking. Sign me up. When would you like to test this in a clinical setting?", "I would like to use the iPad, but I think the residents will prefer the iPhone form factor as they can just pull it out of their pocket." and "Superb user-friendly and easy-to-use tool for the task at hand. It will be a valuable adjunct towards the safe and timely placement of EVDs."

Other comments included: "Another anchor point that isn’t co-planar with rigid points to better account for out of plane rotations" and "Try using multiple selections of the same point to both assess intra-user variability in point selection and to use centroid of chosen points as anchor point for registration", suggesting that improvements could be made on the registration procedure.

Based on the various feedback, we have determined an ergonomic solution that would work in resource-limited emergency and ICU settings. First, an iPhone/iPad holder that would be clamped to the bed during the procedure would allow the user to have both hands available for catheter placement (see Figure 5). Next, simple solutions for stabalizing the patient’s head were discussed. Lastly, in future work, to ensure that the catheter can be tracked without the need for the QR code, we will focus on developing computer vision techniques.

Refer to caption
Figure 5: After feedback from clinicians we began using a mobile phone holder to improve ergonomic issues.

6 Discussion

iSurgARy prioritizes affordability, aiming to make advanced navigation technology accessible to a wider range of medical institutions while maintaining accuracy. Unlike traditional IGNS systems, which can cost thousands of dollars due to sophisticated tracking cameras and dedicated computers, iSurgARy utilizes commercially available and affordable mobile devices. While there is an initial investment associated with these devices, it represents a significantly more economical option. The cost-effectiveness, combined with the portability and ease of use of our system makes it a much better navigation option for resource-constrained settings.

iSurgARy combines both human expertise and machine capabilities, and in doing so, this introduces potential sources of error for which the user should be aware. The initial placement of virtual landmarks is a key step for accurate guidance, but it relies on the user’s judgment and precision. This can lead to inaccuracies that may significantly affect subsequent stages, particularly alignment. Errors can also arise from the ItCP algorithm and the ARKit framework. The ItCP algorithm, while robust in aligning 3D structures, can struggle with sparse data, uneven distributions of landmarks, or large initial misalignment that exceed its convergence criteria. The ARKit framework, used for real-world environment tracking, has its own limitations due to sensor accuracy and environmental factors. The iPhone/iPad uses an accelerometer and a gyroscope, and their precision limitations can manifest as inaccuracies in landmark tracking, potentially causing misalignment between the real world and the augmented overlay. In future work, we will consider capturing a point cloud of the patient with LiDAR and performing a more dense point-based registration.

Despite a modest user study sample size, we believe our findings provide reliable results about the usability and applicability of the system. Our second study aimed at using domain experts (mobile app developers, HCI experts and clinicians) to determine the usability of the system as human-computer interaction (HCI) research suggests that a sample of even just 3-5 system evaluators can identify  75% of usability issues. Furthermore, the inclusion of double experts (in this case a clinician who was also an IGNS researcher) may identify more issues [13, 18]. Feedback from the neurosurgeon, clinician with IGNS research background and an IGNS researcher and developer, as well as our HCI experts not only validated our approach but also helped us identify areas for improvement in the next iteration of our application. This collaboration underscores the importance of iterative development and expert input in refining and enhancing the usability and functionality of medical applications.

The next step of this work will be to further test iSurgARy with neurosurgeons and residents. This testing will be important in evaluating the robustness and accuracy of our system in real-world surgical settings, determining its practical viability and clinical effectiveness in achieving precise EVD placement. Furthermore, we plan to compare our smartphone/tablet system accuracy, usability, and ergonomics with head-mounted displays (HMDs) like the Apple Vision Pro or Microsoft HoloLens. These devices potentially offer a hands-free experience and potentially better immersion, which could be advantageous for complex procedures. However, weight, battery life, and maintaining sterility remain challenges. Our future research will explore these trade-offs to identify the most effective AR solution for surgical applications.

7 Conclusion

In this work, we aimed to develop a practical system with an intuitive interface that could be used in an ICU, emergency room and/or resource-limited settings. By working closely with neurosurgeons in defining the app’s scope that aligns with their needs, iSurgARy addresses a critical need for a low-cost, portable, and user-friendly IGNS system in resource-limited settings and emergency situations. Ventriculostomy, a common neurosurgical procedure, is particularly suited to such a system. Our initial prototype demonstrates promising accuracy and sets the stage for continued refinement and clinical evaluation. Successful implementation of iSurgARy has the potential to significantly improve the accuracy of EVD placement, leading to reduced healthcare costs, mortality and morbidity rates.

\fundingandinterests

The work described in this paper was funded by XXX Conflict of interest: None declared.

References

  • [1] Arcamera documentation. https://developer.apple.com/documentation/arkit/arcamera.
  • [2] Ardepthdata documentation. https://developer.apple.com/documentation/arkit/ardepthdata.
  • [3] Arimageanchor. https://developer.apple.com/documentation/arkit/arimageanchor.
  • [4] Arkitworldtracking documentation. https://developer.apple.com/documentation/arkit/arkit_in_ios/configuration_objects/understanding_world_tracking.
  • [5] Arsession documentation. https://developer.apple.com/documentation/arkit/arsession.
  • [6] C++ interopability documentation. https://www.swift.org/documentation/cxx-interop/.
  • [7] Combine documentation. https://developer.apple.com/documentation/combine.
  • [8] Eigen. https://eigen.tuxfamily.org/index.php?title=Main_Page.
  • [9] Image detection. https://developer.apple.com/documentation/arkit/arworldtrackingconfiguration/2941063-detectionimages.
  • [10] Realitykit framework documentation. https://developer.apple.com/documentation/realitykit.
  • [11] Swift language documentation. https://developer.apple.com/documentation/swift.
  • [12] Swiftui documentation. https://developer.apple.com/xcode/swiftui/.
  • [13] Abulfaraj, A., and Steele, A. Detailed usability heuristics: a breakdown of usability heuristics to enhance comprehension for novice evaluators. In International Conference on Human-Computer Interaction (2020), Springer, pp. 3–18.
  • [14] Alizadeh, M., Xiao, Y., and Kersten-Oertel, M. Virtual and augmented reality in ventriculostomy: A systematic review. World Neurosurgery (2024).
  • [15] Asadi, Z., Asadi, M., Kazemipour, N., Léger, É., and Kersten-Oertel, M. A decade of progress: bringing mixed reality image-guided surgery systems in the operating room. Computer Assisted Surgery 29, 1 (2024), 2355897.
  • [16] Azimi, E., Niu, Z., Stiber, M., Greene, N., Liu, R., Molina, C., Huang, J., Huang, C.-M., and Kazanzides, P. An interactive mixed reality platform for bedside surgical procedures. In International Conference on Medical Image Computing and Computer-Assisted Intervention (2020), Springer, pp. 65–75.
  • [17] Brooke, J. SUS – a quick and dirty usability scale. 01 1996, pp. 189–194.
  • [18] Cho, H., Keenan, G., Madandola, O. O., Dos Santos, F. C., Macieira, T. G., Bjarnadottir, R. I., Priola, K. J., Lopez, K. D., et al. Assessing the usability of a clinical decision support system: heuristic evaluation. JMIR human factors 9, 2 (2022), e31758.
  • [19] de Almeida, A. G. C., Fernandes de Oliveira Santos, B., and Oliveira, J. L. A neuronavigation system using a mobile augmented reality solution. World Neurosurgery 167 (2022), e1261–e1267.
  • [20] Dewan, M. C., Rattani, A., Fieggen, G., Arraez, M. A., Servadei, F., Boop, F. A., Johnson, W. D., Warf, B. C., and Park, K. B. Global hydrocephalus epidemiology and incidence: systematic review and meta-analysis. Journal of neurosurgery 130, 4 (2018).
  • [21] Dewan, M. C., Rattani, A., Fieggen, G., Arraez, M. A., Servadei, F., Boop, F. A., Johnson, W. D., Warf, B. C., and Park, K. B. Global neurosurgery: the current capacity and deficit in the provision of essential neurosurgical care. Executive summary of the global neurosurgery initiative at the program in global surgery and social change. Journal of neurosurgery 130, 4 (2018), 1055–1064.
  • [22] Dogan, I., Eray, H. A., Ozgural, O., Tekneci, O., Hasimoglu, S., Terzi, M., Mete, E. B., Kuzukiran, Y. C., Elmas, H., Orhan, O., Abbasoglu, B., Bayatli, E., Zaimoglu, M., and Caglar, S. Navigating the calvaria with mobile mixed reality-based neurosurgical planning: how feasible are smartphone applications as a craniotomy guide? Neurosurgical Focus 56, 1 (2024), E4.
  • [23] Edwards, N. C., Engelhart, L., Casamento, E. M. H., and McGirt, M. J. Cost-consequence analysis of antibiotic-impregnated shunts and external ventricular drains in hydrocephalus. J Neurosurg 122, 1 (Jan 2015), 139–147.
  • [24] Fernandes de Oliveira Santos, B., de Araujo Paz, D., Fernandes, V. M., Dos Santos, J. C., Chaddad-Neto, F. E. A., Sousa, A. C. S., and Oliveira, J. L. M. Minimally invasive supratentorial neurosurgical approaches guided by smartphone app and compass. Scientific Reports 11, 1 (2021), 6778.
  • [25] Gorkem Yavas MD, Kadri Emre Caliskan MD, M. S. C. M. Three-dimensional–printed marker–based augmented reality neuronavigation: a new neuronavigation technique. Neurosurg Focus 51, 9 (2021).
  • [26] Hagel, S., Bruns, T., Pletz, M., Engel, C., Kalff, R., and Ewald, C. External ventricular drain infections: risk factors and outcome. Interdiscip Perspect Infect Dis 2014 (Nov 2014), 708531.
  • [27] Hong, W., Huang, X., Chen, Z., Huang, S., Wen, Y., He, B., Liu, Y., and Lin, Y. A low-cost mobile-based augmented reality neuronavigation system for retrosigmoid craniotomy. Operative Neurosurgery 17, 9 (2023), 1745–1750.
  • [28] ARKit framework documentation.
  • [29] Kersten-Oertel, M., Jannin, P., and Collins, D. L. The state of the art of visualization in mixed reality image-guided surgery. Computerized medical imaging and graphics: the official journal of the Computerized Medical Imaging Society 37, 2 (Mar 2013), 98–112.
  • [30] Léger, É., Drouin, S., Collins, D. L., Popa, T., and Kersten-Oertel, M. Quantifying attention shifts in augmented reality image-guided neurosurgery. Healthcare technology letters 4, 5 (Oct 2017), 188–192. PMID: 29184663.
  • [31] Léger, É., Horvath, S., Fillion-Robin, J.-C., Allemang, D., Gerber, S., Juvekar, P., Torio, E., Kapur, T., Pieper, S., Pujol, S., Bardsley, R., Frisken, S., and Golby, A. Nousnav: A low-cost neuronavigation system for deployment in lower-resource settings. International Journal of Computer Assisted Radiology and Surgery 17, 9 (2022), 1745–1750.
  • [32] Léger, É., Reyes, J., Drouin, S., Popa, T., Hall, J. A., Collins, D. L., and Kersten-Oertel, M. Marin: an open-source mobile augmented reality interactive neuronavigation system. International journal of computer assisted radiology and surgery 15, 6 (2020), 1013–1021.
  • [33] Lin, M. A., Siu, A. F., Bae, J. H., Cutkosky, M. R., and Daniel, B. L. Holoneedle: augmented reality guidance system for needle placement investigating the advantages of three-dimensional needle shape reconstruction. IEEE Robotics and Automation Letters 3, 4 (2018), 4156–4162.
  • [34] Malham, G. M., and Wells-Quinn, T. What should my hospital buy next?—guidelines for the acquisition and application of imaging, navigation, and robotics for spine surgery. Journal of Spine Surgery 5, 1 (2019).
  • [35] Naghmeh Bagher Zadeh Ansari, É. L., and Kersten-Oertel, M. Ventroar: an augmented reality platform for ventriculostomy using the microsoft hololens. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization 11, 4 (2023), 1225–1233.
  • [36] Qi, Z., Jin, H., Xu, X., Wang, Q., Gan, Z., Xiong, R., Zhang, S., Liu, M., Wang, J., Ding, X., et al. Head model dataset for mixed reality navigation in neurosurgical interventions for intracranial lesions. Scientific Data 11, 1 (2024), 538.
  • [37] Reyes, J., El-Mufti, N., Gorman, S., Xie, D., and Kersten-Oertel, M. User-centered design for surgical innovations: A ventriculostomy case study. In Workshop on the Ethical and Philosophical Issues in Medical Imaging (2022), Springer, pp. 51–62.
  • [38] Schneider, M., Kunz, C., Pal’a, A., Wirtz, C. R., Mathis-Ullrich, F., and Hlaváč, M. Augmented reality-assisted ventriculostomy. Neurosurgical Focus 50, 1 (2021), E16.
  • [39] Zhang, Z. Iterative Closest Point (ICP). Springer US, Boston, MA, 2014, pp. 433–434.