TLDR: A new deep learning model, the Vessel-Prior UNet (VP UNet), has been developed for detecting and segmenting intracranial aneurysms from MR angiography scans. This model uniquely integrates a ‘vesselness prior’ to guide its focus, employs multi-task learning for joint detection and segmentation, and utilizes weak annotations (simple spheres) combined with test-time augmentation to overcome data scarcity. Evaluated on two datasets, the VP UNet demonstrated superior performance in reducing false positives for detection and achieving high accuracy in segmentation, showcasing the potential for efficient and scalable aneurysm analysis with less manual labeling effort.
Intracranial aneurysms, which are abnormal bulges in brain blood vessels, pose a significant health risk if they rupture, potentially leading to life-threatening consequences like stroke. Detecting and accurately outlining these aneurysms in radiological scans, such as MR angiography (MRA), is crucial for patient care. However, their small size, subtle appearance, and the scarcity of large, expertly annotated datasets make this a challenging task for traditional methods and even for developing advanced deep learning algorithms.
Researchers Erin Rainville, Amirhossein Rasoulian, Hassan Rivaz, and Yiming Xiao have introduced a novel approach to address these challenges. Their work, detailed in the paper “Weakly Supervised Intracranial Aneurysm Detection and Segmentation in MR angiography via Multi-task UNet with Vesselness Prior”, proposes a new deep learning model called the Vessel-Prior UNet (VP UNet).
A Novel Approach to Aneurysm Detection
The VP UNet is a 3D multi-task UNet designed to simultaneously detect and segment intracranial aneurysms in time-of-flight MR angiography (TOF-MRA images). The model incorporates several key innovations to overcome the limitations of existing methods:
- Vesselness Prior Integration: Aneurysms are pathologies of blood vessels. The VP UNet leverages a well-known technique called Frangi’s vesselness filter to create a “soft spatial prior” of blood vessels. This prior acts as a guide, helping the network focus its learning on regions that are likely to contain vessels, thereby improving the accuracy of aneurysm feature learning. Unlike “hard constraints” that might miss aneurysms if vessel segmentation is imperfect, this soft prior allows the model to learn how vessel information should influence its decisions, even with less-than-perfect vessel enhancement.
- Multi-task Learning: The model is designed to perform both aneurysm detection (identifying if an aneurysm is present) and segmentation (precisely outlining its shape) jointly. This synergistic approach means that features learned for one task can benefit the other, leading to more robust and accurate results. The network shares an encoder for processing both the MRA image and the vesselness map, then branches into separate decoders for classification and segmentation.
- Weak Supervision and Test-Time Augmentation (TTA): A major hurdle in medical deep learning is the lack of large datasets with detailed, voxel-wise annotations, which are time-consuming and expensive to produce. The VP UNet is trained using “weak labels,” specifically coarse spherical annotations that simply enclose the aneurysms, which are much faster to create. To further enhance performance and mitigate the impact of these less precise labels, the model employs test-time augmentation during inference, averaging predictions from multiple orientations of the input to produce more stable and accurate segmentations.
Performance and Generalizability
The researchers evaluated the VP UNet on two publicly available datasets: the Lausanne dataset (used for training with weak labels and internal testing) and the ADAM dataset (used for external validation to assess generalizability). The results demonstrated superior performance compared to several state-of-the-art techniques.
For aneurysm detection, the VP UNet achieved the lowest false positive rate on both internal and external test sets, indicating its robustness in distinguishing true aneurysms from false alarms. While its sensitivity was comparable to other methods, the reduction in false positives is a significant improvement. For aneurysm segmentation, the model achieved the best Dice and Intersection over Union (IoU) scores on the internal test set, showing its strong capability in accurately outlining aneurysms. Although its performance on the external dataset was slightly lower, this highlights the common challenge of generalizing across different data acquisition protocols, a known issue in medical imaging.
Ablation studies, where specific components of the model were removed or altered, confirmed the importance of integrating the vesselness prior at multiple levels and using test-time augmentation. These elements collectively contribute to more accurate and robust detection and segmentation.
Also Read:
- TopoTTA: Enhancing Segmentation of Tubular Structures Across Diverse Datasets
- LesiOnTime: Enhancing Breast Cancer Screening with AI that Learns from Past Scans and Clinical Data
Implications for Clinical Care
This research is particularly significant because it demonstrates that a weakly supervised model can achieve performance comparable to fully supervised methods, even when trained on less precise annotations. This dramatically reduces the manual labor and clinical expertise required for dataset creation, making deep learning solutions for aneurysm analysis more feasible and scalable. The model’s ability to reduce false positives is critical, as it can minimize unnecessary follow-up procedures and patient anxiety.
While the model shows strong results, the authors acknowledge areas for future improvement, such as enhancing generalizability across diverse scanners and protocols, and exploring uncertainty-based loss functions to better balance the trade-off between sensitivity (missing true aneurysms) and specificity (false alarms) in high-stakes clinical settings.
In conclusion, the VP UNet represents a significant step forward in automated intracranial aneurysm detection and segmentation, offering a robust and efficient solution that can potentially aid in earlier diagnosis and better management of this critical cerebrovascular disorder.


