Here we present a 5D ultrasound technique combining multi-planar 3D reconstruction and color Doppler fusion, which enables synchronous visualization of thyroid structural and functional information. By minimizing blind spots, this method allows rapid, precise localization of lesions to improve diagnostic accuracy, especially benefiting novice practitioners.
This paper proposes a novel thyroid examination technique based on five-dimensional (5D) synchronous reconstruction of ultrasound data. The raw temporal sequences are reconstructed into 3D volumetric data reflecting anatomical structure. Triplanar visualization from three orthogonal planes is realized to provide a systematic inspection of the entire gland. Color Doppler imaging is integrated into each triplanar slice to map vascularity changes. This multi-modal fusion enables synchronous display of structural, functional, and blood flow information in the reconstructed 5D space. Compared to conventional scanning, this technique offers the benefits of flexible offline diagnosis, reduced dependency on scanning, enhanced intuitive interpretation, and comprehensive multi-aspect evaluation. By minimizing oversight errors, it could improve diagnostic accuracy, especially for novice practitioners. The proposed 5D fusion method allows rapid and precise localization of lesions for early detection. Future work will explore integration with biochemical markers to further improve diagnostic precision. The technique has considerable clinical value for advancing thyroid examination.
Hashimoto’s thyroiditis (HT), the most frequent autoimmune thyroid disorder (AITD), is the leading cause of hypothyroidism in iodine-sufficient areas of the world1. It is characterized by lymphocytic infiltration and autoantibodies against thyroid antigens, leading to the destruction of thyroid architecture and hypothyroidism2. Staging of HT aims to assess the severity and guide treatment decisions. It relies on a combination of biochemical markers such as thyroid stimulating hormone (TSH) and thyroid autoantibodies3, as well as ultrasonographic features visible on thyroid ultrasound4,5,6.
On ultrasound examination, HT demonstrates characteristic findings, including diffusely decreased echogenicity, heterogeneous echotexture, micronodularity, and increased blood flow on color Doppler6,7. However, conventional two-dimensional (2D) grayscale ultrasound lacks quantitative methods for systematically analyzing these features for HT staging8. The assessment of vascularity changes is also limited to qualitative visual inspection in 2D mode. The complex three-dimensional (3D) architecture of the thyroid gland further hampers thorough evaluation using conventional 2D slicing9,10. These factors lead to imaging blind spots and misinterpretation, resulting in low sensitivity and specificity, especially for less experienced practitioners11,12.
Conventional handheld ultrasound scanning integrates real-time acquisition and diagnosis. This coupled workflow reliance increases the likelihood of oversight errors during scanning. The lack of spatial localization and tracking also makes lesion identification and monitoring imprecise12,13. Dedicated 3D ultrasound systems have emerged to address these limitations and have shown promising results14,15. However, most 3D ultrasound technologies require complex mechanical scanning mechanisms and specialized transducers, leading to high costs and barriers to adoption.
To overcome the limitations of conventional 2D and 3D ultrasound techniques, this study proposes a novel 3D reconstruction and visualization solution tailored for thyroid examination. Using widely available handheld ultrasound, multiple 2D sweeps are first acquired to scan the entire thyroid gland. 3D volumetric reconstruction is then realized by spatial registration and fusion of the 2D sequences. Concurrently, color Doppler frames are coregistered to create vascularity maps visualizing blood flow changes. The reconstructed 3D grayscale volumes and colored vascularity maps are finally integrated into a single platform, enabling synchronized multi-planar visualization and combined structural-functional inspection.
This proposed 3D fusion technique provides a systematic and comprehensive evaluation of the complex thyroid morphology from different aspects. By minimizing blind spots and enabling global overview, it could help improve diagnostic accuracy and reduce oversight errors, especially benefiting novice practitioners. The multi-modal visualization also facilitates rapid and precise localization of lesions, holding promise for early diagnosis and treatment of thyroid nodules and tumors. Moreover, the method introduces quantitative 3D feature analysis which has not been investigated for HT staging before. With wide adoption, it has the potential to standardize and objectify the currently experience-dependent ultrasound diagnosis procedures. By synergistically integrating handheld 3D reconstruction, multi-modal fusion, quantitative feature analysis, and flexible visualization into a streamlined workflow, this low-cost, easy-to-use technique represents a diagnostically powerful leap from conventional 2D ultrasound for advancing thyroid examination.
This study was approved by the Institutional Review Board of Sunsimiao Hospital affiliated with the Beijing University of Chinese Medicine. The patient was recruited from the Department of Thyroid, Sunsimiao Hospital. The patient underwent a thyroid ultrasound examination and gave informed consent for the study. In this investigation, 4D ultrasound data acquired using a handheld device were utilized to reconstruct triplanar views of the thyroid gland. Furthermore, real-time synchronous color Doppler imaging was achieved. The software tools used in this research are listed in the Table of Materials.
1. Data collection and preparation
2. Synchronous observation of B-mode and color Doppler ultrasound
NOTE: The 4D B-Mode Ultrasound Data shown in Figure 1 and the 4D Color Doppler Ultrasound Data shown in Figure 2 contain the same absolute time stamps in the fourth dimension along the temporal axis. This field is recorded in the DICOM metadata as FrameTimeVector. Based on the time values in this field, Figure 1 and Figure 2 can be synchronized in real time.
3. Synchronous triplanar reconstruction for thyroid
NOTE: To enable more precise localization and quantification of lesions, this study performed triplanar reconstruction of the thyroid gland from the acquired 4D ultrasound data, with real-time interactivity. This allows clinicians to rapidly and accurately pinpoint lesions, laying a solid foundation for subsequent quantification of the affected regions.
4. Synchronous triplanar reconstruction for 3D blood flow field
NOTE: Reconstructing the synchronous triplanar views for the 3D blood flow field based on 4D color Doppler ultrasound data is also clinically important for characterizing Hashimoto's Thyroiditis (HT).
5. Synchronization of B-mode triplanar views and color Doppler triplanar views
NOTE: Building upon the triplanar views shown in Figure 4, synchronizing the corresponding color Doppler flow images to the lesion locations would undoubtedly facilitate the diagnosis and quantification of the pathological progression in Hashimoto's Thyroiditis (HT).
As shown in the graphical user interface (GUI) in Figure 1 and Figure 2, the ultrasound scanning sequence can be checked continuously. However, this two-dimensional examination relies heavily on the thyroidologist's anatomical knowledge to mentally reconstruct the lesion's location, which is challenging for novices and results in a lack of quantitative consistency. Figure 3 fuses the B-mode grayscale with color Doppler flow images to enable more informed inspection on the 2D scans.
To facilitate a comprehensive and reliable assessment of thyroid disorders, Figure 4 shows the 3D spatial distribution of B-mode intensities, while Figure 5 exhibits the 3D vascularity map reconstructed from color Doppler data. As illustrated in the GUI (Figure 6), synchronized visualization of the structural and functional information along three orthogonal planes is realized. Clinicians can continuously inspect the multiplanar cross-sections of thyroid grayscale images and the corresponding blood flow images. This seamless integration of complementary modalities could play a pivotal role in precisely localizing and determining the severity of thyroid pathologies.
If the 3D grayscale volumes and 3D color Doppler volumes are essentially 4D data spanning the spatial and pathological dimensions, linking their interaction across the two synchronized triplanar visualizations could empower the thyroidologist to swiftly pinpoint lesions in a unified 5D space and deliver accurate diagnoses based on the joint intensity and flow patterns.
Figure 1: Transverse B-mode ultrasound video loops. Consecutive B-mode frames acquired by continuous transverse scanning show thyroid morphology. Please click here to view a larger version of this figure.
Figure 2: Transverse color Doppler ultrasound video loops. Consecutive color Doppler frames obtained by transverse scanning reveal blood flow characteristics of the thyroid tissue. Please click here to view a larger version of this figure.
Figure 3: Synchronized B-mode and Doppler ultrasound. Integrated video synchronously exhibiting thyroid structure (grayscale) and blood flow (colored overlay). The color Doppler overlay depicts the direction and velocity of flow using a color scale-red indicates flow toward the transducer; blue indicates flow away from the transducer. Please click here to view a larger version of this figure.
Figure 4: Triplanar views extracted from B-mode ultrasound. Orthogonal coronal, sagittal, and axial planes reconstructed from 4D B-mode scans using triplanar visualization. Please click here to view a larger version of this figure.
Figure 5: Triplanar views extracted from Doppler ultrasound. Orthogonal coronal, sagittal, and axial planes reconstructed from 4D Doppler scans to map blood flow characteristics of the thyroid tissue. Please click here to view a larger version of this figure.
Figure 6: Synchronized triplanar views fusing structural and vascularity data. Fused multiplanar reconstruction synchronizing B-mode and Doppler data to enable combined morphological and functional inspection. Please click here to view a larger version of this figure.
Critical steps in the protocol
While Figure 1 and Figure 2 have value for inspection and diagnosis, determining lesion location and views from other perspectives requires expert experience. For the diagnosis of Hashimoto's thyroiditis (HT), synchronizing Figure 1 and Figure 2 in real time is also an important and critical step. Protocol step 3.3 is one of the key steps where, as shown in Figure 4, the attending physician can interactively examine arbitrary cross-sections of the 3D thyroid anatomy. This is crucial for localizing lesions and identifying abnormal tissue regions. Traditionally, handheld ultrasound scanning only provides 2D transverse views. This unavoidably leads to oversight of 3D pathological details due to blind spots. Similarly, protocol step 4.3 generates the 3D blood flow map, which is also critical for pinpointing lesion locations. Protocol steps 5.1 and 5.2 synchronize the structural and functional thyroid images, equipping clinicians with more powerful digital intelligent tools for managing complex conditions.
Modifications and troubleshooting
If reconstruction artifacts occur, the acquisition sweep extent may be insufficient. Repeating scanning with extended coverage can overcome this. Parameters such as slice spacing and pixel size can also be adjusted.
Limitations of the method
Although handheld ultrasound scanning can obtain time stamps for synchronizing various modes, it lacks real-time 3D probe localization. Hence, only the transverse dimensions are precisely reconstructed in the thyroid models. Quantitative measurements on transverse planes are currently accurate, while coronal and sagittal views assist pathological localization but have unreliable quantitative scales at present.
Significance with respect to existing methods
This 5D ultrasound technique enhances conventional 2D scanning by enabling multi-planar structural examination combined with blood flow mapping in a panoramic visualized space. It overcomes limitations like operator dependence, blind spots, and diagnostic ambiguity that persist in 2D ultrasonography. The proposed workflow lays a robust foundation to standardize and transform the current experience-dependent practices for ultrasound diagnosis of thyroid diseases.
Potential applications
This method can be applied to precisely localize and quantify thyroid nodules, tumors, and inflammatory lesions such as Hashimoto's thyroiditis. It provides radiologists and surgeons with enhanced visual perspectives for evaluating pathology. The technique has considerable potential to aid diagnosis, treatment planning, and surgical guidance. Additionally, the study team plans to incorporate biochemical markers with this 5D analysis pipeline to realize AI-empowered precision diagnosis and quantification for thyroid diseases.
The authors have nothing to disclose.
This publication received support from the Shaanxi Provincial Key Research and Development Plan: 2023-ZDLSF-56 and the Shaanxi Provincial "Scientist + Engineer" Team Construction: 2022KXJ-019.
MATLAB | MathWorks | 2023B | Computing and visualization |
Tools for Thyroid Disease Precision Quantification | Intelligent Entropy | Thyroid-3D V1.0 | Beijing Intelligent Entropy Science & Technology Co Ltd. Modeling for Thyroid Disease |