We describe the steps to use our custom designed software for image integration, visualization and planning in epilepsy surgery.
Epilepsy surgery is challenging and the use of 3D multimodality image integration (3DMMI) to aid presurgical planning is well-established. Multimodality image integration can be technically demanding, and is underutilised in clinical practice. We have developed a single software platform for image integration, 3D visualization and surgical planning. Here, our pipeline is described in step-by-step fashion, starting with image acquisition, proceeding through image co-registration, manual segmentation, brain and vessel extraction, 3D visualization and manual planning of stereoEEG (SEEG) implantations. With dissemination of the software this pipeline can be reproduced in other centres, allowing other groups to benefit from 3DMMI. We also describe the use of an automated, multi-trajectory planner to generate stereoEEG implantation plans. Preliminary studies suggest this is a rapid, safe and efficacious adjunct for planning SEEG implantations. Finally, a simple solution for the export of plans and models to commercial neuronavigation systems for implementation of plans in the operating theater is described. This software is a valuable tool that can support clinical decision making throughout the epilepsy surgery pathway.
In surgical practice it is crucial for the surgeon to appreciate anatomical structures and their spatial relationships to one another in three dimensions. This is especially important in neurosurgery, where the surgeon is working in a confined space, with limited visualization and access to complex anatomy. Despite this, to date most imaging has been presented to surgeons in conventional planar 2D form, and different imaging modalities are often presented one after another in series. As a consequence, the surgeon has to mentally integrate this data for each patient, and place it into an anatomical framework for presurgical planning. There is clear benefit in generating 3D computer models of the individual patient brain, which demonstrates the anatomy of the cortex, the blood vessels, any pathological lesions present as well as other relevant 3D landmarks in the same spatial context1-4. Before surgery the surgeon can rotate and alter the transparency of these models, to fully understand the 3D relationships between different structures of interest. This principle is termed 3D multimodality imaging (3DMMI).
The aim of pre-surgical evaluation for epilepsy surgery is to infer the localization of the area of the brain where seizures arise, and ensure that this can be safely resected without causing significant deficits5. There is a wide range of diagnostic imaging modalities that contribute to this, including structural MRI, fluorodeoxyglucose positron emission tomography (FDG-PET), ictal single photon emission computed tomography (SPECT), magnetoencephalography (MEG) dipoles, functional MRI (fMRI) and diffusion tensor imaging (DTI)6. Epilepsy surgery is ideally suited for 3DMMI since it requires the simultaneous interpretation of multiple data sets, and the consideration of how each data set relates to another.
In many cases non-invasive investigations fail to provide the level of evidence required to proceed to resection. In these cases intracranial EEG (IC EEG) recordings are necessary to identify the region of the brain that must be removed to prevent seizures. Increasingly, IC EEG is performed by a technique called SEEG, in which a number of recording depth electrodes are placed intracerebrally to capture the origin and propagation of electrical activity associated with seizures in 3D1,7-10.
The first step of SEEG implantations is to develop the strategy of the implantation, defining the areas of the brain that need to be sampled. This involves integrating the clinical and non-invasive EEG date, with structural imaging, with any lesion, and functional imaging data that infer the location of the source of the epilepsy.
The second step is the precise surgical planning of the electrode trajectories. The surgeon must ensure safe avascular electrode trajectories, centring electrode entries at the crown of the gyri and remote from cortical surface veins, and traversing the skull orthogonally. Additionally the entire implantation arrangement has to be well conceived, with reasonable inter-electrode spacing and no electrode collisions.
The feasibility of generating 3DMMI models to guide implantation of IC EEG electrodes in a busy epilepsy surgery practice has previously been demonstrated11. We have also demonstrated the principle that the use of 3DMMI confers added value in clinical decision-making. In a prospective study, disclosure of 3DMMI changed some aspect of management in 43/54 (80%) cases, and specifically changed the positioning of 158/212 (75%) of depth electrodes12.
There is a range of software packages that facilitate 3DMMI. These include commercially available neuronavigation platforms that are used in the operating theater, specialised planning software suites allied with neuronavigation platforms and research-orientated stand-alone image integration and visualization platforms. As the functionality, flexibility and versatility of these platforms increase, the usability and likelihood of translating them into clinical practice correspondingly decreases.
We have developed custom-designed software for multimodality image integration, advanced 3D visualization and SEEG electrode placement planning12,13 for the treatment of epilepsy. The emphasis is on ease of use in a clinical scenario, allowing real time use of software by clinicians, and rapid incorporation into the clinical pipeline. The software runs on a translational imaging platform14, that combines NiftyReg, NiftySeg and NiftyView.
In this paper the protocol for using the software in clinical practice is set out. The steps for image co-registration, segmentation of regions of interest, brain segmentation, extracting blood vessels from dedicated vascular imaging15, building 3D models, planning SEEG implantations and rapidly exporting models and plans to the operating theater are described. A novel tool is also described for automated multi-trajectory planning13, that increases the safety and efficacy of the implantations and substantially reduces the duration of planning.
NOTE: Software commands provided here are specific to the current version (19.01.2015) of the software and may change upon subsequent software releases. Manuals for individual versions are available on request.
1. Perform Image Integration and Visualization
2. Perform Manual Planning
3. Perform Computer-assisted Planning
4. Export Plans and Models to the Operating Theater
5. Reconstructing Electrode Implantation Post-operatively
The protocol described for image integration, visualization, manual planning and export to a selected neuronavigation system has been employed at the National Hospital for Neurology and Neurosurgery since August 2013. This comprises 35 cases of SEEG implantation12, with the implantation of 319 depth electrodes. 27/35 (77%) of patients have progressed to a cortical resection following implantation, which is an indicator that the implantation identified the area of seizure onset. There has been one haemorrhagic complication related to the placement of depth electrodes, and this was treated conservatively.
The imaging modalities used during the presurgical evaluation are decided on a case-by case basis, and are described in Table 1. The protocol is flexible, and can incorporate any imaging modality that can be imported into DICOM or Nifti format. Figure 1 demonstrates the basic viewer for our in-house software platform, and Figures 2, 3, 4 and 5 illustrate typical screenshots during the building of the 3D multimodality models.
The seamless integration of this protocol into our clinical pipeline, and the dissemination of this software to other centres, is a useful surrogate 'marker' of success. The difficulties in assessing clinical benefit in the epilepsy surgery population are well known and described elsewhere12. This pipeline offers a streamlined solution, which is flexible, relatively user-friendly, and easy to replicate in other centres.
Computer-assisted planning (CAP) is a recent development that has been retrospectively tested on previous manually planned implantations16. Preliminary results suggest that CAP generates safer, more efficient implantations, that are feasible to implement and that are completed in a time effective manner16. Table 2 demonstrates this quantitative comparison. A prospective trial of using CAP in clinical practice is underway. The algorithm that drives CAP has been previously described13.
Figure 6 shows a typical outcome from the automated multi-trajectory planner. The critical structures that have been entered are veins, arteries and surface sulci. Note the centring of the trajectories on the crown of the gyri, and the constraining of trajectory entry points to a scalp exclusion mask. Figure 7 shows a typical risk visualization graph for an individual trajectory, with associated metrics and graphic representation of trajectory length.
Figure 1. Basic Viewer Display of In-house Software Platform. LEFT- DataManager, TOP- toolbar that contains shortcuts plug-in tools, RIGHT- current plug in tool in use, CENTRE- 4 Ortho-view display. Please click here to view a larger version of this figure.
Figure 2. Segmentation and 3D Visualization in In-house Software. (A) axial T1 MRI with superimposed surface models, (B) 3D surface rendering of models (cyan-veins, green- motor hand from transcranial magnetic stimulation, orange- arcuate fasciculus tractography, blue- corticospinal tractography, pink- optic radiation tractography, yellow- uncinate fasciculus tractography, purple- thalamus segmentation). Please click here to view a larger version of this figure.
Figure 3. Generation of Cortex Surface Models. (A) axial view of wmparc file, (B) wmparc file thresholded from 1-5002, (C) surface rendering of binarised wmparc file. Please click here to view a larger version of this figure.
Figure 4. Vessel Extraction in In-house Software using Vesselness. (A) Axial CT angiogram co-registered with 3D phase contrast MRI. (B) 3D surface rendering of veins (cyan) and arteries (red). Please click here to view a larger version of this figure.
Figure 5. Generation of Cortex Volume Model 3D Volume rendering of cortex (grey) and surface rendering of scalp surface (white). Please click here to view a larger version of this figure.
Figure 6. 3D Multimodality Models of Computer-assisted Trajectory Planning. (A) scalp (white), scalp exclusion mask (yellow) and trajectories (purple). (B) scalp and mask transparent to show brain (pink), sulci (green), veins (cyan) and arteries (red). (C) scalp and mask removed to show trajectories and brain. (D) brain removed to show trajectories , surface sulci, veins and arteries. Please click here to view a larger version of this figure.
Figure 7. Graphic Visualization of Metrics Associated with Individual Trajectories. Top- length, angle traversing skull, risk, G/W ratio and minimum distance from a blood vessel >1 mm in diameter. Middle- graphic display of closest critical structure along length of trajectory (red-artery, cyan-vein, y-axis- distance to structure(maximum 10 mm), x-axis- distance along trajectory from brain entry to target, SM- safety margin represented as horizontal red line that marks 3 mm separation of trajectory to critical structure). Bottom- graphic display of trajectory path through grey and white matter (green-extracerebral, grey-grey matter, white- white matter). Please click here to view a larger version of this figure.
Modality | Site | Pre-processing | Field of view (AP x RL x IS) | Voxel size (AP x RL x IS) |
3D T1 FSPGR | ES | No | 256 x 256 x 166 | 0.94 x 0.94 x 1.1 |
Coronal T2 FLAIR | ES | No | 256 x 160 x 32 | 0.94 x 1.5 x 3.5 |
Navigation T1 with gadolinium | NHNN | No | 512 x 512 x 144 | 0.5 x 0.5 x 1.5 |
MRI 3D phase contrast | NHNN | No | 256 x 256 x 160 | 0.85 x 0.85 x 1 |
CT angiogram | NHNN | No | 512 x 512 x 383 | 0.43 x 0.43 x 0.75 |
MEG dipole | NHNN | Yes | ||
Ictal-interictal SPECT | UCLH | Yes | 128 x 128 x 49 | 3.9 x 3.9 x 3.9 |
FDG-PET | UCLH | Yes | 128 x 128 x 47 | 1.95 x 1.95 x 3.3 |
DTI | ES | Yes | 128 x 128 x 60 | 1.88 x 1.88 x 2.4 |
Functional MRI, EEG-correlated fMRI | ES | Yes | 128 x 128 x 58 | 1.87 x 1.87 x 2.5 |
Table 1. Imaging Modalities used for Image Integration ((ES-Epilepsy Society, NHNN-National Hospital for Neurology and Neurosurgery, UCLH- University College London Hospital, FSPGR-FastSpoiledGradientRecalledEcho, MEG-magnetoencephalography, SPECT-single photon emission computed tomography, FDG PET- fluorodeoxyglucose positron emission tomography, DTI-diffusion tensor imaging, AP- anterior posterior, RL – right left, IS – inferior superior).
Manual Planning* | CAP* | Estimated Difference (Manual-CAP) | Error | P value | |
Electrode Length (mm, 1 dp) | 57.9 (21.8) | 53.9 (15.6) | 4.74 | 1.59 | <0.05 |
Angle of Entry (degrees off perpendicular, 1 dp) | 16.2 (12.8) | 13.0 (7.6) | 5.89 | 1.07 | <0.05 |
Risk (normalised units, 2 dp) | 0.41 (0.79) | 0.36 (0.42) | 0.19 | 0.03 | <0.05 |
Minimum Distance from Blood Vessel (mm, 1 dp) | 4.5 (3.0) | 4.5 (3.0) | -0.56 | 0.2 | <0.05 |
Proportion of Intracerebral Electrode in Grey Matter (2 dp) | 0.33 (0.33) | 0.48 (0.28) | -0.11 | 0.02 | <0.05 |
Table 2. Statistical Comparison between Manual and Computer-assisted Planning (CAP). *first value is median, second value in brackets is interquartile range. This Table has been reproduced with permission from 16.
In summary, the crucial steps for image integration and 3D visualization are image co-registration, segmentation of brain, vessels and other structures or areas of interest, and export to a neuronavigation system. This process was previously performed in the group using commercially available image integration software. A disadvantage to this pipeline was the time taken, with the entire process taking 2 – 4 hr. Using our in-house software platform, this pipeline is simplified considerably, and can be completed in 1 – 2 hr. Further, there is the added functionality of surgical planning of SEEG electrode trajectories on this software, that can be done manually or with computer-assistance. The benefits of CAP over manual planning are increased precision, reduced risk and increased speed, and have been discussed elsewhere (Nowell et al, In Press, Sparks et al, submitted).
The in-house software platform is in continuous development, with new tools and functionality being added to support all stages of presurgical evaluation and surgical management. There is therefore a need for rigorous testing at each new version release. Current limitations of the software include a lack of high quality volume rendering, which is present in other platforms and is a valuable addition for advanced 3D visualization. Also export is only compatible with a selected neuronavigation company at the present time. These limitations have not affected the clinical utility of the software in our unit, and have not slowed the dissemination of the technology to other centres.
The significance of this software is that it removes the barriers that previous groups have cited as reasons for not using 3DMMI. The solution provides easy to use tools in one single platform, that does not require specialist training or expertise, is time and cost-effective and is easily translated into clinical practice. We have plans to add further innovations to the software to support Epilepsy Surgery. Furthermore, the methods could easily be applied to other areas of neurosurgery, such as resection of low grade tumours close to eloquent cortex, focal lesioning and delivery of targeted stimulation. 3DMMI and precise surgical planning tools are likely to become increasingly important in modern surgery, as more challenging cases are taken on and as minimally invasive treatments enter common practice.
The authors have nothing to disclose.
This programme has been supported by Department of Health and Wellcome Trust Health Innovation Challenge Fund (HICF-T4-275, Programme Grant 97914). We are grateful to the Wolfson Trust and the Epilepsy Society for supporting the Epilepsy Society MRI scanner. This work was supported by the National Institute for Health Research (NIHR) University College London Hospitals Biomedical Research Centre (BRC)
EpiNav | UCL | Inhouse software platform for image integration, segmentation, visualisation and surgical planning | |
Freesurfer | Martinos Centre for Biomedical Imaging | Software for cortical segmentation | |
S7 Stealthstation | Medtronic | Neuronavigation system | |
MeshLab | ISTI-CNR | 3D mesh processing software | |
NiftiK | UCL | Translational imaging platform | |
AMIRA | Visualisation Sciences Group | Image integration software |