Provided here is a practical tutorial for an open-access, standardized image processing pipeline for the purpose of lesion-symptom mapping. A step-by-step walkthrough is provided for each processing step, from manual infarct segmentation on CT/MRI to subsequent registration to standard space, along with practical recommendations and illustrations with exemplary cases.
In lesion-symptom mapping (LSM), brain function is inferred by relating the location of acquired brain lesions to behavioral or cognitive symptoms in a group of patients. With recent advances in brain imaging and image processing, LSM has become a popular tool in cognitive neuroscience. LSM can provide fundamental insights into the functional architecture of the human brain for a variety of cognitive and non-cognitive functions. A crucial step in performing LSM studies is the segmentation of lesions on brains scans of a large group of patients and registration of each scan to a common stereotaxic space (also called standard space or a standardized brain template). Described here is an open-access, standardized method for infarct segmentation and registration for the purpose of LSM, as well as a detailed and hands-on walkthrough based on exemplary cases. A comprehensive tutorial for the manual segmentation of brain infarcts on CT scans and DWI or FLAIR MRI sequences is provided, including criteria for infarct identification and pitfalls for different scan types. The registration software provides multiple registration schemes that can be used for processing of CT and MRI data with heterogeneous acquisition parameters. A tutorial on using this registration software and performing visual quality checks and manual corrections (which are needed in some cases) is provided. This approach provides researchers with a framework for the entire process of brain image processing required to perform an LSM study, from gathering of the data to final quality checks of the results.
Lesion-symptom mapping (LSM), also called lesion-behavior mapping, is an important tool for studying the functional architecture of the human brain1. In lesion studies, brain function is inferred and localized by studying patients with acquired brain lesions. The first case studies linking neurological symptoms to specific brain locations performed in the nineteenth century already provided fundamental insights into the anatomical correlates of language and several other cognitive processes2. Yet, the neuroanatomical correlates of many aspects of cognition and other brain functions remained elusive. In the past decades, improved structural brain imaging methods and technical advances have enabled large-scale in vivo LSM studies with high spatial resolution (i.e., at the level of individual voxels or specific cortical/subcortical regions of interest)1,2. With these methodological advances, LSM has become an increasingly popular method in cognitive neuroscience and continues to offer new insights into the neuroanatomy of cognition and neurological symptoms3. A crucial step in any LSM study is the accurate segmentation of lesions and registration to a brain template. However, a comprehensive tutorial for the preprocessing of brain imaging data for the purpose of LSM is lacking.
Provided here is a complete tutorial for a standardized lesion segmentation and registration method. This method provides researchers with a pipeline for standardized brain image processing and an overview of potential pitfalls that must be avoided. The presented image processing pipeline was developed through international collaborations4 and is part of the framework of the recently founded Meta VCI map consortium, whose purpose is performing multicenter lesion-symptom mapping studies in vascular cognitive impairment <www.metavcimap.org>5. This method has been designed to process both CT and MRI scans from multiple vendors and heterogeneous scan protocols to allow combined processing of imaging datasets from different sources. The required RegLSM software and all other software needed for this protocol is freely available except for MATLAB, which requires a license. This tutorial focuses on the segmentation and registration of brain infarcts, but this image processing pipeline can also be used for other lesions, such as white matter hyperintensities6.
Prior to initiating an LSM study, a basic understanding of the general concepts and pitfalls is required. Several detailed guidelines and a hitchhiker's guide are available1,3,6. However, these reviews do not provide a detailed hands-on tutorial for the practical steps involved in gathering and converting brain scans to a proper format, segmenting the brain infarct, and registering the scans to a brain template. The present paper provides such a tutorial. General concepts of LSM are provided in the introduction with references for further reading on the subject.
General aim of lesion-symptom mapping studies
From the perspective of cognitive neuropsychology, brain injury can be used as a model condition to better understand the neuronal underpinnings of certain cognitive processes and to obtain a more complete picture of the cognitive architecture of the brain1. This is a classic approach in neuropsychology that was first applied in post-mortem studies in the nineteenth century by pioneers like Broca and Wernicke2. In the era of functional brain imaging, the lesion approach has remained a crucial tool in neuroscience because it provides proof that lesions in a specific brain region disrupt task performance, while functional imaging studies demonstrate brain regions that are activated during the task performance. As such, these approaches provide complementary information1.
From the perspective of clinical neurology, LSM studies can clarify the relationship between the lesion location and cognitive functioning in patients with acute symptomatic infarcts, white matter hyperintensities, lacunes, or other lesion types (e.g., tumors). Recent studies have shown that such lesions in strategic brain regions are more relevant in explaining cognitive performance than global lesion burden2,5,7,8. This approach has the potential to improve understanding of the pathophysiology of complex disorders (in this example, vascular cognitive impairment) and may provide opportunities for developing new diagnostic and prognostic tools or supporting treatment strategies2.
LSM also has applications beyond the field of cognition. In fact, any variable can be related to lesion location, including clinical symptoms, biomarkers, and functional outcome. For example, a recent study determined infarct locations that were predictive of functional outcome after ischemic stroke10.
Voxel-based versus region of interest-based lesion-symptom mapping
To perform lesion-symptom mapping, lesions need to be segmented and registered to a brain template. During the registration procedure, each patient's brain is spatially aligned (i.e., normalized or registered to a common template) to correct for differences in brain size, shape, and orientation so that each voxel in the lesion map represents the same anatomical structure for all patients7. In standard space, several types of analyses can be performed, which are briefly summarized here.
A crude lesion-subtraction analysis can be performed to show the difference in lesion distribution in patients with deficits compared to patients without deficits. The resulting subtraction map show regions that are more often damaged in patients with deficits and spared in patients without deficits1. Though a lesion-subtraction analysis can provide some insights into correlates of a specific function, it provides no statistical proof and is now mostly used when the sample size is too low to provide enough statistical power for voxel-based lesion-symptom mapping.
In voxel-based lesion-symptom mapping, an association between the presence of a lesion and cognitive performance is determined at the level of each individual voxel in the brain (Figure 1). The main advantage of this method is the high spatial resolution. Traditionally, these analyses have been performed in a mass-univariate approach, which warrants correction for multiple testing and introduces a spatial bias caused by inter-voxel correlations that are not taken into account1,10,11. Recently developed approaches that do take inter-voxel correlations into account (usually referred to as multivariate lesion-symptom mapping methods, such as Bayesian analysis13, support vector regression4,14, or other machine learning algorithms15) show promising results and appear to improve the sensitivity and specificity of findings from voxel-wise LSM analyses compared to traditional methods. Further improvement and validation of multivariate methods for voxel-wise LSM is an ongoing process. The best method choice for specific lesion-symptom mapping depends on many factors, including the distribution of lesions, outcome variable, and underlying statistical assumptions of the methods.
In the region of interest (ROI)-based lesion-symptom mapping, an association between the lesion burden within a specific brain region and cognitive performance is determined (see Figure 1 in Biesbroek et al.2 for an illustration). The main advantage of this method is that it considers the cumulative lesion burden within an anatomical structure, which in some cases may be more informative than a lesion in a single voxel. On the other hand, ROI-based analyses have limited power for detecting patterns that are only present in a subset of voxels in the region16. Traditionally, ROI-based lesion-symptom mapping is performed using logistic or linear regression. Recently, multivariate methods that deal better with collinearity have been introduced (e.g., Bayesian network analysis17, support vector regression4,18, or other machine learning algorithms19), which may improve the specificity of findings from lesion-symptom mapping studies.
Patient selection
In LSM studies, patients are usually selected based on a specific lesion type (e.g., brain infarcts or white matter hyperintensities) and the time interval between diagnosis and neuropsychological assessment (e.g., acute vs. chronic stroke). The optimal study design depends on the research question. For example, when studying the functional architecture of the human brain, acute stroke patients are ideally included because functional reorganization has not yet occurred in this stage, whereas chronic stroke patients should be included when studying the long-term effects of stroke on cognition. A detailed description of considerations and pitfalls in patient selection is provided elsewhere7.
Brain image preprocessing for the purpose of lesion-symptom mapping
Accurate lesion segmentation and registration to a common brain template are crucial steps in lesion-symptom mapping. Manual segmentation of lesions remains the gold standard for many lesion types, including infarcts7. Provided is a detailed tutorial on criteria for manual infarct segmentation on CT scans, diffusion weighted imaging (DWI), and fluid-attenuated inversion recovery (FLAIR) MRI sequences in both acute and chronic stages. The segmented infarcts (i.e., the 3D binary lesion maps) need to be registered before any across-subject analyses are performed. This protocol uses the registration method RegLSM, which was developed in a multicenter setting4. RegLSM applies linear and non-linear registration algorithms based on elastix20 for both CT and MRI, with an additional CT processing step specifically designed to enhance registration quality of CT scans21. Furthermore, RegLSM allows for using different target brain templates and an (optional) intermediate registration step to an age-specific CT/MRI template22. The possibility of processing both CT and MRI scans and its customizability regarding intermediate and target brain templates makes RegLSM a highly suitable image processing tool for LSM. The entire process of preparing and segmenting CT/MRI scans, registration to a brain template, and manual corrections (if required) are described in the next section.
Figure 1: Schematic illustration of the concept of voxel-based lesion-symptom mapping. The upper part shows the brain image pre-processing steps consisting of segmenting the lesion (an acute infarct in this case) followed by registration to a brain template (the MNI-152 template in this case). Below, a part of the registered binary lesion map of the same patient is shown as a 3D grid, where each cube represents a voxel. Taken together with the lesion maps of 99 other patients, a lesion overlay map is generated. For each voxel, a statistical test is performed to determine the association between lesion status and cognitive performance. The chi-squared test shown here is just an example, any statistical test could be used. Typically, hundreds of thousands of voxels are tested throughout the brain, followed by a correction for multiple comparisons. Please click here to view a larger version of this figure.
This protocol follows the guidelines of our institutions human research ethics committee.
1. Collection of Scans and Clinical Data
2. Conversion of DICOM Images to Nifti Files
3. Infarct Segmentation
Scan type | Time window after stroke | Infarct properties | Reference scan | Pitfalls |
CT | >24 h | Acute: hypodense | – | – Fogging phase |
Chronic: hypodense cavity with CSF and less hypodense rim | – Hemorrhagic transformation | |||
DWI | <7 days | Hyperintense | ADC: typically hypointense | – T2 shinethrough |
– High DWI signal near interfaces between air and bone/tissue | ||||
FLAIR | >48 h | Acute: hyperintense | Acute: DWI/ADC, T1 (isointense or hypointense) | – White matter hyperintensities |
Chronic: hypointense or isointense (cavity), hyperintense rim | Chronic: T1 (hypointense cavity with CSF characteristics). | – Lacunes |
Table 1: Summary of criteria for infarct segmentation for different scan types.
4. Registration to Standard Space
5. Review Registration Results
6. Manually Correct Registration Errors
7. Preparing Data for Lesion-symptom Mapping
Exemplar cases of brain infarct segmentations on CT (Figure 3), DWI (Figure 5), and FLAIR (Figure 6) images, and subsequent registration to the MNI-152 template are provided here. The registration results shown in Figure 3B and Figure 5C were not entirely successful, as there was misalignment near the frontal horn of the ventricle. The registered lesion maps of these unsuccessful registrations were manually corrected, the results of which are shown in the figures. After this manual correction, the lesion maps of each of these three exemplar cases are an accurate representation of the infarcts in native space, and the lesion maps are ready to be used for subsequent lesion-symptom mapping. Figure 6C shows an example of an adequate registration result that does not require any manual correction.
These figures also highlight several potential pitfalls in brain infarct segmentation on each of these scan modalities. Figure 2 shows an example of motion artifacts on a CT scan, in which case the patient should be excluded from LSM studies. Figure 4 shows an example of fogging on a CT scan, which typically occurs 14-21 days after stroke, leading to an underestimation of the infarct size. CT scans made in this time interval should therefore not be used for lesion-symptom mapping. Figure 7 shows the results of three typical brain image registration schemes generated using the RegLSM software. Figure 8 shows the results of the registration of a DWI image to the MNI-152 T1 template in the RegLSM registration result viewer.
These results illustrate the entire process of infarct segmentation on CT and MRI, registration to standard space, subsequent quality checks, and when necessary, the manual correction of the registration results. The resulting lesion maps are ready to be used in voxel-based or region of interest-based lesion-symptom mapping.
Figure 2: Example of motion artifacts on a CT scan, presenting as shading, streaking and blurring in the image. Two different slices of a single CT scan are shown. Some examples of streaks and shades in the image are indicated by arrows. In this case, an infarct with a hemorrhagic component in the right cerebellar hemisphere is clearly visible, but a precise delineation of the lesion's anterior and medial border is difficult due to these artifacts. This scan should, therefore, not be used for LSM. Please click here to view a larger version of this figure.
Figure 3: Segmentation and registration of an infarct on a CT scan. (A) CT scans at three timepoints for a single patient. The CT <24 h cannot be used for segmentation because the infarct is not yet visible even though the CT-perfusion maps show ischemia in a large right frontal region. Legends to CT-perfusion maps: cerebral blood flow (CBF in mL/100 g/min) ranging 0 (dark blue) to 200 (red) and mean transit time (MTT in s) ranging from 0 (red) to dark blue (20). The CT scan on day 6 shows swelling of the infarcted brain tissue, with slight midline shift and hemorrhagic transformation visible as a region with higher density within the infarct. The CT scan after 4 months shows brain tissue loss with ex vacuo enlargement of ventricles and nearby sulci. The registration will have to compensate for the resulting displacement of adjacent structures. (B) The result of registration to the MNI-152 template. The registration algorithm insufficiently compensated for the midline shift and compression of the left ventricle, which required a manual correction (shown on the right). Please click here to view a larger version of this figure.
Figure 4: Examples of the fogging effect on CT imaging. Scans at three different timepoints are shown for two different patients to illustrate why a CT scan made in the fogging phase (i.e., 14-21 days after stroke) should be avoided. (A) For patient 1, the CT scan performed 24 h after stroke onset shows a well-demarcated infarct in the left frontal lobe. 20 days after stroke onset, the infarct is not well-demarcated, and using this scan for segmentation would result in the underestimation of the infarct size. The follow-up MRI (3 years after) shows that the CT scan after 24 h was an accurate representation of the infarct size, whereas the CT scan at day 20 was not. (B) For patient 2, the CT scan within 24 h shows subtle early signs of ischemia with loss of gray-white matter differentiation and diffuse swelling in the right temporal and insular regions. The CT scan at day 4 shows a well-demarcated infarct. On the CT scan at day 18, a large part of the hypodense infarcted region has become isodense, which would result in undersegmentation of the infarct. Please click here to view a larger version of this figure.
Figure 5: Segmentation and registration of an infarct on an MRI DWI sequence. MRI scan performed 12 h after stroke onset. (A) the acute ischemic lesion is hyperintense on the DWI sequence (b-value = 1000) and hypointense on the ADC, indicating restricted diffusion due to cytotoxic edema. The infarct is segmented on the DWI image. It should be noted that there is a subtle increase in signal on the FLAIR, but this is insufficiently clear to allow for lesion segmentation at this timepoint. (B) The dotted ellipse shows artifacts near bone-air configurations on the DWI (upper image) and ADC (lower image). (C) Comparison of the registered DWI sequence (left image; same scan as shown in panels A and B) and the corresponding registered infarct with the MNI-152 template (middle image). Note the slight error at the head of the right caudate nucleus, where the ventricles are not perfectly aligned. This required a manual correction of the segmentation in standard space (shown on the right). Please click here to view a larger version of this figure.
Figure 6: Segmentation and registration of an infarct on an MRI FLAIR sequence. MRI scans were performed at two different timepoints after stroke for a single patient. (A) In the MRI scans on day 3 the acute lacunar infarct (indicated with white arrows) can be reliably distinguished from chronic hyperintense lesions, such as white matter hyperintensities (indicated with dashed circles), because only acute infarcts show diffusion restriction on the DWI. It should be noted that at this timepoint, the DWI can also be used for segmentation. (B) At 7 months, the DWI is no longer useful for distinguishing the infarct from white matter hyperintensities. Instead, the T1 should be used to identify the infarct based on the presence of a cerebrospinal fluid-filled cavity that has a low signal on T1 (and high signal on ADC). At this chronic stage, both the cavity and the surrounding hyperintense signal on FLAIR should be segmented as an infarct. (C) This shows the results of the registration of the FLAIR on day 3, which is adequate and requires no manual correction. Please click here to view a larger version of this figure.
Figure 7: Overview of frequently used registration schemes implemented in RegLSM. The use of intermediate templates that provide a better match with the patient than the target template is optional. This is of particular importance when a CT scan is registered to an MRI template (see patient 1). When segmenting on FLAIR or DWI, the segmented scan can either be co-registered to a native T1 image (see patient 2), if available or directly registered to the T1 template (patient 3). Other alternatives are also available, as explained in the relevant sections of the discussion. Please click here to view a larger version of this figure.
Figure 8: Registration result viewer implemented in RegLSM. The left three panels show the MNI-152 template in three planes (transversal, sagittal, coronal), and the right three panels show a registered DWI image in three planes. The crosshair helps can be used to verify if anatomical structures are accurately aligned. Please click here to view a larger version of this figure.
Supplementary Figure 1: Typical folder structure during an image processing for LSM. The first subfolder for subject ID002 contains three native scans in nifti format (FLAIR, T1 and T2, in red box) and the segmentation of the FLAIR sequence (in blue box). The three subfolders are created during the registration process by RegLSM. The subfolder to_MNI contains the registered segmented scan (in this case the FLAIR, in green box). The subsequent subfolder contains the registered lesion map in standard space (purple box). Of note, RegLSM will be made BIDS-compatible in the upcoming update. Please click here to download this figure.
LSM is a powerful tool to study the functional architecture of the human brain. A crucial step in any lesion-symptom mapping study is the preprocessing of imaging data, segmentation of the lesion and registration to a brain template. Here, we report a standardized pipeline for lesion segmentation and registration for the purpose of lesion-symptom mapping. This method can be performed with freely available image processing tools, can be used to process both CT and structural MRI scans, and covers the entire process of preparing the imaging data for lesion-symptom mapping analyses.
The first major step in processing brain imaging data for lesion-symptom mapping is lesion segmentation. This protocol provides a detailed tutorial including criteria for infarct delineation, several examples, and pitfalls to facilitate accurate and reproducible segmentation. As mentioned in the protocol and summarized in Table 1, each scan type has a specific time window in which it can be used for infarct segmentation. Infarcts are visible on DWI within several hours after stroke onset as hyperintense on DWI and hypointense on ADC (reflecting restricted water diffusion due to cytotoxic edema), whereas other MRI sequences, including FLAIR, (and CT scans) are not sensitive enough to reliably detect infarcts within 48 h39. After the first week, the ADC image becomes isointense and eventually hyperintense as vasogenic edema develops30, while the DWI usually remains hyperintense for several more weeks31,39,40. It is therefore advised to use DWI only within 7 days and to use the FLAIR sequence after 7 days.
As noted in step 3.4, a FLAIR hyperintense lesion is not always an infarct. White matter hyperintensities and other chronic lesions can resemble a subcortical infarct on a FLAIR sequence. In the acute stage, small subcortical infarcts can easily be distinguished from white matter hyperintensities or other chronic lesions such as lacunes of presumed vascular origin when there is a DWI available, as mentioned in the protocol (see Figure 5). In the chronic stage, the T1 sequence needs be closely reviewed to look for small cavities (of at least 3 mm) within a lesion, indicating the lesion is not a white matter hyperintensity (see Figure 6). Cavities of <3 mm, particularly when elongated in shape, within a FLAIR hyperintense lesion are more likely to be a perivascular space than an infarct and are not to be segmented as infarcts33. If a chronic cavitated lesion fits the criteria for a lacune (i.e., the cavity is 3-15 mm)33, it can still be challenging to ensure that this is in fact the symptomatic infarct, because lacunes can occur in individuals without overt neurological symptoms, and some individuals have multiple lacunes41. It helps to know the clinical stroke phenotype in these cases to ensure that the infarct is located in a structure that fits the initial stroke symptoms. When there is doubt whether a lacune corresponds with the stroke symptoms, it is best to exclude the patient.
There are several considerations regarding accurate infarct identification that need to be taken into account. The first concerns reliability of the scans in detecting brain infarcts. In minor ischemic stroke patients with small infarcts, final infarct size on follow-up FLAIR is often smaller than the initial DWI lesion42. In large (cortical) infarcts, there is considerable evidence that the DWI lesion in the hyperacute stage (<24 h) accurately represents the infarct core (i.e., represents irreversible damage), even when DWI imaging is performed before the reperfusion therapy43,44. However, in some cases, the DWI lesion seen within 24 h is an underrepresentation of the final infarct size, because the penumbra (hypoperfused but potentially salvageable brain tissue) is not visible as a DWI lesion, but it may still progress to form part of the final infarct43 (particularly if reperfusion therapy is not performed in patients with large artery occlusions).
Another issue with using DWI within 24 h is that DWI lesions are to some extent dynamic and may show reversal after reperfusion therapy. However, follow-up scans showed that this reversal was transient and that the initial DWI lesion did accurately represent the infarct core. However, this does indicate that DWI performed several hours after reperfusion therapy might result in further underestimation of the final infarct size43. This potential underestimation of the final infarct size is an important limitation of using DWI performed within 24 h after stroke onset in lesion-symptom mapping studies. However, it should be noted that there are limitations to using other scan protocols as well. First of all, scans of any modality that are performed >24 h after the stroke can show mass effect due to swelling of the infarct in the acute stage, and ex vacuo enlargement of ventricles, sulcal widening, and displacement of surrounding structures in the chronic stage7. This displacement should be corrected by the registration algorithm and, if necessary, a manual correction should be performed by an expert reviewer. Still, both conditions can affect the accuracy of the translation of the infarcted region to standard space, even when rigorous quality checks are performed.
Of note, DWI in the hyperacute stage does not suffer from this limitation, since there is no significant mass effect within 24 h. In light of these scanner type-specific limitations, consideration of obtaining a homogeneous dataset should be made when designing a lesion-symptom mapping study, using a single scan type at a standardized timepoint. However, this will introduce a systematic bias in patient inclusion, as in most clinics, stroke patients that undergo MRI are different (i.e., often have smaller infarcts and less, more isolated symptoms) compared to patients that undergo CT. As such, systematically excluding patients with a specific imaging modality will limit the variability in lesion distribution, which in turn has a negative impact on the validity of the lesion-symptom mapping results45.
Finally, a limitation of all structural imaging modalities is that they do not capture the presence of decreased perfusion around the infarct, even though abnormal perfusion in brain regions that appear normal on structural imaging can interfere with brain function7,46. In summary, CT and several structural MRI sequences can be used to segment infarcts for the purpose of lesion-symptom mapping, as long as the proper time windows and criteria for lesion detection are followed, and the registration results are carefully checked. Taking into account scanner type-specific and time window-specific limitations is crucial when designing and interpreting lesion-symptom mapping studies.
An important issue in any lesion segmentation method is evaluating its reproducibility. Adequate training and knowledge of brain anatomy are crucial to distinguish lesions from normal anatomical structures and anatomical variants. Also, evaluation of inter- and intra-observer reproducibility prior to performing infarct segmentations for the purpose of lesion-symptom mapping is recommended. We have previously demonstrated high inter-observer agreement for the manual infarct segmentation protocol on CT scans in both the acute [mean Dice Similarity Coefficient (DSC) 0.77; SD 0.11] and chronic (DSC 0.76; SD 0.16) stages, as well as high intra-observer agreement (DSC 0.90, SD 0.05 in acute stage; DSC 0.89, SD 0.06 in chronic stage)16. The inter-observer agreement for infarct segmentation on DWI and FLAIR is also known to be high47.
The main limitation of the method described here is that manual segmentation, quality checks, and manual corrections are time-consuming. Fully automated infarct segmentation tools that can process both CT and MRI scans with varying scan protocols in a reliable manner are lacking7,47. Automated infarct segmentation tools that are optimized for specific scan protocols do provide promising results (e.g., for DWI where the contrast between infarcted and normal brain tissue is very high48), and further improvements are likely to be made in the near future. Semi-automated methods can reduce the time needed for segmenting infarcts but also require an expert to ensure accurate lesion classification47. This quality check is crucial, because even a few failed infarct segmentations may significantly reduce the validity of the lesion-symptom mapping results. Thus, manual infarct segmentation remains the gold standard7.
The second major step in processing brain imaging data for lesion-symptom mapping is the registration of the lesion maps to a brain template. RegLSM provides multiple validated registration schemes. For CT scans, histogram equalization is performed to improve soft-tissue contrast21, and an intermediate registration step to a CT template22 is performed to optimize the registration quality. For MRI scans, the scan on which the segmentation was performed is co-registered to the corresponding T1 sequence, if available, using linear registration. Subsequently, the native T1 is registered to an intermediate age-specific T1 template22 or directly to the target T1 template34 using linear and non-linear registration20. The intermediate templates, both CT and T1, have been aligned with the target T1 template using a linear and non-linear registration that was manually optimized and verified. When the intermediate template is used, this pre-computed transformation is appended as the final transformation step.
When no T1 is available, the scan on which the segmentation was performed (usually a FLAIR or DWI) can be registered directly to the target T1 template using a linear and non-linear registration20. For DWI images, a brain tissue mask is created using unified segmentation as implemented in SPM35, to guide the linear registration after which a non-linear registration completes the procedure. The registration schemes in RegLSM are highly customizable, and the commonly used MNI-152 T1 template and intermediate template can be replaced by any template that may provide a better match with the segmented scan. An interesting possibility would be the development of FLAIR and DWI brain templates that provide a better match with individual stroke patients. A limitation of the described registration method is that the registration fails in some cases, meaning a visual inspection of the registration results is required for all patients, followed by a manual correction in some cases. The number of cases that require a manual correction varies with stroke subtype. In our previous experience, manual corrections are needed in up to one-third of large brain infarcts49,50,51 but only 13% of patients with small lacunar infarcts4. The majority of failed registrations is caused by anatomical distortions due to the lesion (as discussed previously), which is particularly likely to happen in cases of large infarcts with either severe swelling or ex vacuo enlargement of surrounding structures. The manual correction of these misalignments is time-consuming but crucial before performing lesion-symptom mapping analyses. The number of cases that require manual correction is lower when studying white matter hyperintensities compared to infarcts, probably because these lesions do not cause significant anatomical distortion. In our recent lesion-symptom mapping study in patients with white matter hyperintensities, only 3% were of insufficient quality to proceed without manual correction6.
By default, RegLSM does not apply any form of lesion masking nor lesion filling, although the customizable nature of RegLSM allows users to enable it. The use of mutual information metric52 in the registration procedure avoids most of the issues previously raised with the presence of a lesion affecting the registration quality. Mutual information is well-suited for multi-modal registrations (e.g., FLAIR to T1) and is less affected by the presence of pathology than other metrics or cost-functions. Even for intra-modal registration (e.g., the subject T1 to the template T1), mutual information should be used to cope with the presence of pathology. Lesions will have their own cluster in the joint histogram that can be optimized without affecting registration quality. In some cases, lesion masking can even degrade the registration quality, since insufficient image information remains to guide the registration when the lesion volume is large.
As a general comment regarding the software used, including conversion from DICOM to nifti format, scan visualization, and annotation, it should be noted that many open-access tools exist. We did not provide a systematic overview of all the available tools, because this was beyond the scope of this article. Also, many institutions develop their own image visualization and annotation tools. Here, we chose to provide a comprehensive framework that covers the entire process of CT/MRI preprocessing, segmentation, and registration for the purpose of lesion-symptom mapping using several commonly used open-access tools. When using this method, the proposed image conversion, visualization, or annotation tools could be replaced by other available tools or by custom-made tools, if this better suits the data or is considered more convenient. Also, the image processing pipeline can be further customized by implementing available (semi-)automated infarct segmented tools, if this fits the study design of a particular lesion-symptom mapping study. This paper focuses on processing scans of patients with ischemic stroke, but the framework can be used for processing other lesion types as well (e.g., white matter hyperintensities or lacunes) by replacing the lesion segmentation procedure (section 3 of the protocol) with another appropriate segmentation procedure.
An important issue in lesion-symptom mapping is how to deal with co-occurring pathologies. For example, when performing a study in patients with acute ischemic stroke, there may be a substantial amount of co-occurring white matter hyperintensities or even previous infarcts. When studying white matter hyperintensities, some patients may also have (silent or clinically overt) brain infarcts. Co-occurring pathologies on brain imaging can have an independent contribution to cognitive impairment and should ideally be taken into account. A straightforward way of dealing with this issue is to exclude patients with co-occurring pathologies [e.g., exclude patients with (large) brain infarcts when focusing on white matter hyperintensities], but this has the disadvantage of limiting the generalizability of the findings to patients with a single type of pathology.
An alternative approach that is often used is regressing out the effects of co-occurring pathologies (e.g., adjust for white matter hyperintensity volume or the presence of brain infarcts) on the outcome variable prior to or during the lesion-symptom mapping analysis. However, a limitation of this approach is that the location of these co-occurring pathologies is not taken into account, even though this is known to be relevant for infarcts and white matter hyperintensities2, and likely for other lesion types. Therefore, on theoretical grounds, the best approach is to perform an integrated lesion-symptom mapping analysis in which the VLSM results are corrected for the location of co-occurring pathologies at the voxel-level. In a recent study, a multivariate support vector regression-based method was used to perform integrated voxel-wise lesion-symptom mapping on multiple lesion types and identified brain regions where white matter hyperintensities are associated with cognitive decline after stroke, independent of acute infarct location53. This study shows how an integrated voxel-wise analysis of multiple lesion types can provide new insights into the complex interaction between different lesion types in the development of cognitive impairment and dementia53.
In summary, the image processing pipeline provided here serves as a standardized method of brain lesion segmentation and registration for the purpose of lesion-symptom mapping. The strengths of this method are the (1) reliability of the segmentation and registration method, which comes at the cost of rigorous quality checks, and in some cases corrections by a trained rater, (2) customizability of the registration pipeline in which the registration scheme and templates can be adjusted to fit the data in the best possible way, and (3) possibility to process highly heterogeneous brain imaging data, including CT and structural MRI sequences. Future challenges include the development of robust, automated lesion segmentation tools for CT and MRI, further improvements of the registration methods, and development of brain templates that provide a better match with individual stroke patients, including DWI and FLAIR templates. These improvements may further increase the reproducibility of lesion segmentation and reduce the time spent on performing visual checks and manual corrections.
The authors have nothing to disclose.
The work of Dr. Biesbroek is supported by a Young Talent Fellowship from the Brain Center Rudolf Magnus of the University Medical Center Utrecht. This work and the Meta VCI Map consortium are supported by Vici Grant 918.16.616 from ZonMw, The Netherlands, Organisation for Health Research and Development, to Geert Jan Biessels. The authors would like to thank Dr. Tanja C.W. Nijboer for sharing scans that were used in one of the figures.
dcm2niix | N/A | N/A | free download https://github.com/rordenlab/dcm2niix |
ITK-SNAP | N/A | N/A | free download www.itksnap.org |
MATLAB | MathWorks | N/A | Version 2015a or higher |
MRIcron | N/A | N/A | free download https://www.nitrc.org/projects/mricron |
RegLSM | N/A | N/A | free download www.metavcimap.org/support/software-tools |
SPM12b | N/A | N/A | free download https://www.fil.ion.ucl.ac.uk/spm/ |