In this paper, we present a protocol to investigate differential cortical visual evoked potential morphological patterns through stimulation of ventral and dorsal networks using high-density EEG. Visual object and motion stimulus paradigms, with and without temporal jitter, are described. Visual evoked potential morphological analyses are also outlined.
This paper presents a methodology for the recording and analysis of cortical visual evoked potentials (CVEPs) in response to various visual stimuli using 128-channel high-density electroencephalography (EEG). The specific aim of the described stimuli and analyses is to examine whether it is feasible to replicate previously reported CVEP morphological patterns elicited by an apparent motion stimulus, designed to simultaneously stimulate both ventral and dorsal central visual networks, using object and motion stimuli designed to separately stimulate ventral and dorsal visual cortical networks. Four visual paradigms are presented: 1. Randomized visual objects with consistent temporal presentation. 2. Randomized visual objects with inconsistent temporal presentation (or jitter). 3. Visual motion via a radial field of coherent central dot motion without jitter. 4. Visual motion via a radial field of coherent central dot motion with jitter. These four paradigms are presented in a pseudo-randomized order for each participant. Jitter is introduced in order to view how possible anticipatory-related effects may affect the morphology of the object-onset and motion-onset CVEP response. EEG data analyses are described in detail, including steps of data exportation from and importation to signal processing platforms, bad channel identification and removal, artifact rejection, averaging, and categorization of average CVEP morphological pattern type based upon latency ranges of component peaks. Representative data show that the methodological approach is indeed sensitive in eliciting differential object-onset and motion-onset CVEP morphological patterns and may, therefore, be useful in addressing the larger research aim. Given the high temporal resolution of EEG and the possible application of high-density EEG in source localization analyses, this protocol is ideal for the investigation of distinct CVEP morphological patterns and the underlying neural mechanisms which generate these differential responses.
Electroencephalography (EEG) is a tool that offers an inexpensive and non-invasive approach to the study of cortical processing, especially when compared to cortical assessment methods such as functional magnetic resonance imaging (fMRI), positron emission tomography (PET), and diffusion tensor imaging (DTI)1. EEG also provides high temporal resolution, which is not possible to attain when using measures such as fMRI, PET, or DTI2. High temporal resolution is critical when examining central temporal function in order to obtain millisecond-precision of neurophysiologic mechanisms related to the processing of specific input or events. In the central visual system, cortical visual evoked potentials (CVEPs) are a popular approach in studying time-locked neural processes in the cerebral cortex. CVEP responses are recorded and averaged over a number of event trials, resulting in peak components (e.g., P1, N1, P2) arising at specific millisecond intervals. The timing and amplitude of these peak neural responses can provide information concerning cortical processing speed and maturation, as well as deficits in cortical function3,4,5.
CVEPs are specific to the type of visual input presented to the viewer. Using certain stimuli in a CVEP paradigm, it is possible to observe the function of distinct visual networks such as the ventral stream, involved in processing form and color, or parvocellular and magnocellular input6,7,8, and the dorsal stream, which largely processes motion or magnocellular input9,10. CVEPs generated by these networks have been useful not only in better understanding typical neurophysiologic mechanisms underlying behavior but also in the targeted treatment of atypical behaviors in clinical populations. For example, delayed CVEP components in both dorsal and ventral networks have been reported in children with dyslexia, which suggests that visual function in both these networks should be targeted when designing an intervention plan11. Thus, CVEPs recorded via EEG offer a powerful clinical tool through which to assess both typical and atypical visual processes.
In a recent study, high-density EEG was used to measure the apparent motion-onset CVEPs in typically developing children, with the goal of examining variable CVEP responses and related visual cortical generators across development. Participants passively viewed apparent motion stimuli12,13,14,15, which consisted of both shape change and motion, designed to simultaneously stimulate dorsal and ventral streams. It was found that approximately half of the children responded with a CVEP waveform shape, or morphology, consisting of three peaks (P1-N1-P2, pattern A). This morphology is a classic CVEP response observed throughout the literature. In contrast, the other half of the children presented with a morphological pattern comprised of five peaks (P1-N1a-P2a-N1b-P2b, pattern B). To our knowledge, the robust occurrence and comparison of these morphological patterns have not previously been discussed in CVEP literature in either child or adult populations, although variable morphology has been noted in both apparent-motion and motion-onset CVEPs14,16. Furthermore, these morphological differences would not have been apparent in research using other cortical functional assessment methods, such as fMRI or PET, due to the low temporal resolution of these measures.
To determine the cortical generators of each peak in CVEP patterns A and B, source localization analyses were performed, which is a statistical approach used to estimate the most likely cortical regions involved in the CVEP response12,13. For each peak, regardless of the morphological pattern, primary and higher-order visual cortices were identified as sources of the CVEP signal. Thus, it appears that the main difference underlying CVEP morphology elicited by apparent motion is that those with pattern B activate visual cortical regions additional times during processing. Because these types of patterns have not been previously identified in the literature, the purpose of the additional visual processing in those with CVEP pattern B remains unclear. Therefore, the next aim in this line of research is to gain a better understanding of the cause of the differential CVEP morphology and whether such patterns may relate to visual behavior in both typical and clinical populations.
The first step in understanding why some individuals might demonstrate one CVEP morphology versus another is to determine whether these responses are intrinsic or extrinsic in nature. In other words, if an individual demonstrates one pattern in response to a visual stimulus, will they respond with a similar pattern to all stimuli? Or is this response stimulus-dependent, specific to the visual network or networks activated?
To answer this question, two passive visual paradigms were designed, intended to separately activate specific visual networks. The stimulus presented in the initial study was designed to stimulate both dorsal and ventral streams simultaneously; thus, it was unknown if one or both networks were involved in generating specific waveform morphology. In the current methodological approach, the paradigm designed to stimulate the ventral stream is composed of highly identifiable objects in basic shapes of squares and circles, eliciting object-onset CVEPs. The paradigm designed to stimulate the dorsal stream consists of visual motion via a radial field of coherent central dot motion dots at a fixed speed toward a fixation point, eliciting motion-onset CVEPs.
A second question that arose as a result of the initial study was whether differential VEP morphology could be due to participant anticipation of upcoming stimuli13. For instance, research has shown that top-down cortical oscillatory activity occurring prior to a target stimulus may predict subsequent CVEP and behavioral responses to some degree17,18,19. The apparent motion paradigm in the first study employed non-randomized frames of a radial star and circle with consistent inter-stimulus intervals (ISIs) of 600 ms. This design may have encouraged the expectation and prediction of the upcoming stimulus, with resulting oscillatory activity affecting subsequent CVEP morphology12,13,19.
To address this issue, the visual object and motion paradigms in the current protocol are designed with both consistent ISIs of the same temporal value and randomized ISIs with different temporal values (i.e., jitter). Using this approach, it may be possible to determine how temporal variation can affect VEP morphology within distinct visual networks. Altogether, the aim of the described protocol is to determine if the visual object and motion stimuli would be sensitive to variations in CVEP morphology and whether the temporal variation of stimuli presentation would affect characteristics of the CVEP response, including peak latency, amplitude, and morphology. For the purpose of the current paper, the goal is to determine the feasibility of the methodological approach. It is hypothesized that both visual objects and motion may elicit variable morphology (i.e., patterns A and B will be observed across subjects in response to both stimuli) and that temporal variation would affect object-onset and motion-onset CVEP components.
All methods described here have been approved by the Institutional Review Board (IRB) for Human Research at the University of Texas at Austin.
1. Stimuli Characteristics
2. Visual Paradigm Design
3. Participant Consent, Case History, and Vision Screening
4. EEG Preparation
5. EEG Recording
6. EEG Analyses
Figure 3 and Figure 4 show the representative object-onset and motion-onset CVEP results of five participants, aged 19-24 years, who passively viewed each visual paradigm. This design allowed observation of CVEP responses elicited by visual objects (with and without jitter) and visual motion (with and without jitter) both within and across subjects according to each condition. Participant CVEPs were grouped according to the morphological pattern elicited by visual stimuli and grand-averaged to create an average CVEP pattern. In the objects with no temporal jitter condition (Figure 3), two participants were found to present with pattern A, while three presented with pattern B (Figure 3A). Similarly, in the objects with temporal jitter condition (Figure 3B), two subjects presented with pattern A and three with pattern B. Interestingly, two subjects presented with a different pattern as a result of the jitter paradigm (i.e., one subject presenting with pattern A in the no jitter condition presented with pattern B in the jitter condition, and one subject presenting with pattern B in the no jitter condition presented with pattern A in the jitter condition). It may also be observed that jitter affects amplitude and latency in each object-onset CVEP pattern (Figure 3C,D).
For the motion condition (Figure 4), two subjects demonstrated pattern A morphology and three subjects presented with pattern B. However, in contrast to the object-onset CVEPs, motion-onset CVEP morphological patterns for each participant were consistent across jitter condition. Furthermore, the pattern B group average shows no clear evidence of the multiple peak components typically present. This lack of differential morphology occurred in both motion paradigms without and with temporal jitter (Figure 4A,B). Similar to the object’s paradigm, jitter in the motion paradigm appears to affect motion-onset CVEP characteristics in both morphological patterns (Figure 4C,D).
Figure 1: Example of Visual Object Stimuli Paradigms Without and With Temporal Jitter. (A) Without temporal jitter: A fixation cross is presented for 500 ms, followed by a randomized presentation of one of four objects from the BOSS database (button, book, ball, brick). Each object presentation is 600 ms in duration. (B) With temporal jitter: A fixation cross is presented for 500 or 1,000 ms, values which are randomized across trials, and then one of four objects from the BOSS database (button, book, ball, brick). Each object is presented for randomized values of 600 or 1000 ms. Please click here to view a larger version of this figure.
Figure 2: Example of Visual Motion Stimuli Paradigms Without and With Temporal Jitter. (A) Without temporal jitter: A fixation cross is presented for 500 ms, followed by a visual motion movie of a radial field of dots moving inward toward a central fixation point (denoted by white arrows) for 1,000 ms. (B) With temporal jitter: A fixation cross is presented for 500, 750, or 1,000 ms, values which are randomized across trials. A visual motion movie is then presented for either 600 or 1,000 ms, values which are randomized across trials. Please click here to view a larger version of this figure.
Figure 3. Representative Object-onset CVEP Data Without and With Temporal Jitter. (A) Pattern A morphology (i.e., a P1-N1-P2 response) was observed in two participants (solid black line) in response to the object paradigm without jitter. Pattern B morphology (i.e., a P1-N1a-P2a-N1b-P2b response) was observed in 3 participants (dashed red line) in response to the object paradigm without jitter. Amplitude in microvolts is depicted on the vertical axis and time in milliseconds on the horizontal axis. (B) Pattern A morphology was found in two participants (solid black line) elicited by the object paradigm with jitter. Pattern B morphology was found in 3 participants (red dashed line) elicited by the object paradigm with jitter. (C) Pattern A morphology comparison in the same three participants in response to the object paradigm without jitter (solid black line) and the object paradigm with jitter (red dashed line). (D) Pattern B morphology comparison in the same two participants as elicited by the object paradigm without jitter (solid black line) and the object paradigm with jitter (red dashed line). Please click here to view a larger version of this figure.
Figure 4. Representative Motion-onset CVEP Data Without and With Temporal Jitter. (A) Pattern A morphology (i.e., a P1-N1-P2 response) was observed in two participants (solid black line) in response to the motion paradigm without jitter. Pattern B morphology (i.e., a P1-N1a-P2a-N1b-P2b response) was observed individually in 3 participants (dashed red line) in response to the motion paradigm without jitter. Note, however, the typical pattern B morphology is not observed in the CVEP group grand average. Amplitude in microvolts is depicted on the vertical axis and time in milliseconds on the horizontal axis. (B) Pattern A morphology was found in two participants (solid black line) elicited by the motion paradigm with jitter. Pattern B morphology was found individually in 3 participants (red dashed line) elicited by the motion paradigm with jitter. Again, the pattern B morphology is not apparent in the CVEP grand average. (C) Pattern A morphology comparison in the same three participants in response to the motion paradigm without jitter (solid black line) and the motion paradigm with jitter (red dashed line). (D) Pattern B morphology comparison in the same two participants as elicited by the motion paradigm without jitter (solid black line) and the motion paradigm with jitter (red dashed line). Please click here to view a larger version of this figure.
Supplementary File: Please click here to download this file.
The goal of this methodological report was to evaluate the feasibility in recording differential CVEP morphology by using visual object and motion stimuli specifically designed to separately stimulate ventral and dorsal streams in passive viewing tasks6,7,8, both with and without variation of ISIs (jitter)19. Conditions were not designed to be directly compared, rather, observations were made as to whether variable CVEP morphology was present in either condition, and whether temporal jitter within that condition affected morphology. Object-onset and motion-onset CVEP responses were recorded and time-locked to the onset of visual object and motion stimuli, presented in four paradigms, via 128-channel high-density EEG. Five young adults participated in passive viewing of each visual paradigm, and resulting CVEP responses were visually categorized, subjectively, according to CVEP pattern A (P1-N1-P2) morphology and CVEP pattern B (P1-N1a-P2a-N1b-P2b) morphology, a method used in previous research upon which this approach is based12,13.
Representative data suggest that the described visual stimuli are sensitive to differential CVEP morphology. In addition, jitter appears to affect specific characteristics of the CVEP response, such as latency and amplitude, rather than the overall morphology of the waveform. No further conclusions may be drawn due to the small sample size and lack of statistical comparisons. Therefore, these data show that the experimental design may be useful in the study of variable CVEP morphology and associated visual behavior. Future research is planned to focus on significantly enlarging the number of participants to verify whether CVEP patterns elicited by a variety of stimuli are an intrinsic or extrinsic phenomenon and whether certain visual cortical networks may be more involved than others in generating specific morphology. Future studies will also include temporal variation in visual paradigms for further assessment of possible anticipatory effects on CVEP responses, including greater variability in jitter values, as the limited jitter intervals included in the current approach may not completely eliminate predictability. Finally, source localization analyses on CVEP peak components will be performed for qualitative information on visual cortical networks involved in the generation CVEP morphological patterns, including verification that the presented stimuli activate the intended visual networks.
Although the methods described show an effective approach to the investigation of object-onset and motion-onset CVEP morphology, critical steps should be noted. For instance, in visual stimuli creation, it is important that factors such as luminance be consistent and controlled for, as these lower-order changes may affect CVEP characteristics22. In EEG preparation, it is imperative that close attention is paid to electrode impedance values. The high-density EEG system used in the current study is a high-impedance system, meaning that EEG activity can be successfully recorded with electrode impedance values of up to 50 kΩ. However, in our laboratory, we aim to maintain these values under 20 kΩ, and ideally around 10 kΩ. Lower impedance values greatly affect the overall quality of the recording and result in faster analyses and a higher number of accepted trials. In addition, it is important to monitor the subject state, especially as these paradigms are passive in nature. It can be a challenge for some participants to remain alert, resulting in alpha oscillations and ocular artifact that can contaminate the recording. In EEG analyses, it is critical to remove bad electrode channels prior to artifact rejection to ensure that the maximum number of trials are accepted into the average. The greater the number of trials, the better the signal-to-noise ratio of the CVEP response. Furthermore, a large number of trials are necessary for source localization analyses. In our laboratory, a minimum of 100 accepted trials is typical for visual studies12,13,22. The EEG analysis method described in this study may also be modified according to the researcher’s discretion. There are many approaches to successful EEG analysis, and the one provided has been developed in our laboratory. Other approaches that may be useful can be reviewed through various tutorials provided by the creators of the EEGLAB toolbox.
While EEG methodology does have limitations, specifically in spatial resolution for imaging purposes2, the benefits of a low cost, non-invasive approach, and high temporal resolution make this an ideal tool for the investigation of CVEP morphological patterns. For example, the latency and amplitude of the specific peak components which constitute the CVEP waveform would not be identifiable using a different approach, except possibly with magnetoencephalography (MEG). Furthermore, source localization analyses, which are possible with high-density EEG recordings, have advanced to such a level that estimation of cortical generator location has been accepted in a multitude of studies12,13,23,24,25,26. If spatial localization remains a concern for the researcher, a multi-modal approach may be used to combine the temporal resolution of EEG with the spatial resolution of other measures, such as fMRI27. It is important that a large amount of trials is collected in each paradigm for future source localization analyses, which requires a high EEG signal-to-noise ratio for accurate estimation of cortical generators12,13,23.
Overall, the described protocol is useful and effective for the observation and study of CVEP morphological patterns. Similar methodologies have been presented in the literature14,15,28,29, but have not focused on the categorization of group participant responses according to morphology, as described in the EEG analyses section. Future research may benefit from examining CVEP morphology more closely, as distinct visual processes have been shown to underlie specific patterns12,13. While additional work is necessary to clarify whether CVEP morphology elicited by various stimuli and underlying visual function are related to visual behavior, the experimental paradigms and EEG analyses discussed in this pilot study provide an initial point from which to better understand basic visual cortical processes.
The authors have nothing to disclose.
This research was supported by the University of Texas at Austin Moody College of Communication Grant Preparation Award and the University of Texas at Austin Office of the Vice President of Research Special Research Grant.
E-Prime 2.0 | Psychology Software Tools, Inc | Used in data acquisition | |
Net Amps 400 | Electrical Geodesics, Inc | Used in data acquisition | |
Net Station Acquisition V5.2.0.2 | Electrical Geodesics, Inc | Used in data acqusition | |
iMac (27-inch) | Apple | Used in data acquisition | |
Optiplex 7020 Computer | Dell | Stimulus computer | |
HydroCel GSN EEG net | Electrical Geodesics, Inc | Used in data acqusition | |
1 ml pipette | Electrical Geodesics, Inc | Used to lower impedances | |
Johnson's Baby Shampoo | Johnson & Johnson | Used in impedance solution | |
Potassium Chloride (dry) | Electrical Geodesics, Inc | Used in impedance solution | |
Control III Disinfectant Germicide | Control III | Used in disinfectant solution | |
32-inch LCD monitor | Vizio | Used to present stimuli | |
Matlab (R2016b) | MathWorks | Used in data analysis | |
EEGlab v14.1.2 | Swartz Center for Computational Neuroscience, University of California, San Diego | https://sccn.ucsd.edu/eeglab/index.php | Used in data analysis |
BOSS Database | Bank of Standardized Stimuli | https://sites.google.com/site/bosstimuli/ | Used in generation of visual object stimuli |
Psychtoolbox-3 | Psychophysics Toolbox Version 3 (PTB-3) | http://psychtoolbox.org/ | Used in generation of visual motion stimuli |