The study of cognitive planning combining EEG and eye-tracking systems provides a multimodal approach to investigate the neural mechanisms that mediate cognitive control and goal-directed behavior in humans. Here, we describe a protocol for investigating the role of brain oscillations and eye movements in planning performance.
The planning process, characterized by the capability to formulate an organized plan to reach a goal, is essential for human goal-directed behavior. Since planning is compromised in several neuropsychiatric disorders, the implementation of proper clinical and experimental tests to examine planning is critical. Due to the nature of the deployment of planning, in which several cognitive domains participate, the assessment of planning and the design of behavioral paradigms coupled with neuroimaging methods are current challenges in cognitive neuroscience. A planning task was evaluated in combination with an electroencephalogram (EEG) system and eye movement recordings in 27 healthy adult participants. Planning can be separated into two stages: a mental planning stage in which a sequence of steps is internally represented and an execution stage in which motor action is used to achieve a previously planned goal. Our protocol included a planning task and a control task. The planning task involved solving 36 maze trials, each representing a zoo map. The task had four periods: i) planning, where the subjects were instructed to plan a path to visit the locations of four animals according to a set of rules; ii) maintenance, where the subjects had to retain the planned path in their working memory; iii) execution, where the subjects used eye movements to trace the previously planned path as indicated by the eye-tracker system; and iv) response, where the subjects reported the order of the visited animals. The control task had a similar structure, but the cognitive planning component was removed by modifying the task goal. The spatial and temporal patterns of the EEG revealed that planning induces a gradual and lasting rise in frontal-midline theta activity (FMθ) over time. The source of this activity was identified within the prefrontal cortex by source analyses. Our results suggested that the experimental paradigm combining EEG and eye-tracker systems was optimal for evaluating cognitive planning.
During the past 10 years, extensive research has been conducted to examine the role of oscillatory neural dynamics on both cognition and behavior. These studies have established that frequency-specific interactions between specialized and widespread cortical regions play a crucial role in cognition and cognitive control1,2,3. This approach highlights the rhythmic nature of brain activity, which helps coordinate large-scale cortical dynamics and underpins cognitive processing and goal-directed behavior4,5. There is substantial evidence showing that rhythmic oscillations in the brain are involved in various cognitive processes, including perception6, attentio7,8,9, decision-making10, memory reactivation11, working memory12, and cognitive control13. Different oscillatory mechanisms have been proposed to guide goal-directed behavior, with transient large-scale frequency-specific networks providing a framework for cognitive processing1,14,15. For example, recent findings suggest that specific frequency bands in the brain may reflect a feedback mechanism that regulates spiking activity, providing a temporal reference frame to coordinate cortical excitability and spike timing for producing behavior16,17,18. A review is provided by Helfrich and Knight19.
This body of evidence raises questions about how the prefrontal cortex (PFC) encodes planning task contexts and related behaviorally relevant rules. The PFC has long been thought to support cognitive control and goal-directed behavior through the oscillatory patterns of neural activity it generates, selectively biasing the neural activity in distant brain regions and controlling the flow of information in large-scale neural networks20. Additionally, it has been proposed that regions exhibiting local synchrony are more likely to participate in inter-regional activity21,22,23. In particular, cortical theta-band (4-8 Hz) oscillations, as measured by scalp electroencephalogram (EEG), have been proposed as a potential mechanism for transmitting top-down control across broad networks13. Specifically, theta-band activity in humans reflects high-level cognitive processes, such as memory encoding and retrieval, working memory retention, novelty detection, decision-making, and top-down control12,24,25,26.
Related to this, Cavanagh and Frank13 proposed two sequential mechanisms of control processes: the recognition of the need for control and the instantiation of control. The recognition of the need for control may be indicated by frontal midline theta (FMθ) activity originating from the medial prefrontal cortex (mPFC), which has been described in terms of event-related potential (ERP) components that reflect mPFC-related control processes in response to various situations, such as novel information27,28,29, conflicting stimulus-response requirements30, error feedback31, and error detection32. These ERP components, which reflect the need for increased cognitive control in the presence of novelty, conflict, punishment, or error, exhibit a common spectral signature in the theta band recorded at frontal midline electrodes26,27,33,34,35,36,37,38,39,40,41,42,43,44.
The EEG responses of FMθ activity display a pattern of phase reset and power enhancement in the theta frequency band26. Despite the limitations of the EEG method in terms of its spatial resolution, various sources of evidence have been collected to demonstrate that FMθ activity is generated by the mid-cingulate cortex (MCC)13. These theta dynamics are believed to serve as temporal frameworks that regulate the neuronal processes of the mPFC, which are subsequently augmented in response to events requiring heightened control26. This has been established through source analysis31,33,45,46,47, concurrent EEG and functional magnetic resonance imaging (fMRI) recordings48,49, and invasive EEG recordings in humans50 and monkeys51,52,53.
Based on these observations, the frontal midline theta is considered to serve as a universal mechanism, a common language, for executing adaptive control in different situations where there is a lack of certainty regarding the actions and outcomes, such as during planning. The behavioral paradigm that we propose in this protocol has been used to study cognitive planning and its temporal and neural characteristics. Although various mechanisms for cognitive control have been reported in other scenarios, the current protocol has allowed for the recent description of planning and its associated neural and temporal properties54. The cognitive process of planning comprises two distinct phases: the mental planning phase, during which an internal representation of a sequence of plans is developed55, and the planning execution phase, in which a set of motor actions are executed to achieve the previously planned goal56. Planning is known to require the integration of various components of executive functions, including working memory, attentional control, and response inhibition, making the experimental manipulation and isolated measurement of these processes challenging57,58.
Neuroimaging studies on cognitive planning have commonly used behavioral paradigms such as the Tower of London59,60,61; however, in order to control the confounding factors, the tasks used for studying cognitive planning can become limited and artificial, leading to less predictive and ecological validity62,63,64,65. To overcome this problem in the neuropsychology field, real-world planning situations have been proposed as ecological tasks62,63. The Zoo Map Task subtest in the Behavioral Assessment of the Dysexecutive Syndrome battery measures planning and organizational skills in a more natural and relevant manner64,66. This test is a pencil-and-paper test that involves planning a route to visit 6 out of 12 locations on a zoo map. The locations are common places that can be found in a regular zoo, such as an elephant house, lion cage, rest area, coffee shop, etc. There are two conditions that evaluate different levels of planning: i) the formulation condition, where the subjects are instructed to plan a route to visit six places in the order of their choice but according to a set of rules; and ii) the execution condition, where the subjects are instructed to visit six places in a specific order and following a set of rules as well. These two conditions provide information about planning skills in ill-structured (formulation) and well-structured (execution) problems67. The first is presented as a more demanding cognitive task in an open situation because it requires subjects to develop a logical strategy to achieve the goal. Before tracing a path, a sequence of operators must be devised; otherwise, errors are likely to occur. On the other hand, the execution condition requires a lower cognitive demand because solving a task involving following a specific imposed strategy only requires the subject to monitor the implementation of the formulated plan to achieve the goal66. On the other hand, the Porteus Maze is a well-known task in the field of psychology, particularly in the areas of cognitive psychology and neuropsychology, and it has been widely used as a tool to assess various aspects of cognition, such as problem-solving and planning68,69. The Porteus Maze task is a pencil-and-paper task that starts with a simple visual stimuli analysis and becomes increasingly difficult. The subject must find and trace the correct path from a starting point to an exit (among several options) while following rules, such as avoiding intersecting paths and dead ends, and acting as quickly as possible68. Each time a fork appears while drawing the path, the subjects make decisions to reach the goal and avoid breaking the given rules69.
Considering the limitations and strengths of the commonly used and ecological tasks, we designed our behavioral paradigm mainly based on the Zoo Map Task66 and the Porteus Maze Task68. The behavioral paradigm consists of four distinct stages that encompass the cognitive process of planning in a daily life scenario. These stages are as follows: Stage 1, planning, where the participants are tasked with creating a route to visit various locations on a map, ensuring adherence to the established rules; Stage 2, maintenance, where the participants are required to keep the planned route in their working memory; Stage 3, execution, where the participants execute their previously planned route by drawing and closely monitoring its accuracy; and Stage 4, response, where the participants report the sequence of animals visited according to their planned route54. Our paradigm enables the measurement of different parameters of planning ability using different stages, which reflect the various components of planning (such as working memory, executive attention, and visuospatial skills) in a more realistic manner since mapping out routes is a common occurrence in daily life. Additionally, to control for confounding factors, the paradigm includes a control task with a planning task structure and equivalent stimuli, which engages the executive cognitive components also involved in planning but excludes the planning process component. This allows for the separation of the planning process component for the comparison of both electrophysiological markers and behavioral parameters54.
Furthermore, eye-tracking has made significant contributions to cognitive neuroscience studies by providing a non-invasive method for measuring and analyzing eye movements, which can provide valuable insights into the cognitive processes and neural mechanisms underlying perception, attention, and cognitive functions. Measuring different types of eye movements with an eye-tracking system can provide valuable information about the cognitive processes and neural mechanisms involved in planning. For example, the following aspects can be measured: fixations, which are the periods of stable gaze during which visual information is acquired70; saccades, which are the rapid eye movements that are used to shift the gaze from one location to another71; smooth pursuit, which is a type of eye movement that allows the eyes to follow a moving object smoothly72; microsaccades, which are small, rapid eye movements that occur even during fixations73; and blinks, which are a reflex action that helps to keep the eyes lubricated and protect them from foreign objects74. These eye movements can provide insights into the cognitive processes involved in visual search, attention allocation70, visual tracking72, perception73, and working memory74, which are important components for planning and cognitive control.
On the other hand, recent studies on the locus coeruleus-norepinephrine (LC-NE) system have shown its relevant role in cognitive control75. The locus coeruleus (LC) projects to several brain regions, such as the cerebral cortex, hippocampus, thalamus, midbrain, brainstem, cerebellum, and spinal cord76,77,61. Particularly dense LC-NE innervations receive PFC brain areas associated with cognitive control75. Besides, some studies indicate that chronic hyperactivity of the LC system may contribute to symptoms of manic-depressive disorder, such as impulsivity and sleeplessness. In contrast, a chronic decrease in LC function has been linked to reduced emotional expression, a prevalent characteristic among patients suffering from depression78. An overactive response of the locus coeruleus to stimuli may lead to an excessive response in individuals with stress or anxiety disorders79. Therefore, alterations in the LC-NE system may contribute to the symptoms of cognitive and/or emotional dysregulation. Non-invasive techniques can be used to examine locus coeruleus activity, one of which is pupil diameter changes, which are mostly controlled by noradrenaline released from the locus coeruleus. Noradrenaline acts on the iris dilator muscle by stimulating the alpha-adrenoceptors and on the Edinger-Westphal nucleus, which sends signals to the ciliary ganglion and controls iris dilation through the activation of postsynaptic alpha-2 adrenoceptors66,80,81,82. Direct LC neuronal recordings from monkeys have confirmed the relationship between LC-NE activity, pupil diameter, and cognitive performance83. Pupil dilation has been repeatedly observed in response to enhanced processing demands in several cognitive tasks71,84,85,86,87.
Electrophysiological markers of cognitive control combined with eye tracking and pupillary recordings might disentangle crucial questions about how cognitive control and planning are implemented in the brain. The importance of using our protocol combining EEG and eye-tracker systems is two-fold. On the one hand, cognitive control seems to require the participation of distributed brain activity in precise temporal relationships, which constitute ideal candidates for studying brain network function. On the other hand, abnormalities in any of these capacities have a severe impact on normal behavior, as might be in the case of a variety of cognitive and neuropsychiatric disorders, such as attention-deficit/hyperactivity disorder88,89, major depressive disorder90,91, bipolar disorder91, schizophrenia92, frontotemporal dementia93, as well as disorders due to frontal lesions94. Additionally, the current protocol allows for using pupillometry as a parameter to compare LC-NE activity and oscillations using eye-tracking and electroencephalography. This might not only provide evidence for the theoretical relationship between LC-NE, pupillometry, and neural markers in humans but could also permit the tracking of the developmental trajectory of characteristics related to the LC-NE system during cognitive planning. However, in our model, we focused on testing whether there was a specific pattern of saccades during planning that could potentially result in specific oscillation changes95. Additionally, we used an eye-tracker system as an important part of examining the behavioral execution of a plan in the execution phase of our behavioral paradigm.
To sum up, this protocol might produce testable models of brain network dynamics that could serve as a platform for both further basic research and eventual clinical and therapeutic applications.
All procedures in this protocol were approved by the bioethics committee of the Faculty of Medicine of Pontificia Universidad Católica de Chile, and all participants signed an informed consent form before the beginning of the study (research project number: 16-251).
1. Participant recruitment
2. Stimuli preparation
Figure 1: Stimuli of the experimental and control task. Illustrative examples of the (A) planning and the (B) control task stimuli are shown. The stimuli represent a zoo map consisting of a gate, four animal locations in different places, and several paths. The stimuli for both conditions were similar; the only difference was that for the control task, (B) the stimuli had a marked line indicating an already existing path (black line here for illustrative purposes). This line in the real control stimuli was slightly darker, with low contrast controlled by illuminance (see step 2.4). This figure has been modified from Domic-Siede et al.54. Please click here to view a larger version of this figure.
Figure 2: Experimental design. (A) Planning task trial. Trials in this condition started with a 3 s fixation cross. Then, the participants were instructed to plan a path to visit all the four animal locations following a set of rules (10 s maximum). Next, a shifted fixation cross appeared (3 s), followed by the appearance of the maze again. In this period (execution), the subjects had to execute the trace planned in the previous planning period using their gaze with online visual feedback (given by the eye-tracker system), which delineated their gaze movement in real-time (dark line) (10 s maximum). Afterward, in the response period, the subjects had to report the sequence made during the execution by ordering the animals visited. According to their responses, feedback was delivered. (B) Control task trial. Trials in this condition started with a 3 s fixation cross. Then, the participants were instructed to evaluate whether a traced path (dark line) followed the rules or not. Next, a shifted fixation cross appeared (3 s), followed by the appearance of the maze again. In this period, the subjects had to redraw the already traced path with online visual feedback, like in the planning execution period (10 s maximum). Afterward, in the response period, the subjects had to answer (yes or no) whether the traced sequence followed the previously stated rules According to their responses, feedback was delivered. This figure has been modified from Domic-Siede et al.54. Please click here to view a larger version of this figure.
3. Planning and control task programming
Figure 3: Example of a laboratory setup. Schematic representation of a laboratory setup showing three interconnected computers. The host computer (eye-tracker computer) is responsible for tracking and storing the eye movement data. The EEG computer acquires and stores the EEG signals. The display computer controls the behavioral experiment, presents the stimuli to the subjects, and sends event triggers to the host and EEG computers through parallel ports and LAN connections to synchronize the data collection. Please click here to view a larger version of this figure.
Figure 4: Path reconstruction from visual online feedback given by the eye-tracker system. Illustrative examples of a path reconstruction from the motor execution of a plan (A, in purple, planning execution period) and a control execution period (B, line in green) and with eye-tracker data. The path reconstructed in the planning execution period is used to evaluate the accuracy of each planning task trial. Please click here to view a larger version of this figure.
4. Laboratory setting and equipment
5. Electroencephalography and eye-tracking recording sessions
6. Data analyses
In the present protocol, the RT of the planning period was compared to the RTs of the control period and the planning execution period. The planning RT was greater than the control and the planning execution period RTs. Additionally, compared to the control condition, participants made more mistakes and had lower accuracy during the planning period (Figure 5).
Figure 5: Reaction time and accuracy for the planning task. Comparison between the (A) reaction times in the planning period (purple circles) and the control period (green circles) using a matched-paired t-test. (B) Comparison between the reaction times in the planning period (purple circles) and the planning execution period (purple squares) using a matched-paired t-test. (C) Comparison of the accuracy rate in the planning condition (purple diamonds) and the control condition (green diamonds) using a Wilcoxon signed-rank test. This figure has been modified from Domic-Siede et al.54. Please click here to view a larger version of this figure.
Moreover, the analysis of planning complexity levels showed significant differences in accuracy and reaction times (RTs) between the "difficult" and "easy" levels during planning and execution (Figure 6). The "difficult" level had longer RTs and lower accuracy. These findings suggest that dividing the trials based on the number of valid solutions can distinguish "easy" from "difficult" trials.
Figure 6: Comparison of behavioral performance at the different complexity levels. Significant differences in behavioral performance at the "easy" and "difficult" levels of complexity were identified using a matched-pair t-test. Lower reaction times (RTs) were seen during planning and execution for the "easy" level compared to the "difficult," and the accuracy was higher for the "easy" level. The error bars represent the SEM (standard error of the mean). This figure has been modified from Domic-Siede et al.54. Please click here to view a larger version of this figure.
These results indicated that when the planning component was successfully removed from the control condition (via instruction manipulation), the planning task was cognitively more complex, demanding, challenging, and time-consuming. Hence, the neural correlates induced by the tasks could be compared to each other.
To analyze frontal midline theta activity during planning, the average theta frequency band during planning for the Fz electrode was compared to that of the control period, and a significant increase in theta band frequency was found during planning (Figure 7).
Figure 7: Frontal midline theta activity during cognitive planning. (A) Topographic maps representing the theta band power across all the subjects normalized to the z-scores during the planning task (left), the control task (middle), and the planning effect (right). During cognitive planning, the subjects exhibited an increase in frontal midline theta activity. The color bar shows the z-values between −0.5 to 1.5. (B) A violin plot showing the minimum, quartiles, median, and maximum z-score values of theta activity across the subjects during planning (purple) compared to the control period (green) for electrodes Fz (left), Pz (middle), and Oz (right) using a matched-pair t-test. This figure has been modified from Domic-Siede et al.54. Please click here to view a larger version of this figure.
Additionally, to assess the temporal dynamics of the observed frontal theta activity, topographic maps corresponding to specific time points of theta band power (750 ms, 1,750 ms, 2,750 ms, and 3,750 ms) were formulated (Figure 8A). Further, compared to the control period, the time-frequency analysis demonstrated a significant, progressive, and sustained increase in theta activity starting 1 s after the onset of the planning period (Figure 8B).
Figure 8: Frontal midline theta temporal dynamics. (A) Topographic time slices of the theta activity. A progressive increase in the frontal midline theta activity across time during planning implementation (planning period) was observed. The color bar indicates the z-score units (−0.5 to 2.2). (B) Time-frequency charts for the planning period (top), the control period (middle), and the planning effect, calculated by subtracting the control period from the planning period (bottom). Non-significant pixels, as determined using a non-parametric cluster-based permutation test for paired samples, are shown lighter in the planning effect plot. The color bar indicates the z-score units (−4 to 4). This figure has been modified from Domic-Siede et al.54. Please click here to view a larger version of this figure.
For source reconstruction of the theta activity, a brain model template was visualized and compared between conditions, and this indicated that the theta activity originated within the prefrontal cortex areas (frontal superior cortex, FS; anterior cingulate cortex, ACC; and mid-cingulate cortex, MCC), as well as that there were significant differences between the conditions (in the bilateral SF, the bilateral ACC, and the bilateral MCC) (Figure 9), with higher theta activity observed in the planning period (Figure 9).
Figure 9: Source reconstruction. An sLORETA algorithm was used to estimate the theta activity from different brain sources. The theta activity was 4-8 Hz bandpass filtered, z-score normalized, corrected by baseline, averaged between 1 s or 4 s after planning or control onset, respectively, and compared between conditions. A significant increase in theta activity was found in the bilateral frontal superior area, the bilateral anterior cingulate cortex, and the bilateral mid-cingulate cortex. The figure shows significant t-values from the permutation test. Abbreviations: FS = frontal superior; ACC = anterior cingulate cortex; MCC = mid-cingulate cortex. This figure has been modified from Domic-Siede et al.54. Please click here to view a larger version of this figure.
Afterward, the time profile of the theta changes over time for each source was evaluated by computing a Hilbert transform, and then we compared the instantaneous amplitude of the theta activity between the conditions. We found that the left frontopolar, bilateral ACC, and bilateral MCC sources presented higher theta activity after the planning period onset (Figure 10). These results suggested that our experimental paradigm demanding cognitive planning induced theta activity originating within the PFC regions.
Figure 10: Theta activity time profile of the PFC sources. The instantaneous amplitude calculated with the Hilbert transform was applied to the first component of the PCA decomposition for each frontal source and both conditions and baseline normalized to the z-score to show the frontal theta activity over time. The gray shaded areas show significant differences determined using a non-overlapping moving window with steps of 1 s (Wilcoxon signed-rank test) corrected by the FDR. The shaded regions represent 95% confidence intervals. The left FP region, the bilateral ACC, and the bilateral MCC showed increases in theta activity after planning onset. Abbreviations: ACC = anterior cingulate cortex; MCC = mid-cingulate cortex. The planning condition is shown in purple. The control condition is shown in red. This figure has been modified from Domic-Siede et al.54. Please click here to view a larger version of this figure.
Further, we aimed to examine the variation in spectral features during planning with regard to the complexity level, as indicated by the behavioral results. Of note, a significant discrepancy was found only in the left ACC within the alpha band. This supports the notion that our planning task evaluates the intrinsic facets of planning through changes in theta oscillations to a greater extent than the general cognitive demands (effort) typically encountered in cognitive control tasks (Figure 11).
Figure 11: EEG across the planning complexity levels. The ROI time-frequency charts showed a significant positive cluster in the alpha band exclusively in the left anterior cingulate cortex (ACC) for the "difficult" level. Non-significant pixels, as determined using a non-parametric cluster-based permutation test for paired samples, are shown in a lighter shade on the plot, with the color bar indicating the z-score units from −3 to 3. This figure has been modified from Domic-Siede et al.54. Please click here to view a larger version of this figure.
When correlations between theta activity and behavioral performance were performed, a negative correlation was observed; specifically, as the theta activity in the left frontopolar region during the planning period increased, the LISAS planning execution score decreased (Figure 12). This pattern may reflect that the left FP region may be necessary during planning elaboration to execute a plan successfully afterward and suggests a role for theta activity.
Figure 12: Theta activity and behavioral performance. The Spearman's rho correlation between the theta activity from the left frontopolar cortex and the Δ LISAS planning execution showed a significant negative correlation. This figure has been modified from Domic-Siede et al.54. Please click here to view a larger version of this figure.
Additionally, the varying cognitive demands and goals induced by each condition may have caused contrasting eye movements between the planning and control conditions, leading to differing oscillatory activity patterns95. To address the above issue, we analyzed the single-subject, single-trial data at various levels. Notably, the Fz channel time series and theta activity time dynamics appeared to have no connection with the rate of saccades over time (Figure 13A).
Figure 13: Results of EEG and eye movement recordings. (A) The rows present the EEG (top), the time-frequency chart (middle top), the theta time profile from electrode Fz (middle bottom), and the saccade rate of subject 8 and trial 9 (bottom) in the planning condition. (B) A Wilcoxon signed-rank test comparison of the saccade amplitude, saccade peak velocity, and power-saccade rate coherence between the conditions is shown, revealing significant statistical differences in the saccade amplitude between the planning and control conditions. The SEM is represented by the error bars. This figure has been modified from Domic-Siede et al.54. Please click here to view a larger version of this figure.
Next, we obtained the saccade amplitude and peak velocity from the entire trial and from 0 s to 3.75 s for comparison (Figure 13B). We discovered that the saccade amplitude was larger in the control condition. However, no statistically significant differences were found between the conditions in the coherence index between the Fourier theta power at electrode Fz and the saccade rate (Figure 10B), indicating that any potential relationship between saccades and theta activity was consistent across conditions.
Taken together, these results support that the experimental protocol described is suitable for studying cognitive planning as a cognitive control function.
The protocol described here offers an innovative approach for assessing cognitive planning and cognitive control during a novel and ecological planning task in association with pertinent and complementary behavioral and physiological measurements, such as oscillatory and pupillary dynamics. During our experiments, EEG activity was recorded while the participants performed the planning task, in which the participants were instructed to first elaborate and then execute a plan. The control condition, which involved evaluating a pre-drawn path on the zoo map, was established to eliminate the cognitive planning aspect while maintaining a similar setting and structure. This approach enables the assessment of whether cognitive planning, as a cognitive control function, leads to the generation of frontal theta activity from PFC regions and whether different PFC theta oscillation sources are linked to different aspects of planning performance. Another aspect that might be evaluated using this protocol is the differentiation of the various cognitive processes involved during phases of planning, such as plan elaboration, plan execution, plan achievement, and feedback processing. We found that planning induced a canonical frontal theta activity associated with cognitive control, which contributed to efficiently achieving a goal. These results underpin the interest of this protocol.
Despite the vast developments in cognitive neuroscience, most neuroimaging experiments examine isolated cognitive functions using artificial tasks in sensorimotor-deprived environments and oversimplified stimuli to control confounds. Problematically, those experiments might not be able to identify the real brain mechanisms involved when a cognitive function is implemented in an everyday situation (during ecological situations)138,140. In particular, the capacities for formulating goals, planning, and executing plans effectively are difficult to assess since they require various cognitive functions (working memory, inhibitory control, cognitive flexibility, etc.)104,144. Thus, designing an ecological behavioral task is encouraged and suggested based on the current trends in cognitive neuroscience142,143,145,146.
Our planning task, despite taking place in a laboratory environment (inside a room with the stimuli displayed on a screen), was made engaging and interactive for participants through the use of meaningful stimuli and goals that they could interact with on the screen. Additionally, the task requires participants to engage in a real-life situation-planning a path to visit various locations. To have an ecological task design, the paradigm must challenge the subjects to perform a specific behavior or cognitive function in a manner similar to what they would have to do in everyday life62,63,147. To develop an ecological task design, the planning task used here involves planning a path to visit different places in several stages56. The first stage involves the participants creating a plan while ensuring it follows a set of rules. The second stage involves maintaining the plan in working memory, while the third stage involves executing the plan and monitoring its adherence to the rules. These stages represent different phases of planning and the orchestration of other executive functions, such as cognitive flexibility, inhibitory control, and working memory. In order to have a valid ecological cognitive task design, the task should be able to detect specific cognitive impairments in patients with psychiatric or cognitive disorders who have difficulty performing that specific cognitive function in their daily life105. This can be achieved through future research using this protocol.
The behavioral results obtained through the use of this protocol were aligned with the experimental predictions. A significant difference in behavior was observed when the planning component was removed from the control task to form a control condition, thus facilitating further comparisons. The planning condition was found to be cognitively more demanding than the control condition, as evidenced by parameters such as the reaction time and accuracy. This may reflect the increased involvement of high cognitive functions in the implementation of planning23,55,56,57,148,149,150.
Considering that the control condition involved less complex cognition, as evidenced by the faster reaction times, better performances, and different cognitive processes required (the evaluation of rules), a possible alternative modification is to exploit the complexity levels present in the planning task, manipulate them, and analyze the planning function parametrically according to different levels of complexity (for instance, increasing the number of trials, and creating difficult, medium, and easy trial conditions). However, the results from our protocol showed that while it was possible to distinguish between "easy" and "difficult" trials based on behavioral measures, there were no differences detected in electrophysiological measures. This suggests that the results in our protocol more accurately reflect the intrinsic characteristics of the planning function rather than broader aspects of cognitive control, such as attention, mental effort, level of difficulty, or a high level of cognitive demand54. Nevertheless, further research may consider other types of control conditions, such as following a marked path that visits the four animal locations but also remembering the sequence order. This way, the level of difficulty could be better controlled, and planning could be distinguished from working memory, but one possible disadvantage of this is fatigue, because the subjects would have to perform two highly demanding tasks.
Several studies have linked different eye movement parameters with specific cognitive events. On the one hand, certain studies have found correlations between theta oscillations and pupil diameter during cognitive tasks, suggesting a relationship between these two measures of cognitive function. For example, Lin et al.152 found a correlation between midfrontal theta activity and changes in pupil size, reflecting varying degrees of subjective conflict. Their findings suggest that these signals represent conflict processing, increased attention, and flexible behavioral responses. Hence, the relationship between midfrontal theta activity and pupil responses seems to play a role in weighing costs and benefits during decision-making processes. In another study, Yu et al.153 examined how time-on-task engagement neurophysiologically affects cognitive control through a working memory task that modulated control inhibitory responses. They studied the relationship between pupil diameter data and frontal theta activity and showed that as the task duration increased, the performance decreased, and this was accompanied by a decrease in pupil dilation modulation and frontal theta activity. At the beginning of the task, they found a strong correlation between task engagement, theta activity, and cognitive control, as indicated by pupil dilation modulation, principally for demanding tasks that required high working memory and inhibitory control. However, this relationship dissipated toward the end, signaling a disconnection between the effort invested and the cognitive control used for performing the task, which is a hallmark of prefrontal time-on-task effects153. On the other hand, other studies have investigated saccades and oscillations. For example, Nakatani et al.154 revealed that, in a perceptual task, the alpha band amplitude from occipital regions predicted blinks and saccade effects. Moreover, Velasques et al.155 showed that, during a prosaccadic attention task, the saccade amplitude was associated with frontal gamma changes. Furthermore, Bodala et al.156 found that decreases in frontal midline theta were accompanied by decreases in sustained attention, as well as the amplitude and velocity of saccades. These findings suggest that eye movements, especially saccades, may reflect cognitive processes rather than just contributing to the background noise in EEG signals. In the current study, we enhanced the elimination of eye movement-related artifacts using the ICA algorithm with the saccade-to-fixation variance ratio criterion126. This criterion enhances artifact removal for free viewing tasks157. In our study, no differences were observed in saccade peak velocity and the coherence between theta power and saccade rate across conditions. However, more studies are needed to address these questions.
A critical step in using this protocol is constantly calibrating the eye tracker during the experiment, as the loss of gaze data from the camera could result in errors that would contaminate the task and make it difficult to obtain accurate responses. Therefore, it is crucial to calibrate as often as possible. However, there is a trade-off between the number of trials with a calibrated eye tracker and the length of the experiment. In our study, we decided to calibrate every five trials.
Future research exploring the relationship between theta oscillations and pupil diameter during this planning task should be conducted. Planning is a critical aspect of executive control that requires the allocation of attentional resources and the coordination of multiple cognitive processes. Understanding the relationship between theta oscillations and pupil diameter during planning tasks could provide valuable insights into the underlying neural mechanisms of executive control and how they change over time. Furthermore, such studies could lead to a deeper understanding of how changes in cognitive function, such as fatigue or attentional lapses, affect performance on planning tasks and the ability to allocate resources effectively. This information could have important implications for developing interventions aimed at improving planning performance, such as cognitive training programs or treatments for conditions such as attention-deficit/hyperactivity disorder (ADHD), among others.
Previous research has indicated that the PFC plays a crucial role in cognitive planning, as confirmed by our results. These results demonstrate that cognitive planning induces FMθ activity in the PFC, particularly in the anterior cingulate cortex, mid-cingulate cortex, and superior frontal regions54. These findings align with prior research on executive functions. There is substantial evidence to support the idea that FMθ activity acts as a top-down process for initiating control and facilitating communication between brain regions during demanding tasks13. While only a few studies have examined the temporal dynamics of FMθ activity associated with cognitive control, there is widespread agreement that the time profile of FMθ can provide information about various facets of cognitive control and the involvement of distinct PFC regions. Using our protocol for evaluating cognitive planning allowed us to characterize the time profile of FMθ activity during planning. Specifically, the FMθ activity during the planning condition showed a progressive increase. By implementing this protocol, for the first time, it was demonstrated that FMθ, is also present during planning implementation, as in other higher-order cognitive functions, and its temporal dynamics may serve as an indicator of cognitive control.
Our results and protocol have potential applications in the field of neuroscience, including for improving virtual neuropsychological assessments and the treatment of neuropsychiatric disorders with associated cognitive planning issues, such as depression and attention-deficit/hyperactivity disorder. For example, assessments could involve examining different patterns of errors at the behavioral performance level, different oscillatory patterns at the electrophysiological level, and different eye movements. Additionally, the results of this work may inform the development of brain-computer interfaces and cognitive training programs that aim to enhance cognitive planning abilities.
The present protocol may contribute new evidence to understanding the neural mechanisms that underpin the elusive cognitive control function of cognitive planning in neurotypical and neuropsychiatric populations. Moreover, our behavioral paradigm might offer insights into the neurobiology of cognitive control and planning through the examination of electrophysiological, pupillometry, and behavioral measurements with a practical planning task that examines intrinsic aspects of planning rather than the general cognitive demands typically present in cognitive control tasks, as reflected in the changes in theta oscillations.
The authors have nothing to disclose.
This research was financially supported by the doctoral scholarship program Becas de Doctorado Nacional año 2015 of ANID 21150295, FONDECYT regular grant 1180932, FONDECYT regular grant 1230383, FONDECYT de Iniciación grant 11220009, Postdoc grant Universidad de O'Higgins, and the Institut Universitaire de France (IUF). We want to thank Professor Pablo Billeke for his feedback on the paradigm design. We thank Professor Eugenio Rodríguez for kindly sharing his time-frequency analysis codes. Finally, we thank Milan Domic, Vicente Medel, Josefina Ihnen, Andrea Sánchez, Gonzalo Boncompte, Catalina Fabar, and Daniela Santander for their feedback.
EEG System | Biosemi | ActiveTwo Base system, 64 channels | |
Eye-tracker System | Eyelink SR Research | EyeLink 1000 Plus Core Unit, High-speed camera, Host PC/Monitor, | |
CPU display | Intel | Hard drive 221 GB, Processor Intel Core i7-4790 3.60 Hz, OS Windows 7, 4GB RAM | |
CPU EEG | Intel | Hard drive 223 GB, Processor Intel Core i7-4790 3.60 Hz, OS Windows 7, 4GB RAM | |
Monitor | ASUS | ASUS VG248QE 24" LCD monitor | |
Joytsick | Logitech | Model F310 | |
Luxmeter | Focket | LCD screen (0-200.000 lux) model Liebe WH LX1330B | |
Statistics software | GraphPad Prism | GraphPad Prism version 8 for Windows | |
MATLAB Programming Software | The MathWorks | MATLAB R2014a and R2018b | |
SVG tool Inkscape | Inkscape Project | vector graphic editor software | |
Presentation Software | Neurobehavioral Systems | stimulus delivery and experiment control program for neuroscience |
.