This article introduces an automated T-maze apparatus that we invented, and a protocol based on this apparatus for analyzing delay-based decision making and effort-based decision making in free moving rodents.
Many neurological and psychiatric patients demonstrate difficulties and/or deficits in decision making. Rodent models are helpful to produce a deeper understanding of the neurobiological causes underlying the decision-making problems. A cost-benefit based T-maze task is used for measuring decision making in which rodents choose between a high reward arm (HRA) and a low reward arm (LRA). There are two paradigms of the T-maze decision-making task, one in which the cost is a time delay and the other in which it is physical effort. Both paradigms require a tedious and labor-intensive management of experimental animals, multiple doors, pellet reward, and arm choice recordings. In the current work, we invented an apparatus based on traditional T-maze with full automation for pellet delivery, door management and choice recordings. This automated setup can be used for the evaluation of both delay- and effort-based decision making in rodents. With the protocol described here, our lab investigated the decision-making phenotypes of multiple genetically modified mice. In the representative data, we showed that the mice with ablated medial habenular showed aversions of both delay and effort and tended to choose the immediate and effortless reward. This protocol helps to decrease the variability caused by experimenter intervention and to enhance experiment efficiency. In addition, chronic silicon probe or microelectrode recording, fiber-optic imaging and/or manipulation of neural activity can be easily applied during the decision-making task using the setup described here.
Humans and other animals evaluate the cost (including delay, effort, and risk) to get a reward, and then make their decision to choose a certain course of action. Decision-making deficits appear in numerous neuropsychiatric diseases, including schizophrenia (SZ), attention deficit hyperactivity disorder (ADHD), obsessive-compulsive disorder (OCD), Parkinson's disease (PD) and addiction1. Studies on humans and monkeys revealed that several key brain regions are involved in decision making2,3,4. Although primates engage in more complicated decision makings, rodents have been reported to be able to make adaptive decisions to survive in an environment where reward contingencies change frequently. In addition, the neural circuit mechanisms and molecular mechanisms underlying decision making can be thoroughly investigated in mouse models due to the availability of chemogenetic tools, optogenetic tools and genetically engineered mice. There are multiple tasks used in evaluating rodents' decision-making behaviors, including the attentional set-shift task, the effortful or delay-based T-maze task, the Iowa gambling task, the visual discrimination reversal learning task5, etc. Analogous T-maze cost-benefit protocols were originally developed by the Pierre group6 and have been used to examine the effects of two types of decision cost (delay and effort) on free moving rodents7,8,9,10. The special advantage of this task is that animals do not have to be trained to press levers or dig in a bowl. Instead, animals make a choice between a high reward high cost option in one arm (the HRA) or a low reward low cost option in the other arm (the LRA). Therefore, this task is much easier to perform.
In the delay-based paradigm, a junction door is introduced once the experimental animal enters one of the goal arms, so that the animal is kept in the goal arm. If the animal chooses the LRA, the goal door on the LRA is retracted immediately and a small quantity of food is delivered. If the animal chooses the HRA, the goal door on the HRA is retracted after the required delay and a large quantity of food pellets is delivered (Figure 1A). In the effort-based paradigm, the HRA is obstructed by a barrier and animals must climb over it to obtain a large quantity of pellets (Figure 1B). Generally speaking, the delay-based paradigm is very useful to test the impulsivity of animal models and the effort-based one can help to figure out apathetic animals2,4,11,12,13. Hitherto researchers have been performing this assay by manually counting the time delay, inserting and withdrawing doors, maneuvering the effort barrier, counting the pellet number, placing pellets into position, placing and returning animals, and recording animals' choices for every trial. These labor and time costs pose a severe experimental bottleneck for researchers, hampering widespread use of this behavioral assay. In current work, we developed a T-maze based setup to assess delay- or effort-based decision making of rodents, with full automation, standardization, and high-throughput capacity.
Apparatus
In collaboration with a commercial manufacturer (see Table of Materials), we developed a modified automated T-maze apparatus which used software-based instrument control (Figure 2). In particular, we introduced a "back door" and "back way" as compared to the traditional T-maze (Figure 2), so that animals could go back to the start point themselves and start a new trial. The T-maze is matte grey colored, and when the experiment condition and software are set properly, both black and white mice can be detected. It is comprised of three arms: one start arm and two goal arms, each 410 mm in length with V-shaped walls of 155 mm in height, a base of 30 mm in width and an open top of 155 mm in width. The V-shaped corridor can effectively prevent mice from jumping. In addition, the V-shaped corridor makes it easier to apply in vivo recording with cables.A start box is attached to the end of the start arm. A goal box is attached to the end of each goal arm. An automatic food dispenser is installed in each goal box to deliver a predefined number of sweet food pellets. The pellet intake is detected by an infrared sensor and is automatically recorded by a computer. Each goal box is connected to the start box by a straight corridor. Animals can autonomously return to the start box via the corridor once they finish a trial. There are sliding doors of 155 mm in height at the entrance and exit of start and goal boxes. Additionally, a sliding door is located at the entrance of each goal arm to prevent animals from moving backwards after making a choice (Figure 2A). All sliding doors are controlled by a computer and can be automatically opened and closed. A high sensitivity 1/2" charge coupled device (CCD) monocle camera is set above the apparatus to track the animals' behavior. The focal length of the lens is 2.8–12 mm. The position of camera is around 1.9 m high. Since the height of maze is 0.5 m from floor, the distance between camera and the maze is around 1.4 m (Figure 2B). The tracking data obtained from the CCD camera is used to live-control the T-maze, opening and closing the specific doors when animals enter certain regions of interest (ROIs). The barriers used for the effort-based paradigm are in the shape of a three-dimensional right-angled triangle (Figure 2C), which perfectly fits in the V-shaped walls, and are about 155 mm in height. Animals must scale the vertical side but are able to descend a 45° slope. The apparatus is illuminated at 100 lux during the experiment. Sugar pellets used in the experiment (see Table of Materials), and silica-gel (see Table of Materials) is used to keep the pellets dry.
All experimental protocols were approved by the Animal Care and Use Committees of the RIKEN Brain Science Institute.
1. Animal Preparation
2. Animal Habituation to the Maze
3. Animal Discrimination of HRA from LRA
NOTE: This protocol includes both delay-based and effort-based decision-making tests. However, depending on the purpose, researchers can test only one of them, or both. Control software (Table of Material) is used to automatically control the T-maze setup for the following steps. If effort-based decision making will be tested, introduce barriers to both HRA and LRA in the forced arm entry phase. Then animals will be trained for both discrimination and barrier climbing simultaneously. The starving mice actively climb the barriers and after this phase, all of them can climb skillfully. Therefore, it is not necessary to start from a lower barrier with this protocol.
4. Delay-based Decision-making Test
5. Effort-based Decision-making Test
6. Data Analysis
An example of the delay- and effort- based decision-making task performed by medial habenular ablated mice (mHb:DTA mice)14 with their wild-type littermate control mice (CT mice) is shown in Figure 6. Two mHb:DTA mice and two CT mice were co-housed in one cage after weaning.
In the delay-based decision-making test (Figure 6A), there was no significant interaction between genotype and session in any phase, including the discrimination training phase (when the delay time of HRA was 0) and delay-based decision-making test phase (when the delay time of HRA was 5 s, 10 s, and 15 s, respectively). The main effect of genotype was not significant when the delay time was 5 s. However, when the delay time was elongated to 10 s and 15 s, mHb:DTA mice demonstrated a significant reduction in the percentage of HRA visits compared to CT mice. These results revealed that the ablation of mHb decreased the preference of mice to wait for a bigger reward, and instead displayed a tendency to select a small reward immediately, when the waiting times were 10 seconds or even longer. The data suggested that mHb might be an important brain structure in the control of impulsivity and/or time cost/benefit evaluation, rendering animals more prone to tolerate delayed access to get a large reward.
In the effort-based decision-making test (Figure 6B), the percentage of HRA visits were significantly decreased in mHb:DTA mice when a barrier was placed in the HRA, regardless of the left/right localization of the HRA (1x barrier phase and reversal phase). This means that the phenotype of mHb:DTA mice was not due to a deficit in spatial preference and memory. In the effort control test, barriers were placed in both goal arms (2× barriers phase) and both LRA and HRA were associated with high effort. Therefore, the effort cost was the same for animals selecting either the low reward or the high reward. The mHb:DTA mice visited the HRA more frequently than the LRA, and reached a comparable HRA visit number on the final session (session 5). This result suggests that reward sensitivity and spatial memory in mHb:DTA mice was intact. The data elucidated that mHb may play an important role in effort cost/benefit evaluation, allowing animals to put in more work to acquire greater rewards.
Figure 1: Schematic diagram of traditional T-maze apparatus for decision-making test. (A) Delay-based decision-making test apparatus. Animals were placed in the start arm and chose between two goal arms, HRA and LRA. When animals chose the HRA, they had to wait (depending on the delay time in seconds) to get a larger reward. Researchers need to manually handle animals, pellets, and doors for each trial. (B) Effort-based decision-making test apparatus. Animals were placed in the start arm and chose between two goal arms, HRA and LRA. When animals chose the HRA, they had to climb over a triangular barrier to get a larger reward. Researchers need to manually handle animals, pellets, doors and barriers for each trial. Please click here to view a larger version of this figure.
Figure 2: Automated T-maze setup for decision-making test. (A) Top view of the automated setup. (B) Side View of the automated setup. (C) The 3D right-angle triangle barrier used for effort-based decision-making test, from left to right, are the side view, the opposite side view and the hypotenuse side view, respectively. Original technical photos edited with permission from the commercial manufacturer. GBL: goal box (left), GBR: goal box (right), GDL: goal door (left), GDR: goal door (right), DAL: delay area (left), DAR: delay area (right), JDL: junction door (left), JDR: junction door (right), BDL: back door (left), BDR: back door (right), CCD: charge coupled device camera). Please click here to view a larger version of this figure.
Figure 3: The Parameter registration window. Please click here to view a larger version of this figure.
Figure 4: The Subject ID registration window. Please click here to view a larger version of this figure.
Figure 5: The experiment interface window. Please click here to view a larger version of this figure.
Figure 6: Delay-based and effort-based decision making in mHb:DTA mice. (A) Delay-based decision-making test in mHb:DTA mice (mice were 12–14 months-old, n = 8/genotype). The percentage of HRA choice was comparable between genotypes when the delay time was 0 and 5 s, but significantly decreased in mHb:DTA mice when the delay time was 10 s and 15 s. When the delay time was 5 s, genotype×day interaction: F(1,14) = 0.594, p = 0.236; the effect of genotype: F(1,14) = 0.61, p = 0.45; when the delay time was 10 s: genotype×day interaction: F(1,14) = 37.5, p = 0.346; the effect of genotype: F(1,14) = 32.4, p <0.0001; when the delay time was 15 s: F(1,14) = 38.7, p = 0.243; the effect of genotype: F(1,14) = 31.6, and p ≤0.0001. (B) Effort-based decision-making test in mHb:DTA mice (mice were 12-14 months-old, n = 9/genotype). During 1x barrier phase, there was a significant interaction between genotype and session (genotype×day interaction: F(1,16) = 2.11, p = 0.015), and the post hoc pairwise comparison revealed that HRA% of mHb:DTA mice significantly dropped in all sessions. During the reversal phase, there was no significant interaction between genotype and session (genotype×day interaction: F(1,16) = 1.61, p = 0.08). mHb:DTA mice visited HRA significantly less than CT mice (main genotype effect: F(1,16) = 8.18, p = 0.01). During 2×barriers phase, there was a significant interaction between genotypes and sessions, and a significant difference in session 3 and session 4 (2x barriers phase: genotype×day interaction: F(1,16) = 3.9, p = 0.0067). The mHb:DTA mice reached a HRA visit number comparable to that of CT mice on the final session, session 5. Data represent mean ± SEM. ** p <0.01; *** p <0.001. Please click here to view a larger version of this figure.
Figure 7: The flowchart of decision making test (delay- or effort-based).
Decision making is a cognitive process highly conserved during evolution15. Humans and animals can evaluate the cost of competing action options relative to the potential reward and then make their choice. Patients suffering from a number of neurological diseases and psychological disorders demonstrate deficits in different forms of decision making16. It is therefore important to investigate the neurobiological and pathophysiological mechanisms underlying the decision-making process. In the past few years, delay- and effort-based decision making is attracting more and more research interest. Furthermore, rodents, especially rats have been extensively used to study these two forms of decision-making17.
Many studies led to interesting discoveries using a behavioral task involving a T-maze apparatus with a HRA and a LRA2,6,7,8,9,10,18,19,20,21,22. In the task, HRA associates large rewards with either a time delay or effort exertion. On the LRA, animals can acquire a small reward immediately without any time delay and physical effort. The traditional approach relies on human experimenter's manual intervention. In each trial, the experimenter needs to count the pellets and place them in the food trays of HRA and LRA, place the goal doors on both HRA and LRA, and then place the animal at the end of the start arm. When the animal enters either of the arms, a junction door needs to be placed to restrict the animal to the goal arm. Depending on the protocol, the experimenter needs to count the time and open the goal door after a set delay. After the animal enters the goal area and obtains the pellet(s), the experimenter needs to return it to the cage, and record the animal's arm choice and behavior. Then the experimenter needs to prepare the T-maze doors and pellet for the next trial. The whole training and testing processes are tremendously time and labor intensive. Furthermore, a lack of standardization across different labs is another concern.
In this paper, we presented a protocol based upon a modified automated T-maze apparatus with a video-tracking system (Figure 7) to solve the problems of traditional protocols. By introducing a "back door" and "back corridor" to the traditional T-maze, we obtained maze with a "bisected isoceles triangle" shape. The advantages of this setup are (1) full automation of the behavioral training and testing. This removes the impact of experimenter subjectivity and minimizes human time and labor commitments. We have four setups in the lab, so that four mice could be trained or tested simultaneously by one experimenter, which is impossible to be accomplished using traditional protocols. (2) There is software flexibility as the control software allows experimenters to freely set up multiple parameters, including pellet number, delay time, door opening and closing, trial numbers, duration, and trace mode. Therefore, this system can meet different kinds of experimental needs. (3) There is broad compatibility as all sliding doors on the T-maze are designed to be stored under the base of the maze when they are open. Therefore, the setup can be easily integrated with diverse physiological systems, including optogenetic/optical manipulation, in vivo electrophysiology recording, and microdialysis. In addition, for excluding the possibility that the mice chose the HRA due to a position preference, we recommend applying a control test for both the delay- and effort- based assay. By equalizing the costs in the two goal arms, animals have the opportunity to experience both reward outcomes at the same cost. The choice can be made simply on the basis of the reward differential, thus removing the need to integrate both costs and benefits before deciding. This also tests whether any change in the animals' choices is the result of an inability to scale the cost or reward, or memory deficit rather than an alteration in the way in which they assessed their decisions.
In our lab, we have analyzed about 10 strains of mice with this setup. One example was shown in the representative data, mHb:DTA mice demonstrated a robust phenotype in both delay- and effort- based decision making. That is, reward value is strongly discounted by time and effort in mHb:DTA mice. The result revealed the important role of mHb on impulsivity control. In addition, we have applied silicon probe recordings on free moving mice during the decision-making process (unpublished data). All the experiments provided validation benchmarks for the capability of the automated setup. Thus, the standardized protocol for the T-maze based decision making with the automated apparatus is suitable for detecting genetic effects, pharmacological effects and neural circuit effects on delay and effort discounting of rodents. In summary, the setup has many advantages to serve as an ideal system for the delay- and effort-based decision-making assays.
The authors have nothing to disclose.
We would like to thank Dr. Matthew F S Rushworth (Department of Experimental Psychology, University of Oxford) and Dr. Sakagami Masamichi (Brain Science Research Center, Tamagawa University) for their valuable advice on initiation of the project and on the details of the protocols. We thank Dr. Lily Yu for critical comments and editing the manuscript. This project was supported by the RIKEN Incentive Research Project (100226201701100443) to Q.Z, the Brain Science Project, Center for novel science initiatives, National institutes of natural sciences (BS291003) to Q.Z, the RIKEN Aging Project (10026-201701100263-340120) to Q.Z and the JSPS Kakenhi Grant-in-Aid for Young Scientists (B) (17841749) to Q.Z.
Authors contributions: Q.Z conceived and initiated the project, Q.Z, Y.K and H.G performed the experiments and data analysis, H.G coordinated the work between the lab and O'HARA & Co., Ltd., Q.Z and Y.K wrote the manuscript, S.I supervised the project.
automated t-maze for decion making testing | O’HARA & Co.,ltd | no catalog number, customorized | Address requested by the reviewer: 4-28-16 Ekoda, Nakano-ku, Tokyo 165-0022 TEL: 81-3-3389-2451 FAX:81-3-3389-2453 |
slica gel | Nacalai Tesque | 1709155 | |
AIN-76A Rodent Tablet 10mg | Test Diet | 1811213(5TUL) | Manufactured for Japan,SLC |
Time TM1 software | O’HARA & Co.,ltd | no catalog number | |
SPSS statistics V21.0 | IBM |