Persistent practice improves the precision of coordinated movements. Here we introduce a single-pellet reaching task, which is designed to assess the learning and memory of forelimb skill in mice.
Reaching for and retrieving objects require precise and coordinated motor movements in the forelimb. When mice are repeatedly trained to grasp and retrieve food rewards positioned at a specific location, their motor performance (defined as accuracy and speed) improves progressively over time, and plateaus after persistent training. Once such reaching skill is mastered, its further maintenance does not require constant practice. Here we introduce a single-pellet reaching task to study the acquisition and maintenance of skilled forelimb movements in mice. In this video, we first describe the behaviors of mice that are commonly encountered in this learning and memory paradigm, and then discuss how to categorize these behaviors and quantify the observed results. Combined with mouse genetics, this paradigm can be utilized as a behavioral platform to explore the anatomical underpinnings, physiological properties, and molecular mechanisms of learning and memory.
Understanding the mechanisms underlying learning and memory is one of the biggest challenges in neuroscience. In the motor system, the acquisition of novel motor skills with practice is often referred as motor learning, whereas the retention of previously learned motor skills is regarded as motor memory1. Learning a new motor skill is usually reflected in improvement of desired motor performance over time, until a point when the motor skill is either perfected or satisfactorily consistent. For most cases, the acquired motor memory can persist for a long period of time, even in the absence of practice. In humans, neuroimaging studies using positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) have shown that primary motor cortex (M1) activity changes during the acquisition phase of motor skill learning2-4, and temporary interference of M1 activity by low frequency transcranial magnetic stimulation leads to significantly disrupted retention of motor behavioral improvement5. Similarly, forelimb-specific training in rats induces functional and anatomical plasticity in the M1, exemplified by the increase of both c-fos activity and synapse/neuron ratio in the M1 contralateral to the trained forelimb during the late phase of motor skill learning6. Furthermore, a similar training paradigm also strengthens layer 2/3 horizontal connections in the contralateral M1 corresponding to the trained forelimb, resulting in reduced long term potentiation (LTP) and enhanced long term depression (LTD) after rats acquire the tasks7. Such synaptic modification, however, is not observed in the M1 cortical regions corresponding to untrained forelimb or hindlimbs8. Alternatively, when the M1 is damaged through stroke, there are dramatic deficiencies in forelimb specific motor-skills9. While most of the motor behavioral studies have been conducted on humans, monkeys, and rats2-8,10-17, mice become an attractive model system because of its powerful genetics and low cost.
Here we present a forelimb specific motor-skill learning paradigm: a single-pellet reaching task. In this paradigm, mice are trained to extend their forelimbs through a narrow slit to grasp and retrieve food pellets (millet seeds) positioned at a fixed location, a behavior analogous to learning archery, dart-throwing, and shooting basketballs in human. This reaching task has been modified from previous rat studies that have shown similar results between mice and rats18. Using two-photon transcranial imaging, our previous work has followed the dynamics of dendritic spines (postsynaptic structures for majority excitatory synapses) over time during this training. We found that a single training session led to rapid emergence of new dendritic spines on pyramidal neurons in the motor cortex contralateral to the trained forelimb. Subsequent training of the same reaching task preferentially stabilized these learning-induced spines, which persisted long after training terminated19. Furthermore, spines that emerged during repetitions of reaching task tended to cluster along dendrites, whereas spines formed during tandem execution of reaching task and another forelimb-specific motor task (i.e. the pasta handling task) did not cluster20.
In the present video, we describe step-by-step the setup of this behavioral paradigm, from the initial food deprivation to shaping, and to motor training. We also describe the common behaviors of mice during the process of executing this behavioral paradigm, and how these behaviors are categorized and analyzed. Finally, we discuss the precautionary measures needed to practice such a learning paradigm and the issues that may be encountered during data analyses.
Experiments described in this manuscript were performed in accordance with the guidelines and regulations set forth by the University of California, Santa Cruz Institutional Animal Care and Use Committee.
1. Setup (Also See Materials List)
2. Food Deprivation (2 Days)
3. Shaping (3-7 Days)
Notes:
4. Training (8+ Days)
Notes:
5. Data Quantification
There are many ways to quantify mouse behavior following training. Two most straight-forward analyses are:
Learning curve:
Mastery of a motor skill often requires persistent practice over time. A typical averaged learning curve is composed of two phases: an initial acquisition phase during which the success rate improves progressively, and a later consolidation phase when the success rate reaches the plateau (Figure 2C). It should be noted the learning curves of individual mice vary; different mice take different numbers of days to reach the plateau level, and the individual learning curves are usually not as smooth as the average one. Another way to present the mouse's improvement of reaching skills is the speed of success, which reflects the overall motor performance by taking accounts of the reaching speed as well as the accuracy. In general, the speed of success keeps improving after the mouse reaches its plateau success rate (Figure 2D).
In addition to individual variations of performance, some mice fail to learn the task (Figure 2E). These "nonlearners" usually make initial attempts to reach for the seeds, but for unknown reasons perform poorly despite repetitive training. They generally lose interest in reaching for the seeds after continuously failed attempts and stop reaching after 6-8 days. By contrast, some mice are over-shaped (Figure 2E). These over-shaped mice usually start with a very high success rate (>40%), and do not make significant improvement (i.e. 15% increase in success rate compared to first day of training) in motor performance with continued training. Their learning curves stay relatively flat, or may even decrease with continued training.
Motor memory:
Our previous data have suggested that once a motor skilled movement is mastered through repetitive practice, it can be stored as a form of motor memory and further practices are not required for its maintenance19. This motor memory can be measured by stopping the training after mice have reached plateau level of success rates, and retest their performance after an extended resting period (e.g. a few months). Retrained mice usually start with comparable success rates as have observed at the end of earlier training, and maintain high success rate in subsequent days. By contrast, age-matched naïve mice usually start with significantly lower success rates and progressively improve their performance with practice19 (Figure 2F). While food deprivation (2 days) before commencement of retraining is required, reshaping the previously trained mice is not necessary.
Figure 1. Design of the mouse training chamber. A. A photograph of the training chamber, with dimensions indicated. B. A photograph of the shaping seed tray, made from three slides glued together and placed in front of the shaping chamber. A pile of millet seeds are placed at the trough of the seed tray. C. A photograph of the food tray for training, placed in front of the training chamber. One millet seed is placed on the divot (pointed by arrows) that corresponds to right forelimb training. Dimensions and the location of the divot are indicated in the photograph. D. A cartoon drawing of the shaping chamber. The single-slit side of the training chamber is placed facing downwards. Seeds are placed in front of the middle slit and mice can use both paws to plow the seeds. E. A cartoon drawing of the training chamber. The double-slit side of the training chamber is placed facing downwards. One seed is placed on the food tray in front of the chamber slit corresponding to the preferred limb (in this case, the right forelimb). (D and E, modified from Xu et al.19). Click here to view larger image.
Figure 2. Representative results of mouse single-pellet reaching tasks. A. A general timeline of the experimental design. B. An example of bodyweight loss for a single mouse during food deprivation (F), shaping (S), and training (T). C. Average success rates improve over time during training (n=39). D. Average speed of success from the same group of mice presented in C. E. Success rates during training for an over-shaped mouse and a nonlearning mouse. F. Motor performance of pretrained (n=14) and naïve (n=10) adult mice during 4 day training (modified from Xu et al.19). All data are presented as mean ± s.e.m., ***, P<0.001. Click here to view larger image.
Importance of the shaping phase:
Because of increased anxiety from being in an unknown environment, it is usually difficult for mice to be trained in a novel environment21,22. Therefore, the goal of shaping is to familiarize mice with the training chamber, the trainer (i.e. reduce their anxiety levels), and the task requirements (i.e. to identify seed as food source). Another goal of the shaping is to determine the preferred limbs of individual mice for future training. During shaping, it is critical that the mice are not over-shaped, as it may provide unwanted "reaching practice sessions", which would falsely inflate the success rate in the initial learning phase, resulting in no or little subsequent improvement of success rate in later training (Figure 2E). In these cases, rather than simply plowing the seed into the cage and then picking it up to eat, the over-shaped mice already started developing reaching skills during the shaping phase. The only way to limit over-shaping is keen observation during the shaping sessions. Over-shaped mice should be excluded from the data analysis. On the other hand, it is equally important that mice are not under-shaped. If the mouse does not recognize the millet seeds as the food source, if the mouse is unfamiliar with the task requirement, and/or if the mouse is too anxious, it will experience difficulties during the training sessions and will likely end up as a nonlearner (Figure 2E, also see "nonlearners" below).
Implementing proper controls:
To determine whether or not the associated changes are due to reaching-specific motor learning, it is important to implement various forms of controls. Several controls can be used: 1) The general control group: in this group, mice do not experience training or shaping, but food restriction, the food reward (seeds), and handling. 2) The shaping control group: mice in this group experience the shaping period as described above (see protocols), however they are not trained subsequently. Instead, they are placed in the training cage for 20 min, and provided with approximately 20 seeds/mouse. The shaping control group is useful for determining whether experience of the shaping period caused any plasticity in the interested brain areas. 3) The activity control group: in this group, mice experience exactly the same conditions as the trained mice except during the training period, the seed is always placed outside of the reaching range or held by the trainer. Hence, the activity of the forelimb muscles is similar to the trained mice, but the mice in the activity control group, unlike the trained mice, do not acquire the reaching skills. To promote continuous reaching attempts, seeds are periodically dropped in the training chamber from the reaching slit, and mice would pick up the seeds for consumption. Most of activity controls give up reaching after 6-8 days of training.
Nonlearners:
It is uncertain why some mice learn while others do not. Speculating from our experiences, some of these nonlearners may result from wrong judgment of paw preference, thus the acquisition of skilled movement is hampered by training the nondominant limb. It is also possible that under-shaping is responsible for these nonlearners, for these mice are not clear on the task requirement, and/or not yet comfortable with the testing environment. Other possible reasons include losing weight too rapidly and/or too much weight loss, while others might have lost not enough weight, in which either scenario will result in decreased hunger level and impeded motivation to reach for the food, thereby making the learning process difficult. Regardless of the reasons, these nonlearners do not acquire nor master the reaching skills, and may be treated as an additional type of control group, complementing the various types of controls mentioned above.
Circuitry for motor learning and memory:
Many brain regions have been identified to be involved in motor learning. In addition to the primary motor cortex6,7,19,23, many other brain regions such as the substantial nigra and ventral tegmental area16,24, striatum25, and hippocampus26 have been suggested to also play important roles in the single seed reaching task introduced here. Therefore, the single seed reaching task may be useful to study many discriminatory regions of the rodent brain associated with motor learning. Moreover, there is a plethora of other motor tasks, each with its own temporospatial pattern of motor execution, as well as brain macro/microstructures involved. For example, the accelerated rotarod has been used to study long term motor memory in both striatum and hippocampus27, the delay eye-blink conditioning response engages implicit procedural motor learning which is predominantly mediated by the cerebellum28,29, while the running-wheel task depends on the proper functioning of dorsal striatum30. Even for the motor tasks that induce synapse reorganization in the cortex (i.e. the Capellini handling task and single-pellet reaching task), different sets of synapses are likely to be involved in different tasks19. Such data suggest that each motor task could have its own specific neural coding, by recruiting different brain regions, neuronal populations and synapse sets. Proper experiments should be used to study different brain structures and motor circuits.
In summary, we have introduced a detailed protocol on how to perform the single-pellet reaching task in mice. This reliable and valid protocol will be useful for future researchers who are interested in studying biochemical, structural, physiological, and genetic changes in many discriminatory regions of the mouse brain associated with motor learning and memory formation.
The authors have nothing to disclose.
This work is supported by a grant (1R01MH094449-01A1) from the National Institute of Mental Health to Y.Z.
Training chamber in clear acrylic box | For dimensions, see Fig. 1A |
Tilted tray for shaping | custom-made from glass slides, see Fig. 1B |
Food platform for training | For dimensions, see Fig. 1C |
Millet seeds | filtered from “Wild Bird Food Dove and Quail Blend Wild Bird Food (All Living Things) |
Forceps | For placing the seeds |
A weighing scale | For daily body weight measurement |
A stopwatch | For time measurement during shaping/training sessions |