Here, we present a protocol to elicit Pavlovian conditioned approach behavior in rats. This procedure can be used to measure individual differences in the tendency to approach and attribute incentive salience to reward-related cues and investigate addiction vulnerability.
Cues that are contingently paired with unconditioned, rewarding stimuli can acquire rewarding properties themselves through a process known as the attribution of incentive salience, or the transformation of neutral stimuli into attractive, "wanted' stimuli capable of motivating behavior. Pavlovian conditioned approach (PCA) develops after the response-independent presentation of a conditioned stimulus (CS; e.g., a lever) that predicts the delivery of an unconditioned stimulus (US; e.g., a food pellet) and can be used to measure incentive salience. During training, three patterns of conditioned responses (CRs) can develop: sign-tracking behavior (CS-directed CR), goal-tracking behavior (US-directed CR), and an intermediate response (both CRs). Sign-trackers attribute incentive salience to reward-related cues and are more vulnerable to cue-induced reinstatement of drug-seeking as well as other addiction-related behaviors, making PCA a potentially valuable procedure for studying addiction vulnerability. Here, we describe materials and methods used to elicit PCA behavior from rats as well as analyze and interpret PCA behavior in individual experiments.
The transition of drug use to addiction involves complex interactions between Pavlovian and instrumental learning1,2. During drug-taking and drug-seeking behaviors, actions and outcomes are learned through instrumental processes; however, relationships between stimuli (e.g., drug-related cues) and rewards are also learned through Pavlovian processes. Pavlovian cues acquire predictive value, but they can also acquire incentive motivational value3, whereby they become attractive, desirable, and capable of promoting and maintaining reward-seeking behavior4.
Many procedures investigating reward learning in animals, however, do not permit the disentanglement of predictive versus incentive motivational learning. In drug self-administration procedures, for example, both instrumental and Pavlovian contingencies are typically employed, such that rats learn to perform an action (e.g., nose-poking, lever-pressing, etc.) in order to receive an outcome (i.e., intravenous drug infusion). The rewarding outcome is also paired with Pavlovian stimuli (e.g., illumination of a nose-poke port, cue light presentation, sound of the infusion pump, interoceptive feeling of fluid delivery into the bloodstream, etc.). It is often unclear in these procedures whether cues are supporting goal-directed actions simply because of their predictive relationship with the reward, or whether cues have acquired incentive motivational properties of their own.
In order to experimentally isolate the incentive motivational value from the predictive value of Pavlovian stimuli, our laboratory uses a Pavlovian conditioned approach (PCA) procedure in order to identify rats that attribute incentive salience to reward-related cues. During a training session, a conditioned stimulus (CS; e.g., a lever) response-independently predicts the delivery of an unconditioned stimulus (US; e.g., a food pellet). Over the course of multiple training sessions, three phenotypes develop: sign-tracking (CS-directed conditioned response [CR]), goal-tracking (US-directed CR), and an intermediate response (both CRs). For goal-trackers (GTs), the CS is utilized as a predictor of reward delivery; however, for sign-trackers (STs), the CS is attributed with incentive salience, becoming attractive and desirable. In this review, we outline the equipment, setup, and data processing necessary to perform a PCA procedure. In addition, we provide representative results of PCA training, outline important experimental considerations, and discuss the putative utility of PCA procedures in investigating addiction and other neuropsychiatric disorders.
All procedures have been approved by the University Committee on the Use and Care of Animals (UCUCA; University of Michigan, Ann Arbor, MI).
1. Equipment and Software
2. PCA Training
3. Data Processing
We have found that 5-7 daily sessions of PCA training is sufficient to phenotype rats as STs, GTs, and intermediate responders (IRs), although rats can be trained further based on the needs of a particular laboratory or experiment. Phenotyping is based on PCA index scores, which are calculated by averaging the response bias, latency score, and probability difference of individual sessions as previously described in the protocol. Phenotypes are determined by averaging the PCA index scores from the last two PCA training sessions (i.e., Sessions 4 and 5 if there are a total of five PCA training sessions). The PCA index scores behavior from 1.0 (absolute sign-tracking) to -1.0 (absolute goal-tracking), with 0 representing no bias (absolute intermediate response). Because the tendency to sign- vs. goal-track varies over a continuum, cut-offs are required to identify phenotypes, and our laboratory generally uses PCA index score cut-offs of -0.5 and 0.5. In other words, STs have PCA index scores ≥0.5, IRs have PCA index scores between -0.5 and 0.5, and GTs have PCA index scores ≤-0.5. Based on the needs of the individual experiment, however, different PCA index score cut-offs can be used. Figure 1 shows a typical progression of the number, latency, and probability of lever presses and magazine entries across PCA training sessions in the three phenotypes. Figure 2 shows typical distributions of PCA index scores (averaged across Sessions 4 and 5) and average PCA index scores across PCA training sessions after rats have been phenotyped. As can be seen in both figures, PCA behavior stabilizes between Sessions 4-5.
In addition to these data, non-CS magazine entries (i.e., magazine entries performed during inter-trial intervals when the lever is retracted) may also be analyzed. These data may be particularly useful in determining whether a manipulation affects total conditioned responding (not just conditioned responding during the CS period) or alters the timing of conditioned responding. Additional analyses, such as pellet retrieval latency (i.e., the time to enter the magazine and retrieve the pellet following the CS period) or omissions (i.e., not performing any CR during the CS period) can also be calculated based on the needs of individual experiments.
Figure 1. Number, latency, and probability of lever presses and magazine entries across five daily sessions of Pavlovian conditioned approach (PCA) training in sign-trackers (STs), intermediate responders (IRs), and goal-trackers (GTs). In this experiment, male Sprague Dawley rats (n = 48; 275-300 g upon arrival) were ordered from Harlan Laboratories (Barrier 206) and Charles River (Barriers C72, R04, and R09). Data presented as mean ± S.E.M. Please click here to view a larger version of this figure.
Figure 2. (A) The distribution of Pavlovian conditioned approach (PCA) index scores averaged across the final two PCA training sessions. Scores are calculated for each session by averaging the bias in the number, latency, and probability of lever presses and magazine entries across all trials within an individual session. (B) PCA index scores (averaged over the final two PCA training sessions) are used to phenotype sign-trackers (STs), intermediates (IRs), and goal-trackers (GTs). The average PCA index scores of Sessions 4 and 5 are used to classify rats as STs (score ≥0.5), IRs (-0.5 <score <0.5), or GTs (score ≤-0.5). Data presented as mean ± S.E.M. Please click here to view a larger version of this figure.
PCA training can be used to determine individual variation in the tendency to attribute incentive salience to conditioned cues, which has been argued to be an important component of addiction vulnerability. For example, it has previously been demonstrated that STs attribute incentive salience to both food and drug cues6, and both food- and drug-related cues activate similar brain regions within an amygdalo-striatal-thalamic circuit in STs7. Moreover, STs are more impulsive8, vulnerable to cue-induced reinstatement of drug-seeking behavior7,9, and seek drug-related cues despite adverse consequences10.
When performing a PCA procedure, the selection of rats represents a critical step in optimizing phenotypic diversity. For example, there are marked differences in the acquisition of PCA behavior in inbred strains of rats (e.g., Lewis and Fischer F344)11. Even in outbred stocks (e.g., Sprague Dawley), there exists considerable heterogeneity in the acquisition of PCA behavior between vendors (e.g., Harlan Laboratories versus Charles River) and the individual facilities where rats are bred (i.e., Charles River R04 and R09 facilities in Raleigh, NC)12. To increase phenotypic diversity, Sprague Dawley rats may be ordered from multiple vendors and barriers, as long as the exact source of each rat is carefully documented. The age and sex of rats should also be considered. For example, adults (compared to adolescents) and females (compared to males) tend to express more sign-tracking behavior13,14.
It is important to note that housing conditions and conditioning parameters can limit the ability of this procedure to provide the desired level of phenotypic diversity during the acquisition of PCA behavior. In regards to housing conditions, food deprivation and social isolation alter the acquisition of PCA behavior, which also depends on the age of the rat15. If food deprivation is required (e.g., for subsequent operant conditioning), it should be performed following PCA training. In addition, environmental enrichment reduces sign-tracking behavior and should be taken into account when performing PCA procedures16.
Conditioning parameters also affect the acquisition of PCA behavior, and we have carefully tailored each parameter of our sessions to promote equal distributions of STs, IRs, and GTs. For instance, the duration of CS presentation and its spatial proximity to the US can bias behavior toward sign- or goal-tracking, such that shorter CS presentations17 and smaller CS-US distances18 promote sign-tracking behavior. In addition, the CS modality can affect the acquisition of sign-tracking behavior. In example, rats do not readily sign-track to nose-poke ports or auditory tones19,20. Even when using a retractable lever as the CS, care should be taken not to overtrain rats. Previously, it has been observed that after sufficient training sessions, sign-tracking behavior, which is a dopamine-dependent21,22, becomes dopamine-independent23 potentially affecting the results of pharmacological manipulations. Moreover, reward uncertainty (i.e., decreasing the probability of reward delivery following CS presentation) increases sign-tracking behavior, which can interact with the spatial proximity of the CS and US (e.g., increasing reward uncertainty biases sign-tracking towards distal rather than proximal CSs)24,25. Finally, the inter-trial interval (i.e., the time between CS presentations), and whether it is fixed or variable, can impact conditioned responding26.
PCA offers some distinct advantages over other tests of reward-related behaviors. For example, PCA uniquely allows separate measurement of the incentive salience and the predictive properties of reward-associated cues. PCA behavior can also be used to identify individuals vulnerable to certain addiction-like behaviors while avoiding the experimental confound of exposure to psychoactive drugs. Disadvantages of the PCA procedure include the multitude of variables outlined above that can affect the PCA behavior of experimental subjects. Reproducibility of results is dependent on accounting for these many sources of variance, some of which, such as genetic variability and subtle differences in rearing conditions at commercial vendor facilities, can be all but impossible for experimenters to control. Furthermore, the neurobiological underpinnings of PCA behavior are not as well understood as those of other widely studied appetitive behaviors.
In addition to investigating addiction vulnerability, PCA has also been used to explore individual variation in vulnerability to other neuropsychiatric disorders, such as posttraumatic stress disorder. For example, STs are more vulnerable to cued fear expression27 and show incubation of cued fear following extended fear conditioning28. Therefore, PCA procedures can be used to model individual variation in cue-directed behavior that may have relevance for multiple neuropsychiatric disorders and even comorbid disorders (e.g., addiction and posttraumatic stress disorder). In addition, it appears that GTs are more vulnerable to context-induced reinstatement of cocaine-seeking29 following cocaine self-administration and contextual fear expression following fear conditioning27. PCA procedures might be useful for assessing these unique variations in associative learning (cued versus contextual learning), which can better inform investigations into the neural substrates and signaling pathways that may underlie separate vulnerabilities to neuropsychiatric disorders in unique subpopulations of individuals. Therefore, PCA procedures are potentially valuable assays of behavior to investigate the attribution of incentive salience, cued versus contextual processing, and individual variation in vulnerability to neuropsychiatric disorders.
The authors have nothing to disclose.
This work was funded by the University of Michigan Department Of Psychiatry (U032826; JDM), the National Institute on Drug Abuse (NIDA; K08 DA037912-01; JDM) and the Department of Defense (DoD) National Defense Science and Engineering Graduate (NDSEG) Fellowship (CJF).
Standard Modular Operant Test Chamber with Modified Top for Rat | Med Associates, Inc. | ENV-008CT | Top has access slot for drug delivery leashes or other harness systems; comes with ENV-008CTC (Cover Insert) for access slot |
Expanded PVC Sound Attenuating Cubicle | Med Associates, Inc. | ENV-022V | |
PCI Operating Package for up to Sixteen Chambers | Med Associates, Inc. | MED-SYST-16 | Based on the number of operant chambers, MED-SYST-8 (PCI Operating Package for up to Eight Chambers) is also available |
SmartCtrl | Med Associates, Inc. | DIG-716P2 | |
Universal Cable, 25′ (7.6 m) | Med Associates, Inc. | SG-210CB | Based on individual needs, SG-210CB-50 (Universal Cable, 50′ [15.2 m]) is also available |
18″ (45.7 cm) 3-Pin Mini-Molex | Med Associates, Inc. | SG-216A | Based on individual needs, SG-216A-2 (2′ [61.0 cm] 3-Pin Mini-Molex) is also available |
Power Cable, 25′ (7.6 m) | Med Associates, Inc. | SG-210CP-25 | |
Stainless Steel Grid Floor for Rat | Med Associates, Inc. | ENV-005 | Based on preference, ENV-005A (Stainless Steel Grid Floor for Mouse) is also available |
Reusable Waste Pan | Med Associates, Inc. | ENV-007-P3 | |
Filler Panel Package for Standard Modular Test Chamber | Med Associates, Inc. | ENV-008-FP | |
Modular Pellet Dispenser for Rat, 45mg | Med Associates, Inc. | ENV-203M-45 | |
Pellet Receptacle, Trough Type | Med Associates, Inc. | ENV-200R2M | Based on preference, ENV-200R1M (Pellet Receptable, Cup Type) is also available |
Retractable Lever | Med Associates, Inc. | ENV-112CM | Calibrated to 25 g; needs to be adjusted to 10 g before Pavlovian conditioned approach training |
Retractable Lever Cue Light | Med Associates, Inc. | ENV-112CML | |
House Light for Rat | Med Associates, Inc. | ENV-215M | |
100 mA Replacement Bulbs, Pack of 10 | Med Associates, Inc. | SG-800R | Red-colored; for use with ENV-215M (House Light for Rat) |
Pellets, 45 mg, Primate Purified Diet, Banana Flavor | Bio-Serv | F0059 | 50,000/box |