Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Mojtaba Kermani; Zahra Fatahi; Dechuan Sun; Abbas Haghparast; Chris French

doi:10.3791/57907

JoVE Journal > Neuroscience

神经科学

Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents

Published: September 10, 2018

doi:

10.3791/57907

Mojtaba Kermani*^1,3, Zahra Fatahi*², Dechuan Sun³, Abbas Haghparast², Chris French^3,4

¹Department of Optometry and Vision Science,The University of Melbourne, ²Neuroscience Research Center,Shahid Beheshti University of Medical Science, ³Department of Medicine,The University of Melbourne, ⁴Royal Melbourne Hospital

Summary

A cost-benefit analysis is a weighing-scale approach that the brain performs during the course of decision making. Here, we propose a protocol to train rats on an operant-based decision-making paradigm where rats choose higher rewards at the expense of waiting for 15 s to receive them.

Abstract

Reinforcement-guided decision making is the ability to choose between competing courses of action based on the relative value of the benefits and their consequences. This process is integral to the normal human behavior and has been shown to be disrupted by neurological and psychiatric disorders such as addiction, schizophrenia, and depression. Rodents have long been used to uncover the neurobiology of human cognition. To this end, several behavioral tasks have been developed; however, most are non-automated and are labor-intensive. The recent development of the open-source microcontroller has enabled researchers to automate operant-based tasks for assessing a variety of cognitive tasks, standardizing the stimulus presentation, improving the data recording and consequently, improving the research output. Here, we describe an automated delay-based reinforcement-guided decision-making task, using an operant T-maze controlled by custom-written software programs. Using these decision-making tasks, we show the changes in the local field potential activities in the anterior cingulate cortex of a rat whilst it performs a delay-based cost-and-benefit decision-making task.

Introduction

Decision making is the process of recognizing and selecting choices based on the values and preferences of the decision maker and the consequences of the selected action¹. Although decision making has been extensively studied in different fields (i.e., economics, psychology, and neuroscience), neural mechanisms underlying such cognitive abilities are not yet fully understood. Two subcategories of decision making are perceptual decision making and reinforcement-guided decision making. Though they incorporate considerable overlapping elements and concepts, perceptual decision making relies on the available sensory information¹^,², whereas reinforcement-guided decision-making deals with the relative value of actions gained over a specific timescale³. One important aspect of reinforced decision making is the cost-benefit analysis which is performed intuitively by the brain by computing the benefits of the given choices and subtracting the associated costs of each alternative¹.

The T-maze (or the variant Y-maze) is one of the most-used mazes in cognitive experiments using rodents. Animals are placed in the start arm (the base of the T) and permitted to choose the goal arm (one of the side arms). Tasks such as a forced alternation or left-right discrimination are mainly used with rodents in the T-maze to test reference and working memory⁴. T-mazes are also widely used in decision-making experiments⁵^,⁶^,⁷. In the simplest design, the reward is placed in only one goal arm. The choice is predictable, and animals would certainly prefer the reward rather than nothing, regardless of the reward value. Another option is to place rewards in both goal arms and then let the animals make a choice of which path to take depending on several parameters (i.e., the natural preference of the animal, the difference in the value of the rewards, and the costs to be paid). In the value-based design, the task is more complicated by having weighing-scale properties. In this way, an animal receives differently valued rewards by choosing between the two alternatives, as well as between the costs of the actions [i.e., the amount of waiting (delay-based) or the amount of effort (effort-based) needed to receive rewards], each contributing to the decision that is made⁵^,⁶.

In traditional delay-based T-maze decision making, animals are trained to select the high reward arm (HRA) and avoid the opposite low reward arm (LRA). The sides of the HRA and the LRA remain unchanged throughout the experiment. Although the task described above has been well documented in the literature, it suffers from several procedural drawbacks. Firstly, by having a fixed goal arm, the animal knows which arm to choose from the beginning of each trial. In this scenario, animals may select the goal arm based on their memory rather than on decision making. Hence, in a delay-based decision-making paradigm, if an animal selects the low reward because of the study intervention, it will not be clear whether this is due to a loss of memory or to the study intervention. A memory control group to segregate the observed behavior from the memory problem might be considered, but this burdens researchers and animals alike because of the additional work⁷. A second concern is the moment of decision making by the animal: once animals reach the decision zone (the junction of all three arms), they usually look to the left and to the right, weigh the costs and benefits regarding each arm, and then make their decision. However, after a few trials, they perform such a computation prior to arriving at the decision zone and simply run directly to the reward arm. As a result, these two drawbacks—a pre-bias to one arm and finding the moment of decision making—both highly interrupt the interpretation of electrophysiological and neuroimaging data.

In the method explained in this paper, the preferred arm (HRA) is cued by an auditory cue and may vary from trial to trial. Animals initiate the trials by entering the test zone (Figure 1) and triggering the auditory cue by "nose-poking" an infrared gate that has been placed at the junction of the three arms. The audio signal (20 dB, between 500 and 1,000 ms) is played from a speaker at the end of the goal arm.

Protocol

All procedures explained here were approved and carried out in accordance with the Guide for the Care and Use of Laboratory Animals and were approved by the Florey Institute Animal Ethics Committee or the Neuroscience Research Center.

1. Housing, Handling, and Food Restriction

Use adult (normally 8 weeks old) male rats (any strains) and keep them in the room with a 12-h light/dark cycle.
Restrict their food access to encourage the animals to perform the task.
Note: Housing the animals singularly is suggested, as it provides a better control of each one’s food intake.
On days 1 – 3, handle the animals for approximately 5 min, 2x a day.
Note: Handling familiarizes the animals with human contact and decreases the level of stress and anxiety in the animals throughout the experiments.
Weigh the animals after each handling session. Use the first day’s weight as the free-feeding amount and keep the animals on about 80 – 85% of their free-feeding amount.

2. Experimental Set-up

Use a T-maze equipped with 3 partitions or arms, 2 stimulus speakers, 5 retractable doors, and 5 infrared motion sensors or infrared beam (IRB) sensors.
Note: The T-maze can be constructed of medium-density fiberboard (MDF) or polyvinyl chloride (PVC).
Control the maze constructed here by an Arduino microcontroller.
Copy the Arduino code into the computer.
Download the Arduino software from the software website and install it on a computer.
Connect the microcontroller to the computer using a USB port.
On the computer, click the software icon, go to Tools, and then select Port.
From the drop-down menu, choose the COM port (Communication port) which connects the software to the computer.
Go to Tools and select Boards. From the drop-down menu, select the type of Arduino that controls the T-maze.
Click Upload on the top left of the interface window. Select the Arduino code. Wait until the process finishes.
Click Serial monitor at the top right of the interface window. Then, in a new pop-out window, change the baud rate to 115200.

3. Habituation to the Maze

Prior to each session of habituation, bring the animals to the experiment room at least 1 h prior to the experiment.
Leave 10 sugar pellets at each goal arm and leave all doors open.
Note: At this stage, there is no need to track the animals’ movements (Figure 1).
Days 1 – 3: Place the animals individually in the maze for periods of 10 min, 1x per day, to explore the maze with no restrictions.
Days 4 – 5: Place the animals individually in the maze. Leave 2 pellets in each arm and allow them to sample the food from both sides. Remove the animal from the maze immediately after eating pellets from both sides or after 5 min of being in the maze.
Note: The main difference between this stage and the previous stage is that animals need to be removed from the maze immediately after eating pellets from both sides. This would familiarize an animal with being removed from the maze at the end of a trial.
After each session, clean the maze’s floors with 70% ethanol and make sure the ethanol has evaporated before placing the next animal in the maze.

4. Discrimination Training

Maze preparation
1. Day 6: Bring the animals to the experiment room at least 1 h prior to the experiment.
2. Run the Arduino program and set the trial number to 14 of which the first 4 trials will be forced-choice and the rest will be choice trials.
  Note: The program will randomly generate an equal number of trials to be assigned to the left and right side of the T-maze.
3. Before each trial begins, place 4 pellets in the goal arm which is to be cued as the HRA and 2 pellets in the other arm which is the LRA.
Forced-choice trial training (4 trials)
1. Pseudo-randomly block one arm before each trial so that the animal is forced to select the other arm.
  Note: The blocked arm can be a high reward arm or a low reward arm whilst the auditory signal highlights the side of the HRA.
2. Place an animal in the start box (Figure 1). After 5 – 7 s, simultaneously open the start gate and click Start in the Arduino’s interface window.
3. Collect the animal immediately after eating pellets or after 5 min of being in the maze.
4. Leave the animal in the home cage for 2 min.
Choice trial training (10 trials)
1. Prior to each trial, close door-B in the arm which is selected by the software to be the HRA. Leave door-A open in the opposite arm (the LRA).
2. Place an animal in the start box (Figure 1). After 5 – 7 s, simultaneously open the start gate and click Start.
3. Let the animal freely choose either arm. If the animal chooses the HRA, open door-A, let the animal enter the chamber, shut door-A, and open door-B immediately to give the animal access to the selected food well.
4. If the animal chooses the LRA, open door-B in order to give the animal access to the food well.
5. Remove the animal after it has eaten all the food in the selected food well and leave it in the home cage for 2 min.
6. Complete the 10 choice trials for each animal and record the animal’s choice (HRA or LRA) in each trial.
7. Calculate the percentage of high reward choice (HRC) for all choice-trials after each training session.
8. Following the completion of 14 trails, the individual times obtained by each infrared sensor are shown in the Arduino interface window.

5. Delay Training

Once each animal has reached 80% of HRC in the discrimination training (step 4), begin the delay training by running 10 trials per day for each animal. In this stage, door-B is to be opened after only a 5 s delay when the animal chooses the HRA.
If the animal reaches an HRC of 80% at the end of a training session with a 5 s delay, increase the delay to 10 s for the next training session.
Once the animal has reached an HRC of 80% with a 10 s delay, increase the delay to 15 s for the next training session.
Record the animal’s choice for each trial to calculate the HRC after each training session.
Following the completion of the trials, the individual times obtained by each infrared sensor are shown in the Arduino interface window.
Note 1: The timer starts when you click Enter. The ‘Time_decision’ is the time after the nose-poke to the IRB-1. ‘Time_left_1’ is the time when an animal breaks IRB-1L and ‘Time_left_2’ is when IRB-2L is broken. If the behavioral study is combined with electrophysiology or neural imaging (e.g., calcium imaging) methods, film recording is suggested for a better synchronization of the animal’s behavior to neural signals.

6. Electrophysiology (Electrode Fabrication)

Use single or bipolar electrodes to record the local field potentials (LFPs).
Note: The use of bipolar electrodes is suggested because it enables local re-referencing to reduce the impact of the volume conduction. Therefore, the recorded LFP is the differential voltage between 2 electrodes with a ~200 μm distance between the tips.
To make a bipolar electrode, glue 2 tungsten electrodes together or wind 2 stainless-steel wires together (normally, PFA-coated stainless-steel wires with a 50 μm diameter are used).
Solder the grounding and recording wires to a mini plug/socket to become a connector to the electrophysiology recording system.

7. Anesthesia

To implant the electrodes, anesthetize the rats by an intraperitoneal injection of a mixture of ketamine (100 mg/kg) and xylazine (8 mg/kg), or by administering isoflurane as described in the following steps.
Note: Isoflurane is recommended due to the improved control of its anesthetic depth.
Use an anesthetic machine with a controlled oxygen and anesthetic vapor flow.
To anesthetize the animal by isoflurane, place it in the induction chamber and set isoflurane at a rate of around 4% and oxygen at 500 – 1,000 mL/min on the anesthetic machine.
Continue the induction until the righting reflex of the animal disappears.
Set the anesthetic maintenance rate at 1 – 2.5% isoflurane and 300 – 400 mL/min oxygen on the machine.
Place a heat-pad with insulation (cotton wool) on a stereotaxic device and then immobilize the animal in the stereotaxic device.
Measure the level of anesthesia by pinching the toes of the animal.

8. Surgical procedure

Using an electric shaver or a pair of scissors, shave the animal’s head where the incision is to be made.
Scrub the surgery area with ethanol and then with povidone–iodine, 4%.
Apply eye lubricant to protect the animal’s cornea during the surgery.
Using tissue forceps, gently pull the skin between the animal’s eyes and ears. Using scissors, cut the skin that is pinched between the forceps and remove the periosteum.
Use hydrogen peroxide to clean and disinfect the skull.
Find the location of the electrode insertion point by using stereotaxic coordinates and mark it on the skull with a permanent marker.
Use a handheld drill to make one hole for the grounding electrode, one for anchoring the implant, and one hole per recording electrode.
Insert the electrodes at a very slow rate to minimize the possible cortical and subcortical damage.
Connect the grounding electrode to the skull using a small screw.
Secure the connector plug/socket in place by using a thin layer of dental acrylic cement.
Inject buprenorphine (15 µg/kg, subcutaneously) or meloxicam (1 – 3 mg/kg, subcutaneously) as a painkiller.
Leave the animal in a cage on a heated mat to recover. Observe the animal at least every 30 min until it has recovered from the anesthetic.

9. Post-procedure Training

Following the surgery, allow at least a 10-day recovery period. House the animals individually with free access to food and water ad libitum and monitor them on a daily basis (see Rudebeck, Walton, Smyth, Bannerman, and Rushworth⁷ for more information).
Following the recovery, start restricting the animal’s diet to 85% of their free-feeding amount.
Retrain the animals in the maze to recall the discrimination phase (step 4).
Continue re-training the mice until they have achieved 80% of HRC.

Representative Results

The data presented here is the recorded LFP from the left orbitofrontal cortex (OFC) and the anterior cingulate cortex (ACC) of six male Wistar rats using bipolar electrodes (of PFA-coated stainless steel). Table 1 shows the behavioral acquisition length for each training stage. The coordinates for the target locations were determined from a rat brain atlas⁹ and are as follows: for the AAC, 1.2 mm anterior to the bregma, 0.8 mm lateral to the midline, and 2 mm ventral to the skull; and for the OFC, 3.5 mm anterior to the bregma, 2.3 mm lateral to the midline, and 5.4 mm ventral to the skull.

The recordings were bandpass-filtered (0.01 – 250 Hz) to extract LFPs and then sampled at 1,000 Hz. The spectral analysis was performed on LFPs using the multi-taper¹⁰. Five Slepian tapers and a time-bandwidth product of three were used to achieve the optimal spectral concentration. Time-frequency spectrograms were estimated using a sliding-window of 300 ms that was shifted over the data at 5 ms steps. For a better observation of the task-dependent modulation of the spectral powers and to attenuate the 1/f power-scaling problem, all spectrograms were baseline normalized and converted to decibel using dB_tf = 10log10(S_tf/mSf), where S_tf is the spectrum at time t and frequency f and mSf is the mean spectrum of all time points in the baseline within a frequency band¹¹. The spectral powers were computed for the baseline (300 ms before nose-poking), stimulus (100 ms), pre-chamber (300 ms before entering the chamber), and chamber (600 ms) time windows. The statistical analysis was performed using a non-parametric permutation-based t-test.

As shown in the top row of Figure 2A, there was a decrease in both the low (4 – 12 Hz) and the high (45 – 85 Hz) frequency powers in the ACC from the onset to the end of the stimulus. Comparing the time spent outside the chamber with the time in the chamber, the spectral analysis showed no changes in the oscillatory activities (as seen in the top row of Figure 2B) in the ACC.

Low-frequency oscillations in the OFC also showed decreases in the spectral powers while the animals approached the IR gate; however, this appeared earlier (-80 ms) and lasted longer compared to the low-frequency oscillations in the ACC (50 – 420ms). Mid/high-frequency band activities (23 – 100 Hz) in the OFC increased following the stimulus onset (Figure 2A, bottom row). No significant changes were observed in the pre-chamber and chamber time windows when they were compared together (Figure 2B, bottom row). These results are in line with previous findings supposing that the OFC and ACC are both involved in the value-based decision making²^,¹²^,¹³.

Figure 1: Schematic of a choice trial in a delay-based decision-making task. The maze measures 60 cm x 10 cm x 40 cm. The start box is connected to the start arm through a retractable door. Two other retractable doors (door-A and door-B) are placed at each goal arm and together they make a chamber to delay the animals' access to rewards. Door-A is placed 12.5 cm from the entry point to each arm and door-B is placed just before the food well, 5 cm from the end of the arm. A raised metal food well, 3 cm in diameter, is placed at the far end of each goal arm, 2 cm above the maze floor.

The animal is placed in the start box and is allowed to approach and nose-poke the infrared gate (IRB-1) to trigger the auditory stimulus that cues the HRA (in this panel, the right arm). The IRB-2L and IRB-2R timestamp the animal's choice. If the animal turns right, door-A is opened to let the animal enter the arm (chamber) and is closed immediately after the animal enters. After 15 s, door-B is opened to give the animal access to the reward. If the animal chooses to turn left, (door-A is opened in the left side), door-B is opened immediately after it enters the left chamber. The IRB-3L and IRB-3R timestamp the animal's entrance to the chamber.

Figure 2: Temporal and spectral dynamics of ACC and OFC neural activities. (A) This panel shows time-frequency plots of ACC (top row) and OFC (bottom row) neural activities during a successful high-reward discrimination. The spectral powers are baseline-normalized by subtracting the post-poking time window from the baseline time window. The value 0 in the abscissa denotes the onset of the auditory stimulus. (B) This panel shows time-frequency plots of ACC (top row) and OFC (bottom row) neural activities when the animal enters the chamber. The chamber time window is normalized by the pre-chamber time window. The value 0 in the abscissa denotes the time of opening door-A. The color bags depict the extent of the spectral changes in decibel scale. The black rectangles demonstrate significant deviations from the chance level (p < 0.05 by two-sided permutation test). Please click here to view a larger version of this figure.

	Habituation	Discrimination training	Delay training (5s)	Delay training (10s)	Delay training (15)	total
Rat 1	3 days	15 days	8 days	6 days	5 days	37 days
Rat 2	3 days	18 days	9 days	6 days	5 days	41 days
Rat 3	3 days	13 days	7 days	5 days	6 days	34 days
Rat 4	3 days	15 days	9 days	6 days	6 days	39 days
Rat 5	3 days	17 days	8 days	7 days	5 days	40 days
Rat 6	3 days	16 days	7 days	6 days	6 days	38 days

Table 1: Behavioral variability and the time course of learning for 6 rats.

Discussion

Rodents have long been used in neuroscientific studies that deal with different topics, from cognitive abilities such as learning and memory²^,¹⁴ and reinforced behavior⁷^,¹⁵^,¹⁶ to the central control of organs¹⁷^,¹⁸ and neuropharmacology¹⁹^,²⁰. The proposed protocol explained a complex behavioral task suitable for experiments involved with electrophysiology and neuroimaging. We have described the delay-based reinforced guided task for rats, but it can be adapted for mice since rats and mice perform similarly on dry land tasks.

We used nose-poking as the stimulus to trigger an audio stimulus. However, lever-pressing and other stimulus modalities such as visual or olfactory stimuli can also be used, individually or concurrently. The proposed operant task has a number of benefits and advantages over existing non-operant methods. Most compelling is the automatic precise timestamping of the course of the animals' decisions which, otherwise, is very difficult. The method is especially well suited to electrophysiology and neuroimaging studies. Another advantage is removing the spatial components of the task which require spatial memory control groups. As a highly demanding task, it is quite likely that not all rats perform well on the paradigm. Replace the animal if it stays idle in the start arm, delays entering the decision zone for more than 5 min or produces higher error rates compare to other animals in the group.

At any decision moment, the costs and values of any choice are assumed to be evaluated simultaneously. Therefore, choosing either HRA or LRA in this task can be results of changes in the encoding of the costs, in the encoding of the benefits, or in the cost-benefit computation. One caveat of the proposed method is being unable to discriminate between the encoding processes.

There are a number of steps that can be taken to maximize the success in training the animals and recording their electrophysiological signals. Firstly, handling the animals before the training is crucial. As the recording sessions start with connecting the recording wires to the animal's head-stage, try to acclimate them so that they allow you to hold their head. This is very important, as infrequently handled animals become anxious during this procedure and may damage the head-stage or the recording cable. Generally, well-handled animals are less stressed, easier to work with, and tend to produce less variable data.

Secondly, rodents leave behind a variety of odorant cues in the maze (i.e., pheromone-containing urine and feces, secrete pheromones from their whisker region, and in fluids from their foot pads). Therefore, the maze needs to be wiped after each individual use and at the conclusion of an experiment to minimize the impact of these residual odorant molecules on the test results. Ethanol (70%) is a common disinfectant used to clean testing equipment. However, like many disinfectants, alcohol itself has an odor that can influence rodent behavior. Therefore, make sure that it has fully evaporated before placing an animal in the maze.

Thirdly, although LFPs are less sensitive to noise than spikes, using solid connectors and a well-secured cable decreases the level of movement noise. Lightly spraying water on the maze floor may decrease any static electricity which is created by friction between the animal's fur and the floor surface.

In conclusion, the protocol described in this article may help to design delay-based reinforced decision-making experiments and record electrophysiological signals while the animal is performing the task.

Disclosures

The authors have nothing to disclose.

Acknowledgements

This research was supported by RMH Neuroscience Foundation, Australia; the Australian Brain Foundation; the RACP Thyne Reid Fellowship, Australia; and by a project grant from the Cognitive Sciences and Technologies Council, Iran to Abbas Haghparast.

Materials

T-maze			Self made
Dustless Precision Sugar Pellets	TSE Systems Intl. Group	F0023	45 mg, Sucrose
Ketamine Hydrochloride Injection, USP	Sigma-Aldrich	6740-87-0
Xylazine	Sigma-Aldrich	7361-61-7
stereotaxic device	Stoelting
Isofluran	Santa Cruz Biotechnology	sc-363629Rx
PFA-coated stainless-steel wires	A-M systems
acrylic cement	Vertex, MA, USA
(wooden or PVC (polyvinyl chloride)-made)	local suppliers
Mini-Fit Power Connector	Molex	15243048
ethannol 70%	Local suppliers
buprenorphine	diamondback drugs
Arduino UNO	Arduino		https://www.arduino.cc/
Infrared emitting diode	Sharp	GL480E00000F	http://www.sharp-world.com/
Chronux Toolbox			Chronux.org
Arduino codes			https://github.com/dechuans/arduino-maze

References

Gold, J. I., Shadlen, M. N. The neural basis of decision making. Annual Review of Neuroscience. 30, 535-574 (2007).
Shi, Z., Müller, H. J. Multisensory perception and action: development, decision-making, and neural mechanisms. Frontiers in Integrative Neuroscience. 7, 81 (2013).
Sutton, R. S., Barto, A. G. . Reinforcement Learning: An Introduction. 1, (1998).
Khani, A., Rainer, G. Neural and neurochemical basis of reinforcement-guided decision making. Journal of Neurophysiology. 116, 724-741 (2016).
Fatahi, Z., Haghparast, A., Khani, A., Kermani, M. Functional connectivity between anterior cingulate cortex and orbitofrontal cortex during value-based decision making. Neurobiology of Learning and Memory. 147, 74-78 (2018).
Khani, A., et al. Activation of cannabinoid system in anterior cingulate cortex and orbitofrontal cortex modulates cost-benefit decision making. Psychopharmacology. 232, 2097-2112 (2015).
Rudebeck, P. H., Walton, M. E., Smyth, A. N., Bannerman, D. M., Rushworth, M. F. Separate neural pathways process different decision costs. Nature Neuroscience. 9, 1161-1168 (2006).
Gage, G. J., et al. Surgical implantation of chronic neural electrodes for recording single unit activity and electrocorticographic signals. Journal of Visualized Experiments. (60), e3565 (2012).
Paxinos, G., Watson, C. . The Rat Brain in Stereotaxic Coordinates. , (1998).
Bokil, H., Andrews, P., Kulkarni, J. E., Mehta, S., Mitra, P. P. Chronux: a platform for analyzing neural signals. Journal of Neuroscience Methods. 192, 146-151 (2010).
Cohen, M. X. . Analyzing Neural Time Series Data: Theory and Practice. , (2014).
Luk, C. -. H., Wallis, J. D. Choice coding in frontal cortex during stimulus-guided or action-guided decision-making. Journal of Neuroscience. 33, 1864-1871 (2013).
Rudebeck, P. H., et al. Frontal cortex subregions play distinct roles in choices between actions and stimuli. Journal of Neuroscience. 28, 13775-13785 (2008).
Goshadrou, F., Kermani, M., Ronaghi, A., Sajjadi, S. The effect of ghrelin on MK-801 induced memory impairment in rats. Peptides. 44, 60-65 (2013).
Haghparast, A., et al. Intrahippocampal administration of D2 but not D1 dopamine receptor antagonist suppresses the expression of conditioned place preference induced by morphine in the ventral tegmental area. Neuroscience Letters. 541, 138-143 (2013).
Esmaeili, M. -. H., Kermani, M., Parvishan, A., Haghparast, A. Role of D1/D2 dopamine receptors in the CA1 region of the rat hippocampus in the rewarding effects of morphine administered into the ventral tegmental area. Behavioural Brain Research. 231, 111-115 (2012).
Chaleek, N., Kermani, M., Eliassi, A., Haghparast, A. Effects of orexin and glucose microinjected into the hypothalamic paraventricular nucleus on gastric acid secretion in conscious rats. Neurogastroenterology & Motility. 24, e94-e102 (2012).
Kermani, M., Eliassi, A. Gastric acid secretion induced by paraventricular nucleus microinjection of orexin A is mediated through activation of neuropeptide Yergic system. 神经科学. 226, 81-88 (2012).
Kermani, M., Azizi, P., Haghparast, A. The role of nitric oxide in the effects of cumin (Cuminum Cyminum L.) fruit essential oil on the acquisition of morphine-induced conditioned place preference in adult male mice. Chinese Journal of Integrative Medicine. , 1-6 (2012).
Ahmadi, A., et al. Synthesis and antinociceptive behaviors of new methyl and hydroxyl derivatives of phencyclidine. Current Medicinal Chemistry. 19, 763-769 (2012).

Play Video

PDF

DOI

DOWNLOAD MATERIALS LIST

Cite This Article

Kermani, M., Fatahi, Z., Sun, D., Haghparast, A., French, C. Operant Protocols for Assessing the Cost-benefit Analysis During Reinforced Decision Making by Rodents. J. Vis. Exp. (139), e57907, doi:10.3791/57907 (2018).