Delay discounting refers to a decline in the value of a reward when it is delayed relative to when it is immediately available. We outline a computer-based delay discounting task that is easy to implement and allows for the quantification of the degree of delay discounting in human participants.
Delay discounting refers to a decline in the value of a reward when it is delayed relative to when it is immediately available. Delay discounting tasks are used to identify indifference points, which reflect equal preference for two dichotomous reward alternatives differing in both delay and magnitude. Indifference points are key to assessing the shape of a delay-discounting gradient because they allow us to isolate the effect of delay on value. For example, if at a 1 week delay and a maximum of $1,000, the indifference point is at $700 we know that, for that participant, a 1-week delay corresponds to a 30% reduction in value. This video outlines an adjusting amount delay-discounting task that identifies indifference points relatively quickly and is inexpensive and easy to administer. Once data have been collected, non-linear regression techniques are typically used to generate discounting curves. The steepness of the discounting curve reflects the degree of impulsive choice of a group or individual. These techniques have been used with a wide range of commodities and have identified populations that are relatively impulsive. For example, people with substance abuse problems discount delayed rewards more steeply than control participants. Although degree of discounting varies as a function of the commodity examined, discounting of one commodity correlates with discounting of other commodities, which suggests that discounting may be a persistent pattern of behavior1.
Delay discounting is a behavioral phenomenon that affects many situations people encounter Delay discounting refers to the fact that temporally proximal rewards are more highly valued than temporally distal rewards. That is, the value of rewards decline with delays. This is an important process because many choices that people make involve a tradeoff between immediate low quality outcomes (e.g., a piece of cheesecake after dinner) and delayed high quality outcomes (e.g., long-term health). Delay discounting has also been observed in a variety of species in addition to humans2,3, including monkeys4,5, rats6,7, and pigeons8.
Individual differences in degree of discounting have been linked to various maladaptive behaviors9. The value of rewards declines as a function of delay according to a hyperbolic decay function8. With hyperbolic decay, value decreases extensively with relatively short delays, but decreases proportionally less so across relatively long delays. Mazur's finding that value degrades hyperbolically as a function of delay is important, because the hyperbolic function is able to predict preference reversals where other theoretical functions cannot without additional assumptions. Preference reversals are a well-documented finding10-12 that preference for a small reward available relatively soon (SSR) over a larger reward available at a relatively distal point in the future (LLR) will reverse if a common delay is added to both alternatives. For example, if, while driving home from work, a feeling of hunger suddenly hits, a person may be inclined to stop at the first fast food restaurant in sight for a relatively unhealthy snack as opposed to waiting until they get home for a piece of fruit or some other high quality snack. If, however, the hunger hits while still at work, when the person still has to walk to their car and drive down the road before approaching the fast food restaurant, they are more likely to decide to wait until they get home for the fruit.
The steepness with which rewards decline in value as a function of delay can be considered a measure of an organism's choice impulsivity. Choice impulsivity can be defined as a preference for SSR over LLR13,14.Higher degrees of impulsive choice are linked to use and abuse of various drugs such as alcohol15,16, cigarettes17,18, cocaine19, heroin20,21, and methamphetamine22. Higher degrees of impulsive choice are also linked to problematic gambling23, obesity24,25, and poor health and personal safety choices26.
Various tasks can be used to assess delay discounting in humans. For instance, participants could be asked to make decisions between alternatives and experience some or all of the consequences associated with their choice (real reward task27,28) or they could be asked to make decisions between hypothetical alternatives, in which case they would not actually experience the consequences associated with their choice (hypothetical reward task1-3,9,15-19,25,29). Similar degrees of discounting are generally observed regardless of whether the reward and delays are real or hypothetical30. The method of administering delay-discounting tasks differs across studies. For example, various laboratories have administered the task using a fill-in-the-blank questionnaire31, a multiple-choice questionnaire32, an adjusting amount procedure33, and a monetary choice questionnaire34. The adjusting amount task, originally developed by Du, Green, and Myerson33, and used extensively in our laboratory, provides several benefits. Once the task is programmed data collection is automated, limiting human error throughout the process. Due to the adjusting nature of the task, indifference points are reached with relatively few questions, which minimizes the time participants are required to be in the and laboratory and limits boredom. Importantly, the task provides detailed and reliable data. The adjusting amount task will be detailed below.
The protocol was approved by the Institutional Review Board at Utah State University. The steps outlined below should serve as a guide for programming and conducting a delay discounting task.
1. Setting up a Delay Discounting Task
2. Obtain Informed Consent and Login Participant
3. Provide Instructions and Practice Trials
4. Assess a Single Indifference Point
NOTE: Indifference points serve as the major dependent variable from delay discounting tasks and represent a point at which the present value of the delayed alternative is equal to that of the immediate alternative.
5. Determine Indifference Points at Each Delay
6. Assess Delay Discounting of Qualitatively Different Outcomes (Optional)
Figure 1. Trial Structure of the Adjusting Amount Task. The starting value for the delayed alternative, Y, should equal the maximum. The starting value for the immediate alternative, X, should equal .5Y. If X is chosen then the value of X should be decreased on the next trial. If Y is chosen then the value of X should be increased on the next trial. The amount of the adjustment is .25Y on Trial 1 and is .5 of the previous adjustment on each subsequent trial. Please click here to view a larger version of this figure.
7. Data Analysis
Delay discounting results are commonly analyzed by fitting curvilinear regression models to both the median indifference points from the groups and indifference points from individual participants for each outcome. Median group indifference points are used because the indifference points for a sample are usually not normally distributed. Three non-linear regression models are commonly used: those suggested by Mazur (Equation 1)8, Myerson and Green (Equation 2)35, and Rachlin (Equation 3)36.
In these models, V is the present (discounted) value of a delayed outcome (i.e., the experimentally-determined indifference point), A is the amount of the future outcome, D is the delay to the outcome, and k is a free parameter that quantifies the steepness with which the delayed outcome loses value as a function of delay. In Equations 2 and 3, s is a scaling parameter that is also free to vary. Traditional statistical analyses may be conducted on the natural log (ln) of k from Equation 1. Statistical analyses are less appropriate for ln(k) from Equation 2 and Equation 3 because k is not an independent measure of discounting due to its interaction with the s parameter.
In our laboratory, we have shown that the specific outcome that is being investigated (e.g., food vs. money) affects discounting (e.g., food is discounted more steeply than money1). Despite this fact, individual participants' degree of discounting is correlated across different outcomes. We have interpreted this finding as evidence that delay discounting is a trait-like process. However, while delay discounting seems to be a trait-like process, it is also affected by state variables37,38.
The following results, previously published in the journal Psychopharmacology1 demonstrate typical delay discounting curves obtained through non-linear regression. For group analysis, median group indifference points are obtained for each delay. These points are fit to the non-linear regression model (see provided R code). Figure 2 displays the model fits of Equation 2 for four outcomes: money, alcohol, entertainment, and food. Results have been separated into two groups: cigarette smokers and non-smokers.
Figure 2. Delay Discounting of Different Commodities. Discounting functions for smokers and non-smokers for the commodities of money, alcohol food, and entertainment. In all four panels, the points show median indifference points and lines show the best fitting hyperbola-like discounting function35. Insets for the commodities of alcohol, entertainment, and food are the same data with the x-axis scaled to show indifference points at the shortest delays. In some cases, data points may overlap. This figure was originally published in Psychopharmacology1 (under CC-BY license). Please click here to view a larger version of this figure.
The quality of the fits can be evaluated using two measures: R2 and Akaike Information Criteria (AIC). R2 is calculated as 1 – (Residual Sum of Squares/Total Sum of Squares). R2 scores for non-linear regression should be interpreted with caution (and possibly avoided) because the model sum of squares and error sum of squares do not equal 1. Nonetheless, we typically include R2 scores due to convention and so that the values from our studies can be compared to previous studies. AIC is calculated as 2k + n Log(RSS/n) where k is the number of free parameters (1 for Equation 1, and 2 for Equations 2 and 3), and n is the number of indifference points (see Table 1). Individual data are analyzed in a similar method. Median R2 and AIC values are reported to demonstrate the quality of the individual fits (Table 2). It is important to note that Equation 1 is a special case of Equation 2 and Equation 3 (when s = 1) and will never produce a larger R2 value than these other equations. Thus, AIC can be used to evaluate if the gain in R2 for the more complex models justifies the extra parameter (the increased complexity) in these equations. An alternative method of evaluating whether the more complex model is justified would be to determine whether s differed significantly from 139.
Alternatively, a non-theoretical measure, area under the curve (AUC), can be obtained from the participant's indifference points40. AUC is the sum of the trapezoidal area between each set of adjacent indifference points. AUC is calculated as (x2 – x1)[(y1 + y2)/2], where x1 and x2 are the successive delays and y1 and y2 are the indifference points for those delays (see provided R code). AUC ranges between 0 and 1 and lower values indicate steeper discounting. Parametric statistics can be used to analyze AUC if the specific sample meets the requirements of normality.
Table 1:Model Fit Comparisons. Model fit comparisons for the Mazur8 hyperbola and Myerson and Green35 hyperboloid. Bolded values indicate the better fit. For median indifference points, the Akaike Information Criterion (AIC) results indicate that the hyperboloid provided a better fit five out of eight times. Comparisons of R2 values obtained from fitting both models to individual participant data indicate that the hyperboloid fit better in all cases than the hyperbola.
Table 2: Parameter Estimates. The k and s parameters as well as R2 for hyperboloid fits to median indifference points for each outcome for each group.
Supplemental File 1. Monetary Discounting Eprime Instructions.txt Please click here to download this file.
Supplemental File 2. Monetary Gain Delay Discounting Only.ebs2 Please click here to download this file.
Supplemental File 3. Monetary Gain Delay Discounting Only.es2 Please click here to download this file.
Supplemental File 4. JOVE Pseudocode.pdf Please click here to download this file.
Supplemental File 5. Delay Discounting.R Please click here to download this file.
Supplemental File 6. Data.txt Please click here to download this file.
This video describes the steps that should be taken to conduct a delay discounting experiment using the adjusting amount task. The adjusting amount task is relatively quick to conduct (10 – 15 min per participant) and produces reliable data. The adjusting nature of the task provides a fine-tuned analysis of an individual participant's degree of discounting. Since the task is computer-based data collection is automated, which limits human-error and influence during the data collection process. Typically the task is used to assess discounting of hypothetical outcomes, but it has also been used to assess discounting of real outcomes28. One limitation to the adjusting amount task is that the task is not robust against participant error. Due to the titrating nature of the task an error made in the first trial of a delay block (e.g., clicking $50 now instead of $100 in a week when the participant meant to choose $100 in a week) will drastically affect the indifference point for this delay as the immediate option will never again reach $50 in this block due to the decreasing adjustment across trials. An error made in a later trial within a block will not affect the indifference point as much. Based on observation in our laboratory, we find that such errors are relatively rare. The experimenter could program the task to verify with the participant that the indifference point is accurate and repeat the process for that delay if it is not.
Three critical parameters within a delay discounting experiment using the adjusting amount task are up to experimenter discretion, but should align with the experimental question: 1) The amount of the outcomes being used should make sense for the experimental questions (e.g., $100,000 worth of food is nonsensical). 2) The delays used in the experiment should make sense with the outcome and amounts being used (e.g., due to steep discounting $10 may not be enough to provide meaningful data if one uses a delay progression that ranges from 1 week to 25 years). 3) The number of adjustments within each delay block should balance resolution and time (more resolution with more trials, but greater time required from participants). Here we outlined one way in which a delay discounting assessment can be carried out, but delay discounting tasks are robust to variation and slight modifications of the procedure outlined above are not likely to make a significant difference in the findings.
Analyzing data from delay discounting experiments consists of curvilinear regression techniques that are relatively easy to implement and produce good fits to the data. We have included several documents in Supplementary Materials that will aid in programming a delay discounting experiment and analyzing the data that are collected through a delay discounting task: pseudo-code to assist in programming a delay discounting task in any language, a delay discounting task programmed in E-Prime, and script for running non-linear regression in the statistical program R (with comments).
Delay discounting experiments, using the adjusting-amount task, provide a robust way to identify between-group and within-subject differences in impulsive choice. Experiments have identified differences in the degree of delay discounting between people with maladaptive behavior patterns and control participants41. Experiments using delay-discounting tasks can also be used to identify variables that impact delay-discounting within-subject and assess the relative permanence of those manipulations.
While previous research has focused on examining differences in delay discounting among different populations, more research is needed to understand how delay discounting can be impacted through therapeutic intervention. Delay discounting experiments have been extremely successful in identifying differences between control populations and populations of people with maladaptive behavior patterns and provide researchers with a rationale for why individuals gamble, use drugs, overeat, or have little regard for health-related behavior. Because the negative outcomes associated with these behaviors are delayed, those outcomes have little impact on the behavior of people with steep discounting functions.
Little research has yet focused on the mechanisms underlying delay discounting. What gives rise to high degrees of discounting, which may lead to these maladaptive behavior patterns? Although there is evidence to suggest that delay discounting is at least somewhat heritable42, delay discounting may still be malleable. It is important to identify the psychological and neurobiological mechanisms underlying delay discounting and variables that can impact those mechanisms. It is possible that the degree of delay discounting may be reduced by therapeutic intervention43, but more research is needed to understand the generality of these findings and the impact that decreases in delay discounting may have on the propensity to engage in the maladaptive behavior patterns associated with steep delay discounting gradients.
The authors have nothing to disclose.
Preparation of this manuscript was supported in part by grant R01DA029100 from the National Institute on Drug Abuse.
Computer | any | Mac or Windows | |
Programming Software | Visual Studios | https://www.visualstudio.com | |
Data Analysis Software | The R Foundation | http://www.r-project.org | |
Informed Consent Form |