This manuscript describes a memory retrieval procedure for destabilizing robust reward memories and rewriting them with counterconditioning prior to their reconsolidation.
Maladaptive reward memories (MRMs) can become unstable following retrieval under certain conditions, allowing their modification by subsequent new learning. However, robust (well-rehearsed) and chronologically old MRMs, such as those underlying substance use disorders, do not destabilize easily when retrieved. A key determinate of memory destabilization during retrieval is prediction error (PE). We describe a retrieval procedure for alcohol MRMs in hazardous drinkers that specifically aims to maximize the generation of PE and therefore the likelihood of MRM destabilization. The procedure requires explicitly generating the expectancy of alcohol consumption and then violating this expectancy (withholding alcohol) following the presentation of a brief set of prototypical alcohol cue images (retrieval + PE). Control procedures involve presenting the same cue images, but allow alcohol to be consumed, generating minimal PE (retrieval-no PE) or generate PE without retrieval of alcohol MRMs, by presenting orange juice cues (no retrieval + PE). Subsequently, we describe a multisensory disgust-based counterconditioning procedure to probe MRM destabilization by re-writing alcohol cue-reward associations prior to reconsolidation. This procedure pairs alcohol cues with images invoking pathogen disgust and an extremely bitter-tasting solution (denatonium benzoate), generating gustatory disgust. Following retrieval + PE, but not no retrieval + PE or retrieval-no PE, counterconditioning produces evidence of MRM rewriting as indexed by lasting reductions in alcohol cue valuation, attentional capture, and alcohol craving.
Building on seminal work of Lewis and colleagues1 over the last twenty years has highlighted an unprecedented potential for plasticity in established (consolidated) memories via the process of memory reconsolidation2,3. Reconsolidation occurs under certain circumstances when memories are retrieved4 and consists of two temporally5 and molecularly6 dissociable stages: initial destabilization7 and subsequent restabilization8. Following retrieval-induced memory destabilization, memories enter an 'active', malleable state, in which they are susceptible to modification through incorporation of novel information9,10,11,12, or weakening through pharmacological interference with the molecular pathways required for restabilization13,14,15,16. This 'reconsolidation window,' the interval between destabilization and restabilization, lasts 1 to 6 h and represents a unique opportunity to directly interfere with the maladaptive reward memories (MRMs) that are believed to play a key role in the aetiology17, progression18, and maintenance19,20 of substance use disorders (SUDs) like alcohol use disorder.
MRMS are associations formed through Pavlovian mechanisms that link environmental stimuli or 'drug cues' to the availability, and intoxicating and rewarding effects of drugs21. MRMs imbue drug cues with enhanced value, salience22, and motivational properties such that these cues grab attention23, trigger craving and motivate drug seeking-and-using behaviour in people with SUDs. These MRMs are therefore thought to be responsible for triggering relapse when drug cues are encountered24. The primary challenge in the long-term clinical management of SUDs is therefore to reduce the ability of MRMs to promote drug-taking, which, by extension, should reduce the incidence of relapse21. The reconsolidation window offers an exciting opportunity to achieve this aim by updating MRMs while they are unstable to a form that is less likely to contribute to relapse.
Recent research has shown that this can be achieved using purely behavioral interventions10,25. These can produce profound reductions in craving and drug-related reward metrics in heroin addicts26, smokers27, and hazardous drinkers28. By giving a brief reminder of MRMs (typically brief exposure to drug cues) to destabilize them, and subsequently re-associating drug cues with lack of drug (extinction), or aversive outcomes (counterconditioning)29 while MRMs are unstable, the associations between drug cues and outcomes restabilize in an updated, more adaptive form. These rewritten MRMs no longer support relapse. The only difference between these and standard extinction or counterconditioning interventions is the retrieval and destabilization of MRMs – produced by brief exposure to drug cues – prior to the learning intervention. They are therefore typically referred to as 'retrieval-extinction' or 'retrieval-counterconditioning' interventions.
However, there is now a significant body of research showing inconsistent results with these interventions30,31,32,33. This may be partially explained by individual differences in the expression of plasticity-promoting proteins34. However, since retrieval is necessary but not sufficient4,35,36 for memory destabilization, there are also certain boundary conditions that determine whether a memory destabilizes or not. The extent to which these boundary conditions were operative likely also varied from study-to-study. Chief among these conditions are memory age (chronology)37 and strength (reinforcement history)38,39, duration of the reminder trial5, and the occurrence of mismatch35,40 between predicted and actual outcome during retrieval, known as prediction error (PE)41,42,43. These factors are inter-related, as PE is the central reward 'learning signal'44,45 and diminishes over the course of learning. PE encodes the difference between expected outcome encoded in memory and actual outcome, reflecting the inaccuracy of learned predictions. It is by minimizing the occurrence of PE that learning accrues. Old, strongly reinforced memories like MRMs – which have formed over many years – have extremely good predictive power for outcomes across different situations. As such, little PE will be generated when MRMs are retrieved under normal conditions, conferring these traces with destabilization-resistance.
Leveraging this knowledge, we developed a retrieval and PE-generation (Retrieval + PE) procedure for alcohol MRMs that aims to maximize the likelihood of these memories destabilizing by maximizing PE at retrieval. We have shown that subsequent counterconditioning causes comprehensive updating of alcohol MRMs in hazardous drinkers28,46. This manuscript describes the implementation of the Retrieval + PE procedure for destabilizing alcohol MRMs, along with a multisensory counterconditioning technique that rewrites these memories.
The Retrieval + PE procedure involves the use of verbal instructions to maximize participants' expectancy of alcohol reward, then preventing alcohol consumption at the last moment. Without knowledge of the exact learning history, this PE maximization putatively maximizes the likelihood of MRMs destabilization and provides a platform for testing the efficacy of post-destabilization behavioral interventions in improving indices of maladaptive reward memory. Here we describe how to implement this procedure with subsequent disgust-based counterconditioning, which we28 and others29 have shown to be an effective learning modality for updating MRMs. However, the Retrieval + PE procedure could also be used in combination with alternative post-retrieval drug interventions and many other forms of learning-based interventions25.
All procedures were approved by the University College London Research Ethics Committee and carried out in accordance with the Declaration of Helsinki. Obtain all necessary local approval prior to using this method.
1. Preparation of Gustatory Disgust Unconditioned Stimulus
2. Preparation of Participants and Drinking Measures
3. Memory Reactivation and Control Non-reactivation Procedures
NOTE: See Figure 1 for the schematic.
4. Distractor Tasks
5. Instructions for Counterconditioning Task
6. Running Counterconditioning Task
7. One-Week Follow Up Measures
8. Dot-probe Task (Optional)
9. Inclusion and Exclusion Criteria
10. Data Pre-Processing and Analysis59
Compare group means at baseline for subjective measures. Groups should be equivalent on baseline intake of alcohol, disgust sensitivity/propensity, SOCRATES and NAEQ scores, and momentary craving (ACQ-NOW). If there are differences in these measures at baseline, analysis should continue using mixed-effects models and these measures should be included as random-effects59. Performance of these analyses are not described here. Assess frequency of positive alcohol breathalyzer readings in each group and report this as an outcome.
Pleasantness ratings of CS+s and CS-s did not differ at baseline (before counterconditioning), but diverged over trials of counterconditioning, with pleasantness ratings for beer CS+s reducing significantly through repeated pairing with the pictorial and bitter drink UCSs. If CS+s and CS-s differ at baseline, use a mixed-effects model with random intercepts and slopes to analyze these data. The CS-s are never paired with UCSs, so do not show a decline in pleasantness. This is represented by a CS Type (CS+ vs. CS-) x Trial (Baseline, Trial 1, 2, 3 & 4) interaction if counterconditioning has been successful, as indicated in Figure 2 (representative data from Das et al.28)
Evidence of rewriting of MRM networks is provided by a generalized reduction in pleasantness ratings to alcohol stimuli, but not neutral stimuli at follow up (Day 8). In the RET+PE group, reduced pleasantness ratings were evident in response to CS+s used in the retrieval/counterconditioning task (Beer CS+s), as well as to novel beer and wine images rated for the first time at follow up. Statistically this was evident in a CS Type (Beer CS+, Neutral CS-, Novel Beer, Novel Wine) x Group ( No RET+PE, RET+PE, RET no PE) interaction. Example results showing this pattern taken from Das et al.28 are shown in Figure 3.
Examine this pattern of results in the optional attentional bias task. Attentional bias is calculated as dwell time on a target alcohol image – dwell time on its composition-matched non-target pair image. A score of 0 indicates no bias, positive score attentional bias towards alcohol stimuli, and a negative score an oculomotor aversion to alcohol pictures. Representative results taken from Das et al.28 are shown in Figure 4. It can be seen that an oculomotor aversion to alcohol images at follow up (Day 8) was produced in the RET+PE group only, indicated by a significant Group x CS Type interaction.
Figure 1: A Schematic of the three retrieval groups and prediction error procedures.
Key to abbreviations: RET + PE = Retrieval + Prediction Error; the group who retrieve alcohol memories and have expected alcohol withheld. RET + No PE = Retrieval + No Prediction Error; the group who retrieve alcohol memories and consume alcohol as expected. No RET + PE = No retrieval + Prediction Error; this group does not retrieve alcohol memories and has expected orange juice withheld. In vivo drink: A 150 mL glass of beer in RET + PE and RET + No PE or a 150 mL glass of orange juice in the no RET group. 1) In vivo drink: The drink relevant to the particpants' group is placed in front of participants and they are told that they will consume this drink according to prompts they will see on screen; after rating a series of pictures for pleasantness. 2) Cue image rating: Participants in RET + PE and RET + No PE rate four images of beer and two images of soft drinks (coffee and cola) for pleasantness. Brief in vivo exposure to beer and rating of beer images triggers retrieval of drinking memories in these groups. The No RET group rates four images of orange juice and the soft drink images for pleasantness and thus do not retrieve alcohol memories. 3) Prediction error: As all participants are told that they will drink the in vivo drink at the start of the procedure, PE is engendered by preventing participants in RET + PE and No RET + PE from consuming the drink in front of them. In RET + No PE, the drink is consumed as expected, engendering no PE. 4) Distractors: High working-memory tasks are performed (prose recall, digit span, and category and verbal fluency) to distract participants and disengage them from the retrieval task. 5) Intervention: a counterconditioning task where beer images are paired with disgust-inducing images and very bitter drinks. This procedure aims to create an association between beer images and the experience of disgust that overwrites existing associations in the RET + PE group due to destabilization of alcohol memories. Please click here to view a larger version of this figure.
Figure 2: Mean pleasantness ratings (± SEM) of neutral and beer cues during counterconditioning. Representative changes in pleasantness ratings of CS+s (beer images paired with disgusting outcomes) and CS-s (neutral images paired with neutral outcomes) over the course of counterconditioning, taken from Das et al.28 As counterconditioning aims to invoke conditioned disgust in response to beer images, perceived pleasantness of these images should reduce during counterconditioning. Ratings do not differ at baseline, but reduce to CS+s over the course of counterconditioning. ** = CS+ > CS- at p< 0.001. Please click here to view a larger version of this figure.
Figure 3: Mean pleasantness ratings (± SEM) of counterconditioned, novel alcohol cues and neutral cues at test. Representative generalized reductions in pleasantness ratings (liking) of alcohol images seven days after counterconditioning is performed following retrieval (RET) with prediction error (PE) (RET +PE) from Das et al.28 This pattern is consistent with rewriting of reward associations relating to alcohol in RET + PE. Key: Neutral CS- = coffee and cola images paired with neutral images during counterconditioning. Beer CS+ = beer images paired with disgusting outcomes during counterconditioning. Novel Beer = previously unseen beer images. Wine = previousy unseen wine images. * = significant pairwise comparisons at p<0.05, Bonferroni corrected. Please click here to view a larger version of this figure.
Figure 4: Mean attentional bias to counterconditioned, novel alcohol cues and neutral cues at test. Representative generalized abolition of attentional bias to all alcohol stimuli in the group that underwent counterconditioning after RET + PE from Das et al28. Bars indicate mean attentional bias scores, calculated as the averaged difference in total time looking at a 'target image' containing visible alcohol vs. a composition-matched 'non target' imagelacking visible alcohol. Error bars are SEMs. Neutral CS- = coffee and cola images paired with neutral images during counterconditioning. Beer CS+ = beer images paired with disgusting outcomes during counterconditioning. Novel Beer = previously unseen beer images. Wine = previously unseen wine images. * = significant pairwise comparisons at p<0.05, Bonferroni corrected. Please click here to view a larger version of this figure.
TRIAL NUMBER | CS TYPE | UCS TYPE | UCS FILE NAME | |||
1 | Beer CS+1 | GUSTATORY | DRINK_SCREEN.PNG | |||
2 | Neutral CS-1 | NEUTRAL | 7020.jpg | |||
3 | Beer CS+1 | GUSTATORY | DRINK_SCREEN.PNG | |||
4 | Neutral CS-2 | NEUTRAL | 7019.jpg | |||
5 | Beer CS+4 | PICTORIAL | rotten_foot.jpg | |||
6 | Beer CS+3 | PICTORIAL | 9325.jpg | |||
7 | Beer CS+2 | GUSTATORY | DRINK_SCREEN.PNG | |||
8 | Beer CS+4 | PICTORIAL | 9325.jpg | |||
9 | Beer CS+3 | PICTORIAL | rotten_foot.jpg | |||
10 | Neutral CS-1 | NEUTRAL | 7020.jpg | |||
11 | Beer CS+1 | GUSTATORY | DRINK_SCREEN.PNG | |||
12 | Neutral CS-2 | NEUTRAL | 7019.jpg | |||
13 | Neutral CS-1 | NEUTRAL | 7019.jpg | |||
14 | Beer CS+2 | GUSTATORY | DRINK_SCREEN.PNG | |||
15 | Beer CS+4 | PICTORIAL | 9405.jpg | |||
16 | Beer CS+1 | GUSTATORY | DRINK_SCREEN.PNG | |||
17 | Beer CS+4 | PICTORIAL | 9301.jpg | |||
18 | Neutral CS-2 | NEUTRAL | 7019.jpg | |||
19 | Beer CS+3 | PICTORIAL | 9405.jpg | |||
20 | Beer CS+2 | GUSTATORY | DRINK_SCREEN.PNG | |||
21 | Beer CS+3 | PICTORIAL | 9301.jpg | |||
22 | Neutral CS-2 | NEUTRAL | 7019.jpg | |||
23 | Beer CS+2 | GUSTATORY | DRINK_SCREEN.PNG | |||
24 | Neutral CS-1 | NEUTRAL | 7020.jpg |
Table 1: Pseudorandomized trial order for counterconditioning task used in Das et al.28
CS Type = Conditioned stimulus type. There are four beer images used in the counterconditioning. These are arbitrarily numbered Beer CS+ 1 to 4. Two neutral images of coffee and cola are also used and these are arbitrarily numbered Neutral CS-1 and Neutral CS-2. UCS Type = Unconditioned Stimulus type. Gustatory unconditioned stimuli are the words "DRINK NOW" appearing on-screen, and participants consuming 15 mL 0.067% Denatonium Benzoate solution. Pictorial UCSs are unpleasant/disgusting images sourced from the International Affective Picture System (IAPS) database and internet. Neutral UCSs are two images sourced from the IAPS database that are rated neutrally. UCS file name: this column gives the specific images to be displayed as outcomes on each trial. Numeric file names refer to IAPS database numbers. These images are available upon request to the IAPS database. Other images are available from the authors on request.
The protocol in this paper describes an alcohol MRM retrieval procedure that explicitly generates prediction error in alcohol delivery (Retrieval + PE) to maximize the probability that naturalistic alcohol MRMs will destabilize. This retrieval procedure takes account of recent experimental work demonstrating the necessity of prediction error for memory destabilization and engaging the reconsolidation process60. It has been shown to produce the most profound changes in indices of alcohol MRMs from subsequent behavioral interventions (counterconditioning and cognitive reappraisal) in two papers28,46 and is currently being further validated in drug models. Since this effect appears to be independent of learning history, the procedure represents a significant improvement over other memory reactivation techniques, which do not incorporate a PE, and should be used as a platform for the assessment of post-destabilization interventions for reducing maladaptive drinking behaviour. Such refinement of techniques is particularly important in light of null findings in the reconsolidation field (see below). Moreover, the RET+PE method has considerable applied significance and may be applicable in combination with a variety of post-retrieval relearning methods. For example, we have demonstrated effects on semantic memory and craving using RET+PE followed by reappraisal, a prototypical adaptive emotion regulation technique commonly used in cognitive behavioural therapy46.
The procedure is easily modified to suit the characterisitics of the participant group. For example, the stimuli used as CS+s during counterconditioning can be changed to wine pictures, if the participants are primarily wine preferring. Alternatively, smoking-related stimuli can be used if the procedure is employed in tobacco smokers.
Effective counterconditioning relies on potent disgust cues. To ensure sufficient relearning during reconsolidation, select visual UCSs that are likely to elicit powerful disgust responses. Although these are visual cues, they should have relevance to gustatory disgust (e.g., contamination-related images; images of food spoilage). If an alternative gustatory UCS (other than denatonium benzoate at the concentrations used here) is used, we recommend a compound that strongly activates bitterness responses.
Although we use an expectancy violation, it is theoretically possible to generate PE using other methods, although their efficacy in destabilizing robustly encoded reward memories has yet to be demonstrated. We have trialed an alternative procedure involving unexpected devaluation of alcohol (using unexpectedly bitter tasting alcohol), although we did not demonstrate convincing memory modifications using this procedure46.
Randomization of participants to groups should prevent baseline differences in trait questionnaire measures. If this is the case, however, these differences should be modelled as random effects in mixed-effects analyses of outcomes. A supplementary approach, which the authors recommend, is to include an extra baseline day prior to the retrieval and counterconditioning day. This allows better assessment of pre-existing group differences, the reliability of these differences, and gives researchers the option of stratified randomization to groups to prevent such differences.
In order to generate an effective PE, it is essential that participants experience a relevant surprising occurrence during retrieval. If an expectancy violation is used, as described here, ensure that participants are observed during this step so that they do not inadvertently consume the alcohol at a point they are instructed not to. Related to this, it is essential that participants are not aware of the experimenter's intention to withhold alcohol after generating the expectation of alcohol reward. As such, the protocol involves a necessary degree of deception. Upon debriefing, ensure participants are aware that they should not discuss the protocol with others.
While there is evidence that the procedure robustly destabilizes memories and has been designed to maximize the probability of doing so, there is currently no independent means of assessing whether or not destabilization has occurred. This is a limitation of all memory destabilization procedures described to date and as such, null effects of post-destabilization interventions at test are difficult to interpret, as they may be due to low efficacy of the intervention or a failure to sufficiently destabilize MRMs in the first place.
The remarkable generalization of Ret+PE dependent counterconditioning effects to non-trained stimuli makes this approach highly promising for clinical implementation. However, our demonstration of efficacy is limited to an experimental (non-clinical) setting with problem drinkers, who do not have an alcohol use disorder.
Relatedly, although the procedure is easily adapted, it is unknown whether the RET+PE procedure is similarly efficacious (in a modified form) in destabilizing MRMs in different (illicit) substance using populations. We believe it would be at least as effective, as alcohol MRMs are likely to be more overlearned, robust, and cross-contextual than MRMs for most illicit drugs. This remains to be verified experimentally however, and it is unknown how sensitive the efficacy of the procedure is to variations in number of cues presented or their exact nature. We therefore encourage experimentation with the procedure in different drug-using populations and with different retrieval cues, as well as tailoring post-destabilization interventions to population-specific reward maladaptations.
To address the measurement issues outlined above – namely the reliance on efficacy of the post-destabilization intervention to infer effective memory destabilization – independent measures of destabilization are required. We are currently developing electroencephalographic and psychophysiological techniques for resolving this issue and will make these available upon request when completed.
Implementation across the range of severities of problem drinking is required to establish the clinical utility of this technique. Moreover, clinically-oriented studies are essential to determine whether this procedure will be acceptable to treatment seekers.
The authors have nothing to disclose.
This work was funded in its entirety by a UK Medical Research Council grant (grant reference: MR/M007006/1) awarded to Sunjeev Kamboj and Ravi Das. The refinement of the memory retrieval procedure and sourcing of cue images was performed by Grace Gale. We would like to thank Katie Walsh and Josie Hanniford for contributions towards piloting the procedure.
Multipipette M4 x 1 | Eppendorf | 4982 000.012 | High-accuracy pipette for dosing Bitrex |
Combitips advanced 0.2ml x 1000 | Eppendorf | 0030 089.413 | Syringe tip for use with Micropipette for dosing Bitrex |
Simax 100ml measuring cylinder | Phillip Harris | B8A73325 | Any suitable measuring cylinder may be used |
Bitrex (2.5% w/v aqueaous Denatonium Benzoate solution) | Mcfarlan Smith | N/A | Bitter solution for counterconditioning drink UCSs |
International Affective Picture System images | International Affective Picture System (Lang et al, 2008) | (http://csea.phhp.ufl.edu/media/iapsmessage.html) | Upon request from Margaret Bradley |
Stimulus presentation monitor with 1024 x768 colour display minimum | Dell | N/A | |
Eyelink 1000 Core System | SR Research | Desktop-type mount | Other eye-tracking systems can be used |
Experiment Builder | SR Resesarch | N/A | Other systems (Presentation/MATLAB/ePrime/Psychopy etc) can be used |
DataViewer | SR Resesarch | N/A | Use software as appropriate to eye tracker setup |
SPSS 21.0 for Windows | IBM | Base Package | Use any appopriate statistical software |
Lion Alcometer 500 | Lion Laboratories | N/A | Any accurate alcohol breath testing device may be used |
Terumo 5ml syringe | MediSupplies | PMCO595 | Any 5ml syringe may be used |
Mini Table Top Scale | On Balance | MTT-200 | Any high-accuracy scales may be used |
Non-alcoholic beer | Bavaria | N/A | Any brand non-acloholic beer may be used |