We demonstrate how an objective measure can be employed in the widely employed rubber hand illusion paradigm. This measure is obtained by modifying the well-established crossmodal congruency task. This task allows the investigation of multisensory processes which are critical for modulations of body representations as in the rubber hand illusion.
The rubber hand illusion (RHI) is a popular experimental paradigm. Participants view touch on an artificial rubber hand while the participants’ own hidden hand is touched. If the viewed and felt touches are given at the same time then this is sufficient to induce the compelling experience that the rubber hand is one’s own hand. The RHI can be used to investigate exactly how the brain constructs distinct body representations for one’s own body. Such representations are crucial for successful interactions with the external world. To obtain a subjective measure of the RHI, researchers typically ask participants to rate statements such as “I felt as if the rubber hand were my hand”. Here we demonstrate how the crossmodal congruency task can be used to obtain an objective behavioral measure within this paradigm.
The variant of the crossmodal congruency task we employ involves the presentation of tactile targets and visual distractors. Targets and distractors are spatially congruent (i.e. same finger) on some trials and incongruent (i.e. different finger) on others. The difference in performance between incongruent and congruent trials – the crossmodal congruency effect (CCE) – indexes multisensory interactions. Importantly, the CCE is modulated both by viewing a hand as well as the synchrony of viewed and felt touch which are both crucial factors for the RHI.
The use of the crossmodal congruency task within the RHI paradigm has several advantages. It is a simple behavioral measure which can be repeated many times and which can be obtained during the illusion while participants view the artificial hand. Furthermore, this measure is not susceptible to observer and experimenter biases. The combination of the RHI paradigm with the crossmodal congruency task allows in particular for the investigation of multisensory processes which are critical for modulations of body representations as in the RHI.
We demonstrate how an objective measure of effects in the commonly employed rubber hand illusion paradigm can be obtained by combining this paradigm with the well-established crossmodal congruency task.
In the RHI paradigm participants view touch on an artificial rubber hand while the participants’ own hidden hand is touched. If the viewed and felt touches are given at the same time then this is sufficient to induce the compelling experience that the rubber hand is one’s own hand for the majority of participants. When touch is given asynchronously then the RHI is abolished or reduced. As the name suggests, the RHI paradigm typically involves a hand, however similar paradigms have also been established for whole bodies 1-3. Experiments using this paradigm can explore the conditions which modulate body representations. Previous experiments for example demonstrated that both viewing a body form as well as the synchrony of the given touch are important cues for the representation of one’s own body 4,5. Thus, the RHI as an experimental paradigm can be used to shed light on how the brain constructs and updates distinct representations for one’s own body 4-7. Such body representations support many vital processes when interacting with the external environment. Furthermore, body representation changes are related to many clinical disorders for example chronic pain, eating disorders and schizophrenia 8-10.
To investigate the mechanisms underlying the construction of distinct body representations researchers have employed several measures that are modulated in the rubber hand illusion paradigm. Typically, researchers ask participants to rate statements such as “I felt as if the rubber hand were my hand.” on a scale from -3 to 3 7,11. Another more indirect measure which has often been employed involves asking participants to indicate the position of their own hand before and after the illusion was induced 12. The hand position is typically perceived to be closer to the rubber hand after the RHI is induced (“proprioceptive drift”).
Researchers have also employed physiological measures to index the effect of experimental manipulations in the RHI, for example skin conductance responses when a sudden threat (for example an approaching knife) to the rubber hand is perceived 13,14. The RHI has also been related to small skin temperature changes which can be measured 15. The advantage of these physiological measures is that they occur automatically and thus are less susceptible to potential experimental biases. Potential disadvantages of these techniques include adaption of the physiological response throughout the experimental manipulation. Furthermore, the physiological processes these measures tap into can be generally deregulated in certain patient groups (for example chronic pain, eating disorders and schizophrenia, see supplementary material in 15).
Our specific aim was to obtain an objective behavioral measure of the effects in the rubber hand illusion, which is less susceptible to possible observer or experimenter biases. For this purpose we combined the RHI with the crossmodal congruency task. This task involves speeded forced-choice location discriminations of targets in one modality while, additional stimuli are presented in a different modality 16,17. This measure thus involves a relatively simple task which unlike physiological measures can be repeatedly administered many times. Furthermore, unlike “proprioceptive drift” this measure can be obtained on-line during the illusion while participants view the artificial hand. And the combination of the RHI paradigm with the crossmodal congruency task allows in particular for the investigation of multisensory processes which are critical for modulations of body representations as in the RHI 4,5,18. We think that the CCE measure is suited to study changes in body representations in patient groups. We think this is especially the case for the study of disorders which include a range of cognitive, motivational or physiological changes which might generally affect more subjective and physiological measures of the RHI.
In the variant we use for the RHI, tactile targets (short vibrations) are presented to different fingers (for example index and middle finger) of one hand. Participants are simply asked to indicate which finger received the tactile stimulation by pressing one of two buttons with the free hand. The distractors are visual stimuli (brief flickering of small lights) which are mounted above the fingers of the viewed rubber hand. These visual stimuli occur close in time to the tactile stimuli. Importantly, the visual stimuli appear on the same finger – spatially congruent – half of the time and occur on the other finger – spatially incongruent – the other half. Spatially congruent visual stimuli improve the localization of the tactile target, whereas spatially incongruent visual stimuli can slow this process down. The overall difference in performance between incongruent and congruent trials, known as the crossmodal congruency effect (CCE), reflects the influence of the visual information on discriminating the tactile target locations and thus indexes multisensory interactions.
Viewing a hand form 19-21 as well as the synchrony of the given touch 22 in the RHI determines the magnitude of the CCE. In other words, the CCE magnitude indexes how much the visual stimuli near the rubber hand influence the response to touches on one’s own hand. When participants experience the rubber hand to be one’s own hand then the CCE for visual-tactile stimuli is increased. It is thought that the RHI leads to changes in multisensory processing which likely increases the interactions between tactile and visual stimuli 5,18.
We have previously used the combination of the RHI and crossmodal congruency task to investigate experimental effects in the RHI 22. Others have shown that the CCE magnitude can be used as a measure in whole body illusions which involve more global aspects of body representations 23. In this study participants discriminated the location of tactile vibration stimuli on their backs. At the same time participants viewed their bodies from a position as if standing 2 m behind their own body via a camera and a head mounted display. Participants could also see lights which were either flashed in the same location as the tactile targets (congruent trials) or in a different location (incongruent trials). In addition to the crossmodal congruency task, the authors also stroked the backs of the participants. This stroking was either in synchrony with viewed strokes or in asynchrony. This manipulation caused on average a difference in the experience of body ownership and also affected the magnitude of the CCE. Thus, the CCE magnitude can be used as an objective measure for changes both in the RHI as well as in the ‘whole body illusion’. Combinations of these paradigms with the crossmodal congruency task allow, in particular, probing of multisensory processes which are critical for the occurrence of these illusions. We will now provide a detailed step-by-step description of how we implemented the crossmodal congruency task in the RHI paradigm.
1. Experimental Setup
2. Participants
3. Experimental Procedure
4. Data Analysis
The magnitude of the CCE is significantly modulated in the RHI. In Figures 2 and 3 we present representative results from a previous study we have conducted 22. In Figure 2 both the CCE for response time and response error differed significantly between different RHI conditions. The CCE magnitude was significantly increased when the RHI was induced with synchronous stroking as compared to asynchronous stroking which reduces or abolishes the RHI. In Figure 3, we depict data from an experiment where brush stroking was not delivered prior to every crossmodal congruency task. Instead, brushing was blocked and given prior to an entire larger set of trials. In this design the CCE is not significantly modulated.
Figure 1. Overview setup and procedure. The experimental setup includes a cover for the participant’s real hand, a rubber hand, tactors, lights, brushes and a response device. The covered hand of the participant and the rubber hand are brushed synchronously to induce the RHI. Brush strokes are given prior to every crossmodal congruency trial. The difference in performance between incongruent and congruent trials – the crossmodal congruency effect (CCE) – indexes changes in the RHI. Click here to view larger figure.
Figure 2. The crossmodal congruency effect (CCE) is shown for both response time and response error. Synchronous brushing (red) induces the RHI and asynchronous brushing (blue) abolishes the RHI. The crossmodal congruency effect (CCE) for response time and response error differs significantly between synchronous and asynchronous brushing. Adapted from Zopf et al. (2010), with permission (average for synchronous and asynchronous stroking from Experiment 2).
Figure 3. Crossmodal congruency effect (CCE) does not differ significantly between RHI conditions when brush stroking is not performed prior to crossmodal congruency trials and in this case only as one block before a set of trials. Adapted from Zopf et al. (2010), with permission (average for synchronous and asynchronous stroking from Experiment 1).
We demonstrated how an objective measure of effects in the commonly employed RHI paradigm can be obtained by combining this paradigm with the well-established crossmodal congruency task. The magnitude of the crossmodal congruency effect is significantly increased when the RHI is induced.
Stimulation as given in the rubber hand illusion paradigm modulates several aspects of body-related experiences such as body-ownership and body-location. Research has provided evidence that several processes related to perception, homeostasis and action are modulated in the RHI 14,15,22,26,27. Importantly, the combination of the RHI paradigm with the crossmodal congruency task allows in particular for the investigation of multisensory processes which are critical for all of these aspects.
Both viewing of the hand and the synchrony of stroking in the RHI, as well as in the whole body illusion, has been shown to also modulate the magnitude of the CCE 20,22,23. The crossmodal congruency task provides a relatively simple on-line measure which can be repeated many times and is not susceptible to observer and experimental biases.
Potential disadvantages of using this task are that it can be more time consuming and can be technically more sophisticated as compared to other measures. Furthermore, measuring the effects of the RHI can itself modulate the illusion. The important challenge for the crossmodal congruency task is that it involves multisensory visual and tactile stimuli, which can independently of brush stroking modulate body representation changes.The crossmodal congruency task itself might thus interfere with the effect of brush stroking in the RHI. We found that stroking prior to each crossmodal congruency trial is more effective than just stroking at the beginning of a whole set of trials 22. Furthermore, Aspell et al. (2009) found that presenting the visual and tactile stimuli for the crossmodal congruency task further apart (for example with a small delay of 150-250 msec) increases the effects of prior stroking. Such a small delay still allows for multisensory interactions 28, but reduces the interference of visuo-tactile stimuli on the RHI manipulation. Furthermore, we found that the effect of stroking synchrony is reduced when using the crossmodal congruency task while at the same time placing the rubber hand relatively close to the real hand 22. Most likely this is partly due to a relatively long stimulation interval (up to 15 min) and possibly partly because the asynchronous condition also includes crossmodal visuotactile stimulation making this condition “more synchronous” or “less asynchronous” than it usually would be. Therefore, we would recommend using a larger distance between the hands when implementing this method. All in all, the multisensory stimuli in the crossmodal congruency task can itself modulate body representations by changing the amount of overall synchronous or asynchronous multisensory stimulation. When comparing synchronous with asynchronous stimulations in the illusion paradigms, it is thus important to ensure that the brush stroking leads to relatively more overall synchronous or asynchronous visual-tactile stimulation. This can be achieved by trial-by-trial brush stroking and using a short delay between visuotactile crossmodal congruency task stimuli.
Our previous study demonstrated the effect of RHI manipulations on CCE 22. However, other aspects which have been studied for other RHI measures still need to be investigated. For example, it would be interesting to study if the degree of the RHI for example of the experience of ownership is related to CCE magnitude and if the CCE magnitude changes over time. Furthermore, it would be interesting to investigate if the CCE effects during the RHI are comparable to results observed with the same task on the real hand.
To summarize, we demonstrated that the crossmodal congruency task can be used to obtain an objective behavioral measure in the rubber hand illusion. This behavioral task is relatively simple and we think it is suitable for studying changes in body representations and underlying multisensory processing in both the general population as well as patient groups. However, it is important to note that this measure might not be causally related to subjective experiences in the rubber hand illusion 29. It is likely that both objective and subjective measures rely on common or similar multisensory mechanisms but possibly also on separate mechanisms. Depending on the research question, it might be advisable to obtain an objective behavioral measure and also a more subjective measure using rating scales.
The authors have nothing to disclose.
M.A.W. is funded by a Queen Elizabeth II Fellowship (DP 0984919) from the Australian Research Council.
Name of Reagent/Material | Company | Catalog Number | Comments |
artificial hand | Otto Bock Australia Pty. Ltd | passive arm prostheses | other company or custom made is possible |
paint brushes | |||
custom-made box | e.g. cardboard or wood | ||
2 tactors e.g. small speakers | e.g. Altronics, China | C0600 (Mylar Cone Speaker) | other tactors can be used for example bone conductors (from hearing aids, e.g. Oticon) or electromagnetic solenoid-type stimulators (e.g. dancerdesign.co.uk) |
2 light-emitting diodes (LEDs) | e.g. A-Bright Industrial Co., LTD | AL-513YD-004 | |
computer with mouse | |||
Presentation software | Neurobehavioural Systems | Presentation | other software can be used |
headphones and recorded sound file as metronome |