Here, we present an original mixed method combining a quantitative and a qualitative approach to examine accurately participants' experiences during the Trier Social Stress Test and the Trier Social Stress Test for groups.
The single Trier Social Stress Test (TSST) and the TSST for groups (TSST-G) are the most used protocols to experimentally induce psychosocial stress. These tests are based on uncontrollability and social-evaluative threat, inducing psychological and physiological consequences (e.g., anxiety, emotional states, salivary cortisol increases). Many quantitative experimental studies have investigated these stress inducers and these consequences. But, as far as we know, this study is the first to provide a qualitative analysis to access the participants’ voices so as to understand the dynamics of their experience throughout the TSST and the TSST-G. This paper outlines a mixed methods approach to the TSST. This approach can help to maximize the information that can be gained from the TSST, which researchers often use without looking more closely at what is qualitatively happening psychologically for participants during the stressor itself. In this way, this protocol is an example of mixed methods, showing the added value of using the enactive phenomenological approach to analyze experimental protocols more deeply. This kind of mixed methods is helpful to access the experience, to understand the actor’s point of view, and to analyze in-depth the dynamics of cognitive processes like intentions, perceptions, enacted knowledge, and emotion. The discussion section shows the different uses of a mixed methods protocol, exploiting the enactive phenomenological approach to analyze a protocol or to give a cross vision of the same research subject. This section deals with different existing applications, pointing out some critical steps in this mixed methods approach.
Mixed methods give various advantages when trying to understand a phenomenon1,2,3,4,5. Greene et al.6 define them as protocols that include a quantitative method to analyze numbers and a qualitative method to analyze words. This approach aims to move beyond paradigm wars or conflicts between qualitative and quantitative research. The goal is to increase the strengths of studies and diminish the weaknesses of single studies3; thus, it functions as a third research paradigm. Combining different kinds of analyses on the same object makes it possible to have different points of view. This paper presents a particular form of mixed methods, combining an experimental protocol with experiential data using the single TSST7and the TSST-G8. The TSST is the most used protocol to experimentally perform psychosocial stress investigations9,10. These tests are based on uncontrollability and social-evaluative threat, linked with physiological and psychological consequences. Different empirical, theoretical, or meta-analysis studies11 have shown that the TSST and the TSST-G elicit psychological effects and activate the HPA axis, leading, for example, to negative emotional states, self-reported anxiety, and cortisol rise. Many experimental studies investigated these markers of stress, their relations, and their influences12. However, only one qualitative approach has been conducted13 to understand the participants' lived experiences during these tests.
The present protocol develops the original mixed methods approach mainly used in an earlier publication13. The originality of this mixed methods research lies in the qualitative approach based on an enactive phenomenological framework13,14,15,16 to examine accurately participants' experiences when confronted with the TSST and the TSST-G. Qualitative investigations can be heuristic because they make it possible to characterize and analyze what is happening psychologically for participants in a particular situation17. Last, the enactive phenomenological approach allows researchers to understand the participants' points of view and, thus, to analyze stress and emotion18,19,20. Following this approach, participants can describe, comment on, and show their lived experience step-by-step. This enactive phenomenological framework has two main assumptions16,21. First, action and situation are coupled22,23 (i.e., the dynamics of the action emerge within a specific context). This assumption provides access to the dynamics of the participant's experience confronted with the TSST and the TSST-G and to identify particular components of the context for the actor. Secondly, every action carries significations for the actor23,24. This approach provides access to the actor's signification construction of the experience during the action, thanks to a rigorous method originating from phenomenological interviews and named enactive interviews16,25. The actor's experience can be characterized in its emotional, perceptional, and situational dimensions26. Different kinds of mixed methods are based on this enactive phenomenological approach, which has already produced heuristic results in different areas, namely sport14,15,18,27, doping28, work29, and education30,31,32.
The mixed methods presented here aim to give confirmation and comprehension to findings in the TSST literature: confirmation through a comparison of the effect of the TSST and the TSST-G on physiological indicators (like cortisol), on self-reported indicators (like anxiety and emotional states), and on experiential indicators (like participants' voices) and comprehension through the qualitative method accessing participants' dynamics of action as they emerge in these stressful protocols. This is an original way to access in-depth the dynamics of psychosocial stress and to understand the participants' voices about the stressful moment of the TSST and the TSST-G. This protocol is, thus, an example of mixed methodology, showing the added value of using the enactive phenomenological approach to analyze the experimental protocol more deeply.
The Institutional Review Board of the University approved this research.
NOTE: An example of mixed methods using the enactive phenomenological protocol.
1. Exclusion Criteria
2. Preliminary Instructions
NOTE: The following preliminary instructions need to be given 1 day before the experimentation.
3. Pretest Measurements
NOTE: The protocol presented in this section was used in the earlier publication mentioned in the introduction13. Prestress measurements can be done after an inactive wait of 45 min10; also, the first point of measure can be done 20 min before the TSST35.
4. Performance of the TSST or the TSST-G
NOTE: Different aspects of the TSST have already been described in other JoVE articles10,12,39.
5. Posttest Measurements
NOTE: Then, collect a second saliva sample and let the participant complete questionnaires in another room (same process as the first collections, described in section 3 of this protocol).
6. Qualitative Investigations
7. Data Analysis
The results shown here come from a review of literature (for the cortisol)8 and two studies on stress done in our lab (for the state anxiety, the affective reaction, and the qualitative approach)13,41. The results presented here are representative of what can be found, using the protocol, about (1) salivary cortisol levels, (2) state anxiety, (3) pleasure, arousal, and dominance, and (4) meaningful experience.
First, the results below are an example of a quantitative analysis of stress with salivary cortisol as physiological marker8. They show the dynamics of the salivary cortisol rises for a group confronted with the TSST and a control group (Figure 1).
Second, the results below are an example of a quantitative analysis of stress consequences, with the STAI scale as an indicator of stress anxiety, a psychological marker of stress41. They show the dynamics of state anxiety during the TSST and the placebo-TSST with four points of measure (baseline, t-2 min before the TSST, t+2 min after the TSST, and t+20 min after the TSST) (Figure 2). The Placebo-TSST is a protocol similar to the TSST without causing stress for the participants42.
Third, the results below are an example of a quantitative analysis of stress with the SAM38 scale as indicator of 'affective reaction', a psychological marker of stress41. They show the dynamics of pleasure, arousal, and dominance during the TSST and the placebo-TSST (Figure 3).
Four, the results below are an example of a qualitative approach to lived stress based on an enactive phenomenological framework13. Also, the typical experience of participants can be described during the TSST (Table 2) and the TSST-G (Table 3).
This particular mixed methods approach has different functions here: confirmation, comprehension, and development. The results show a confirmation of the increase of stress measured with physiological indicators (like cortisol), with self-reported indicators (like anxiety and emotional states), and with experiential indicators (like the participants' voices).
Mixed methods allow the comprehension of stress manifestations during the TSST and the TSST-G, accessing the participants' dynamics of action. For example, the quantitative results show a similar level of stress between the TSST and the TSST-G participants. The qualitative results show common lived experiences, such as each participant beginning with an exploratory investigation, in which they state they are surprised by the uncommon environment. Common sequences appear in the mock job interview (Recitation, Expanding on ideas, Time pressure, Loss of control, Paradoxical liberation) and in the mental arithmetic task (Calculation disturbed, Negative Spiral, Seeking solutions, Abandonment-resignation, Paradoxical liberation), giving details about the perception, action, and intention of the participants for each phase. The level of comprehension allowed by mixed methods goes deeper with the different singular typical experiences. The quantitative methods do not show differences between the TSST and the TSST-G, but the qualitative methods show some singular experiences between these stressful protocols. For example, stress fluctuation, temporality, and the presence of peers are not experienced in the same way in the TSST and the TSST-G. This "comprehensive picture"3 can be taken further with case studies of high and low cortisol responders43.
Finally, the mixed methods approach presented here has a development function for the research, in that the findings provide by one method can be used to modify the other6. For example, qualitative methods show some important moments in the dynamics of the participant's actions. It could be interesting to measure the level of stress with quantitative methods in these specific moments.
Figure 1: Cortisol reactivity to the TSST-G. Mean salivary cortisol levels before, during (shaded area), and after a standardized psychosocial stressor in a group format (Trier Social Stress Test for Groups [TSST-G]) and a control condition. The error bars are the SEM8.This figure has been modified from Von Dawans et al.8. Please click here to view a larger version of this figure.
Figure 2: Anxiety reaction to the TSST. The state of anxiety of the participants exposed to the two treatments (TSST and placebo-TSST) measured with the STAI41. This figure has been modified from Mascret et al.41. Please click here to view a larger version of this figure.
Figure 3: Affective reaction to the TSST. Pleasure, arousal, and dominance of the participants exposed to the two treatments (TSST and placebo-TSST) measured with the SAM41. This figure has been modified from Mascret et al.41. Please click here to view a larger version of this figure.
Time | Description of action and communication | Verbatim of enactive interview |
5 min | François enters the experimental room. He is looking around, staying quiet. | François: Oh, yes, at this moment…er… (he points to his image on the video) I'm thinking, where I am… ouch… that's strange. Researcher: what are you doing here? François: I'm waiting, I say to myself 'What have I got myself into here?' I didn't think it would be like this. I'm out of my… comfort zone (he touches his head, looking lost). "What's going to happen?… I'm in an observation phase… it's weird…. A really strange situation for me. I don't like being destabilized. I like to have things announced well in advance. |
Table 1: Example of the two-part table.
Situation | SEQUENCES | Perceptions | Actions | Intentions | |
Job interview task | Entering the room Explanation of instructions |
Exploratory investigation | Surprise Generally tense atmosphere |
Im listening I'm observing |
Try to understand |
Preparation phase 3 minutes |
Preparation | Time pressure Preparing |
I'm organizing my presentation | Find and select ideas Keep within the time |
|
Interview phase 5 minutes |
1) Recitation | Reassured to be doing what is planned | I'm reciting | Repeat the prepared introduction | |
2) Expanding on ideas | Stressed by hesitations and memory lapses | I'm expanding on the ideas I've planned | Retrieve and state the ideas I have prepared Convince the committee |
||
3) Time pressure | Anxiety on seeing how much time is left | I'm watching the countdown | Know how far I've got | ||
4) Loss of control: Nothing more to say |
Feel observed, judged Uncomfortable about saying whatever comes into my head Time perceived as interminable |
I can't think any more I'm searching chaotically I'm hesitating, I'm stuttering, I'm leaving gaps I'm constantly glancing at the time left |
Fill the time Avoid gaps Look for support |
||
5) Abandon, resignation | Sense of incompetence Sense of looking incompetent |
I'm losing my grip I'm doing nothing, I'm keeping quiet |
Wait for it to end | ||
6) Detachment | Realize it's not important | I'm laughing I'm laughing at myself |
Try to reassure myself | ||
7) Paradoxical liberation | Hear beep at end of countdown Relief Sense of failure |
I'm relaxing I'm staying concentrated for the second task |
Self-evaluate Worry about what the committee will think of me |
Table 2: Typical experience of the TSST participants. This table has been modified from Vors et al.13.
Situation | SEQUENCES | Perceptions | Actions | Intentions | |
Mental arithmetic task | Explanation of instructions | Exploratory investigation | Pressure increasing Sense of relative easiness |
I'm listening to the instructions | Try to understand |
Calculation phase 5 minutes |
1) Calculation disturbed | Under time pressure Ashamed of making mistakes in an easy task |
I'm going fast but I'm making lots of mistakes I'm getting lost: I'm recalculating several times |
Not make mistakes Be quick |
|
2) Negative Spiral | Feel everything getting jumbled up in my head Aware of my negative thoughts |
I can't count any more I'm making repeated errors |
Not look incompetent | ||
3) Seeking solutions | Withdraw into self | I'm looking for strategies | Find solutions Not lose face |
||
4) Abandonment, resignation | Fed up, I've had enough of this Realize it's too much for me |
I have nothing more to say I'm saying whatever comes into my head |
Make the time go by | ||
2') Repeated successes | Only thinking about the numbers | I'm concentrating I'm giving one right answer after another |
Not make a mistake and have to go back to the start | ||
3) Paradoxical liberation | Hear beep at end of countdown Relief Sense of failure |
I'm relaxing | Self-evaluate Leave |
Table 3: Typical experience of the TSST participants. This table has been modified from Vors et al.13.
Situation | SEQUENCES | Perceptions | Actions | Intentions | |
Job interview task | Entering the room Instructions explained |
Exploratory investigation | Surprise Generally tense atmosphere Embarrassed having to talk in presence of others |
I'm listening I'm observing |
Try to understand Worry about what the others will think of me |
Preparation phase 3 minutes |
Preparation | Time pressure Reassured to be preparing |
I'm organizing my presentation | Find and select convincing ideas | |
Others performing | Alternation -Phases of exploratory listening -Phases of isolation |
Stressed by long unpredictable wait for my turn Destabilized or reassured by others' performances |
I'm listening to parts of the speeches I'm putting myself in my bubble to repeat my speech |
Find and select ideas Keep within the time |
|
Interview phase 2 minutes |
Pressure spike | Hear my number Peak stress: I don't remember anything |
I'm looking at my number I'm repositioning |
Not make a fool of myself | |
1) Recitation | Reassured to be doing what was planned | I'm reciting | Repeat the prepared introduction | ||
2) Expanding on ideas | Stressed by hesitations and things forgotten | I'm expanding on the ideas I planned | Retrieve and state the ideas I have prepared Convince the committee |
||
3) Time pressure | Anxious at seeing the time left | I'm watching the countdown | Know how far I've got | ||
4) Loss of control: Nothing more to say |
Uneasy at saying whatever comes into my head Feel observed, judged |
I can't think any more I'm searching chaotically I'm hesitating, I'm stuttering, I'm leaving silences I'm constantly glancing at the time left |
Fill the time Avoid gaps Look for support |
||
5) Paradoxical liberation | Hear beep at end of countdown Relief Sense of failure |
I'm relaxing I'm staying concentrated for the second task |
Self-evaluate Worry about what the others will think of me |
||
Others performing | Alternation -Phases of comparative, empathetic listening -Phases of relaxation |
Relaxation Feeling a "knot in the stomach" |
I'm comparing what is being said with my own performance I'm sympathizing with my struggling peers I'm gloating I'm thinking of something else |
Compare myself, try to reassure myself Relax a bit |
Table 4: Typical experience of the TSST-G participants. This table has been modified from Vors et al.13.
Situation | SEQUENCES | Perceptions | Actions | Intentions | |
Mental arithmetic task | Explanation of instructions | Exploratory investigation | Pressure rising Sense of relative easiness Stressed by having to calculate in front of everyone |
I'm listening to the instructions | Try to understand |
Others performing | Training | Stressed by unpredictable wait for my turn Destabilized by other' performances |
I'm trying to do the sums I'm assessing the difficulty of the task |
Get ready for my turn | |
Calculation phase 80 seconds |
Pressure spike | Hear my number Stress spike |
I'm looking at my number I'm repositioning |
Not make a fool of myself | |
1) Calculation disturbed | Under time pressure Ashamed of making mistakes in an easy task |
I'm going fast but I’m making a lot of mistakes I'm getting lost: I'm recalculating several times |
Not make mistakes Be quick |
||
2) Negative spiral | Feel everything getting jumbled up in my head Aware of my negative thoughts |
I can't count any more I'm making repeated mistakes |
Not look incompetent | ||
2') Repeated successes | Only thinking about the numbers | I'm concentrating I'm giving one right answer after another |
Not make a mistake and have to go back to the start | ||
3) Paradoxical liberation | Hear beep at end of countdown Relief Sense of failure |
I'm relaxing | Self-evaluate Leave |
||
Others performing | Alternation -Phases of comparative, empathetic listening -Phases of relaxation |
Relaxation Feeling a "knot in the stomach" |
I'm comparing what is being said with my performance I'm feeling sorry for my struggling peers I'm gloating I'm thinking of something else |
Compare myself, try to reassure myself Relax a bit |
|
End of task | Relieved but tense and disappointed | I’m relaxing | Leave |
Table 5: Typical experience of the TSST-G participants. This table has been modified from Vors et al.13.
In this article, we present an original mixed methods approach combining an experimental protocol with the enactive phenomenological approach. This kind of mixed methods is helpful to access experience, to understand participants' points of view, and to analyze in depth the dynamics of cognitive processes like intentions, perceptions, enacted knowledge, and emotions.
Mixed methods can be used in different ways. Green et al.6 present five functions: triangulation, complementarity, development, initiation, and expansion. A protocol exploiting the enactive phenomenological approach can be heuristic in these functions. Triangulation and complementarity are close to the purposes of confirmation and comprehension already presented in this paper. Triangulation seeks the convergence of the results from the various methods to increase the validity of the investigation. For example, the results presented here show a confirmation of the increase of stress measured with physiological indicators, with self-reported indicators and with experiential indicators. Complementarity seeks an enhancement of the results and the clarification from one method to the other, to increase the relevance of the investigation. For example, qualitative results give illustrations of and clarification about quantitative methods between two points of measure, showing the dynamics of the participants' experience in different sequences, and their typical perception, action, and intention during experiential sequences. As has been seen above, development is another function of mixed methods, using the findings of one method to modify a part of the other as sampling, implementation, and/or measurement decision, to obtain a stronger method. For example, in the presented results, the qualitative methods give a new development of quantitative ones, inviting the multiplication of quantitative points of measure at several moments experienced as important by the participants.
Then, initiation is used to find new perspectives on or contradictions between the two methods to increase the range of results. For example, experiential and biomechanical approaches are combined to analyze a technical device for elite training in swimming44,45. The results show a difference between quantitative and qualitative findings. Participants do not perceive the same things as the biomechanical results. These findings open new perspectives to adapt the technical device according to the swimming speed. For example, in the beginning, it is recommended to use a "medium" speed so that the participants can more easily adjust the device. Our lab is also developing this kind of mixed methods with virtual reality, to understand the point of view of the participant in this specific virtual context and to improve protocols. In this way, mixed methods using an enactive phenomenological approach could be heuristic to analyze a protocol or a device. The protocol can be improved by the participants' experience and its dynamics. Case studies help to understand what happens with particular participants. Thus, this kind of mixed methods is useful for adjusting a protocol as the TSST-G; taking time to select the next participant during the task increases the feeling of uncontrollability13.
Finally, expansion is another function of mixed methods. Expansion is used to select the most appropriate method from various inquiry components to extend the scope of the results. For example, the enactive phenomenological approach gives an expansion to motor control analysis to investigate perception and action during ice climbing46. The quantitative results show a wider range of limb coordination patterns for experts than for beginner climbers. The qualitative results increase the scope of inquiry, showing that these different coordination patterns are linked to the perception of holes in the icefall.
However, these kinds of mixed methods have some limitations and require vigilance. The power of enactive interview is limited to a specific level of consciousness. This interview allows researchers to access the prereflexive level of consciousness47. This level is on the "fringe of consciousness"48 (i.e., at the interface of conscious and unconscious processes). So, different data like reflex actions or unconscious behaviors cannot be studied. Moreover, this enactive interview is a critical step in the protocol, due to the difficulty of conducting. The rater must have extensive experience to help the re-emergence of past activity through questions about the video and avoid global discourse and a posteriori analysis40 (cf. section 6 of the protocol). Lastly, this specific interview and its analysis are time-consuming and limit the number of participants in the mixed methods; studies with the enactive phenomenological framework usually have an number of participants between 4 and 1314,15,18,19,20,27,49,50,51. This particularity of in-depth qualitative research with case studies raises the question of generalization of the results. Thus, it is all the more interesting to cross this qualitative approach with a quantitative approach.
Finally, mixed methods inquiries pose problems on data articulation and on congruence between frameworks. The mix of methods can take different forms. It is not easy to compare quantitative and qualitative methods, to mix word and number. Some studies try to quantify qualitative data to help the comparison3,6. There are three kinds of mixed method analysis6. First, most mixed methods research uses analyses and interpretation conducted separately, as in the protocol presented here. Secondly, studies present separate analyses with some integration occurring during interpretation. Thirdly, a minority of studies integrate analyses and interpretation (9%)6. The congruence between quantitative and qualitative frameworks is a huge debate between the purists, the situationalists, and the pragmatists. The pragmatists consider mixed method as a new way to understand the world, as a third paradigm which helps to bridge the separation between qualitative and quantitative methods52. Different relations exist between frameworks. On one side, there are researchers who study different noncongruent paradigms to give two different points of view on the same phenomenon. For example, in a study about the role of the referee in physical education32, researchers use two separate frameworks drawn from motivation and enactive phenomenology. On the other hand, other studies keep a "paradigm emphasis"53,54 between frameworks. For example, in rowing performance, the enaction paradigm is used to connect enactive phenomenological with biomechanical approaches27. The phenomenological data serves to identify categories of oar strokes according to the rowers' point of view. The biomechanical data make it possible to determine mechanical signatures that are correlated with each phenomenological category. This kind of mixed method is close to a combined approach. Moreover, Johnson and Onwuegbuzie3 define mixed methods as a mix or a combination of approaches, concepts, techniques, methods, or language from quantitative and qualitative research into a specific inquiry. On this basis, combined approaches using qualitative and quantitative methods are a kind of mixed method. For example, a recent article summarizes the complex combinations of data using heterogeneous data with a common paradigm55. That study investigated two ways of collecting and analyzing interactions between trail runners and their equipment from online forums and from test protocol. Quantitative (e.g., indicators of the forum messages) data were combined with qualitative data (e.g., discussion contents, or enactive interviews) within the same enactive perspective. The results of that study suggest a method that designers can appropriate to analyze experiential data, which can then be integrated into the conception process.
This paper provides the foundation for future research to utilize mixed methods with a qualitative approach, to improve a protocol, evaluate a device, or give a cross vision of the same research subject.
The authors have nothing to disclose.
The authors thank Perrine Labeaume and Fanny Vieu for their help.
Enzyme-linked immunosorbent assay (ELISA) | Salimetrics, UK | Kit– N° No. 1-3002 | Expanded Range High Sensitivity Salivary Cortisol Enzyme Immunoassay |
Spectrophotometer | Thermo Fisher, Germany | Multiska FC Microplate Photometer |