被験者内反復測定による設計
22,249 Views
•
•
Overview
Source: Laboratories of Gary Lewandowski, Dave Strohmetz, and Natalie Ciarocco—Monmouth University
A within-subjects, or repeated-measures, design is an experimental design where all the participants receive every level of the treatment, i.e., every independent variable. For example, in a candy taste test, the researcher would want every participant to taste and rate each type of candy.
This video demonstrates a within-subjects experiment (i.e., one where there is an independent variable with several variations or levels) that examines how different motivational messages (e.g., hard work, self-affirmation, outcomes, and positive affect) influence willingness to exert physical effort. As a within-subjects design, the participant will read each of the four types of motivational messages and then lift weights to measure physical effort. By providing an overview of how a researcher conducts a repeated-measures experiment, this video allows viewers to see how to address order effects through counterbalancing, which involves a systematic approach to making sure all possible orders of the conditions occur in the study.
Psychological studies often use higher sample sizes than studies in other sciences. A large number of participants helps to ensure that the population under study is better represented and the margin of error accompanied by studying human behavior is sufficiently addressed. In this video, we demonstrate this experiment using just one participant. However, as represented in the results, we used a total of 72 participants to reach the experiment’s conclusions.
Procedure
1. Define key variables.
- Create an operational definition (i.e., a clear description of exactly what a researcher means by a concept) of a motivational message.
- For the purposes of this experiment, a motivational message is any combination of image and phrase designed to energize a person’s behavior, manipulated here by viewing a series of images accompanied by empowering quotes focusing on one of 4 areas: hard work, self-affirmation, outcomes/success, and general positive feelings/emotions (Figures 1 – 4).
Figure 1: The image shown with hard work motivational message.
Figure 2: The image shown with self-affirmation motivational message.
Figure 3: The image shown with outcomes/success motivational message.
Figure 4: The image shown with general positive feelings and emotions motivational message.
- For the purposes of this experiment, a motivational message is any combination of image and phrase designed to energize a person’s behavior, manipulated here by viewing a series of images accompanied by empowering quotes focusing on one of 4 areas: hard work, self-affirmation, outcomes/success, and general positive feelings/emotions (Figures 1 – 4).
- Create an operational definition (i.e., a clear description of exactly what a researcher means by a concept) of effort.
- For purposes of this experiment, effort is defined as the participant’s willingness to exert physical strength on a weight-lifting task.
2. Conduct the study.
- Meet the student/participant at the lab.
- Provide participants with informed consent, a brief description of the research (influences on physical behavior), a sense of the procedure, an indication of potential risks/benefits, the right of withdrawal at any time, and a manner to get help if they experience discomfort.
- Determine the order of conditions through counterbalance.
- It is important to address order effects. If conditions were always in the same order, the later conditions would likely perform worse because participants would be tired.
- Counterbalanced conditions involve a systematic approach in which the researcher insures that every order occurs during the study. Each condition occurs the same number of times in each of the spots in the order.
- Each participant receives only one order.
- Determine all possible orders of the four conditions (Figure 5).
Figure 5: Possible orders for the four conditions. - Put each of the 24 possible orders on a slip of paper and place all slips in a bowl.
- Researcher selects one slip and proceeds to run the experiment in that order. This action randomly selects one of the counterbalanced orders. The researcher should not replace the order in the bowl so that every order gets done once before repeating any one order a second time.
- Run the conditions. (NOTE: the researcher will run all 4 conditions using these exact same steps. The only difference will be the image the participant views. The same participant will be shown doing all 4 conditions.)
- Show the participant a page-sized printout of the image/quote while the participant sits at a table.
- Tell the participant: “Please read this over and take 1 min to reflect on what it means to you.”
- After a minute say: “Please stand and take this 10 lb dumbbell in your dominant hand. Complete as many curls as you’d like to in the next 30 s.” Demonstrate the curl motion to the participant. Count aloud as you complete each one.
- Note the participant’s number of curls on a data sheet (Figure 6).
Figure 6: An example for recording participants’ data by condition.
3. Debrief the participant.
- Tell the participant the nature of the study.
- “Thank you for participating. In this study, I was trying to determine if different types of motivational messages would increase the amount of physical effort participants were willing to exert. There were four types of messages: one emphasizing hard work, one emphasizing what a good person you are, one emphasizing successful outcomes, and one that was generally positive. We hypothesized that the message emphasizing hard work would result in exerting more physical effort.”
- Explain explicitly why deception was necessary for the experiment.
- “We could not tell you about our hypotheses ahead of time because we wanted you to act as naturally as possible.”
Choosing the correct experimental design for the specific scientific question at hand is essential to obtain reliable results. A within-subjects design is an experimental paradigm where all the participants receive every level of the treatment; there is one independent variable with several variations, or conditions. In this way, the amount of error arising from natural variance between individuals—typical of a between-subjects design—is reduced.
One caveat of this type of experiment is that the order in which treatments are given can influence the results. To minimize order effects, counterbalancing is used to ensure all possible orders of the conditions occur in the study.
This video demonstrates a within-subjects experiment that examines how different motivational messages influence willingness to exert physical effort. As a within-subjects design, the participant will read each of four types of motivational messages and then have their physical effort measured via lifting weights.
First, several concepts to consider when designing a within-subjects experiment are introduced. The video will then go on to demonstrate how to conduct the experiment using proper counterbalancing. Finally, analysis of data from a large number of participants will be discussed.
To begin, create an operational definition of a motivational message. An operational definition is an unambiguous description of a variable for the purpose of the experiment.
For the purposes of this experiment, a motivational message is any combination of image and phrase designed to energize a person’s behavior. The person’s behavior is manipulated here by viewing a series of images accompanied by empowering quotes focusing on one of 4 areas: hard work, self-affirmation, outcomes and success, and general positive feelings and emotions.
Next, create an operational definition of effort. For purposes of this experiment, effort is defined as the participant’s willingness to exert physical strength on a weight-lifting task.
Then determine the order of conditions through counterbalance. It is important to address order effects because if conditions were always in the same order, the participants would likely perform worse on the later conditions due to fatigue.
Counterbalance conditions involve a systematic approach by which the researcher ensures that every order occurs during the study. Determine all possible orders of the four conditions. Here, H equals Hard Work, S equals Self-Affirmation, O equals Outcomes, and P equals Positive Emotion.
To conduct the study, first meet the participant at the lab. Provide the participant with informed consent. This is a brief description of the research, a sense of the procedure, an indication of potential risks and benefits, the freedom of withdrawal at any time, and a manner to get help if they experience discomfort.
Next, write each of the 24 possible orders of the four conditions on a slip of paper. Then, place all slips in a bowl.
Select one slip and proceed to run the experiment in that order; this randomly selects one of the counterbalanced orders. Do not replace the order in the bowl so that every order gets done once before repeating any one order a second time.
To run the conditions, show the participant a page-sized printout of the quote while the participant sits at a table. Tell the participant to read the quote over and take a minute to reflect on what it means to them.
After a minute instruct the participant to stand and take a 10 pound dumbbell in his or her dominant hand. Tell the participant to complete as many curls as they would like to in the next 30 sec, and to count aloud as they complete each one.
After 30 sec, note the participant’s number of completed curls on a sheet as the participant takes a brief 10 to 15 sec rest.
Proceed to run all four conditions using the same steps, with the only difference being the image the participant views.
To debrief the participant, tell them the nature of the study.
Researcher: “Thank you for participating. In this study I was trying to determine if different types of motivational messages would increase the amount of physical effort participants were willing to exert. There were four types of messages: one emphasizing hard work, one emphasizing what a good person you are, one emphasizing successful outcomes, and one that was generally positive. We hypothesized that the message emphasizing hard work would result in exerting more physical effort.”
Then, explain explicitly why deception was necessary for the experiment.
Researcher: “We couldn’t tell you about our hypotheses ahead of time because we wanted you to act as naturally as possible.”
The procedure was run for 24 counterbalanced orders three times. Accordingly, data was collected from 72 total participants; a large number of participants are necessary to ensure that the results are reliable and reflective of the greater population.
The numbers shown here reflect the number of times participants in each condition lifted the weight. The results are the means for the 72 participants in each condition.
The outcome indicates that participants who read the hard work motivational message exerted more physical effort by doing more curls of the 10 pound weight in 30 sec.
Within-subjects designs are particularly common in functional magnetic resonance imaging, or fMRI, research where participants lay in an fMRI machine while experiencing several conditions to see how the brain reacts to different experiences.
For example, an fMRI study was used to investigate which areas of the brain correlate with feelings of long-term intense romantic love. To test this, images were shown to participants that represented a highly familiar acquaintance, a close long-term friend, a low-familiar person, and their long-term romantic partner.
Analyses indicated that the long-term romantic partner activated areas of the brain associated with the dopamine reward system, and areas associated with emotional attachments.
You’ve just watched JoVE’s introduction to within-subjects experimental design. Now you should have a good understanding of the concept of counterbalancing to generate proper controls for this type of experiment, how to set up a within-subjects experiment through creating operational definitions, and how to conduct the study. You’ve also been introduced to research performed using fMRI as an application of this type of experiment.
Remember, proper counterbalancing and use of a large number of participants is critical to obtain reliable results when performing within-subjects experiments.
Results
The procedure was repeated three times in 24 counterbalanced orders, so data were collected from 72 total participants. A large number of participants is necessary to ensure that the results are reliable. If this research were conducted using just a few participants, it is likely that the results would have been much different and not reflective of the greater population.
To determine if there were differences between the motivational messages on physical effort, we performed a repeated-measures analysis of variance (ANOVA). The results indicated that participants who read the hard work motivational message exerted more physical effort by doing more curls of the 10 lb weight in 30 s (Figure 7).
This repeated-measures within-subject experiment shows how researchers use a study design to compare participants’ experiences in one context to their own experiences in another context. In other words, the study allowed researchers to compare participants to themselves.
Figure 7: Average number of times participants lifted the weight by motivational message type.
Applications and Summary
Repeated-measures within-subjects designs are particularly common in functional magnetic resonance imaging (fMRI) research. Participants lie in an fMRI machine and experience several conditions to see how the brain reacts to different experiences.
For example, one fMRI study wanted to determine which areas of the brain correlate with feelings of long-term and intense romantic love.1 To test this, participants saw each of the following images: a highly familiar acquaintance, a close long-term friend, a low-familiar person, and their long-term romantic partner. Analyses indicated that the long-term romantic partner activated areas of the brain (e.g., the ventral tegmental area and dorsal striatum) associated with the dopamine reward system, as well as areas (e.g., globus pallidus and substantia nigra) associated with emotional attachments.
References
- Acevedo, B. P., Aron, A., Fisher, H. E., & Brown, L. L. Neural correlates of long-term intense romantic love. Social Cognitive And Affective Neuroscience. 8 (2), 145-159. doi:10.1093/scan/nsq092 (2012).
Transcript
Choosing the correct experimental design for the specific scientific question at hand is essential to obtain reliable results. A within-subjects design is an experimental paradigm where all the participants receive every level of the treatment; there is one independent variable with several variations, or conditions. In this way, the amount of error arising from natural variance between individuals—typical of a between-subjects design—is reduced.
One caveat of this type of experiment is that the order in which treatments are given can influence the results. To minimize order effects, counterbalancing is used to ensure all possible orders of the conditions occur in the study.
This video demonstrates a within-subjects experiment that examines how different motivational messages influence willingness to exert physical effort. As a within-subjects design, the participant will read each of four types of motivational messages and then have their physical effort measured via lifting weights.
First, several concepts to consider when designing a within-subjects experiment are introduced. The video will then go on to demonstrate how to conduct the experiment using proper counterbalancing. Finally, analysis of data from a large number of participants will be discussed.
To begin, create an operational definition of a motivational message. An operational definition is an unambiguous description of a variable for the purpose of the experiment.
For the purposes of this experiment, a motivational message is any combination of image and phrase designed to energize a person’s behavior. The person’s behavior is manipulated here by viewing a series of images accompanied by empowering quotes focusing on one of 4 areas: hard work, self-affirmation, outcomes and success, and general positive feelings and emotions.
Next, create an operational definition of effort. For purposes of this experiment, effort is defined as the participant’s willingness to exert physical strength on a weight-lifting task.
Then determine the order of conditions through counterbalance. It is important to address order effects because if conditions were always in the same order, the participants would likely perform worse on the later conditions due to fatigue.
Counterbalance conditions involve a systematic approach by which the researcher ensures that every order occurs during the study. Determine all possible orders of the four conditions. Here, H equals Hard Work, S equals Self-Affirmation, O equals Outcomes, and P equals Positive Emotion.
To conduct the study, first meet the participant at the lab. Provide the participant with informed consent. This is a brief description of the research, a sense of the procedure, an indication of potential risks and benefits, the freedom of withdrawal at any time, and a manner to get help if they experience discomfort.
Next, write each of the 24 possible orders of the four conditions on a slip of paper. Then, place all slips in a bowl.
Select one slip and proceed to run the experiment in that order; this randomly selects one of the counterbalanced orders. Do not replace the order in the bowl so that every order gets done once before repeating any one order a second time.
To run the conditions, show the participant a page-sized printout of the quote while the participant sits at a table. Tell the participant to read the quote over and take a minute to reflect on what it means to them.
After a minute instruct the participant to stand and take a 10 pound dumbbell in his or her dominant hand. Tell the participant to complete as many curls as they would like to in the next 30 sec, and to count aloud as they complete each one.
After 30 sec, note the participant’s number of completed curls on a sheet as the participant takes a brief 10 to 15 sec rest.
Proceed to run all four conditions using the same steps, with the only difference being the image the participant views.
To debrief the participant, tell them the nature of the study.
Researcher: “Thank you for participating. In this study I was trying to determine if different types of motivational messages would increase the amount of physical effort participants were willing to exert. There were four types of messages: one emphasizing hard work, one emphasizing what a good person you are, one emphasizing successful outcomes, and one that was generally positive. We hypothesized that the message emphasizing hard work would result in exerting more physical effort.”
Then, explain explicitly why deception was necessary for the experiment.
Researcher: “We couldn’t tell you about our hypotheses ahead of time because we wanted you to act as naturally as possible.”
The procedure was run for 24 counterbalanced orders three times. Accordingly, data was collected from 72 total participants; a large number of participants are necessary to ensure that the results are reliable and reflective of the greater population.
The numbers shown here reflect the number of times participants in each condition lifted the weight. The results are the means for the 72 participants in each condition.
The outcome indicates that participants who read the hard work motivational message exerted more physical effort by doing more curls of the 10 pound weight in 30 sec.
Within-subjects designs are particularly common in functional magnetic resonance imaging, or fMRI, research where participants lay in an fMRI machine while experiencing several conditions to see how the brain reacts to different experiences.
For example, an fMRI study was used to investigate which areas of the brain correlate with feelings of long-term intense romantic love. To test this, images were shown to participants that represented a highly familiar acquaintance, a close long-term friend, a low-familiar person, and their long-term romantic partner.
Analyses indicated that the long-term romantic partner activated areas of the brain associated with the dopamine reward system, and areas associated with emotional attachments.
You’ve just watched JoVE’s introduction to within-subjects experimental design. Now you should have a good understanding of the concept of counterbalancing to generate proper controls for this type of experiment, how to set up a within-subjects experiment through creating operational definitions, and how to conduct the study. You’ve also been introduced to research performed using fMRI as an application of this type of experiment.
Remember, proper counterbalancing and use of a large number of participants is critical to obtain reliable results when performing within-subjects experiments.