Realism in Experimentation
8,025 Views
•
•
Vue d'ensemble
Source: Laboratories of Gary Lewandowski, Dave Strohmetz, and Natalie Ciarocco—Monmouth University
In an ideal world researchers would conduct their studies in real world settings where behaviors naturally happen. For example, if you want to see what influences individuals’ voting behavior, it would be best to watch them vote. However, research in these settings is not always ethical or even practical. Further, a researcher may want more control over the setting to better pinpoint the exact variables that are influencing an outcome.
When researchers need to conduct studies in a lab, they try to optimize mundane realism, which means that they do everything they can to make the lab feel like a real-life experience. This video demonstrates a two-group design that examines how researchers use mundane realism in a lab to determine whether positive restaurant reviews are connected to diners’ level of tipping.
Psychological studies often use higher sample sizes than studies in other sciences. A large number of participants helps to ensure that the population under study is better represented and the margin of error accompanied by studying human behavior is sufficiently accounted for.
In this video, we demonstrate this experiment using just two participants, one for each condition. However, as represented in the results, we used a total of 200 (100 for each condition) participants to reach the experiment’s conclusions.
Procédure
1. Define key variables.
- Create an operational definition (i.e., a clear description of exactly what a researcher means by a concept) of online restaurant reviews.
- For the purposes of this experiment, online restaurant reviews are reviews provided on a website that offer diners’ insights into the restaurant.
- A positive review is one that gives a general rating of 4 stars (out of 5) or higher and also compliments the service.
- A negative review is one that gives a general rating of 2 stars (out of 5) or lower and also criticizes the service.
- For the purposes of this experiment, online restaurant reviews are reviews provided on a website that offer diners’ insights into the restaurant.
- Create an operational definition of tip amount.
- For purposes of this experiment, tip amount is defined as the amount of money the participant allocates to the server in paying the bill.
2. Conduct the study.
- Welcome participants at the lab door, which is set-up as the “Hawk Villa” restaurant.
- Dress and act like a restaurant server (e.g., wear white shirt and black apron, folded at waist).
- Sit participant down at a table.
- Provide participant with informed consent, a brief description of the research (influences on spending behavior), a sense of the procedure, an indication of potential risks/benefits, the right of withdrawal at any time, and a manner to get help if they experience discomfort.
- Give participant a wallet containing $136.10 (3-$20, 4-$10, 5-$5, 10-$1, and $1.10 in coins).
- Independent variable = restaurant review
- Say to participant: “Before you dine, to give you a bit more context, I thought you’d like to see the most recent online review of our restaurant.”
- Provide participant with the positive review (Figure 1).
Figure 1. Positive restaurant review. This review was shown to participants in the positive review group. - Play a video depicting a subpar dining scene.
- Instruct the participant to imagine themselves as one of the diners in the video and to imagine that the researcher is the server in the video.
- Dependent variable = the bill
- Return with the bill (Figure 2) placed in a restaurant billfold and say: “Here is your bill. I’ll take that when you’re ready.”
Figure 2. Restaurant receipt. This bill was given to all participants at the end of watching the dining scene. - After the participant places money in billfold, return and ask, “do you need any change?”
- Participant responds, “No thanks. Keep the change.”
- Return with the bill (Figure 2) placed in a restaurant billfold and say: “Here is your bill. I’ll take that when you’re ready.”
3. Debrief
- Report the nature of the study.
- “Thank you for participating. In this study I was trying to determine if reading an online restaurant review influences how much a person tips. There were two conditions, both of which watched the same video of subpar service. However, one group read a positive online review, while the other read a negative online review. We hypothesized that the group who read the positive online review would be more forgiving of the subpar service and give a higher tip.”
- Explain explicitly why the experiment was run this way.
- “We want to tell you why we ran this study this way. First, we couldn’t explicitly tell you that we were studying online reviews because it may have affected how you tipped. We also had to run this study in a laboratory setting because, as you can easily imagine, a real restaurant would not want to be part of a study involving subpar service where the key variable was their online reviews (particularly the negative ones).”
4. Conduct sections 2 and 3 with a new participant.
- Provide the negative review (Figure 3).
Figure 3. Negative restaurant review. This review was shown to participants in the negative review group. - Everything else should be the same.
5. Data Analysis
- Count the money the participant placed in the billfold.
- Use a calculator to subtract the bill total ($44.67) from the amount the participant left.
- $55.00 in the positive condition = $10.33 tip
- $45.00 in the negative condition = $0.33 tip
- Calculate tip percentage.
- Positive = 23%
- Negative = 0.7%
Conducting research in a realistic setting is optimal, but unfortunately, is not always ethical or even practical.
For example, researchers cannot simply march into a voting booth and observe what factors influence individuals’ voting behaviors.
Instead, they can create realism in the laboratory by designing an authentic voting experience, which includes questioning and observing the exact variables that might influence the study’s outcome.
Using a realistic setting, this video will demonstrate how to design, conduct, analyze, and interpret an experiment that investigates whether restaurant reviews are related to a diner’s level of tipping.
In this experiment, a realistic restaurant setting is designed to allow the researcher to manipulate how restaurant reviews—positive and negative— influence participants’ dining behavior.
For the positive review group, participants are asked to read a critique that compliments the service. In contrast, the negative review group is asked to read a critique that condemns the service.
After reading one of the reviews, participants are then shown a video that depicts a dining scenario with subpar service and must imagine themselves as one of the diners and the researcher as the server.
Once the video is over, participants are given a bill for the imagined meal. The dependent variable is the amount of money left as a tip.
Thus, participants who read the positive review are hypothesized to be more forgiving of the subpar service and offer a higher tip than diners who read the negative review.
To begin the study, meet the participant at the lab door and welcome them into the Hawk Villa restaurant. Guide all participants through the consent process and discuss the overall plan for the session.
After the participant consents to the experiment, give them a wallet containing $136.10, divided into specific bill and coin amounts.
Randomly divide participants to one of two experimental groups by handing them either a positive or negative review.
When the participants finish reading the reviews, have them watch a video depicting a dining scene. Instruct the participants to imagine themselves as the diner and the researcher as the server.
After showing the video, return to the table with the bill.
Once the participant places money in the billfold, return to the table and ask if they need any change.
To conclude the experiment, debrief the participant and explain why simulating a restaurant in the lab was necessary for the experiment.
To analyze the data, first count the money each participant placed in the billfold. Subtract the bill total of $44.67 from the amount the participant left to calculate the tip amount. Then, calculate the tip percentage.
To visualize the data, graph the mean tip percentages by group. Notice that participants in the positive review condition tipped higher than those in the negative review condition.
Now that you are familiar with how to optimize realism within a laboratory environment, let’s take a look at how you can apply this approach to other forms of research.
Driving simulators are often used in the laboratory to safely investigate driving ability in individuals with visual deficits or those under the influence of a substance, such as alcohol.
In addition, researchers can study navigational skills in individuals by examining task performance in a simulated real-world environment.
Finally, researchers have adapted dance movements to engage patients who express poor mobility and balance, such as those with Parkinson’s disease, and subsequently monitored changes in motor performance.
You’ve just watched JoVE’s introduction to using realism in laboratory experiments. Now you should have a good understanding of how to design and conduct this type of study, and how to calculate results and apply the phenomenon conducting research using realistic settings.
Thanks for watching!
Résultats
Data were collected from 200 participants overall during a different instance of this study. This large number of participants helps to ensure that the results are reliable. If this research were conducted using just two participants, it’s likely that the results would have been much different, and not reflective of the greater population. A t-test was performed for independent means comparing the positive review condition to the negative review condition to see how they influenced tip amount (Figure 4).
Figure 4. Tip amount by condition. Shown is the mean tip amount, represented by the percentage of the bill, from participants who read positive or negative restaurant reviews before watching a subpar dining service.
Applications and Summary
Some tipping experiments can occur in actual restaurants. For example, Guéguen and Jacob studied how the color of a waitresses’ tee shirt influenced tipping.1 To do this, servers at five restaurants wore red, blue, black, yellow, green, or white shirts. The results indicated that servers who wore red tee shirts received higher tips, but only when the customer was a male. In another study, Stohmetz et al. showed that customers who received candy with their bill tipped more than those who did not.2
The use of mundane realism in research is particularly common when researchers want to study variables that cannot be easily manipulated for ethical or practical reasons.
Because it is often impractical to conduct experimental studies in casinos, gambling researchers commonly have participants come to a laboratory to gamble in a simulated setting. For example, researchers wanted to determine if gamblers’ beliefs in their own skill level or rituals influenced gambling behavior on a slot machine.3 Their results indicated that perceived skills (e.g., a false sense of control) led participants to want to continue gambling following a near-miss; however, ritual beliefs (e.g., superstitions) did not influence desire to continue playing.
References
- Guéguen, N., & Jacob, C. Clothing color and tipping: Gentlemen patrons give more tips to waitresses with red clothes. Journal of Hospitality & Tourism Research. 38(2), 275-280. doi:10.1177/1096348012442546 (2014).
- Strohmetz, D. B., Rind, B., Fisher, R., & Lynn, M. Sweetening the till: The use of candy to increase restaurant tipping. Journal of Applied Social Psychology., 32(2), 300-309. doi:10.1111/j.1559-1816.2002.tb00216.x (2002).
- Billieux, J., Van der Linden, M., Khazaal, Y., Zullino, D., & Clark, L. Trait gambling cognitions predict near‐miss experiences and persistence in laboratory slot machine gambling. British Journal of Psychology. 103 (3), 412-427. doi:10.1111/j.2044-8295.2011.02083.x (2012).
Transcription
Conducting research in a realistic setting is optimal, but unfortunately, is not always ethical or even practical.
For example, researchers cannot simply march into a voting booth and observe what factors influence individuals’ voting behaviors.
Instead, they can create realism in the laboratory by designing an authentic voting experience, which includes questioning and observing the exact variables that might influence the study’s outcome.
Using a realistic setting, this video will demonstrate how to design, conduct, analyze, and interpret an experiment that investigates whether restaurant reviews are related to a diner’s level of tipping.
In this experiment, a realistic restaurant setting is designed to allow the researcher to manipulate how restaurant reviews—positive and negative— influence participants’ dining behavior.
For the positive review group, participants are asked to read a critique that compliments the service. In contrast, the negative review group is asked to read a critique that condemns the service.
After reading one of the reviews, participants are then shown a video that depicts a dining scenario with subpar service and must imagine themselves as one of the diners and the researcher as the server.
Once the video is over, participants are given a bill for the imagined meal. The dependent variable is the amount of money left as a tip.
Thus, participants who read the positive review are hypothesized to be more forgiving of the subpar service and offer a higher tip than diners who read the negative review.
To begin the study, meet the participant at the lab door and welcome them into the Hawk Villa restaurant. Guide all participants through the consent process and discuss the overall plan for the session.
After the participant consents to the experiment, give them a wallet containing $136.10, divided into specific bill and coin amounts.
Randomly divide participants to one of two experimental groups by handing them either a positive or negative review.
When the participants finish reading the reviews, have them watch a video depicting a dining scene. Instruct the participants to imagine themselves as the diner and the researcher as the server.
After showing the video, return to the table with the bill.
Once the participant places money in the billfold, return to the table and ask if they need any change.
To conclude the experiment, debrief the participant and explain why simulating a restaurant in the lab was necessary for the experiment.
To analyze the data, first count the money each participant placed in the billfold. Subtract the bill total of $44.67 from the amount the participant left to calculate the tip amount. Then, calculate the tip percentage.
To visualize the data, graph the mean tip percentages by group. Notice that participants in the positive review condition tipped higher than those in the negative review condition.
Now that you are familiar with how to optimize realism within a laboratory environment, let’s take a look at how you can apply this approach to other forms of research.
Driving simulators are often used in the laboratory to safely investigate driving ability in individuals with visual deficits or those under the influence of a substance, such as alcohol.
In addition, researchers can study navigational skills in individuals by examining task performance in a simulated real-world environment.
Finally, researchers have adapted dance movements to engage patients who express poor mobility and balance, such as those with Parkinson’s disease, and subsequently monitored changes in motor performance.
You’ve just watched JoVE’s introduction to using realism in laboratory experiments. Now you should have a good understanding of how to design and conduct this type of study, and how to calculate results and apply the phenomenon conducting research using realistic settings.
Thanks for watching!