This protocol describes a randomized controlled trial as a method to test the effect of a video demonstration on the intra-individual difference between self-reported and accelerometer-based moderate-to-vigorous physical activity.
Physical activity (PA) assessment needs tools that are inexpensive and easy to administer. Common questionnaires inquire time spent in light, moderate, and vigorous PA. However, inaccuracies may occur due to individually different understanding of PA intensity levels. Alternatively used direct measures (e.g., accelerometers) are susceptible to reactivity bias and may lack the ability to capture certain activities. Compared to accelerometer measurement, respondents report more time spent in higher-intensity PA. A video that visualizes PA intensity levels might help to overcome this problem. This report describes the design of a randomized controlled trial as a methodology to investigate the effect of a video on the difference between self-reported and directly measured PA. It is hypothesized that the video reduces the mean difference between the two measures. Individuals from the general population are recruited. Hip-worn accelerometers are used to collect directly measured PA data on seven consecutive days. Afterwards, participants are randomly allocated to the experimental and the control group. The experimental group receives a video demonstration on PA intensity levels and subsequent PA assessment via self-administered computer-assisted questionnaire. The control group receives PA assessment only. Thereafter, the data are processed to compare the difference between self-reported and accelerometer-based moderate-to-vigorous physical activity (MVPA) between the study groups using a two-sample t-test. This methodology is appropriate for investigating the effect of any existing or self-produced video on the difference between the two measurement methods. It can be used not only for persons from the general population, but for a variety of other populations and contexts as accurate measures are needed to evaluate PA levels.
Assessment of physical activity (PA) is commonly done by questionnaires because they are inexpensive and easy to administer. As positive associations between amounts of higher-intensity PA and cardiovascular health are well established1,2,3, many questionnaires inquire frequency and time spent in light, moderate, and vigorous PA presenting examples of respective activities4,5,6,7,8. However, they may be flawed by inaccuracy due to individually different understanding of PA intensity levels9. Further, specific activity examples may not hold true for individuals with different physical constitutions. For example, overweight or obese persons may feel more exerted than persons with normal weight when performing the exact same activity. Direct measures on the other hand (e.g., accelerometry) require considerable amounts of time and costs and possess limited validity due to reactivity bias10,11, sample selection bias12, and the lack of ability to accurately capture certain activities13. A broad range of studies showed only low to moderate agreements between self-reported and accelerometer-based PA14,15,16. Most findings indicate that respondents report more time spent in higher-intensity PA compared to directly measured data. Throughout the manuscript, the term "gap" is used to designate this lack of agreement between accelerometry and self-reported PA.
A video as part of a computer-assisted self-completed questionnaire might help to reconcile the two measures by increasing the accuracy of self-reports. A video demonstration provides an opportunity to show different intensity levels of PA that are hard to explain by written text only. Respondents receive a visual reference they may compare their performance levels with and thus, misclassification of light, moderate, and vigorous PA may be reduced. Up to now, videos to support assessments are available in the context of mobility and physical functioning validated for older adults17,18,19. To our knowledge, there are no video-supported assessments that provide a reference for light, moderate, and vigorous PA.
We developed a 3-minute video showing a middle-aged man on a treadmill in a fitness center who describes the terms light, moderate, and vigorous PA and simultaneously visualizes symptoms related to these intensity levels. The methodology described here is a randomized controlled trial to test the effect of the video demonstration on the gap between self-reported and accelerometer-based moderate-to-vigorous physical activity (MVPA). In addition, standardized assessment of somatometry (height, body weight, and waist and hip circumference) is conducted to investigate whether effects differ according to participants' physical constitution.
The methodology is appropriate to test the effect of any video demonstration that is meant to support computer-assisted PA questionnaire assessment with the aim of reducing the gap between self-reported and directly measured PA. The methodology can be used in various populations and contexts as accurate measures are needed to evaluate current and changing PA levels, efficacy of PA interventions, and associations between PA and health outcomes.
This protocol was approved by the ethics committee of the University Medicine Greifswald (number BB 076/18; June 2018).
1. Video construction and experimental design
Figure 1: Schematic structure of the video demonstration of different physical activity intensity levels. The main scenes of the video with according single shots, lengths, and summary of contents are depicted. The video was based on a video clip provided by the CDC20. Please click here to view a larger version of this figure.
2. Power calculation
Figure 2: Schematic depiction of the calculated participation flow. n = number of participants. All n refer to results of the power calculation. Please click here to view a larger version of this figure.
3. Participant recruitment and preparation for data collection
4. Participant assessment session
NOTE: Conduct this session within three days after the last accelerometer wearing day.
5. Download of accelerometer data for processing and creation of feedback letters
6 Statistical analysis
The methods detailed above describe a randomized controlled trial to test whether a video demonstration of PA intensity levels reduces the gap between self-reported and accelerometer-based MVPA. An interim analysis (n = 157) was planned to evaluate whether the estimated sample size of 314 participants is sufficient to test our hypothesis. Up to this point, 142 participants completed the study protocol. Participants who were too old (n = 1) or who did not wear the accelerometer for ≥10 hours per day on ≥6 days (n = 10) were excluded from the analysis. Thus, data analysis was carried out using a sample of 131 participants to give an example of representative results among individuals from the general population aged between 40 and 75 years.
Table 1 presents descriptive statistics of the analysis sample (n = 131). Of this sample, 68 participants (52%) were randomized to the experimental group and 63 participants (48%) were randomized to the control group. The experimental group received a video demonstration before completing the PA questionnaire, whereas the control group received PA assessment only. It was hypothesized that the video demonstration reduces the gap between self-reported and accelerometer-based PA. Preliminary results of interim analysis revealed a lower formal mean difference in the video group (M = 21.8, SD = 108.9) compared to controls (M = 41.0, SD = 117.4, t(129) = 0.97, p = .166, Figure 3 and Figure 4). The p-value lies between the significance (p < 0.010) and futility (p > 0.269) boundaries of the test simulations. Thus, the study may continue as planned until the total sample size is reached.
Total Sample | Control group | Video group | |
N | 131 | 63 (48%) | 68 (52%) |
Sex, women | 85 (65%) | 46 (73%) | 39 (57%) |
Age, years | 60.1 ± 8.9 | 58.1 ± 9.6 | 61.9 ± 7.9 |
Current living together with a partner, yes | 102 (78%) | 51 (81%) | 51 (75%) |
School education | |||
< 10 years | 20 (16%) | 12 (19%) | 8 (12%) |
10 years | 64 (50%) | 27 (44%) | 37 (56%) |
> 10 years | 44 (34%) | 23 (37%) | 21 (32%) |
Not specified (n = 3) | |||
Employment | |||
Full-time or part-time | 55 (42%) | 33 (52%) | 22 (32%) |
Irregularely | 23 (18%) | 8 (13%) | 15 (22%) |
Not employed or retired | 53 (40%) | 22 (35%) | 31 (46%) |
Current smoker, yes | 22 (17%) | 12 (19%) | 10 (15%) |
Body mass index | |||
< 25 kg/m2 | 34 (26%) | 23 (37%) | 11 (16%) |
≥ 25 kg/m2 and < 30 kg/m2 | 55 (42%) | 22 (35%) | 33 (49%) |
≥ 30 kg/m2 | 42 (32) | 18 (29%) | 24 (35%) |
Self-reported general health | 2.8 ± 0.7 | 2.8 ± 0.8 | 2.8 ± 0.6 |
Accelerometer wear time, min/day | 883.0 ± 82.8 | 896.1 ± 74.4 | 870.8 ± 88.7 |
Accelerometer-based MVPA, min/day | 45.2 ± 27.7 | 44.1 ± 24.3 | 46.2 ± 30.7 |
Self-reported MVPA, min/day | 77.2 ± 117.2 | 85.2 ± 119.0 | 68.0 ± 115.8 |
Table 1: Sample characteristics of participants included in the preliminary interim analysis. N = number of participants. MVPA = moderate-to-vigorous physical activity. Data are presented as mean ± standard deviation for continuous variables and as the number of participants (%) for categorical variables. Body mass index was calculated from objectively measured height and body weight at the participant assessment session. Self-reported general health was measured on a 5-point scale from 1 "very good" to 5 "very bad". Self-reported and accelerometer-based MVPA as well as accelerometer wear time refer to average minutes per day across seven days.
Figure 3: Mean difference between self-reported and accelerometer-based moderate-to-vigorous physical activity compared between study groups. Δ = delta. MVPA = moderate-to-vigorous physical activity. min/day = minutes per day. The mean differences with according 95% confidence intervals of the control group (grey square) and the video group (blue diamond) are depicted. Mean differences were calculated as self-reported minus accelerometer-derived min of MVPA. The data refer to preliminary results of interim analysis (n = 131). Please click here to view a larger version of this figure.
Figure 4: Bland Altman plots for visual depiction of the difference between self-reported and accelerometer-based moderate-to-vigorous physical activity in the control group (A) and in the video group (B). MVPA = moderate-to-vigorous physical activity. min/day = minutes per day. SD = standard deviation. Differences were calculated as self-reported minus accelerometer-derived min of MVPA. A perfect agreement between the measures would be present if all dots lied on a horizontal line at the value 0 of the y-axis (red line). The data refer to preliminary results of interim analysis (n = 131). Please click here to view a larger version of this figure.
This report describes a methodology for testing the effect of a video demonstration on the gap between self-reported and accelerometer-based PA. If self-report assessment is preceded by a video demonstration of PA intensity levels, over-reporting of MVPA might be reduced. This protocol can be used to test the effect of any existing or self-produced information video on the gap between self-reported PA data derived from a computer-assisted assessment and directly measured PA.
The most important steps in the protocol include fundamental aspects of trial conduction that ensure the receipt of accurate data, such as correct accelerometer initialization and data download or making sure that the video may not be skipped by respondents. Further, there are more specific issues about the accelerometer wearing period and the daily wear time. First, the accelerometer wearing period and self-reported data should refer to the same time frame. To hand out accelerometers and agree on the date of the assessment session immediately after recruitment seems helpful to ensure participants' adherence to the scheduled appointment. Second, participants may not always comply with the instructions for accelerometer wearing. The device may be worn for less than seven days and/or only a few hours per day, whereas subsequent self-reports refer to the complete wearing period. Thus, over-reporting of MVPA may be bound to occur. Moreover, if wear time substantially differs between study groups, results may be compromised due to biased accelerometer-based MVPA data. Inspection of interim descriptive statistics may uncover insufficient amounts of wear time. For example, among the participants who completed the study protocol (n = 142), only 115 participants wore the device at least 10 hours on each of the seven days. There were three participants with a wear time of 0 minutes on one or more days. Excluding outliers seems necessary to ensure that the data are representative for an entire day as well as the total assessment period. Although most studies on correlations between accelerometry and PA questionnaire data request a wear time of ≥10 hours per day on ≥4 days per week29, investigations on the gap between measures may require more conservative cut-off values. Thus, we decided to exclude participants from the analysis who did not wear the accelerometer for ≥10 hours per day on ≥6 days.
Further modifications of the protocol may be appropriate. Preliminary results of descriptive statistics shown in Table 1 indicate an unbalanced proportion of men and women in our total sample and between study groups. If the video affects self-reports differentially in men and women, overall video effects may be biased. Thus, basic variables (e.g., sex and age) may need to be considered in the randomization algorithm. Moreover, the main analysis model may need to include sociodemographic and health related variables as potential confounders using a linear regression model instead of a t-test.
The methodology described here aims at reducing the gap between self-reported and accelerometer-derived PA by using a video to address comprehension of PA intensity levels. However, specific characteristics inherent to each measure remain to affect this gap. First, self-reported PA data is susceptible to recall bias30 and may be affected by social desirability bias31,32. Second, bias in accelerometer data particularly origins in different motivation to wear the device. Third, hip-worn accelerometers may lack the ability to accurately capture cycling and swimming13. Finally, accelerometers capture absolute amounts of movement whereas self-reports account for relative physical exertion33,34,35. Considering these factors, the visualization of intensity levels may present only one of many options to reduce the gap between self-reported and directly measured PA.
The authors have nothing to disclose.
This research was supported by the University Medicine Greifswald and the DZHK (German Centre for Cardiovascular Research; Grand No. D347000002). The authors wish to thank Christian Goeze, Stefanie Tobschall, and Clip Film- und Fernsehproduktion GmbH.
Accelorometers | ActiGraph, LLC | ActiGraph Model GT3X+ | This is the most common device on the market. Similar products are available from other vendors. |
Access Software | Microsoft | The software ist used for creation of computerized feedback letters. | |
Actilife Software | ActiGraph, LLC | Software to prepare, initialize, download, and processing of data collected by the accelerometers. | |
Belts | ActiGraph, LLC | Elastic Belt | Elastic bands for accelerometer wearing on the hip. |
Computational software | StataCorp | The software Stata ist used for statistical analysis. | |
Digital scales (height) | ADE GmbH & Co. | MZ 10020 | The scales are used for body height measurement. |
Digital scales (weight) | Soehnle Industrial solutions GmbH | SOEHNLE 7720 | The scales are used for body weight measurement. |
Excel Software | Microsoft | The software ist used for calculations on accelerometer-based data. | |
PASS Sample Size Software | NCSS | PASS Sample Size 16 | The software is used for power calculations. |
Tablet | Apple Inc. | iPad MC769FD/A | The tablet comupter ist used for the self-administered assessment. |
USB cable | ActiGraph, LLC | USB cable | USB cable for device communication and charging of accelerometers. |