Accurate and standardized assessment of external power output is crucial in the evaluation of physiological, biomechanical, and perceived stress, strain, and capacity in manual wheelchair propulsion. The current article presents various methods to determine and control power output during wheelchair propulsion studies in the laboratory and beyond.
The use of a manual wheelchair is critical to 1% of the world's population. Human powered wheeled mobility research has considerably matured, which has led to improved research techniques becoming available over the last decades. To increase the understanding of wheeled mobility performance, monitoring, training, skill acquisition, and optimization of the wheelchair-user interface in rehabilitation, daily life, and sports, further standardization of measurement set-ups and analyses is required. A crucial stepping-stone is the accurate measurement and standardization of external power output (measured in Watts), which is pivotal for the interpretation and comparison of experiments aiming to improve rehabilitation practice, activities of daily living, and adaptive sports. The different methodologies and advantages of accurate power output determination during overground, treadmill, and ergometer-based testing are presented and discussed in detail. Overground propulsion provides the most externally valid mode for testing, but standardization can be troublesome. Treadmill propulsion is mechanically similar to overground propulsion, but turning and accelerating is not possible. An ergometer is the most constrained and standardization is relatively easy. The goal is to stimulate good practice and standardization to facilitate the further development of theory and its application among research facilities and applied clinical and sports sciences around the world.
With an estimated 1% of the world's population being dependent on wheeled mobility today1,2, a consistent flow of international research work increasingly emerges into international peer-reviewed journals in diverse fields such as rehabilitation1,3, engineering4, and sport sciences5,6. This leads to a growing knowledge base and understanding of the complexities of this common mode of human ambulation. Yet, for continual development and implementation in rehabilitation and adaptive sport practices, there is a need for further international exchange and collaboration in research. Integral to such collaborative networks are improved standardization of experimental and measurement procedures and technology. Furthermore, consistent implementation of accurate monitoring of performance of the wheelchair-user combination in the laboratory and/or in the field is important for an optimal individual functioning and participation while a healthy and active lifestyle is maintained over the individual's lifespan7,8,9.
Experimentally, manual wheelchair propulsion during steady-state or peak exercise conditions10,11 is often approached as cyclical upper body motion for the purposes of examining the wheelchair-user interface12,13, musculoskeletal loading14,15,16, and motor learning and skill acquisition17,18. The combined biomechanical and physiological notions of cyclic motions allow the use of the "Power balance", a modelling approach that was initially introduced by Van Ingen Schenau19 for speed skating and cycling, and later introduced in manual wheeled mobility8,20,21. Figure 1 shows a power balance diagram for manual wheelchair propulsion. It converges from a selection of critical performance determining factors for the wheelchair-user combination and its three central components (the wheelchair, user, and their interface), at the left-hand side into the layout of (bio)mechanical and physiological power denominators and equations.
Power output is an important outcome parameter in the contexts of sports and daily life where peak power output can represent both increased performance in adapted sports or ease of functioning during activities in daily living22. Moreover, in combination with energy consumption it can be used to evaluate performance in terms of gross mechanical efficiency17,18,23 (i.e., where a more skilled individual would require less internal energy to produce the same amount of external power output). From an experimental perspective, power output is a parameter that needs to be tightly controlled during a test, because changes in power output are of direct influence on all performance outcomes such as push time, recovery time24, and mechanical efficiency25. Consequently, controlling and reporting power output is essential for all studies related to manual wheelchair propulsion.
Overground testing is the gold standard in terms of validity (i.e., inertia, air friction, optical flow, and dynamic movement)26, yet standardization of external power output, speed, and associated environmental conditions is much more difficult, and repeatability over time suffers. Overground wheelchair-related studies started in the 1960s27,28 and focused on the physical strain of wheeled mobility. Although crucial in data interpretation and understanding8,20, notions on external power output were limited to observation of the internal metabolic cost when performing different activities on different surfaces. Nowadays, measurement wheels can be used to measure power output29,30 and coast-down tests31,32 can be performed to infer the frictional losses during propulsion and thereby power output.
Different laboratory-based technologies were developed for wheelchair-specific exercise testing33, ranging from a multitude of ergometers to differently sized and brands of treadmills. Treadmills are considered to be closest to overground testing in terms of validity34 and have been used since the 1960s for wheelchair exercise testing35,36. Prior to testing, the slope and speed of the treadmill must be checked regularly. Even treadmills from the same brand and make may differ considerably and change in their behavior over time37. For the determination of external power output, a drag test20,36 is used for the individual wheelchair-user combination's total of rolling and internal drag force38. The force sensor for the drag test also has to be periodically calibrated. For the experimental individualization of the protocol in terms of overall external load of wheeling over time and between subjects, a pulley system (Figure 2) has been designed as an alternative for the previous slope-dependent gradients of loading36.
Another alternative for standardized wheelchair exercise testing has been the use of stationary ergometers33, from simple off-the shelf ergometer solutions39 towards highly specialized computer-based and instrumented ergometers40. Very few are commercially available. The enormous diversity in ergometer technology and mechanical characteristics introduces large unknown degrees of variability among the test outcomes33. Ergometers and wheelchairs need to be connected or inherently fused by design. Air friction is not present and perceived inertia is limited to the simulated inertia on the wheels, and movement experienced in the trunk, head, and arms during propulsion, while the wheelchair user is essentially stationary. The ergometer does allow for sprint or anaerobic testing as well as isometric testing, if the wheels can be adequately blocked.
A basic methodology for manual wheeled mobility research in lab-based studies is presented. Also, a brief outlook on field-based wheelchair research methodology and its potential outcomes is provided. The central focus is controlling and measuring external power output (W) in both field and laboratory-based experiments. The determination of internal power output through spirometry is also added, as this is often used to determine gross mechanical efficiency. Apart from the implementation of good practice, the goal is to produce discussions on experimental standardization and international information exchange. The current study will primarily address handrim wheelchair propulsion and the measurement thereof because it is the most prominent form of manually wheeled mobility in scientific literature. However, notions discussed below are equally valid for other wheelchair propulsion mechanisms (e.g., levers, cranks41).
The current protocol describes the standardization and measurement of power output during overground, treadmill, and wheelchair ergometer-based testing during steady-state propulsion at 1.11 m/s. As an example, rolling friction will first be determined in overground testing with a coast-down test. Using this estimate of friction, power outputs will be set in the treadmill and ergometer tests using available protocols from the research literature. For treadmill tests, friction will be determined with a drag test, and power output will be adjusted using a pulley system. For the ergometer tests a computer-controlled ergometer is used to match external power output with the overground test.
This study was approved by the local ethical committee (Ethical Committee Human Movement Sciences) at the University Medical Center Groningen. All participants signed written informed consent.
1. Study design and setup
2. External power output during overground testing
3. External power output during treadmill testing
4. External power output during ergometer-based testing
5. Internal estimates of power output during hand rim wheelchair propulsion
6. Testing procedure
Using the aforementioned procedure, power output was determined for 17 familiarized (two 30 min sessions of practice) able-bodied participants with an overground back-and-forth coast-down test (mean of five trials). The coast-down profile was characterized with a measurement wheel in a smooth hospital hallway. Afterwards, participants were measured during overground (25.0 x 9.0 m circuit), treadmill (2.0 x 1.2 m), and ergometer wheelchair propulsion. The power output in the treadmill and ergometer modalities were matched with the overground condition using the protocols described in this paper.
Power output was obtained from the same measurement wheel during three blocks of 4 min of wheelchair propulsion after a familiarization block of equal length. Only the last minute of each block was used for analysis, assuming steady-state propulsion. For the overground propulsion data only the long straights (25 m) were used. All data (pre-)processing was performed in Python 3.7 (Python Software Foundation). ICC estimates and their 95% confidence intervals were calculated in R 3.3.4 (R Core Team), using a single-rating, absolute-agreement, random-effects model.
The mean combined weight of the wheelchair-user system was 92.6 kg (± 8.3). The mean expected power output from the coast-down test was 9.7 W (± 1.6). Power output as calculated from the measurement wheel was lower for overground 8.1 W (± 1.4), treadmill 7.8 W (± 1.9), and ergometer 8.7 W (± 2.2) wheelchair propulsion. The average difference between target power output and measured power output were -1.6 (± 1.6), -1.8 (± 1.4), -1.0 (± 1.0) W for overground, treadmill, and ergometer propulsion, respectively. These results are also shown in Table 1, Figure 5, and Figure 6.
Power output for overground propulsion showed a poor-to-moderate (ICC: 0.38, CI: 0.00-0.73) agreement with the target output. In contrast, treadmill propulsion showed poor-to-good (ICC: 0.45, CI: 0.00-0.79) agreement and ergometer propulsion showed poor-to-excellent (ICC: 0.77, CI: 0.11-0.93) agreement. Absolute error was negatively correlated with power output for propulsion on the ergometer (r = -0.55, p = 0.02), but not for the other two conditions (overground: r = 0.47, p = 0.06; treadmill: r = 0.22, p = 0.40).
Agreement between conditions was poor-to-moderate (ICC: 0.49, CI: 0.20-0.74). Within-modality (between the three 4 min blocks) reliability was good-to-excellent for overground (ICC: 0.91, CI: 0.82-0.97) and treadmill (ICC: 0.97, CI: 0.93-0.99) propulsion and moderate-to-excellent for ergometer propulsion (ICC: 0.97, CI: 0.71-0.99). The ergometer appeared to perform worse over time, which was confirmed by a repeated-measures ANOVA (F(2, 32) = 64.7 , p < 0.01), but there was no time effect for overground (F(2, 32) = 0.9 , p = 0.418) and treadmill (F(2, 32) = 0.9 , p = 0.402) propulsion.
Figure 1: Power balance applied to manual wheelchair propulsion. Pout: external power output (W); ME: gross mechanical efficiency (%); F: mean resisting force; V: mean coasting velocity; A: work per push or cycle (J); fr: frequency of pushes or cycles (1/s); Pint: internal losses (W); Pair: aerodynamic resistance (W); Proll: rolling friction (W); Pincl: losses due to inclination (W). This figure is reprinted from van der Woude et al.20. Please click here to view a larger version of this figure.
Figure 2: Treadmill setup. Left: Pulley setup to increase the external power output on a treadmill during propulsion. Right: Drag test setup to measure the frictional forces during treadmill wheelchair propulsion. Please click here to view a larger version of this figure.
Figure 3: Protocol settings window for the wheelchair ergometer. Power output can be set by choosing a power output and a target speed or a rolling friction and a target speed. Please click here to view a larger version of this figure.
Figure 4: Feedback on the wheelchair ergometer in the form of a line plot. Left and right roller speeds are plotted. Participants should try to keep a steady speed while going in a straight line (by keeping the on-screen line horizontal). Speed data is smoothed with a sliding window that can be changed in the settings. Please click here to view a larger version of this figure.
Figure 5: Relative and absolute difference distributions between coast-down friction and measured power output during overground (OG), treadmill (TM), and ergometer (WE) wheelchair propulsion. The whiskers show 1.5x the interquartile range. Please click here to view a larger version of this figure.
Figure 6: Bland-Altman plot for coast-down friction and measured power output during overground (left), treadmill (middle), and ergometer (right) wheelchair propulsion. The dark gray dotted lines indicate the pooled mean for a combination and the red dotted lines are the mean + 1.96 standard deviations. Please click here to view a larger version of this figure.
Value two-sided (W)2 | Difference with target | Difference with target (%) | Difference with target (abs) | Agreement with target PO (ICC)3 | Reliability between blocks (ICC)3 | |
Target PO1 | 9.68 (± 1.57) | n.a | n.a | n.a. | n.a | n.a. |
Overground PO | 8.12 (± 1.41) | -1.56 (± 1.57) | -15.30 (± 13.70) | 1.72 (± 1.57) | 0.38 (0.00−0.73)* | 0.91 (0.82−0.97)* |
Treadmill PO | 7.84 (± 1.92) | -1.84 (± 1.38) | -18.98 (± 13.42) | 1.91 (± 1.16) | 0.45 (0.00−0.79)* | 0.97 (0.93−0.99)* |
Ergometer PO | 8.65 (± 2.24) | -1.02 (± 0.97) | -11.82 (± 11.94) | 1.16 (± 0.78) | 0.77 (0.11−0.93)* | 0.97 (0.71−0.99)* |
1. Calculated from coast-down friction. 2. Determined with measurement wheel. 3. Two-way, absolute agreement, fixed raters with 95% confidence intervals. * p < 0.001. |
Table 1: Comparison of set power output and actual power output measured with a measurement wheel.
Factors | Rolling resistance |
Body mass ↑ | ↑ |
Wheelchair mass ↑ | ↑ |
Tire pressure ↓ | ↑ |
Wheel size ↑ | ↓ |
Hardness floor ↓ | ↑ |
Camber angle ↑ | ? |
Toe-in/out ↑ | ↑↑ |
Castor shimmy ↑ | ↑ |
Center of mass on rear wheels | ↓ |
Folding frame | ↑ |
Maintenance ↓ | ↑ |
Table 2: Factors influencing rolling friction and power output during manual wheelchair propulsion. This table is reprinted from van der Woude et al.8.
Supplementary Material 1. Please click here to view this file (Right click to download).
Supplementary Material 2. Please click here to view this file (Right click to download).
Supplementary Material 3. Please click here to view this file (Right click to download).
Supplementary Material 4. Please click here to view this file (Right click to download).
Supplementary Material 5. Please click here to view this file (Right click to download).
Supplementary Material 6. Please click here to view this file (Right click to download).
In the previous sections an accessible methodology for determining and standardizing power output for different laboratory-based modalities was presented. Additionally, a comparison between set power output and measured power output during steady-state propulsion was made. While systematic error was present as well as some variability, the tools presented are better than the alternative: not standardizing at all. These results are similar to another study that reported measured power output and set power output50. Moreover, agreement between conditions was poor-to-moderate, indicating that extra attention should be paid when comparing studies using different modalities. As expected, the ergometer condition presented the easiest environment to standardize from the perspective of the operator. The ergometer performed better in the high friction settings. The blocks (3 x 4 min) within one modality showed good-to-excellent and moderate-to-excellent agreement. Interestingly, the ergometer performed worse over time, possibly due to sensor drift. Therefore, it might be prudent to recalibrate the ergometer between every block. Note that these results are for low-intensity steady-state exercise and could differ for different protocols.
Minor mechanical or ergonomic changes in the wheelchair-user combination can have a large impact on experimental outcomes12,51. Material maintenance and a full awareness of vehicle mechanical principles are essential for performance outcomes and the validity of the experiment. The vehicle mechanics (e.g., mass, wheel sizes, tire type and pressure, alignment) and fit (e.g., fore-aft position, center of mass, mass, frontal plane) of wheelchair-user combination will determine rolling and air drag in combination with environmental conditions. The mass and the orientation of the center of mass will affect rolling drag with respect to the larger rear wheels and the smaller castor wheels in front. A summary of factors influencing rolling friction is presented in Table 2. Moreover, the wheelchair is often individualized. Apart from the intervention conditions (e.g., vehicle mechanics or interface) at each test, the wheelchair conditions must also be constant and its vehicle mechanics, including frame, seat, and tires should be checked. The tires need to be at a fixed pressure over tests and among individuals. Important checkpoints52 are possible friction points, rear wheel position, and potential changes in wheel alignment36,53,54,55.
Overground testing also requires ambulant technology for each of the indicators for cardiopulmonary strain, kinematics, or kinetics outcomes. This can be met, but the practicality of complex measurements is limited in a non-research environment. Coast-down tests are specific for the individual wheelchair-user combination and rolling surface. However, they are static, so they might not capture all the characteristics of the wheelchair-user combination56. They are especially sensitive to changes in the center of mass, which might explain the small differences between the coast-down test and the measured overground power output. These limitations are also found in the drag test and ergometer calibration, which also assume a static position of the wheelchair user.
The drag test measures the resisting forces of rolling and internal drag of each individual wheelchair-user combination. It is clearly sensitive to vehicle mechanics of the wheelchair, but also position and body orientation of the user. A standardized procedure is essential20,36, where at a constant belt speed, the user-wheelchair combination is pulled over the belt being connected to a unidimensional calibrated force transducer on the frame of the treadmill at a series of slope angles (Figure 2). A treadmill adaptor for load cells that can be adjusted to the height of the center axis of the wheelchair is required. Using linear regression analysis provides a static estimate of the mean drag force on the treadmill belt at zero inclination for a given wheelchair-user combination, which provides the mean external power output with the product of belt speed and drag force. The drag test is robust with regards to small differences in the execution of the test by different operators (e.g., position of the rope)37.
Although sometimes assumed an apparently simple test, each of the testing elements of the drag test requires understanding of the underlying theory and training on all the details of the procedures8. Similar to the coast-down test, this test is especially sensitive to changes in center of mass. Moreover, the behavior and sensitivity of the strain gauge-based force transducers, their consistent calibration (i.e., precision of calibration weights, sequence of mounting)20,36,37, as well as any of the procedures of the drag test that are sensitive to changes in speed or inclination angle of the treadmill all have to be considered. This means that the treadmill itself needs to be checked and calibrated as well37. Consistent awareness of such noise generating phenomena must be tracked and executed in day-to-day experimentation.
Precision of power output-based simulations and their outcomes are fully dependent on the standardization, practice, and training of those who conduct the experiments. Diversity of treadmills, ergometers, or any other electronically motor driven device can be an issue, as shown by De Groot et al.51. In exchange of population-based data, one should be aware of the potential role of such differences on the test outcomes. In any wheelchair experiment, a proper explanation of the testing conditions and open presentation of the actual values for speed, resistance, and power output should be presented for any subgroup or measurement condition.
In wheelchair experimentation, heterogeneity of the test sample is hard to escape from when focusing on the actual wheelchair users. Among those, people with a spinal cord injury are most frequently subject to research, because they tend to have a stable spinal cord lesion for the rest of their lives. Lesion level, completeness, gender, age, talent, and training status determine the heterogeneity of such study groups57. Increasing the number of participants through multicenter collaboration is an important way to circumvent this and increase the power of experimentation57, even in the early stages of rehabilitation10. This paper is hopefully a stepping-stone to a broad discussion on wheelchair experimenting in rehabilitation and adaptive sports communities that hopefully leads to international collaboration and knowledge exchange through the existing and new networks of researchers. Availability of adequate testing infrastructure allows consistent monitoring and evaluation of progress in clinical rehabilitation, adaptive sports, and beyond.
The authors have nothing to disclose.
The preparation of this manuscript was financially supported by a grant from Samenwerkingsverband Noord-Nederland (OPSNN0109) and was co-financed by the PPP-allowance of the Top consortia for Knowledge and Innovation of the Ministry of Economic Affairs.
'coast_down_test' software | University Medical Center Groningen | – | Custom made |
ADA3 software | University Medical Center Groningen | – | Custom made |
Angle sensor | Mitutoyo | Pro 360 | |
Calibration weights (0-10kg in 1kg increments) | University Medical Center Groningen | – | Custom made |
Drag test force sensor (20kg) | AST | KAP-E/Z | |
Extra wide treadmill | Motek-forcelink | 14-890-0387 | |
IMU sensor set | X-IO Technologies | NGIMU | |
Inertial dummy | Max Mobility | Optipush | |
Lightweight rope | – | – | Custom made |
Lode Ergometry Manager | Lode | LEM 10 | |
Measurement wheel | Max Mobility | Optipush | |
Pulley system | University Medical Center Groningen | – | Custom made |
Spirometer | COSMED | K-5 | |
Stopwatch | Oneplus | 6T | Phone stopwatch |
Tachometer | Checkline | CDT-2000HD | |
Treadmill attachment for drag test | University Medical Center Groningen | – | Custom made |
Weights for pulley (0-2kg in 5g increments) | University Medical Center Groningen | – | Custom made |
Wheelchair | Küsschall | K-series | |
Wheelchair roller ergometer | Lode | Esseda |