Journal of Men's Health,2023,19(9):104-112 DOI:10.22514/jomh.2023.090
Original Research

Effect of unsupervised Kinect-based mixed reality fitness programs on health-related fitness in men during COVID-19 pandemic: randomized controlled study

So Young Ahn1, Yun Ho Sung1, Jun-Hyun Bae2, Byung Gul Lim1, XinXing Li1, Dong Hyun Kim1, Dong Il Seo3, Jung Jun Park4, Hyun Joo Kang5, Han Joon Lee6, Chung Gun Lee7, Yeon Soon Ahn8, Wook Song1,9,10,*,

1Health and Exercise Science Laboratory, Institute of Sports Science, Department of Physical Education, Seoul National University, 08826 Seoul, Republic of Korea

2Virtual Reality Research Institute, Qingdao University of Science and Technology, 266061 Qingdao, Shandong, China

3Department of Sports Science, Dongguk University, 38066 Gyeongju, Republic of Korea

4Division of Sports Science, Pusan National University, 46241 Busan, Republic of Korea

5Department of Sports Medicine, Soonchunhyang University, 31538 Asan-si, Republic of Korea

6University of Ulsan, 44610 Ulsan, Republic of Korea

7Institute of Sport Science, Department of Physical Education, Seoul National University, 08826 Seoul, Republic of Korea

8Department of Preventive Medicine and Genomic Cohort Study Institute, Yonsei Won-ju College of Medicine, Yonsei University, 26426 Wonju-si, Republic of Korea

9Institute on Aging, Seoul National University, 08826 Seoul, Republic of Korea

10Dr. Exsol Co, Ltd, 06521 Seoul, Republic of Korea

*Corresponding Author(s):songw3@snu.ac.kr (Wook Song)

History Submitted: 04 May 2023 | Accepted: 01 June 2023 | Published: 30 September 2023
Copyright:  ©2023  The Author(s). Published by MRE Press.
This is an open access article under the CC BY 4.0 license (https://creativecommons.org/licenses/by/4.0/).

Collapse table of contents

Abstract

This study aimed to investigate the effect of Kinect-based mixed reality (KMR) exercise and unsupervised individual exercise on health-related fitness. A total of 27 participants underwent cardiorespiratory fitness tests for the inclusion criteria and were randomly assigned to three groups: a KMR group (KMRG), an unsupervised individual group (UIG), or a control group (CG). Pre and post-tests were conducted to measure Maximum oxygen uptake (VO₂max), body composition, upper and lower-body (LB) muscle strength, and endurance. KMRG and UIG attended exercise sessions 3 days per week for 8 weeks. KMRG used the KMR device and UIG used an instructive banner for exercise. All groups maintained their daily routines and submitted diet records every 4 weeks. Results showed that VO₂max, upper-body muscle endurance, and LB muscle endurance of knee extension was increased in KMRG and UIG. LB muscle strength in knee flexion was increased in UIG and LB muscle endurance in knee flexion was increased in KMRG. VO₂max, LB muscle strength, and LB muscle endurance were greater in KMRG than in CG. LB muscle strength in knee flexion was greater in KMRG than in UIG. Body fat was increased and skeletal muscle mass was decreased in CG. KMR exercise showed better performance than unsupervised individual (UI) exercise, and the exercise program was effective in both KMR and UI environments. These findings contribute to the growing evidence supporting the use of technology-based exercise interventions as a potential strategy to enhance health-related fitness.

Keywords:Digital health;Fitness program;Kinect;Mixed reality;Unsupervised;Physical fitness
PDF(8.5 MB)|EndNote (RIS)|BibTeX|RefMan|RefWorks

Cite this article

So Young Ahn, Yun Ho Sung, Jun-Hyun Bae, Byung Gul Lim, XinXing Li, Dong Hyun Kim, et al.Effect of unsupervised Kinect-based mixed reality fitness programs on health-related fitness in men during COVID-19 pandemic: randomized controlled study.Journal of Men's Health,2023,19(9):104-112 DOI:10.22514/jomh.2023.090

1. Introduction

With the advancements in information and communication technologies, extended reality (XR) techniques, such as virtual reality (VR), augmented reality (AR), and mixed reality (MR), have gained increasing significance in the realm of digital health [1]. These technologies offer promising avenues for enhancing existing healthcare solutions or creating novel ones. Among these devices, the Kinect-based mixed reality device (KMR) stands out, capable of tracking 25 joints of the user’s body using a Kinect camera during exercise and providing real-time feedback through AR by converting the Kinect data. This unique interaction between the device and the user creates an immersive MR environment, enabling exercise without the need for human supervision or intervention [2]. Previous studies have demonstrated the superior performance of exercise with feedback compared to non-feedback exercise [3, 4, 5, 6], while motion detection has proven effective in guiding exercise routines [7, 8, 9]. Additionally, exercising without proper guidance or feedback can potentially lead to injuries [10]. Consequently, the KMR device holds immense potential for individuals who face challenges in accessing professional exercise assistance, offering a beneficial solution to enhance their exercise experience.

Occupations like firefighting demand a high level of physical fitness [11, 12, 13, 14], with a minimum VO₂max of 42 mL/kg/min deemed necessary for safety according to the National Fire Protection Association (NFPA) standards. However, a significant majority of Korean firefighters fail to meet this requirement, with 63.9% falling short [1, 15]. Many firefighters also struggle with overweight issues and elevated body fat levels [16], which can increase the risk of injuries and cardiovascular diseases, ultimately affecting their occupational capabilities [17].

Shift work and emergency situations can further impact firefighters’ health negatively, but exercise has shown promise in mitigating these effects [18, 19]. Unfortunately, due to the nature of their occupation, most firefighters face constraints in engaging in regular exercise routines [20]. Therefore, there is a pressing need to develop effective and time-efficient fitness programs tailored to Korean firefighters, aiming to prevent injuries and enhance workability [16, 20, 21]. However, no previous study has evaluated the feasibility of non-face-to-face KMR exercise for individuals with limited opportunities to engage in supervised exercise with professionals or access gym or fitness center facilities. Thus, this study aims to compare the effectiveness of KMR exercise and unsupervised individual exercise, evaluating the program’s impact on health-related fitness in moderately fit overweight men. We hypothesize that unsupervised KMR exercise will outperform individual exercise and yield improvements in health-related fitness parameters.

2. Methods

2.1 Participant

The sample size calculation was performed using G*Power version 3.1 (Heinrich-Heine-University Düsseldorf, Düsseldorf, Germany) [22, 23]. With an effect size set at 5%, power at 80%, and a two-sided alpha level of 5%, the minimum required sample size per group was determined to be 8. To account for potential dropouts, the sample size was increased by approximately 20%.

The inclusion criteria for this study were as follows: participants aged between 20 and 50 years, with a VO₂max ranging from 35 to 42 mL/kg/min, body mass index (BMI) between 23 and 30 kg/m2, absence of major diseases (such as Parkinson’s disease, cardiovascular disease, diabetes, hypertension, etc.), no difficulties in using a treadmill and KMR device, no participation in hormonal or mental therapy, no engagement in moderate to heavy training regularly within the past 3 months, no alcoholism, no dietary supplementation, and non-usage of drugs known to influence muscle metabolism.

2.2 Procedure

The study procedure is outlined in Fig. 1. All tests were conducted at a single laboratory in Seoul, and each test was administered by qualified sports science professionals.

Study design for 8 weeks of 
Kinect-based mixed reality group, unsupervised individual group, and a control 
group. The study encompassed an 8-week duration, incorporating pre- and 
post-tests. Participants were randomly assigned to three groups: Kinect-based 
mixed reality group (n = 9), unsupervised individual group (n = 9), and control 
group (n = 9). Both the Kinect-based mixed reality group and unsupervised 
individual group followed a structured exercise program consisting of 3 
non-consecutive exercise days per week, while the control group engaged in 
stretching exercises on 3 non-consecutive days per week for the duration of 8 
weeks.

Fig. 1.Study design for 8 weeks of Kinect-based mixed reality group, unsupervised individual group, and a control group. The study encompassed an 8-week duration, incorporating pre- and post-tests. Participants were randomly assigned to three groups: Kinect-based mixed reality group (n = 9), unsupervised individual group (n = 9), and control group (n = 9). Both the Kinect-based mixed reality group and unsupervised individual group followed a structured exercise program consisting of 3 non-consecutive exercise days per week, while the control group engaged in stretching exercises on 3 non-consecutive days per week for the duration of 8 weeks.

Screening and Pre-test: During the initial visit, screening and pre-testing were performed. Screening involved the administration of the Korean version of the International Physical Activity Questionnaire (IPAQ) [24], a medical health/history questionnaire, and a cardiorespiratory fitness test. Participants who met the inclusion criteria proceeded to the pre-test phase, where data on cardiorespiratory fitness from the screening test were collected. Measurements of body composition, lower body (LB) muscle strength, LB muscle endurance, upper body (UB) muscle strength, and UB muscle endurance were obtained. Following the pre-test, participants were randomly assigned to one of three groups: the Kinect-based mixed reality group (KMRG), the unsupervised individual exercise group (UIG), or the control group (CG), in the order of their registration.

Intervention: The exercise groups commenced their exercise regimen within 5 days after the pre-test. The exercise program consisted of a 22-minute circuit-based whole-body workout. During the first week of the intervention, participants in the KMRG and UIG received supervised training to ensure they performed the exercises correctly within their respective environments. The CG group received a health recommendation and a handbook on muscle stretching.

KMRG: Participants were provided with a login service and an individual ID to access the exercise program through the device. Upon logging in and selecting the displayed program, the exercise would start immediately. Data, such as the number of repetitions, repetition scores, and attendance, were later exported to an online Excel format from the device company’s headquarters. The KMR device was capable of counting each repetition of the exercise and tracking the time (see Fig. 2).

An illustration showcasing 
the functionality of the Kinect-based mixed reality device. The figure depicts 
the Virtual Mate device (My benefit, Seoul, Republic of Korea) utilized in the 
study, with accompanying labels highlighting the essential components and 
features of the equipment.

Fig. 2.An illustration showcasing the functionality of the Kinect-based mixed reality device. The figure depicts the Virtual Mate device (My benefit, Seoul, Republic of Korea) utilized in the study, with accompanying labels highlighting the essential components and features of the equipment.

UIG: Participants in this group were provided with an informative banner displaying exercise instructions with accompanying pictures and narrative texts. Timers set to 1 minute and 15 seconds were also provided.

Both the KMRG and UIG groups were given attendance worksheets and instructed to record the date and their signatures to verify their visits. These worksheets were collected on a weekly basis. For a more detailed explanation of the exercise program, including repetition, time, exercise types, and information about KMR, please refer to our previous publication [2].

All participants were advised to maintain their regular lifestyle and dietary habits throughout the study period. Dietary habits were assessed using a 3-day recall method, and reminder calls were conducted every 2 weeks to ensure adherence to the study protocol. For the CG group, which might not have participated fully in the study, personal training sessions were offered after the completion of the intervention. This was communicated to the participants prior to the start of the intervention. Post-tests were conducted using the same procedure as the pre-test, following the completion of the intervention period.

2.3 Measurements

Nutrient intake: Participants were requested to maintain a food record for 3 days, including 2 weekdays and 1 weekend day, every 4 weeks for a total of 8 weeks. The collected food records were analyzed using Can Pro 5.0 software (The Korean Nutrition Society, Seoul, Korea) [25]. The analysis included the calculation of total energy consumption and the energy derived from proteins, fats and carbohydrates.

Body composition: Prior to the measurements, participants were instructed to rest in a seated position for 5 minutes, and their blood pressure was measured using a blood pressure monitor (BPBIO320S, Inbody Co, Seoul, Korea). Height was measured to the nearest 0.1 cm using an extensometer. Body weight (kg), skeletal muscle mass (kg), fat-free mass (kg), and BMI (kg/m2) were measured using bioelectrical impedance analysis (InBody720, Seoul, Korea). Participants were provided with guidelines for the measurements, which included being in a fasting state prior to the measurement, wearing light clothing, removing all jewelry, and following the instructions provided by the device, such as selecting the appropriate electrodes and maintaining stillness and silence during the measurement.

Cardiorespiratory fitness (VO₂max): The test for cardiorespiratory fitness was conducted using a gas analyzer and treadmill (Quark CPET, COSMED, Italy, Rome) following the standard Bruce protocol [26]. Before the test, a respiratory mask was securely placed on the participant’s face to ensure there was no gas leakage. Participants wore a heartbeat strap (H10, Polar, Kempele, Finland) and performed a 1-minute warm-up walk on the treadmill at a speed of 6 km/h. Rated Perceived Exertion (RPE) was recorded every minute using the Borg Scale, which ranges from 6 to 20 [27]. The test was terminated when participants met any of the following criteria: (1) inability to continue, (2) attainment of VO₂ plateau, (3) heart rate exceeding 95% of maximum heart rate (HRmax), (4) RPE of 17 or higher, or (5) Respiratory Exchange Ratio of 1.10 or above [28, 29].

Lower body muscle strength & endurance: The test for lower body muscle strength and endurance was conducted using an isokinetic dynamometer (HUMAC NORM, Computer Sports Medicine Inc., Stoughton, MA, USA) with angular velocities set at 60º/s for 5 repetitions and 180º/s for 15 repetitions of knee movements. A rest period of 1 minute was provided between sets, and the dominant leg of the participants was tested. The tests were performed for both flexion and extension movements. Peak torque (NM) normalized to body weight (kg) (%) was used as the measurement for muscle strength, and total work (J) normalized to body weight (kg) (%) was used for muscular endurance [16, 26].

Upper body endurance: Upper body endurance was assessed using a 2-minute push-up test with a tempo of 80 beats per minute (bpm). The evaluation began from the “up” position, and participants lowered their bodies towards the floor until their chin touched a 10 cm height box. Any repetitions that were not performed with proper posture were not counted [14]. Participants were allowed to take temporary rest if needed and resume the test before the time expired.

Upper body strength: The test for upper body strength involved using a grip dynamometer (TKK-5401, TAKEI Co, Ibaraki, Japan). Participants stood with their feet shoulder-width apart and grasped the handle of the grip dynamometer using their proximal interphalangeal joint. The test was repeated twice on each side, and the average value was calculated. Grip strength was reported in kilograms (kg) [26].

2.4 Statistical analysis

All data were analyzed using Statistical Package for the Social Sciences version 25 (SPSS ver. 25, IBM Corporation, Chicago, IL, USA). Descriptive statistics were reported as mean ± standard deviation (SD). The Shapiro-Wilk test was conducted to assess the normality of the data at baseline. One-way analysis of variance was employed to compare the differences between the three groups at baseline. A factorial ANOVA with repeated measures, considering the factors of time (pre vs. post) and group (CG vs. UIG vs. KMRG), was conducted to examine the differences between treatments. Subsequently, post hoc analysis using Bonferroni’s test was performed to determine specific pairwise differences, and Cohen’s d was calculated to estimate effect sizes when a significant treatment or treatment-by-time interaction was identified. The significance level was set at p < 0.05.

3. Results

3.1 Participant

Out of the initial 36 individuals who underwent screening, 7 subjects did not meet the inclusion criteria, and 2 declined to participate in the randomized group (CG). Therefore, a total of 27 participants completed the 8-week intervention (CG = 9, UIG = 9, KMRG = 9). The distribution of participants’ characteristics at baseline was found to be normal, and there were no significant differences among the groups (Table 1). The compliance rates for both KMRG and UIG were 94.9% throughout the 8-week intervention. Compliance was calculated as the number of visit days divided by the total number of planned exercise days (8 weeks × 3 days).

Table 1.Baseline characteristics of the participants.
VariablesCGUIGKMRGFp
Age (yr)30.89 ± 0.8930.22 ± 2.2029.11 ± 2.300.2210.804
Height (cm)174.17 ± 1.98172.4 ± 2.32173.5 ± 1.570.2020.818
Weight (kg)79.33 ± 2.9772.18 ± 2.5772.89 ± 2.542.1380.140
BMI (m2/kg)26.12 ± 2.2724.29 ± 2.3824.22 ± 2.901.6300.217
Body fat (%)22.98 ± 6.2622.84 ± 5.3221.33 ± 5.560.2290.797
Skeletal muscle (kg)34.62 ± 2.9331.38 ± 3.5532.23 ± 3.102.4720.106
Values are presented as mean ± standard deviation. CG, Control Group; UIG, Unsupervised Individual Group; KMRG, Kinect-based Mixed Reality Group. BMI: Body Mass Index.

3.2 Energy intake

The amount of energy derived from total energy intake among the three groups (CG, UIG, KMRG) is shown in Table 2. There were no significant differences observed between the three groups.

Table 2.Energy intakes during intervention between three groups.
VariablesCGUIGKMRGF
Energy (kcal/d)2144.20 ± 226.842004.62 ± 294.442152.67 ± 199.451.049
Carbohydrate (g/d)294.86 ± 45.67269.49 ± 61.88273.88 ± 54.020.562
Protein (g/d)81.69 ± 8.4481.42 ± 11.7292.31 ± 20.840.935
Fat (g/d)64.78 ± 11.3961.30 ± 13.5469.37 ± 12.671.619
Values are presented as mean ± standard deviation. CG, Control Group; UIG, Unsupervised Individual Group; KMRG, Kinect-based Mixed Reality Group.

3.3 The effects of exercise on body composition

Body fat percentage (%) showed a significant increase (p = 0.019) over time in the CG, and skeletal muscle mass exhibited a significant decrease (p = 0.038) within the CG. However, there were no significant differences observed between the groups (Table 3).

Table 3.Body composition of KMRG, UIG and CG before and after the intervention.
VariablesCGUIGPost-hoc1KMRGPost-hoc2Post-hoc3
Weight (kg)
Pre79.33 ± 8.9272.18 ± 7.720.10872.89 ± 7.600.1380.892
Post79.19 ± 8.8272.69 ± 8.3273.22 ± 7.70
p40.7690.3030.499
BMI (kg/m²)
Pre26.12 ± 2.2724.29 ± 2.380.21424.22 ± 2.900.1630.872
Post26.07 ± 2.4824.50 ± 2.4424.30 ± 2.87
p40.7230.1860.620
Body fat (%)
Pre22.98 ± 6.2622.84 ± 5.320.59821.33 ± 5.560.3010.606
Post24.17 ± 6.0922.72 ± 5.4621.31 ± 5.64
p40.019 (−0.193)50.7980.963
Skeletal muscle mass (kg)
Pre34.62 ± 2.9331.38 ± 3.550.73032.23 ± 3.100.8850.840
Post33.88 ± 2.7731.42 ± 3.8032.52 ± 3.58
p40.038 (0.260)50.8970.402
Values are presented as mean ± standard deviation. 1, this present p-value compared between CG and UIG; 2, this present p-value compared between CG and KMRG; 3, this present p-value compared between UIG and KMRG; 4, this present p-value of comparison between pre and post; 5, this present Cohen’s d. CG, Control Group; UIG, Unsupervised Individual Group; KMRG, Kinect-based Mixed Reality Group. BMI: Body Mass Index.

3.4 The effects of exercise on physical fitness components

There were significant increases over time in VO₂max (p < 0.001), UB muscle endurance (p = 0.014), LB muscle endurance in knee extension (p = 0.007), and LB muscle endurance in knee flexion (p = 0.012) observed in the KMRG. The UIG showed significant increases in VO₂max (p = 0.012), UB muscle endurance (p < 0.001), LB muscle endurance in knee extension (p = 0.020), and LB muscle strength in knee flexion (p = 0.033) over time. Significant differences between the groups were found in VO₂max (K > C; p = 0.010, I > C; p = 0.040), LB muscle strength in knee extension (K > C; p = 0.008), LB muscle strength in knee flexion (K > I; p = 0.021, K > C; p = 0.0035), LB muscle endurance in knee extension (K > C; p = 0.018), and LB muscle endurance in knee flexion (K > C; p = 0.026) (Table 4).

Table 4.Physical fitness components of three groups before and after the intervention.
VariablesCGUIGPost-hoc1KMRGPost-hoc2Post-hoc3
VO₂max (mL/kg/min)
Pre36.66 ± 3.9436.21 ± 3.400.040 (−1.020)534.79 ± 4.090.010 (−1.313)50.538
Post35.24 ± 3.8839.14 ± 3.7740.27 ± 3.78
p40.2010.012 (−0.816)5<0.001 (−1.391)5
Hand grip (kg)
Pre41.09 ± 6.8038.29 ± 4.100.67443.32 ± 6.890.1910.089
Post40.88 ± 5.2639.82 ± 3.0844.21 ± 6.75
p40.8230.1130.349
2-min Push-up (rep)
Pre40.00 ± 14.4733.89 ± 15.140.61141.22 ± 7.460.1960.423
Post39.78 ± 10.9442.44 ± 11.9246.67 ± 8.49
p40.915p < 0.001 (−0.628)50.014 (−0.682)5
Knee 60º ext peak torque (NM)
Pre225.56 ± 27.77222.33 ± 64.400.160241.33 ± 47.990.008 (0.735)50.169
Post205.89 ± 31.50230.44 ± 35.22254.44 ± 40.39
p40.1690.5640.354
Knee 60º flex peak torque (NM)
Pre105.78 ± 29.6092.89 ± 28.700.815117.78 ± 25.730.021 (−1.082)50.035 (−0.975)5
Post108.78 ± 21.37111.00 ± 21.53132.00 ± 21.53
p40.7110.033 (−0.714)50.088
Knee 180º ext. total work (J)
Pre1244.22 ± 239.221117.89 ± 320.470.3181283.11 ± 331.100.018 (−1.540)50.140
Post1174.11 ± 207.001309.11 ± 375.621511.00 ± 229.90
p40.3690.020 (−0.548)50.007 (−0.800)5
Knee 180º flex. total work (J)
Pre586.89 ± 249.94502.67 ± 215.800.655571.22 ± 153.500.026 (−1.328)50.068
Post537.44 ± 140.02572.11 ± 204.55718.56 ± 132.60
p40.3690.2110.012 (−1.027)5
Values are presented as mean ± standard deviation. 1, this present p-value compared between CG and UIG; 2, this present p-value compared between CG and KMRG; 3, this present p-value compared between UIG and KMRG; 4, this present p-value of comparison between pre and post; 5, this present Cohen’s d. ext., extension; flex., flexion; CG, Control Group; UIG, Unsupervised Individual Group; KMRG, Kinect-based Mixed Reality Group.

4. Discussion

In this study, we examined the effectiveness of KMR compared to unsupervised individual exercise in the context of the COVID-19 pandemic. The results indicate that KMR is a highly effective tool for delivering a fitness program, leading to significant improvements in muscle strength and endurance compared to unsupervised exercise. These findings have important implications for promoting physical activity and enhancing overall health, particularly in situations where access to supervised exercise is restricted.

Previous research has consistently demonstrated that exercises with feedback are more effective and efficient compared to exercises without feedback. For instance, studies have shown that wrist-injured patients who used a live-feedback program for rehabilitation achieved faster recovery compared to those who did non-feedback exercises [6]. Similarly, visual live feedback has been found to improve speed in the “3RM squat” among female athletes compared to exercises without feedback [30, 31]. In this study, we observed that the KMRG group exhibited smaller effects compared to previous studies that utilized real-time feedback. Only one factor, specifically 60º of knee flexion, showed a significant difference compared to the UIG group. However, over time, KMRG demonstrated more significantly enhanced factors compared to UIG. Additionally, KMR may offer an advantage in improving lower body strength due to its counting system, which only recognizes repetitions performed with proper form and range of motion. When compared to the CG that followed the same fitness program for the same duration, UIG showed a significant difference only in VO₂max. On the other hand, KMRG exhibited significant differences in Knee 60º flex peak torque (NM), Knee 180º ext total work (J), and Knee 180º flex total work (J) over time. Overall, KMRG and UIG followed the same fitness program, but KMRG demonstrated superior performance compared to UIG throughout the 8-week intervention. These findings suggest that KMR is an effective device for delivering fitness programs. However, further studies with larger sample sizes, and a broader range of population and fitness programs are necessary to fully understand its effects.

In our previous study, we determined that the exercise program had a moderate-to-high intensity level suitable for Korean men, with a VO₂max range of 35–42 mL/kg/min, and we established the reliability of the KMR device [2]. In this current study, our objective was to evaluate the long-term effects and usability of KMR by implementing the same fitness program over an 8-week period. While there were no significant differences in terms of body composition among the groups, we observed a significant decrease in skeletal muscle mass and an increase in body fat percentage in the control group over time. Interestingly, the exercise program appeared to prevent the increase in body fat percentage and the loss of skeletal muscle mass in the exercise groups, which aligns with findings from previous studies conducted on firefighters [18, 32]. Although there were no significant differences in nutritional intake between the groups, the exercise program seemed to have a positive effect on body composition by maintaining body fat and skeletal muscle mass without the need for calorie restriction.

The study demonstrated significant improvements in VO₂max for both the KMRG and UIG groups compared to the control group and baseline measurements. The baseline VO₂max was recorded at 31.11 mL/kg/min, while after the intervention, the KMRG group showed an average of 40.27 mL/kg/min, and the UIG group showed an average of 39.14 mL/kg/min. Although the achieved VO₂max values did not meet the minimum standard set by the National Fire Protection Association (NFPA), the results indicated a significant increase within the exercise groups. While handgrip strength did not show significant improvement, other fitness components displayed notable enhancements in both KMRG and UIG, which aligns with findings from previous studies [19, 33]. The standardized exercise program utilized a consistent external weight and placed emphasis on maintaining proper posture to ensure safety. Additionally, the program gradually increased the number of repetitions to enhance participants’ fitness abilities. These findings suggest that focusing on increasing repetitions rather than load may be a safer and more effective approach, particularly for beginners [34, 35].

While our study provides valuable insights into the effectiveness of the exercise program, there are several limitations that should be considered when interpreting the findings. First, it is important to note that the participants in our study were not actual firefighters (FFs) due to COVID-19 restrictions. However, the study aimed to assess whether the exercise program could improve the health-related fitness of participants who had similar body composition and VO₂max levels as Korean FFs. It is worth considering the potential variations in results when applied to real FFs in operational settings. Second, we did not include qualitative measurements to examine whether the participants’ interest in the new equipment influenced the differences in effectiveness between the UIG and KMRG. Nevertheless, the high attendance rates and achievement of minimum repetitions indicate that participants were actively engaged and enthusiastic about the program.

Future studies could address these limitations by recruiting real FFs as participants, including female participants to assess sex-specific effects, increasing the sample size for improved statistical power, incorporating qualitative measurements to explore participants’ experiences and perceptions, developing diverse content tailored to different characteristics (e.g., fitness, age, occupation, etc.) and extending the intervention duration to evaluate longer-term effects.

5. Conclusions

In conclusion, this study represents the first attempt to compare the effects of an exercise program using two different modes: Kinect-based mixed reality and unsupervised individual exercise. The results demonstrate that the exercise program inserted in the KMR was effective in improving health-related fitness parameters. Furthermore, the KMR showed greater efficiency compared to unsupervised individual exercise, despite both groups following the same exercise program. These findings highlight the potential benefits and usability of KMR in promoting physical activity and improving health-related fitness. Future studies should aim to investigate the effectiveness and usability of the exercise program using Kinect-based mixed reality (KMR) with diverse populations and different exercise content.

Availability of data and materials

The data presented in this study are available on reasonable request from the corresponding author.

Author contributions

SYA, BGL, YSA and WS—designed this study. SYA and YHS—curated data. SYA and JHB—analyzed the data. SYA, YHS, XXL and DHK—performed the research. SYA—wrote the manuscript. SYA, JHB and BGL—revised the manuscript. WS—approved the final manuscript. YSA, WS, DIS, JJP, HJK, HJL and CGL—got the funding. All authors contributed to editorial changes in the manuscript. All authors read and approved the final manuscript.

Ethics approval and consent to participate

This research was reviewed and approved by the institutional review board of Yonsei University (#CR318031). The trial was conducted according to the ethical principles of the Helsinki Declaration. Informed consent was obtained from all participants.

Acknowledgment

We would like to express our sincere gratitude to the participants, without whom this study would not have been possible. We also acknowledge the support provided by other Health and Exercise Science Laboratory members at Seoul National University. Finally, we appreciate the valuable feedback and suggestions provided by the peer reviewers, which greatly improved the quality of this manuscript.

Funding

This research was supported by the Emergency Response to Disaster Sites Research and Development Program funded by National Fire Agency (20013968, Korea Evaluation Institute of Industrial Technology, KEIT).

Conflict of interest

The authors declare no conflict of interest.

References

Fu Y, Hu Y, Sundstedt V. A systematic literature review of virtual, augmented, and mixed reality game applications in healthcare. ACM Transactions on Computing for Healthcare. 2022; 3: 1–27.

[Google Scholar]

Ahn S, Sung Y, Bae J, Lim B, Song W. Reliability and validity of the Kinect-based mixed reality device: pilot study. The Asian Journal of Kinesiology. 2022; 24: 2–11.

[Google Scholar]

Weakley JJS, Wilson KM, Till K, Read DB, Darrall-Jones J, Roe GAB, et al. Visual feedback attenuates mean concentric barbell velocity loss and improves motivation, competitiveness, and perceived workload in male adolescent athletes. Journal of Strength and Conditioning Research. 2019; 33: 2420–2425.

[Google Scholar]

Weakley JJS, Till K, Darrall-Jones J, Roe GAB, Phibbs PJ, Read DB, et al. Strength and conditioning practices in adolescent rugby players: relationship with changes in physical qualities. Journal of Strength and Conditioning Research. 2019; 33: 2361–2369.

[Google Scholar]

Reither LR, Foreman MH, Migotsky N, Haddix C, Engsberg JR. Upper extremity movement reliability and validity of the Kinect version 2. Disability and Rehabilitation: Assistive Technology. 2018; 13: 54–59.

[Google Scholar]

Blanquero J, Cortés-Vega M, Rodríguez-Sánchez-Laulhé P, Corrales-Serra B, Gómez-Patricio E, Díaz-Matas N, et al. Feedback-guided exercises performed on a tablet touchscreen improve return to work, function, strength and healthcare usage more than an exercise program prescribed on paper for people with wrist, hand or finger injuries: a randomised trial. Journal of Physiotherapy. 2020; 66: 236–242.

[Google Scholar]

Brauner P, Ziefle M. Serious motion-based exercise games for older adults: evaluation of usability, performance, and pain mitigation. JMIR Serious Games. 2020; 8: e14182.

[Google Scholar]

Haghighi Osgouei R, Soulsby D, Bello F. Rehabilitation exergames: use of motion sensing and machine learning to quantify exercise performance in healthy volunteers. JMIR Rehabilitation and Assistive Technologies. 2020; 7: e17289.

[Google Scholar]

Kayama H, Okamoto K, Nishiguchi S, Yamada M, Kuroda T, Aoyama T. Effect of a Kinect-based exercise game on improving executive cognitive performance in community-dwelling elderly: case control study. Journal of Medical Internet Research. 2014; 16: e61.

[Google Scholar]

Gray SE, Finch CF. The causes of injuries sustained at fitness facilities presenting to Victorian emergency departments—identifying the main culprits. Injury Epidemiology. 2015; 2: 6.

[Google Scholar]

Abel MG, Mortara AJ, Pettitt RW. Evaluation of circuit-training intensity for firefighters. Journal of Strength and Conditioning Research. 2011; 25: 2895–2901.

[Google Scholar]

Abel M. G, Sell K, Dennison K. Design and implementation of fitness programs for firefighters. The Journal of Strength and Conditioning Research. 2011; 33: 31–42.

[Google Scholar]

Abel MG, Palmer TG, Trubee N. Exercise program design for structural firefighters. Strength & Conditioning Journal. 2015; 37: 8–19.

[Google Scholar]

International Association of Firefighters (IAFF). The fire service joint labor management wellness-fitness initiative. 2008. Available at: https://www.iafc.org/docs/default-source/1safehealthshs/wfi-manual.pdf (Accessed: 20 December 2018).

[Google Scholar]

National Fire Protection Association. NFPA 1582: standard on comprehensive occupational medical program for fire departments. 2018. Available at: https://www.nfpa.org/codes-and-standards/all-codes-and-standards/list-of-codes-and-standards/detail?code=1582 (Accessed: 10 October 2018).

[Google Scholar]

Noh K, Lee K, Jamrasi P, Zhang Y, Park S, Seo D, et al. Physical fitness levels of south Korean national male and female firefighters. Journal of Exercise Science & Fitness. 2020; 18: 109–114.

[Google Scholar]

Poston WSC, Haddock CK, Jahnke SA, Jitnarin N, Tuley BC, Kales SN. The prevalence of overweight, obesity, and substandard fitness in a population-based firefighter cohort. Journal of Occupational & Environmental Medicine. 2011; 53: 266–273.

[Google Scholar]

Beach TAC, Frost DM, McGill SM, Callaghan JP. Physical fitness improvements and occupational low-back loading—an exercise intervention study with firefighters. Ergonomics. 2014; 57: 744–763.

[Google Scholar]

Mathias KC, Bode ED, Stewart DF, Smith DL. Changes in firefighter weight and cardiovascular disease risk factors over five years. Medicine & Science in Sports & Exercise. 2020; 52: 2476–2482.

[Google Scholar]

Kwon J, Park S, Lee CG, Song W, Seo DI, Park JJ, et al. The effects of number of fire dispatches and other situational factors on voluntary exercise training among Korean firefighters: a multilevel logistic regression analysis. International Journal of Environmental Health Research. 2020; 17: 5913.

[Google Scholar]

Lee CG, Middlestadt SE, Park S, Kwon J, Noh K, Seo DI, et al. Predicting voluntary exercise training among Korean firefighters: Using elicitation study and the theory of planned behavior. International Journal of Environmental Health Research. 2020; 17: 467.

[Google Scholar]

Getty AK, Wisdo TR, Chavis LN, Derella CC, McLaughlin KC, Perez AN, et al. Effects of circuit exercise training on vascular health and blood pressure. Preventive Medicine Reports. 2018; 10: 106–112.

[Google Scholar]

Cunha R, Carregaro RL, Martorelli A, Vieira A, Oliveira AB, Bottaro M. Effects of short-term isokinetic training with reciprocal knee extensors agonist and antagonist muscle actions: a controlled and randomized trial. Brazilian Journal of Physical Therapy. 2013; 17: 137–145.

[Google Scholar]

Oh JY, Yang YJ, Kim BS, Kang JH. Validity and reliability of Korean version of international physical activity questionnaire (IPAQ) short form. Korean Journal of Family Medicine. 2007; 28: 532–541.

[Google Scholar]

Kim J, Kim H, Lee J, Ko H, Jung S, Kim HJ, et al. Comparison of energy and macronutrients between a mobile application and a conventional dietary assessment method in Korea. Journal of the Academy of Nutrition and Dietetics. 2022; 122: 2127–2133.e4.

[Google Scholar]

American College of Sports Medicine. ACSM’s guidelines for exercise testing and prescription. 9th edn. Lippincott Williams & Wilkins: Philadelphia. 2013.

[Google Scholar]

Borg GAV. Psychophysical bases of perceived exertion. Medicine & Science in Sports & Exercise. 1982; 14: 377–381.

[Google Scholar]

Duncan GE, Howley ET, Johnson BN. Applicability of VO2max criteria: discontinuous versus continuous protocols. Medicine & Science in Sports & Exercise. 1997; 29: 273–278.

[Google Scholar]

Lindberg AS, Oksa J, Malm C. Laboratory or field tests for evaluating firefighters’ work capacity? PLOS ONE. 2014; 9: e91215.

[Google Scholar]

Wilson KM, de Joux NR, Head JR, Helton WS, Dang JS, Weakley JJS. Presenting objective visual performance feedback over multiple sets of resistance exercise improves motivation, competitiveness, and performance. Proceedings of the Human Factors and Ergonomics Society Annual Meeting. 2018; 62: 1306–1310.

[Google Scholar]

Campenella B, Mattacola CG, Kimura IF. Effect of visual feedback and verbal encouragement on concentric quadriceps and hamstrings peak torque of males and females. Isokinetics and Exercise Science. 2000; 8: 1–6.

[Google Scholar]

Hirsch KR, Tweedell AJ, Kleinberg CR, Gerstner GR, Barnette TJ, Mota JA, et al. The influence of habitual protein intake on body composition and muscular strength in career firefighters. Journal of the American College of Nutrition. 2018; 37: 620–626.

[Google Scholar]

Roberts MA, O’Dea J, Boyce A, Mannix ET. Fitness levels of firefighter recruits before and after a supervised exercise training program. The Journal of Strength and Conditioning Research. 2002; 16: 271–277.

[Google Scholar]

Paulsen G, Myklestad D, Raastad T. The influence of volume of exercise on early adaptations to strength training. The Journal of Strength and Conditioning Research. 2003; 17: 115.

[Google Scholar]

Dinyer TK, Byrd MT, Garver MJ, Rickard AJ, Miller WM, Burns S, et al. Low-load vs. high-load resistance training to failure on one repetition maximum strength and body composition in untrained women. The Journal of Strength and Conditioning Research. 2019; 33: 1737–1744.

[Google Scholar]