This study investigated the differences in physical and mental health and work stress between field and office workers. Although considerable research has examined the effects of work on physical and mental health individually, there remains a lack of clarity regarding potential disparities among different work types. A total of 83 participants comprising field (n = 42) and office workers (n = 41) were enrolled. We performed measurements based on work stress and physical and mental health. Specifically, we evaluated grip strength, gait speed, and the scores in the 30-s sit-to-stand test, timed up-and-go test, International Physical Activity Questionnaire, Center for Epidemiological Studies Depression scale, and World Health Organization Quality of Life assessment. This study identified that male field and office workers differed in muscle strength. Between the groups, significant differences were observed in grip strength (44.20 ± 6.12 and 39.63 ± 7.93; p = 0.015) and 30-s sit-to-stand test scores (20.37 ± 4.82 and 17.83± 4.17; p = 0.043). Among male participants, a significant association was observed between grip strength (robust model, β = 4.386, 95% confidence interval (CI): 0.705–8.067; adjusted model, β = 4.790, 95% CI: 1.134–8.446) and 30-s sit-to-stand test scores (robust model, β = 2.545, 95% CI: 0.086–5.005; adjusted model, β = 2.102, 95% CI: –0.378–4.581). In conclusion, muscle strength differed significantly according to the type of work performed by male individuals. Therefore, there is a need to develop and intervene in exercise programs for office workers.