COVID-19 Traumatic Stress Scale and Preventive COVID-19 Infection Behaviors Scale: psychometric properties in Portuguese male adults

Background: The coronavirus disease 2019 (COVID-19) pneumonia pandemic constitutes a serious public health emergency. Besides its detrimental social and economic implications, it has generated a negative psychological impact worldwide. Several studies have been carried out concerning psychological impact and mental health related to COVID-19, with the psychological constructs most studied being anxiety, fear, phobia, stress and depression. Other psychological constructs were less studied, namely post-traumatic stress related to COVID-19, as well as preventive behaviors towards COVID-19. Thus, the aims of this study were to validate the COVID-19 Traumatic Stress (C19TSS) Scale and the Preventive COVID-19 Infection Behaviors Scale (PCIBS) with a Portuguese male adult sample and to measure their invariance across age and education. Methods: Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were performed to obtain the final factor structure of the Portuguese version of both scales. Configural, metric and scalar invariance were measured across age and education through multiple-group confirmatory factor analysis (MGCFA). Results: Results showed that both C19TSS and PIBS models fitted the data well. Configural, metric and scalar invariance across age as well as configural and metric invariance across education were found regarding C19TSS. Only configural invariance across education was found regarding PCIBS. Conclusions: The C19TSS and PCIBS are valid and reliable tools for researchers interested in examining post-traumatic stress related to COVID-19 and preventive behaviors towards COVID-19.

COVID-19; COVID-19 Traumatic Stress Scale; male adults; Preventive COVID-19 Infection Behaviors Scale

[1] World Health Organization. COVID-19 Public Health Emer-gency of International Concern (PHEIC) Global research and innovation forum. 22 February 2020. Available at: https://www.who.int/publications/m/item/covid-19-public-hea lth-emergency-of-international-concern-(pheic)-global-research- and-innovation-forum (Accessed: 12 January 2022).

[2] Greene C, Burleson S, Crosby C, Heimann M, Pigott D. Coro-navirus disease 2019: International public health considera-tions. Journal of the American College of Emergency Physicians Open. 2020; 1: 70–77.

[3] Buheji M, da Costa Cunha K, Beka G, Mavric B, De Souza Y, da Costa Silva S, et al. The extent of covid-19 pandemic socio-economic impact on global poverty. A global integrative multi-disciplinary review. American Journal of Economics. 2020; 10: 213–224.

[4] Pfefferbaum B, North C. Mental health and the Covid-19 pan-demic. New England Journal of Medicine. 2020; 383: 510–512.

[5] Elbay R, Kurtulmuş A, Arpacıoğlu S, Karadere E. Depression, anxiety, stress levels of physicians and associated factors in COVID-19 pandemics. Psychiatry Research. 2020; 290:113130.

[6] Mazza M, De Lorenzo R, Conte C, Poletti S, Vai B, Bollettini I, et al. Anxiety and depression in COVID-19 survivors: Role of inflammatory and clinical predictors. Brain, Behavior, and Im-munity. 2020; 89: 594–600.

[7] Peteet J. COVID-19 Anxiety. Journal of Religion and Health. 2020; 59: 2203–2204.

[8] Ahorsu DK, Lin C-Y, Imani V, Saffari M, Griffiths MD, Pakpour AH. The fear of COVID-19 scale: Development and initial val-idation. International Journal of Mental Health and Addiction. 2020; 1–9.

[9] Fitzpatrick K, Harris C, Drawve G. Fear of COVID-19 and the mental health consequences in America. Psychological Trauma: Theory, Research, Practice, and Policy. 2020; 12: S17–S21.

[10] Pakpour A, Griffiths M. The fear of COVID-19 and its role in preventive behaviours. Journal of Concurrent Disorders. 2020; 2: 58–63.

[11] Arpaci I, Karataş K, Baloğlu M. The development and initial tests fr the psychometric properties of the COVID-19 Phobia Scale (C19P-S). Personality and Individual Differences. 2020; 164: 110108.

[12] Dilbaz N, Noyan O, Alpar G, Kazan O. Development of the COVID-19 phobia scale: Validity and reliability study. The Journal of Neurobehavioral Sciences. 2020; 7:142.

[13] Lindinger-Sternart S, Kaur V, Widyaningsih Y, Patel A. COVID-19 phobia across the world: Impact of resilience on COVID-19 phobia in different nations. Counselling and Psychotherapy Research. 2021; 21: 290–302.

[14] Kira IA, Shuwiekh HAM, Rice KG, Ashby JS, Elwakeel SA, Sous MSF, et al. Measuring COVID-19 as Traumatic Stress: Ini-tial Psychometrics and Validation. Journal of Loss and Trauma. 2021a; 26: 220–237.

[15] Odriozola-González P, Planchuelo-Gómez Á, Irurtia MJ, de Luis-García R. Psychological symptoms of the outbreak of the COVID-19 confinement in Spain. Journal Health Psychology. 2020; 1359105320967086.

[16] Park CL, Russell BS, Fendrich M, Finkelstein-Fox L, Hutchison M, Becker J. Americans’ COVID-19 Stress, Coping, and Adher-ence to CDC Guidelines. Journal of General Internal Medicine. 2020; 35: 2296–2303.

[17] Bäuerle A, Teufel M, Musche V, Weismüller B, Kohler H, Het-kamp M, et al. Increased generalized anxiety, depression and distress during the COVID-19 pandemic: a cross-sectional study in Germany. Journal of Public Health. 2020; 42: 672–678.

[18] Ettman CK, Abdalla SM, Cohen GH, Sampson L, Vivier PM, Galea S. Prevalence of Depression, Symptoms in US Adults Before and During the COVID-19 Pandemic. JAMA Network Open. 2020; 3: e2019686.

[19] Shader RI. COVID-19 and Depression. Clinical Therapeutics. 2020; 42: 962–963.

[20] Luo M, Guo L, Yu M, Jiang W, Wang H. The psychological and mental impact of coronavirus disease 2019 (COVID-19) on medical staff and general public – A systematic review and meta-analysis. Psychiatry Research. 2020; 291:113190.

[21] Kontoangelos K, Economou M, Papageorgiou C. Mental Health Effects of COVID-19 Pandemia: A Review of Clinical and Psy-chological Traits. Psychiatry Investigation. 2020; 17: 491–505.

[22] Xiong J, Lipsitz O, Nasri F, Lui LM, Gill H, Phan L, et al. Impact of COVID-19 pandemic on mental health in the general popula-tion: A systematic review. Journal of Affective Disorders. 2020; 277: 55–64.

[23] Kira IA, Shuwiekh HA, Ashby JS, Elwakeel SA, Alhuwailah A, Sous MSF, et al. The Impact of COVID-19 Traumatic Stressors on Mental Health: Is COVID-19 a New Trauma Type. Interna-tional Journal of Mental Health and Addiction. 2021; 1–20.

[24] Tosun Altınöz Ş, Dalgar I, Altınöz AE. The Turkish adaptation and psychometric characteristics of the COVID-19 Traumatic Stress Scale. Death Studies. 2021; 1–7.

[25] Prime H, Wade M, Browne DT. Risk and resilience in family well-being during the COVID-19 pandemic. American Psychol-ogist. 2020; 75: 631–643.

[26] Brodeur A, Clark AE, Fleche S, Powdthavee N. COVID-19, lockdowns and well-being: Evidence from Google Trends. Jour-nal of Public Economics. 2021; 193: 104346.

[27] O’Connor RC, Wetherall K, Cleare S, McClelland H, Melson AJ, Niedzwiedz CL, et al. Mental health and well-being during the COVID-19 pandemic: longitudinal analyses of adults in the UK COVID-19 Mental Health & Wellbeing study. The British Journal of Psychiatry. 2021; 218: 326–333.

[28] Shaw R, Kim Y, Hua J. Governance, technology and citizen behavior in pandemic: Lessons from COVID-19 in East Asia. Progress in Disaster Science. 2020; 100090.

[29] Bruine de Bruin, W, Bennett D. Relationships Between Initial COVID-19 Risk Perceptions and Protective Health Behaviors: A National Survey. American Journal of Preventive Medicine. 2020; 59: 157–167.

[30] Iorfa SK, Ottu IFA, Oguntayo R, Ayandele O, Kolawole SO, Gandi JC, et al. COVID-19 Knowledge, Risk Perception, and Precautionary Behavior Among Nigerians: A Moderated Medi-ation Approach. Frontiers in Psychology. 2020; 11: 3292.

[31] Chang K, Hou W, Pakpour AH, Lin C, Griffiths MD. Psychome-tric Testing of Three COVID-19-Related Scales among People with Mental Illness. International Journal of Mental Health and Addiction. 2020; 1–13.

[32] World Health Organization Q & A on coronaviruses (COVID-19). 2021. Available at: https://www.who.int/news-room/q-a-d etail/q-a-coronaviruses (Accessed: 20 September 2021).

[33] Magano J, Vidal DG, Sousa HFPe, Dinis MAP, Leite Â. Val-idation and Psychometric Properties of the Portuguese Version of the Coronavirus Anxiety Scale (CAS) and Fear of COVID-19 Scale (FCV-19S) and Associations with Travel, Tourism and Hospitality. International Journal of Environmental Research and Public Health. 2021; 18: 427.

[34] Leite Â, Vidal DG, Sousa HFPe, Dinis MAP, Magano J. Portuguese Version of COVID-19 Perceived Risk Scale and COVID-19 Phobia Scale: Psychometric Properties. European Journal of Investigation in Health, Psychology and Education. 2021; 11: 1044–1060.

[35] Pereira H, Esgalhado G, Costa V, Monteiro S, Oliveira V. Pro-priedades psicométricas das escalas de medo e impacto negativo face À COVID-19. Psicologia da Saúde e Doenças. 2021; 22: 338–349.

[36] Santos M, Machado AM, Bernardo AC, Leite A, Pereira MG. Men’s psychological well-being during COVID-19: the mod-erator role of posttraumatic growth. Journal of Men’s Health. 2021; 17: 62–71.

[37] Zigmond AS, Snaith RP. The Hospital Anxiety and Depression Scale. Acta Psychiatrica Scandinavica. 1983; 67: 361–370.

[38] Pays-Ribeiro J, Silva I, Ferreira T, Martins A, Meneses R, Bal-tar M. Validation study of a Portuguese version of the Hospital Anxiety and Depression Scale. Psychology, Health & Medicine. 2007; 12: 225–237.

[39] Grossi E, Groth N, Mosconi P, Cerutti R, Pace F, Compare A, et al. Development and validation of the short version of the Psy-chological General Well-Being Index (PGWB-S). Health and Quality of Life Outcomes. 2006; 4: 88.

[40] Soares M, Antunes M, da Costa, Correia, Brito I, dos Santos Pinto M. Adaptação e validação do Questionário Geral de Bem-Estar Psicológico: Análise fatorial confirmatória da versão re-duzida. Revista de Enfermagem Referência. 2018; 4: 9–18.

[41] Halonen JI, Erhola M, Furman E, Haahtela T, Jousilahti P, Barouki R, et al. The Helsinki Declaration 2020: Europe that protects. The Lancet Planetary Health. 2020; 4: e503–e505.

[42] Pearson RH, Mundform DJ. Recommended Sample Size for Conducting Exploratory Factor Analysis on Dichotomous Data. Journal of Modern Applied Statistical Methods. 2010; 9: 359–368.

[43] Kline RB. Principles and Practice of Structural Equation Mod-eling. 4th edn. Guilford Publications: New York. 2016.

[44] Wang J, Wang X. Structural Equation Modeling. Applications using Mplus. Higher Education Press: New York. 2012.

[45] Busemeyer JR, Diederich A. Estimation and testing of compu-tational psychological models. Academic Press: Massachusetts. 2014.

[46] Hair, J, Black, W, Babin, B. Multivariate Data Analysis: A Global Perspective. Pearson Education; 2009.

[47] Nunnally, J, Bernstein I. Psychometric Theory. 3rd edn. MacGraw-Hill: New York. 1994.

[48] Watkins MW. Exploratory Factor Analysis: A Guide to Best Practice. Journal of Black Psychology. 2018; 44: 219–246.

[49] Brown TA. Confirmatory factor analysis for applied research. 2nd edn. Guilford: New York. 2015.

[50] Joo S, Kim ES. Impact of error structure misspecification when testing, measurement invariance and latent-factor mean differ-ence using MIMIC and multiple-group confirmatory factor anal-ysis. Behavior Research Methods. 2019; 51: 2688–2699.

[51] Caycho-Rodríguez T, Vilca LW, Valencia PD, Carbajal-León C, Vivanco-Vidal A, Saroli-Araníbar D, et al. Cross-cultural Vali-dation of a New Version in Spanish of Four Items of the Preven-tive COVID-19 Infection Behaviors Scale (PCIBS) in Twelve Latin American Countries. Frontiers in Psychology. 2021; 12: 5088.

[52] Liu C, Liu D, Huang N, Fu M, Ahmed JF, Zhang Y, et al. The Combined Impact of Gender and Age on Post-traumatic Stress Symptoms, Depression, and Insomnia During COVID-19 Out-break in China. Frontiers in Public Health. 2021; 8.

[53] Kim JK, Crimmins EM. Age differences in the relationship be-tween threatening and coping mechanisms and preventive be-haviors in the time of COVID-19 in the United States: Protec-tion Motivation Theory. Research in Psychotherapy. 2021; 23: 485.

[54] González Ramírez LP, Martínez Arriaga RJ, Hernández-Gonzalez M, De la Roca-Chiapas JM. Psychological distress and signs of post-traumatic stress in response to the COVID-19 health emergency in a Mexican sample. Psychology Research and Behavior Management, 2020; 13: 589–597.

[55] Kim S, Kim S. Analysis of the impact of health beliefs and re-source factors on preventive behaviors against the COVID-19 Pandemic. International Journal of Environmental Research and Public Health, 2020; 17: 8666.