Document Type : Original Article
Authors
- HEKMAT ALLAH MORADI 1
- MASOUME RAMBOD 2
- RITA REZAEE 3
- MILAD AHMADI MARZALEH 1
- MAHMOUDREZA PEYRAVI 1
- MITRA AMINI 3
1 Department of Health in Disasters and Emergencies, School of Health Management and Information Sciences, Shiraz University of Medical Sciences, Shiraz, Iran
2 Community-Based Psychiatric Care Research Center, Department of Nursing, School of Nursing and Midwifery, Shiraz University of Medical Sciences, Shiraz, Iran
3 Clinical Education Research Center, Shiraz University of Medical Sciences, Shiraz, Iran
Abstract
Introduction: This study is novel in that it is one of the first efforts in Iran to develop and validate a culturally relevant assessment tool tailored to evaluate the professional competencies of emergency managers. The study provides a foundation for evidence-based training of managers, competency development, and improved disaster preparedness and response in Iran by addressing this unmet need.
Methods: This methodological exploratory study which aimed to design and validate a competency assessment tool for the education of emergency managers was conducted in 2022. First, an item pool was collected from the literature review (previously designed questionnaires and existing models of reflection) and experts’ and researchers’ perspectives. After that, 40 experts were shown the first draft of the questionnaire to assess its face and content validity. To assess the construct validity, exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were done. 288 participants consciously completed the questionnaire. The data were analyzed using IBM SPSS version 26.0 (Statistical Package for the Social Sciences) Statistics and AMOS 26.0 software.
Results: The study yielded a structured questionnaire with 36 items across eight competency areas, including Critical thinking, Strategic thinking, Knowledge and experience, Skill management, Effective Communication, Ethical, Resiliency, and Personality. The content validity index (CVI), content validity ratio (CVR), and impact score (IS) for the questionnaire were 0.97, 0.62, and 4.61, respectively. This tool demonstrated strong reliability (Cronbach’s alpha=0.74) and robust convergent and discriminant validity. EFA identified eight key factors that, taken together, explained 51.9 percent of the overall variation. CFA revealed that there was a positive and significant correlation.
Conclusion: The findings confirmed that the assessment tool is a valid and reliable instrument for evaluating professional competencies in Iranian emergency managers. Beyond assessment, it offers a foundation for developing competency-based training strategies that enhance the effectiveness and resilience of emergency response teams. This tool was designed with cultural adaptation to address current limitations and can potentially significantly influence Iran’s emergency management procedures in the future.
Highlights
Keywords
- Azizi A, Eskandari Sedgh H, Ghazi A. Smart Disaster Management Solutions for Risk Mitigation and Preparedness in Tehran, Iran. Disaster Prevention and Management Knowledge (quarterly). 2023;13(2):252-77.
- Habibi Arejan R, Shabany M, Ghodsi Z, Ghashghaei S, Abbaszadeh M, Rahimi-Movaghar V. Lessons from Flood Disaster Management of Khuzestan Province, Iran, Based on the Experiences of Policymakers: A Qualitative Study. Iranian Red Crescent Medical Journal (IRCMJ). 2023;25(10):e2199.
- Saberian P, Kolivand PH, Hasani-Sharamin P, Dadashi F, Farhoud AR. Iranian emergency medical service response in disaster; report of three earthquakes. Advanced journal of emergency medicine. 2019;3(2):e13.
- Jafari H, Jafari AJ, Nekoei-Moghadam M, Goharinezhad S. Morbidity and mortality from technological disasters in Iran: A narrative review. J Educ Health Promot. 2019;8(1):147.
- Fekete A, Asadzadeh A, Ghafory-Ashtiany M, Amini-Hosseini K, Hetkämper C, Moghadas M, et al. Pathways for advancing integrative disaster risk and resilience management in Iran: Needs, challenges and opportunities. International Journal of Disaster Risk Reduction. 2020;49:101635.
- Blaikie P, Cannon T, Davis I, Wisner B. At risk: natural hazards, people's vulnerability and disasters. UK: Routledge; 2014.
- Zarghami SA, Dumrak J. A system dynamics model for social vulnerability to natural disasters: Disaster risk assessment of an Australian city. International journal of disaster risk reduction. 2021;60:102258.
- Naser WN, Saleem HB. Emergency and disaster management training; knowledge and attitude of Yemeni health professionals- a cross-sectional study. BMC emergency medicine. 2018;18(1):23.
- Bordbar G, Konjkav Monfared A, Sabokro M, Dehghani N, Hosseini E. Human resources competencies scale development and validation: An Iranian measure. Industrial and Commercial Training. 2021;53(3):250-67.
- Feufel MA, Antes G, Gigerenzer G. [Competence in dealing with uncertainty: lessons to learn from the influenza pandemic (H1N1) 2009]. Bundesgesundheitsblatt, Gesundheitsforschung, Gesundheitsschutz. 2010;53(12):1283-9.
- Hadian M, Jabbari A, Abdollahi M, Hosseini E, Sheikhbardsiri H. Explore pre-hospital emergency challenges in the face of the COVID-19 pandemic: a quality content analysis in the Iranian context. Frontiers in Public Health. 2022;10:864019.
- Mohammadi M, Firouzkouhi M, Abdollahimohammad A, Shivanpour M. The challenges of pre-hospital emergency personnel in Sistan area: a qualitative study. Journal of Qualitative Research in Health Sciences. 2019;8(3):221-32.
- Poornazari M, Roshanzadeh M, Mohammadi S, Taj A, Shirvani M, Naghneh MHK, et al. Explaining the challenges of pre-hospital emergency healthcare workers in providing care at the scene. Journal of Emergency Medicine, Trauma & Acute Care. 2023;2023(2):21.
- Rezaei SA, Abdi A, Akbari F, Moradi K. Nurses' professional competences in providing care to the injured in earthquake: A qualitative study. J Educ Health Promot. 2020;9:188.
- Siddiqi A, Beikzad J, Nejadhaji Ali Irani F, Vedadi A. Designing a Professional Competence Model for Emergency Medical Technicians of the National Emergency Management Organization. Health in Emergencies and Disasters Quarterly. 2025;10(2):143-52.
- Saxena S, Gujral HK, Pathak S. A study of competency-based approach to identify high performers among disaster management professionals. Studies of Applied Economics. 2022;40(S1):1-12.
- Feldmann-Jensen S, Jensen SJ, Smith SM, Vigneaux G. The next generation core competencies for emergency management. Journal of Emergency Management. 2019;17(1):17-25.
- Stefl ME. Common competencies for all healthcare managers: the healthcare leadership alliance model. Journal of healthcare management. 2008;53(6):360-73.
- Cripe EJ, Workitect. Competency Development Guide: Resource Guide for Developing Competencies. USA: Workitect, Incorporated; 2012.
- Shojaei F, Sohrabizadeh S, Qaraeian P, Khoshsabeghe HY, Jandaghi J, Farivar F. Comparative analysis of two disaster risk assessment tools for primary health care centers: The case of Iran. International Journal of Disaster Risk Reduction. 2024;107:104466.
- Mohammadinia L, Khorasani-Zavareh D, Ardalan A. Children capacity in disaster risk reduction: a call for action. Journal of injury and violence research. 2017;9(1):69-70.
- Farzanegan MR, Fischer S, Noack P. Natural disaster literacy in Iran: Survey-based evidence from Tehran. International Journal of Disaster Risk Reduction. 2024;100:104204.
- DeVon HA, Block ME, Moyle‐Wright P, Ernst DM, Hayden SJ, Lazzara DJ, et al. A psychometric toolbox for testing validity and reliability. Journal of Nursing scholarship. 2007;39(2):155-64.
- Hu Lt, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural equation modeling: a multidisciplinary journal. 1999;6(1):1-55.
- Lawshe CH. A quantitative approach to content validity. Personnel psychology. 1975;28(4):563-75.
- Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Quality of Life Research. 2010;19(4):539-49.
- Pollard B, Dixon D, Dieppe P, Johnston M. Measuring the ICF components of impairment, activity limitation and participation restriction: an item analysis using classical test theory and item response theory. Health and Quality of Life Outcomes. 2009;7(1):41.
- Ma H, Zhu X, Zhang S, Huang J, Lu Y, Luo Y. Development and validation of professional competency scale for military nurses: an instrument design study. BMC Nursing. 2022;21(1):90.
- Marin SM, Hutton A, Witt RR. Development and psychometric testing of a tool measuring nurses’ competence for disaster response. Journal of emergency nursing. 2020;46(5):623-32.
- Li B, Akintoye A, Holt G. Empirical study of project governance among Chinese project management professionals. International Journal of Architecture, Engineering and Construction. 2017;6(2):29-39.
- Lleo A, Ruiz-Palomino P, Viles E, Muñoz-Villamizar AF. A valid and reliable scale for measuring middle managers’ trustworthiness in continuous improvement. International Journal of Production Economics. 2021;242:108280.
- Lockyer J, Carraccio C, Chan MK, Hart D, Smee S, Touchie C, et al. Core principles of assessment in competency-based medical education. Med Teach. 2017;39(6):609-16.
- Hamilton SJ, Briggs L, Peterson EE, Slattery M, O’Donovan A. Supporting conscious competency: Validation of the generic supervision assessment tool (GSAT). Psychology and Psychotherapy: Theory, Research and Practice. 2022;95(1):113-36.
- Amani S, Dolatabadi ZA, Bardsiri TI, Nouri M, Saraji JN, Poursadeqiyan M, et al. Designing and validation of self-assessment tool of professional competency and its psychometrics in the Administrators of Preschool Educational Centers. Iranian Journal of Public Health. 2022;51(11):2582.
- Nilsson J, Johansson S, Nordström G, Wilde-Larsson B. Development and validation of the ambulance nurse competence scale. Journal of emergency nursing. 2020;46(1):34-43.
- Howard PF, Liang Z, Leggat S, Karimi L. Validation of a management competency assessment tool for health service managers. Journal of health organization and management. 2018;32(1):113-34.
- Mohammadi F, Salimi R, Shokouhi M, Khazaei S, Bijani M. Design and psychometric evaluation of the Emergency Medical Services Safe Care Scale (EMSSCS): a mixed-method study. BMC emergency medicine. 2025;25(1):67.
- Castaño AM, Zuazua M, García-Izquierdo AL. Development, measurement, and validation of a managerial competency model in Spain: The pumac questionnaire. European Journal of Psychological Assessment. 2023;40(4):298-310.
- Paz LMCÁ, Odelius CC. Managerial competencies scale in a public management context: development and validation evidences. Organizações & Sociedade. 2021;28:370-97.
)