Document Type : Original Article

Authors

1 Management and Leadership in Medical Education Research Centre, Kerman University of Medical Sciences, Kerman, Iran

2 Ferdows Paramedical School, Birjand University of Medical Sciences, Birjand, Iran

3 Medical Informatics Research Center, Institute for Futures Studies in Health, Kerman University of Medical Sciences, Kerman, Iran

Abstract

Introduction: Epidemics such as the recent one, COVID-19, have caused a change in education and its methods. Virtual simulation is one of the types of technology used in medical education and
related sciences. Virtual simulation provides practical and clinical medical education in a safe, cost-effective, reproducible, and flexible learning environment where students can practice over and over in a standard environment. This study was conducted to compare the effect of virtual-based medical education versus lecture-based method in teaching start triage lessons in emergency medical students in educational and medical centers affiliated to Birjand University of Medical Sciences Ferdows, Paramedical School, in 2020.
Methods: This is a quasi-experimental study. All 44 students of emergency medicine registered for triage course participated in the study. They were divided into two homogenous groups which
were matched based on their grade point average. The simple triage and rapid transport (START) triage course was taught in the traditional way- lecture based- from the beginning of the semester
to the middle of the semester; then, the other group (simulationbased) was trained in the second half of the same semester using virtual simulation.
Results: The students’ rate of learning was measured by their scores at the end of the course exam in both groups. The mean scores of virtual simulation-based education were slightly higher than those of the lecture-based education, but it was not statistically significant (P>0.05). The students were more satisfied with virtual simulation-based education than the lecture-based and the difference between the mean scores of satisfaction was statistically significant (P>0.05).
Conclusion: The results of this study suggest that VR can effectively improve knowledge in undergraduate emergency student’s education, but it was not more effective than traditional
educational methods. More experimental studies with a larger sample size are needed to confirm that virtual simulation-based education can more effectively improve knowledge in teaching practical lessons such as triage.

Keywords

Introduction

One of the most prevalent teaching methods in medical science curriculum is lecture-based teaching. Simplicity, suitability for crowded classrooms, the huge size of educational materials, and time limit are some features of lecture-based teaching and this method is teacher-centered ( 1 ). Although this method is widely used, students are passive in such classes ( 2 ). In this way, medical education which focuses on small groups and case-based scenarios is rapidly evolving ( 3 ). New methods have recently been offered for better training of medical students, and universities should apply these methods to train students capable of preventing diseases, treating patients, and promoting community health ( 4 ). Recent advances such as virtual patients and simulation programs have facilitated an active teaching approach ( 5 , 6 ). Nowadays, educators using simulation training can deliver medical education with new approaches. Simulation-based medical education has developed during the past 40 years ( 7 ). It is a method by which an artificial experience is created that engages the learner in real-life situations without dangerous or harmful situations ( 8 ). This training method has been widely used in many areas of medical education, especially those requiring practical work. Some evidence has shown that virtual reality simulation in the acquisition of clinical psychomotor skills leads to similar or superior educational outcomes in comparison to traditional simulated practice ( 9 ). A systematic review by Harder has shown that the use of simulation, compared to other educational methods, improves the skills of health care students ( 10 ). Another study conducted by Luigi Ingrassia in Italy (2015) on virtual simulation training and real model training on emergency room attendance patients indicated that simulation training increases the students' accuracy in initial START triage. It was also shown that students' abilities and speed of action before and after the application of virtual simulated models have changed significantly ( 11 ). Also, in 2018, Harrington et al. taught decision-making skills to severely injured patients in a trauma department. Participants reported that this was an enjoyable as well as cost-effective learning tool ( 12 ). Some other systematic reviews have evaluated the effect of simulation-based medical education in some specialties and sub-specialties such as radiation oncology ( 13 ), echocardiography ( 14 ), emergency medicine ( 15 ), and trauma education ( 16 ).

Simulation training has been proven to develop the students’ clinical decision-making abilities and improves confidence and satisfaction ( 16 ). In fact, medical and paramedical students need to update their knowledge and skills. In this way, educational methods should be used which strengthen their self-learning, reasoning, and judging ( 17 ). On the other hand, the outbreak of COVID-19 virus in 2020 has influenced medical education. We have to adapt ourselves to this new situation to prepare future clinicians for their professional services ( 18 ). In this regard, virtual learning is widely used in medical education around the world, so it seems there is a shift from simulation-based to virtual simulation-based learning ( 19 ). Despite the evidence, the application of any new educational method in different educational environments is associated with challenges ( 20 ). In this way, simulation-based medical education should be thoughtfully and cautiously introduced and evaluated ( 21 ), especially considering the fact that it engages people’s life.

Emergency medicine is a relatively young field, but it has been quick to use simulation technology ( 15 ). Previous research has studied simulation in emergency education ( 22 , 23 ). Studies have demonstrated the effectiveness of simulation in teaching basic sciences, clinical knowledge, procedural skills, teamwork, and communication skills. As simulation becomes increasingly prevalent in medical school curricula, more studies are needed to assess whether simulation training improves the patient-related outcomes ( 15 ); its effect should be studied and considered, so that its challenges and advantages are identified and . Although lecture-based teaching is widely used, it is not the same for all learning styles ( 24 ); in all situations, the lecture-based teaching has been reported to significantly improve the performance in comparison with the teach-back and the concept map groups, while these two significantly improve knowledge ( 25 , 26 ). Therefore, different teaching methods should be studied.

This study was carried out to evaluate the effectiveness of learning through virtual simulation in comparison with traditional method in learning of START triage knowledge and skill level in a group of undergraduate students majoring in the field of emergency medicine at Birjand University of Medical Sciences, Ferdows Paramedical School, from September 2019 to January 2020.

Methods

The present quasi-experimental study was performed on two groups to compare the effect of virtual simulation-based and lecture-based training on students' learning in triage course. The census sampling method was used in this study. The study population consisted of all 44 emergency undergraduate students who were enrolled in the triage course in 2019-2020 at Ferdows Paramedical School. The students were divided into two homogeneous groups based on their age and grade point average and then randomly assigned to traditional lecture or virtual reality-based learning groups (22 in the intervention group and 22 in the control group). The first group received lecture-based training and 22 students in the second group who received virtual simulation-based training; when allocating the students in each group, their gender and grade point average (GPA) were considered to control their effect, so the groups were homogeneous. Then, the semester was divided into two parts. In the first part of the semester, according to the pre-determined schedule, the first group attended the classes and the lectures were presented, from the beginning of the semester to the middle of it. Then, the second group was taught using virtual simulation-based from the middle to the end of the semester. The content was the same for both groups and the same teacher prepared it. Virtual reality simulation videos were shown to the students in the virtual simulation group in the “crisis management room” of Ferdows Paramedical School, which was equipped with LCD TV and virtual reality glasses. The most appropriate films were used according to the lecture title and according to the triage guideline and triage protocol through START (Simple Treatment and Rapid Transport) method, which is approved by the Ministry of Health (1374) and notified by the emergency department of 115 countries. The content used was simulated "START method triads and its features" according to the course topics presented in the lecture group. To evaluate and compare the efficiency and level of education of these two methods, the students’ scores in the exam of this course were used; also to assess the students’ views on each of these methods, a self-assessment questionnaire with 7 questions was completed at the end of the course on a 4-point Likert scale (4 = excellent, 3 = good, 2 = Fair, 1 = poor).  This questionnaire was completed by the intervention group at the end of the exam. The validity of the questionnaire was determined through several discussions and revisions by the three members of the faculty in departments of medical education. The reliability of the questionnaire was evaluated using internal consistency; the Cronbach coefficient was 0.83. After examining the data for accuracy and the absence of outlier, data Kolmogorov-Smirnov test was used to examine the normal distribution of data. To compare the two teaching methods of lecture and simulation, analysis of covariance was used by considering the GPA confounder variable. The presumption of the equality of variance between the groups was confirmed using Leven’s test.

Ethical Consideration

This study was approved by ethics committee of Kerman University of Medical Sciences, with the code of IR.KMU.REC.1399.172.

Results

In this study, 44 participants with a mean age of 21.13±1.11 were enrolled. All of them were male; among them, 72.7% were single, and the others were married. The results of normality showed that the score variable was normal, but the evaluation variable was not normal. Table 1 shows the mean score and variance of the participants in the two methods; according to this Table, the mean score of teaching based on virtual simulation was higher than that of the lecture group.

Teaching method Frequency Mean±SD
Lecture-based 22 16.67±1.82
Simulation-based 22 17.32±1.83
Table 1.Description of the mean and variance of the score of the participants in the two groups

According to the results of the analysis of covariance ( Table 2), the difference in the scores between the two groups was not significant. In other words, the training method did not have much effect on the score of the participants. According to the beta values, the score of those who had experienced the simulation training method by controlling the grade point average effect was 0.47, which was higher than those who had used the lecture method. There was no significant difference between the two groups based on their GPA (p = 0.99).

Variable Beta SE t p
Training method -0.47 5.68 0.007 0.93
GPA 0.53 0.24 9.88 0.003
Teaching method * GPA -0.004 0.34 0.000 0.99
Table 2.Results of analysis of covariance for comparison of the scores between the two groups of lectures and simulations

The results showed that the participants were more satisfied with the simulation training method, and the difference in the satisfaction score was significant. The mean of satisfaction in the lecture method was a little higher than moderate, while it was good for simulation-based group ( Table 3).

Group Mean±SD Mann-whitney U p
Lecture 3.36±0.31 8 0.001
Simulation 4.10±0.20
Table 3.Comparison of the participants’ satisfaction mean scores between the lecturing and virtual simulation-based education

Discussion

The present study was an attempt to investigate the effect of virtual simulation-based training on learning triage lessons among emergency medical students in comparison with lecture teaching. The findings of this study, considering the comparison of the mean scores of the two educational groups, showed that virtual simulation-based education helped the instructors meet the expectations related to learning to some extent more than the lecture method. In this regard, Luigi Ingarsia’s study compared virtual reality simulation with live simulation to test the ability of 56 medical students in two groups; he performed a triage of casualties using the Simple Triage and Rapid algorithm after training, showing similar results. Although there was no significant difference in the results, it was concluded that virtual reality simulation was a valuable tool, equivalent to live simulation, to educate and evaluate the ability of medical students to perform triage of casualties and detect progress in such skills ( 11 ).

Also, the results of the study conducted by McGrath et al. (2017) which examined the consensus of experts on the use of virtual simulation in teaching emergency medicine were in line with the findings of this study. This study confirmed the need to create more focused environments and the use of advanced technologies for medical evaluation and education ( 22 ).

The study carried out by Tobloo et al. evaluated virtual simulations in theoretical learning and laboratory performance of dental students. Contrary to the results of our study, it showed a significant effect on the students' learning, and those who used virtual learning achieved better results than control students ( 27 ).

Amir Alavi et al. compared the effect of using a bronchoscopic web-based simulator and traditional education methods on the knowledge of tracheobronchial anatomy of anesthesia assistants in Guilan University of Medical Sciences. The results of this study showed that bronchoscopy training through simulator increased the learning rate of residents more than the traditional method ( 28 ).

Emami Sigaroudi et al. have obtained completely different results and reported that there was a significant difference between the two training methods. The scores in the traditional approach were higher than the electronic method; they reported that traditional education method was superior to electronic education ( 29 ).

According to Hashemi et al., comparing the effect of the two methods of teaching "lecture" and "simulation using the patient" in improving the knowledge and practice of health care providers, no significant difference was observed between the two groups ( 30 ).

Finally, a systematic review study put forward the same results as the findings of this study. In the 2018 study, Khan examined whether virtual reality simulation training could be used as a complement to and/or alternative to patient-based introductory gastrointestinal endoscopy. They did not find virtual reality to be superior to traditional patient-based education or any other method of endoscopic simulation training. They reported that the existing virtual reality simulation programs could be improved using educational theories such as gradual learning strategy, where trainees increasingly complete difficult tasks. The results of this review showed that endoscopic virtual reality training could be used to supplement conventional endoscopic basic training for trainees with limited or no endoscopic experience ( 31 ).

Limitation

This study had some limitations; the short time of the courses was the most important limitation. The participants were from the same class, the exchange of information between them could be an important limitation that was considered. This study was conducted only on emergency medical students of Ferdows city in the academic year of 2019-2020 and these should be considered when generalizing its results.

Conclusion

Virtual simulation has several advantages. According to the results of this study, a virtual simulation-based training method, like traditional training, can achieve the goals of the training program. This method leads to an increase in students' knowledge and performance (skills) in the field of triage lessons. Simulation-based education is a useful educational method that can surpass traditional methods in improving academic performance and increase the effectiveness. As it mimics the real life, in the pandemic condition in which virtual teaching is widely used, it can highly be recommended. According to this study, the students were more satisfied with virtual simulation-based education than lecture-based, so it is suitable for practical lessons such as triage.

Acknowledgement

The authors would like to acknowledge all the emergency students who participated in this research.

Conflict of Interest: None Declared.

References

  1. Aliyari S, Pishgooie AH, Abdi A, Mazhari MS, Nazari MR. Comparing two teaching methods based on concept map and lecture on the level of learning in basic life support. Nurse Education in Practice. 2019; 38:40-4.
  2. Abarghouie MHG, Omid A, Ghadami A. Effects of virtual and lecture-based instruction on learning, content retention, and satisfaction from these instruction methods among surgical technology students: A comparative study. Journal of education and health promotion. 2020; 9:296.
  3. Holmboe ES, Sherbino J, Englander R, Snell L, Frank JR. A call to action: The controversy of and rationale for competency-based medical education. Med Teach. 2017; 39(6):574-81.
  4. Kuhn S, Frankenhauser S, Tolks D. Digital learning and teaching in medical education: Already there or still at the beginning?. Bundesgesundheitsblatt, Gesundheitsforschung, Gesundheitsschutz. 2018; 61(2):201-9.
  5. Moran J, Briscoe G, Peglow S. Current Technology in Advancing Medical Education: Perspectives for Learning and Providing Care. Academic psychiatry. 2018; 42(6):796-9.
  6. Lee J, Kim H, Kim KH, Jung D, Jowsey T, Webster CS. Effective virtual patient simulators for medical communication training: A systematic review. Med Educ. 2020; 54(9):786-95.
  7. Pinar G. An Educational Revolution and Innovative Technologies: The Role of Simulation. Creative Education. 2020; 11(11):2218-32.
  8. Pottle J. Virtual reality and the transformation of medical education. Future Healthc J. 2019; 6(3):181-5.
  9. Rourke S. How does virtual reality simulation compare to simulated practice in the acquisition of clinical psychomotor skills for pre-registration student nurses? A systematic review. Int J Nurs Stud. 2020; 102:103466.
  10. Harder BNJJoNE. Use of simulation in teaching and learning in health sciences: A systematic review. Journal of Nursing Education. 2010; 49(1):23-8.
  11. Luigi Ingrassia P, Ragazzoni L, Carenzo L, Colombo D, Ripoll Gallardo A, Della Corte F. Virtual reality and live simulation: a comparison between two simulation tools for assessing mass casualty triage skills. European journal of emergency medicine: official journal of the European Society for Emergency Medicine. 2015; 22(2):121-7.
  12. Harrington CM, Kavanagh DO, Quinlan JF, Ryan D, Dicker P, O'Keeffe D, et al. Development and evaluation of a trauma decision-making simulator in Oculus virtual reality. American journal of surgery. 2018; 215(1):42-7.
  13. Rooney MK, Zhu F, Gillespie EF, Gunther JR, McKillip RP, Lineberry M, et al. Simulation as More Than a Treatment-Planning Tool: A Systematic Review of the Literature on Radiation Oncology Simulation-Based Medical Education. International journal of radiation oncology, biology, physics. 2018; 102(2):257-83.
  14. Rambarat CA, Merritt JM, Norton HF, Black E, Winchester DE. Using Simulation to Teach Echocardiography: A Systematic Review. Simulation in healthcare: journal of the Society for Simulation in Healthcare. 2018; 13(6):413-9.
  15. Chakravarthy B, Ter Haar E, Bhat SS, McCoy CE, Denmark TK, Lotfipour S. Simulation in medical school education: review for emergency medicine. The western journal of emergency medicine. 2011; 12(4):461-6.
  16. Borggreve AS, Meijer JMR, Schreuder HWR, Ten Cate O. Simulation-based trauma education for medical students: A review of literature. Med Teach. 2017; 39(6):631-8.
  17. Kennedy G, Rea JNM, Rea IM. Prompting medical students to self-assess their learning needs during the ageing and health module: a mixed methods study. Med Educ Online. 2019; 24(1):1579558.
  18. Ferrel MN, Ryan JJ. The Impact of COVID-19 on Medical Education. Cureus. 2020; 12(3):e7492.
  19. Tabatabai S. COVID-19 impact and virtual medical education. Journal of advances in medical education & professionalism. 2020; 8(3):140-3.
  20. Price JK. Transforming learning for the smart learning environment: lessons learned from the Intel education initiatives. Smart Learning Environments. 2015; 2(1):16.
  21. McGaghie WC, Issenberg SB, Cohen ER, Barsuk JH, Wayne DB. Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Acad Med: journal of the Association of American Medical Colleges. 2011; 86(6):706-11.
  22. McGrath JL, Taekman JM, Dev P, Danforth DR, Mohan D, Kman N, et al. Using Virtual Reality Simulation Environments to Assess Competence for Emergency Medicine Learners. Academic emergency medicine: official journal of the Society for Academic Emergency Medicine. 2018; 25(2):186-95.
  23. Prickett K, Deshpande A, Paschal H, Simon D, Hebbar KB. Simulation-based education to improve emergency management skills in caregivers of tracheostomy patients. International journal of pediatric otorhinolaryngology. 2019; 120:157-61.
  24. Amaniyan S, Pouyesh V, Bashiri Y, Snelgrove S, Vaismoradi M. Comparison of the Conceptual Map and Traditional Lecture Methods on Students' Learning Based on the VARK Learning Style Model: A Randomized Controlled Trial. SAGE open nursing. 2020; 6:2377960820940550.
  25. Masror Roudsari D, Feizi S, Maghsudlu M. Nurses’ hemovigilance knowledge and performance after teach-back, concept map, and lecture: A quasi-experimental study. Heliyon. 2021; 7(1):e05982.
  26. Mirzaee M, Karimi M. The Assessment of the Effect of the Haemovigilance Education by the Conceptual Map on the Knowledge of Nursing Students. Psychology: Pajouhan Scientific Journal. 2018; 17(1):51-6.
  27. Tubelo RA, Branco VLC, Dahmer A, Samuel SMW, Collares FM. The influence of a learning object with virtual simulation for dentistry: A randomized controlled trial. International Journal of Medical Informatics. 2016; 85(1):68-75.
  28. Amir-Alavi C, Dadgaran I, Aghajanzadeh M, Alavi SA, Dehghan A, Nemati M, et al. Comparison Of The Effectiveness Of Web Based Bronchoscopy Simulator Versus Traditional Educationon On Knowledge Of Tracheobronchial Anatomy Of Anesthesia Residents. GUMS-RME. 2016; 8(4):52-60.
  29. Badanara Marzdashty A, Emami Sigaroudi A, Kazemnezhad-Leyli E, Poursheikhian M. Compare the effect of two electronic and traditional education methods on first principles of instruction in nursing students of Guilan University of Medical Sciences in 2016. GUMS-RME. 2018; 10(1):48-55.
  30. Hashemi J, Jamshidian S, Haghani F. Comparing the effects of “lecture” and “simulated patient” teaching methods on promoting the knowledge and performance of healthcare providers. Iranian Journal of Medical Education. 2017; 17:145-56.
  31. Khan R, Plahouras J, Johnston BC, Scaffidi MA, Grover SC, Walsh CM. Virtual reality simulation training for health professions trainees in gastrointestinal endoscopy. The Cochrane database of systematic reviews. 2018; 8(8):Cd008237.