Document Type : Commentary

Authors

1 Department of Medical Education, Smart University of Medical Sciences, Tehran, Iran

2 Department of eLearning in Medical Sciences, School of Medical Education and Learning Technologies, Shahid Beheshti University of Medical Sciences, Tehran, Iran

3 School of Teaching and Learning, University of Florida, 1221 SW 5th Ave, Gainesville, FL32601 USA

4 Department of Medical Education, School of Medical Education and Learning Technologies, Shahid Beheshti University of Medical Sciences, Tehran, Iran

10.30476/jamp.2024.101479.1931

Abstract

This Letter explores the transformative impact of stealth assessment on medical education and its potential to enhance learning outcomes. Stealth assessment, an innovative approach, subtly measures students’ learning progress while the students interact with rich and engaging environments, seamlessly integrating assessment within authentic learning activities. By mirroring the testing scenario with the learning format, stealth assessment mitigates test-related anxiety and promotes continuous engagement in training. It also plays a pivotal role in evaluating 
non-cognitive skills and attributes, such as empathy and ethical decision-making, which are often overlooked by traditional testing methods. Stealth assessment offers advantages in scalability and
efficiency, leveraging technology and automation to streamline data analysis and feedback generation. The adoption of stealth assessment in medical education holds the promise of nurturing self-directed learning, reflective practices, and the development of nuanced skills necessary for medical practice, ultimately producing competent and well-rounded healthcare professionals.

Highlights

AMIN HABIBI

MASOMEH KALANTARION

Keywords

Introduction

The progressive evolution of medical education has created a growing demand for assessment methodologies that effectively evaluate learners' competencies in complex domains such as clinical reasoning, communication, physical examination, and professionalism. Traditional evaluation methods often fall short in capturing the depth and breadth of students' abilities. In this context, stealth assessment emerges as a promising and innovative approach to meet this demand. This commentary explores the transformative impact of stealth assessment on medical education and its potential to enhance learning outcomes.

Main Body

Stealth assessment, an evidence-based method that subtly measures students' learning progress while they interact with rich and engaging environments, holds significant promise ( 1 ). Moreover, this assessment method mitigates test-related anxiety by framing assessments as habitual learning opportunities centered on self-enhancement. By mirroring the testing scenario with the learning format, students are continually engaged in their training, avoiding a singular fixation on exam performance. However, it is imperative to deliberately structure stealth assessment activities in alignment with defined learning objectives. Faculty members also necessitate training to offer constructive and actionable feedback derived from stealth assessment data. Unlike traditional testing methods, stealth assessments are seamlessly integrated into authentic learning activities like simulations, game-based learning environments and clinical experiences. For example, a simulated patient encounter can assess communication and diagnostic skills without an obvious test structure ( 2 - 4 ).

Furthermore, stealth assessment plays a pivotal role in nurturing essential non-cognitive skills and attributes among medical learners. Traditional testing methods tend to concentrate primarily on the acquisition of factual knowledge and technical proficiencies, often overlooking critical facets such as empathy, cultural competence, and ethical decision-making ( 5 ). Stealth assessment addresses this gap by enabling the evaluation of these crucial attributes through the observation of learners' conduct and interactions within genuine clinical contexts. Noteworthy examples include the utilization of video games to explore creativity within the realm of stealth assessment ( 6 ). By seamlessly integrating the assessment of non-cognitive skills into the learning process, stealth assessment contributes to the cultivation of well-rounded healthcare professionals. These individuals not only possess the requisite clinical expertise but also demonstrate the interpersonal skills essential for delivering effective patient care and engaging in collaborative endeavors within multidisciplinary healthcare teams ( 7 ). Embedded assessments of this nature enable performance evaluation in a natural context, providing an authentic snapshot of learners' abilities. This helps identify knowledge and skill gaps at an earlier stage, guiding teaching interventions and feedback.

Stealth assessment presents distinct advantages concerning scalability and efficiency in the realm of education. By seamlessly integrating assessment within authentic learning activities, it obviates the necessity for discrete and labor-intensive evaluation procedures. Medical educators can leverage Artificial Intelligence (AI) technology to automate specific facets of formative assessment, including data analysis and feedback generation. The process of automating assessment comprises key components: embedding it within digital platforms, employing the Evidence-centered design (ECD) framework, and ensuring continuous feedback loops. Diligent attention to these elements streamlines the design and implementation of stealth assessment, empowering medical educators to adeptly amass and analyze substantial data volumes while delivering timely and precisely tailored feedback to learners. The inherent scalability of stealth assessment renders it particularly valuable for educational programs catering to a substantial learner base. This scalability equips educators to proficiently assess individual progress and facilitate personalized development trajectories. AI tools, such as automated speech analysis or patient note evaluation, further augment this process by discerning learners' strengths and areas for improvement, enhancing the overall efficacy of the assessment endeavor ( 8 ).

Conclusion

Stealth assessment represents a powerful tool for ongoing formative evaluation that seamlessly integrates into the learning process. Its transformative impact on medical education lies in nurturing self-directed learning, promoting reflective practices, and fostering the development of nuanced skills necessary for medical practice. As we shape the future generation of medical professionals, the adoption of stealth assessment stands as an elegant solution to enhance learning outcomes and produce competent and well-rounded healthcare professionals.

Authors’ contributions

Conceptualization: AH, MK. Data curation: AH, MK, ET, SR. Methodology/formal analysis/validation: AH, MK, ET, SR. Writing – review & editing AH, MK, ET, SR.

Conflict of Interest:

The authors declare no conflicts of interest.

References

  1. Shute VJ. Computer Games and Instruction. Information Age Publishers: Charlotte, NC; 2011.
  2. Shute VJ, Kim YJ. Handbook of research on educational communications and technology. Springer: New York, NY; 2014.
  3. Bok HG, Teunissen PW, Favier RP, Rietbroek NJ, Theyse LFH, Brommer H, et al. Programmatic assessment of competency-based workplace learning: when theory meets practice. BMC Med Educ. 2013; 13:123.
  4. Donnon T, Al Ansari A, Al Alawi S, Violato C. The reliability, validity, and feasibility of multisource feedback physician assessment: a systematic review. Acad Med. 2014; 89(3):511-6.
  5. Wang L, Shute VJ, Moore G. Best practices and lessons learned of stealth assessment. Florida State University: Florida; 2015.
  6. Rahimi S, Shute VJ. Stealth assessment: a theoretically grounded and psychometrically sound method to assess, support, and investigate learning in technology-rich environments. Educational technology research and development. 2023; 17:1-25.
  7. Shute V, Ventura M. Stealth assessment. The SAGE encyclopedia of educational technology: Florida; 2015.
  8. Shute V, Ventura M. Stealth assessment: Measuring and supporting learning in video games. The MIT Press: USA; 2013.