F16 - Fairness in Focus: Implementing Equitable and Just Assessments in Simulation Education

Abstract :

Background: In simulation-based education, fair and consistent learner assessment is critical to ensure equitable outcomes. However, simulation educators encounter challenges in implementing interrater reliability due to limited time, resources, and practical methods. The International Nursing Association for Clinical Simulation and Learning (INACSL) has underscored the importance of using validated measurement tools. However, achieving reliable interrater consistency remains challenging, impacting fairness in learner evaluations.

Purpose: This workshop will address gaps in achieving fair and unbiased assessments by providing practical training in interrater reliability methods. Focusing on INACSL’s Healthcare Simulation Standards of Best Practice™, this workshop will equip educators with tools and strategies to prevent inter-rater drift, promote intra-rater consistency, and ensure assessments are equitable and reflective of learners’ true competencies.

Methods: This workshop will introduce Frame of Reference (FOR) and Rater Error Training (RET), both evidence-based methods for enhancing interrater reliability. Attendees will engage in hands-on calibration exercises with benchmarks, standardizing rating scales, and utilizing reflective techniques to mitigate personal biases. Additionally, participants will explore behavioral observation training and documentation techniques to support consistent ratings over time.

Results/Outcomes: Attendees will gain insights into rater biases and learn strategies to align evaluation practices within simulation standards. Participants will demonstrate interrater reliability methods and reflect on their biases, fostering enhanced fairness and accuracy in learner assessment.

Implications for Simulation Education: This workshop supports educators in advancing equitable evaluation practices. By applying standardized assessment techniques, educators can mitigate variability, ensuring each learner receives a fair, consistent assessment aligned with simulation best practices.

Please include a short summary of your presentation that highlights why an attendee would want to participate in your session.: This workshop offers practical training to boost interrater reliability, equipping attendees with INACSL-aligned strategies to prevent bias, maintain consistency, and ensure fair learner evaluation. Hands-on activities will enhance skills in standardizing rating scales and addressing personal biases. Perfect for anyone committed to maintaining rigor and fairness in simulation evaluations for the purpose of learner success.