Assistant Professor Linfield University Fort Worth, Texas, United States
Abstract :
Background: The National Aeronautics & Space Administration Task Load Index (NASA-TLX) is widely used to measure cognitive load (CL) in nursing (Lapierre et al., 2022; Matsushima et al., 2021; Rogers & Franklin, 2021). NASA-TLX quantifies six CL contributors that operationalize Cognitive Load Theory and impact working memory (Sweller, 1988); however, a lack of reliability and validity evidence may undermine results. Simulationists use CL to inform instructional design choices for improving learning and behavioral performance outcomes.
Methods: We performed psychometric testing to estimate the reliability and validity of NASA-TLX in individual and group simulation using a secondary analysis of 488 NASA-TLX surveys completed by learners after either two individual simulations or one group simulation. Cronbach’s alpha determined internal consistency for both individual and group simulation samples. Individual simulation survey item means and global CL scores for Time 1 and Time 2 were compared using paired samples t-test while inter-item correlations were identified using principal component analysis (PCA). Group simulation global CL means between participant roles (RN1, RN2, RN3) were compared using one-way ANOVA.
Results: In individual simulation, acceptable reliability was demonstrated at Time 1 (α=0.729) and Time 2 (α=0.702); and PCA revealed a 2-component model with a cumulative proportion explanation of 65.89%. In group simulation, alpha was acceptable for global sample (α=0.720) but varied by role.
Conclusion: NASA-TLX is a valid and reliable instrument for measuring CL during individual nursing simulation; however, further investigation is needed to determine its sensitivity in group simulation formats.
Please include a short summary of your presentation that highlights why an attendee would want to participate in your session.: Cognitive load underpins knowledge application and behavioral performance errors in simulation. The National Aeronautics & Space Administration Task Load Index (NASA-TLX) is a widely used instrument for measuring perceived cognitive load; however, a lack of reliability and validity evidence may underpin results. This presentation explores the first psychometric testing of NASA-TLX in group and individual nursing simulation.
Learning Objectives:
Describe cognitive load and its components as operationalized by Cognitive Load Theory
Describe NASA-TLX items and their relation to cognitive load construct
Describe NASA-TLX reliability and validity in individual and group simulation formats
Identify potential threats to reliability and validity when using NASA-TLX in nursing simulation