Latent Safety Threat Identification via Medical Simulation


Introduction

A comprehensive definition of simulation-based training incorporates “information, demonstration, and practice-based learning activities into a systematically designed and delivered a program of instruction.”[1]  Simulation-based medical training is a valid and effective strategy for teaching both technical and non-technical skills to individual providers and teams.[2][3][4][5] The Institute of Medicine (IOM) has promoted medical simulation for its ability to evaluate new technologies, enhance policies, and improve systems for the goal of improving patient safety.[6]  The IOM’s To Err is Human is frequently cited for its conclusion that medical errors are not a result of isolated individual actions but rather faulty systems, processes, and conditions that lead people to make mistakes.[7]  These reports have led to a greater examination of the systems approach to error management.  Research is evolving to examine how organizations and individuals can better approach medical error.  This review will discuss the systems approach for error management as it relates to a latent safety threat (LST), and the process of developing in situ simulation to expose LSTs and subsequently address medical error within organizations and teams.

Function

The systems paradigm of medical error, best described by James Reason, holds that healthcare is an inherently human process. As humans are subject to make mistakes, there should be an expectation of errors within any system.  A more reliable strategy to make the system more durable to potential error is to account for the underlying fallibility of humans. Reason states, “we cannot change the human condition; we can change the conditions under which humans work.”[8] He also makes an important distinction between "active errors" and "latent conditions."  Active errors are attributed to the immediate action of a human to cause an error, while latent conditions allow active errors to cause an adverse event or harm the patient. Addressing an active error may provide a temporary fix, but may not address the latent condition that allowed the mistake to have an impact.[9] In other words, LSTs in an organization are accidents waiting to happen, and focusing only on addressing active errors will not result in sustainable solutions.[10]

As may be apparent by the name, "in situ simulation" is simulation-based learning that occurs within the actual care setting as opposed to a designated multi-purpose simulation center. In situ simulation often involves an interprofessional team of practitioners on-duty and has the benefit of offering learners the opportunity to contextualize the actual process of work within their normal workflow and physical plant.[11] Adherents promote simulations conducted in the actual care setting for their affordability, ability to improve realism and that they elevate participant engagement of the broader medical team.[12][13][14] Furthermore, practitioners and teams get confronted with the same distractions, resource limitations, obstacles, and system flaws that they work with daily. These characteristics enable in situ simulation to be an effective vehicle to identify and mitigate medical error nascent within a department and its broader organization.[15][16][17]

Continuing Education

In situ simulation has been accepted as a valuable tool to identify latent hazards and practitioner knowledge gaps.  It is important to conduct scenarios in alignment with best practices to maximize outcomes and ensure participant engagement. Standardized approaches and protocols to conduct in situ simulation include pre-scenario planning, timing, setting, necessary personal, and criteria to cancel the simulation.[18][13][11][19] There can be some degree of variation in the development of in situ programs depending on the stated goals or the conditions challenged. However, the general considerations for executing an in situ simulation program should address patient safety, learner engagement, and record keeping.[13]  

Before beginning any in situ simulation, a supervisor or ward manager should be aware of the plan to ensure proper coverage of patient areas. Often "no-go" criteria are established to minimize risks to active or incoming patients to the unit. Patients and family members in the vicinity should be alerted to on-going training to ensure their psychological safety. Participants should have access to a safe training environment with an introduction to the ground rules of the simulation. Some in situ simulations are “unannounced,” in which case there should be some level of ongoing briefings to potential participants in the days or weeks before the initiation of a one time or longitudinal program. 

The final necessary component intrinsic to almost all medical simulation is a formalized debriefing. It can be a challenge to facilitate a debriefing among an interprofessional group of providers. It can be helpful to have an individual with formal debriefing experience be involved. Adequate time should be allotted to allow participants to identify LSTs and propose subsequent solutions. The seven most common descriptive categories of latent safety threats include staffing, medication, devices/equipment, knowledge-base, workspace/environment, protocols, and communication/teamwork.[6][11] Although these may be subdivided further, especially in regards to teamwork and communication, the broad categorization of potential safety threats allows systems to identify the most common vulnerabilities and direct resources accordingly. 

In collaboration with the clinical operations team, mechanisms should be in place in advance of performing in situ simulation to review and address revealed LSTs. One of the more comprehensive reviews on the role of in situ simulation in addressing latent safety threats advises a model for addressing issues using a Comprehensive Unit-based Safety Program.[1] These programs typically use a bi-directional approach between front line staff and administrative leaders who may have greater capability to address the needs identified during the simulations. These partnerships between staff and administrators help align routine processes with system-level structures. In 2010, the Society for Simulation in Healthcare (SSIH) established accreditation for simulation centers in System Integration for organizations committed to providing “a consistent, planned, collaborative, integrated and iterative application of simulation-based assessment and teaching activities with systems engineering and risk management principles to achieve excellent bedside clinical care, enhanced patient safety, and improved metrics across the healthcare system.” This concept is an important mechanism for providing sustainability and returns on investment for in situ simulation programs geared to exposing LSTs.  

Clinical Significance

At the time of this writing, a great deal of educational and investigative literature has been developed using in situ simulation for identifying latent safety threats. Some notable in situ simulation environments have included acute care settings, labor and delivery, pediatric care, and low-frequency high-risk scenarios.[19][20][21][22][23][24][25] Organizations with new facilities or new adaptations of their care setting have also used in situ simulation to assess the physical plant before opening their doors to patient care.[26][18] A review of this literature identifies qualitative measurements for the common categories that enumerate patient safety threats (e.g., medications, protocols, environment, staffing, and communication). Reported rates of the average LSTs identified per in situ simulation range from 1 to 7.[19][25] Evidence demonstrates that in situ simulation can be superior at identifying LSTs compared to standard institutional reporting systems.[23] Rosen’s systematic review concluded that effective in situ simulations "should include structured needs analysis and clearly defined assessment and feedback strategies to clarify learning objectives and support training transfer to daily practice."[1]  

To provide some concrete examples of simulation programs geared to exposing LSTs, the authors of this paper draw on individual experience conducting and gathering information from in situ simulations performed in a high volume urban emergency department. In the process of transitioning towards a formal Trauma designation, multiple in situ trauma simulations took place with interprofessional staff.  Simulations activated all levels of the system to mirror a real event (e.g., the use of the overhead hospital-wide paging system after a pre-hospital notification, formal patient registration into the electronic medical record, and involvement of ancillary services such as radiology to ensure our capacity to expedite diagnostic imaging). Debriefs revealed LSTs in various domains, including protocols, equipment, and organization of the clinical environment. The ultimate result was the implementation of multiple solutions. A few examples included codifying the massive transfusion protocol and adjusting the positioning of equipment within the room to make them more readily available for providers performing emergent resuscitative procedures. There was an enhancement of team dynamics by adding sticker role-identifiers for personal responding to the trauma notification, redesigning the trauma bay floor tiles to designate positions of resuscitation team members, and creating an illustration of team roles posted to the trauma bay wall. Regular inter-disciplinary team training exercises were developed to improve the ability of teams assembled on an ad hoc basis were prepared to perform highly reliable resuscitations. As the literature suggests, we found that frequent and goal-directed in situ simulations in coordination with operational, administrative committee meetings created an effective iterative process to diagnose and address LSTs.

Enhancing Healthcare Team Outcomes

Poor communication and teamwork inherently represent latent safety conditions. In situ simulation provides opportunities for the deliberate practice among teams and the opportunity for reflection on areas of improvement. Many validated scales are used to assess team performance for evaluation of in situ training.[27][28][26] Almost all the research evaluating in situ simulation report a positive impact on the non-technical skills of leadership, role clarity, decision-making, communication, and task management.[19][13][29][30] Studies also comment on the less tangible impacts of in situ simulation on organizations in the form of culture change. Frequent in situ simulation normalizes it as a training process and promote a culture of safety by engaging participants to identify LSTs as part of developmental team-based exercises.[18][19] The collaborative approach of in situ simulation can strengthen teamwork, and also empower healthcare providers to improve patient safety via a systems paradigm.  


Details

Editor:

Amish Aghera

Updated:

7/24/2023 9:46:07 PM

References


[1]

Rosen MA, Hunt EA, Pronovost PJ, Federowicz MA, Weaver SJ. In situ simulation in continuing education for the health care professions: a systematic review. The Journal of continuing education in the health professions. 2012 Fall:32(4):243-54. doi: 10.1002/chp.21152. Epub     [PubMed PMID: 23280527]

Level 1 (high-level) evidence

[2]

Cook DA, Hatala R, Brydges R, Zendejas B, Szostek JH, Wang AT, Erwin PJ, Hamstra SJ. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA. 2011 Sep 7:306(9):978-88. doi: 10.1001/jama.2011.1234. Epub     [PubMed PMID: 21900138]

Level 1 (high-level) evidence

[3]

Issenberg SB, McGaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Medical teacher. 2005 Jan:27(1):10-28     [PubMed PMID: 16147767]

Level 1 (high-level) evidence

[4]

Issenberg SB, McGaghie WC, Hart IR, Mayer JW, Felner JM, Petrusa ER, Waugh RA, Brown DD, Safford RR, Gessner IH, Gordon DL, Ewy GA. Simulation technology for health care professional skills training and assessment. JAMA. 1999 Sep 1:282(9):861-6     [PubMed PMID: 10478693]


[5]

Zendejas B, Cook DA, Bingener J, Huebner M, Dunn WF, Sarr MG, Farley DR. Simulation-based mastery learning improves patient outcomes in laparoscopic inguinal hernia repair: a randomized controlled trial. Annals of surgery. 2011 Sep:254(3):502-9; discussion 509-11. doi: 10.1097/SLA.0b013e31822c6994. Epub     [PubMed PMID: 21865947]

Level 1 (high-level) evidence

[6]

Guise JM, Mladenovic J. In situ simulation: identification of systems issues. Seminars in perinatology. 2013 Jun:37(3):161-5. doi: 10.1053/j.semperi.2013.02.007. Epub     [PubMed PMID: 23721772]


[7]

Institute of Medicine (US) Committee on Quality of Health Care in America, Kohn LT, Corrigan JM, Donaldson MS. To Err is Human: Building a Safer Health System. 2000:():     [PubMed PMID: 25077248]


[8]

Reason J. Human error: models and management. The Western journal of medicine. 2000 Jun:172(6):393-6     [PubMed PMID: 10854390]


[9]

Reason J. Human error: models and management. BMJ (Clinical research ed.). 2000 Mar 18:320(7237):768-70     [PubMed PMID: 10720363]


[10]

Alfredsdottir H, Bjornsdottir K. Nursing and patient safety in the operating room. Journal of advanced nursing. 2008 Jan:61(1):29-37. doi: 10.1111/j.1365-2648.2007.04462.x. Epub     [PubMed PMID: 18173734]


[11]

Henriksen K, Battles JB, Keyes MA, Grady ML, Patterson MD, Blike GT, Nadkarni VM. In Situ Simulation: Challenges and Results. Advances in Patient Safety: New Directions and Alternative Approaches (Vol. 3: Performance and Tools). 2008 Aug:():     [PubMed PMID: 21249938]


[12]

Beaubien JM, Baker DP. The use of simulation for training teamwork skills in health care: how low can you go? Quality & safety in health care. 2004 Oct:13 Suppl 1(Suppl 1):i51-6     [PubMed PMID: 15465956]

Level 2 (mid-level) evidence

[13]

Walker ST, Sevdalis N, McKay A, Lambden S, Gautama S, Aggarwal R, Vincent C. Unannounced in situ simulations: integrating training and clinical practice. BMJ quality & safety. 2013 Jun:22(6):453-8. doi: 10.1136/bmjqs-2012-000986. Epub 2012 Dec 4     [PubMed PMID: 23211281]

Level 2 (mid-level) evidence

[14]

Wheeler DS, Geis G, Mack EH, LeMaster T, Patterson MD. High-reliability emergency response teams in the hospital: improving quality and safety using in situ simulation training. BMJ quality & safety. 2013 Jun:22(6):507-14. doi: 10.1136/bmjqs-2012-000931. Epub 2013 Mar 1     [PubMed PMID: 23457361]

Level 2 (mid-level) evidence

[15]

Herzer KR, Rodriguez-Paz JM, Doyle PA, Flint PW, Feller-Kopman DJ, Herman J, Bristow RE, Cover R, Pronovost PJ, Mark LJ. A practical framework for patient care teams to prospectively identify and mitigate clinical hazards. Joint Commission journal on quality and patient safety. 2009 Feb:35(2):72-81     [PubMed PMID: 19241727]

Level 2 (mid-level) evidence

[16]

Kneebone R, Arora S, King D, Bello F, Sevdalis N, Kassab E, Aggarwal R, Darzi A, Nestel D. Distributed simulation--accessible immersive training. Medical teacher. 2010 Jan:32(1):65-70. doi: 10.3109/01421590903419749. Epub     [PubMed PMID: 20095777]


[17]

Kneebone R. Simulation, safety and surgery. Quality & safety in health care. 2010 Oct:19 Suppl 3():i47-52. doi: 10.1136/qshc.2010.042424. Epub     [PubMed PMID: 20959319]

Level 2 (mid-level) evidence

[18]

Kaba A, Barnes S. Commissioning simulations to test new healthcare facilities: a proactive and innovative approach to healthcare system safety. Advances in simulation (London, England). 2019:4():17. doi: 10.1186/s41077-019-0107-8. Epub 2019 Jul 16     [PubMed PMID: 31346476]

Level 3 (low-level) evidence

[19]

Patterson MD, Geis GL, Falcone RA, LeMaster T, Wears RL. In situ simulation: detection of safety threats and teamwork training in a high risk emergency department. BMJ quality & safety. 2013 Jun:22(6):468-77. doi: 10.1136/bmjqs-2012-000942. Epub 2012 Dec 20     [PubMed PMID: 23258390]

Level 2 (mid-level) evidence

[20]

Hunt EA, Heine M, Hohenhaus SM, Luo X, Frush KS. Simulated pediatric trauma team management: assessment of an educational intervention. Pediatric emergency care. 2007 Nov:23(11):796-804     [PubMed PMID: 18007210]


[21]

Riley W, Davis S, Miller KM, Hansen H, Sweet RM. Detecting breaches in defensive barriers using in situ simulation for obstetric emergencies. Quality & safety in health care. 2010 Oct:19 Suppl 3():i53-6. doi: 10.1136/qshc.2010.040311. Epub 2010 Aug 19     [PubMed PMID: 20724391]

Level 2 (mid-level) evidence

[22]

Riley W, Davis S, Miller K, Hansen H, Sainfort F, Sweet R. Didactic and simulation nontechnical skills team training to improve perinatal patient outcomes in a community hospital. Joint Commission journal on quality and patient safety. 2011 Aug:37(8):357-64     [PubMed PMID: 21874971]

Level 2 (mid-level) evidence

[23]

Knight P, MacGloin H, Lane M, Lofton L, Desai A, Haxby E, Macrae D, Korb C, Mortimer P, Burmester M. Mitigating Latent Threats Identified through an Embedded In Situ Simulation Program and Their Comparison to Patient Safety Incidents: A Retrospective Review. Frontiers in pediatrics. 2017:5():281. doi: 10.3389/fped.2017.00281. Epub 2018 Feb 1     [PubMed PMID: 29473026]

Level 2 (mid-level) evidence

[24]

Lighthall GK, Poon T, Harrison TK. Using in situ simulation to improve in-hospital cardiopulmonary resuscitation. Joint Commission journal on quality and patient safety. 2010 May:36(5):209-16     [PubMed PMID: 20480753]

Level 2 (mid-level) evidence

[25]

Blike GT, Christoffersen K, Cravero JP, Andeweg SK, Jensen J. A method for measuring system safety and latent errors associated with pediatric procedural sedation. Anesthesia and analgesia. 2005 Jul:101(1):48-58, table of contents     [PubMed PMID: 15976205]


[26]

Geis GL, Pio B, Pendergrass TL, Moyer MR, Patterson MD. Simulation to assess the safety of new healthcare teams and new facilities. Simulation in healthcare : journal of the Society for Simulation in Healthcare. 2011 Jun:6(3):125-33. doi: 10.1097/SIH.0b013e31820dff30. Epub     [PubMed PMID: 21383646]


[27]

Walker S, Brett S, McKay A, Lambden S, Vincent C, Sevdalis N. Observational Skill-based Clinical Assessment tool for Resuscitation (OSCAR): development and validation. Resuscitation. 2011 Jul:82(7):835-44. doi: 10.1016/j.resuscitation.2011.03.009. Epub 2011 Mar 23     [PubMed PMID: 21481519]

Level 1 (high-level) evidence

[28]

Flin R, Maran N. Identifying and training non-technical skills for teams in acute medicine. Quality & safety in health care. 2004 Oct:13 Suppl 1(Suppl 1):i80-4     [PubMed PMID: 15465960]

Level 2 (mid-level) evidence

[29]

Reader TW, Flin R, Mearns K, Cuthbertson BH. Developing a team performance framework for the intensive care unit. Critical care medicine. 2009 May:37(5):1787-93. doi: 10.1097/CCM.0b013e31819f0451. Epub     [PubMed PMID: 19325474]


[30]

Sevdalis N, Brett SJ. Improving care by understanding the way we work: human factors and behavioural science in the context of intensive care. Critical care (London, England). 2009:13(2):139. doi: 10.1186/cc7787. Epub 2009 Apr 29     [PubMed PMID: 19439048]

Level 3 (low-level) evidence