Simulation Training and Skill Assessment in EMS

Function

This brief review seeks to summarize the current literature on the use of simulation in EMS education and in skill assessment. Simulation is widely used by EMS education programs. Its origins can arguably be traced back to the collaboration between the toy company Laerdal and Dr. Safar, who developed mouth-to-mouth resuscitation. This partnership led to the production of the first Resusci-Anne training simulator.[3] Today, nearly all EMS training programs have access to at least one simulation modality.[4]

Issues of Concern

Early exposure to ALS patients during EMS training has been identified as a strategy utilized among highly effective EMS training programs, however, a barrier to training then, is the infrequency of exposure to out-of-hospital cardiac arrest or other events such as mass-casualty incidents even among working medics.[5][6][3] A 2017 survey of ten Australian & New Zealand EMS employers identify simulation-based training in resuscitation skill refresher courses as a possible way to remedy this lack of direct exposure to important clinical scenarios.[6]

Recent events have also demonstrated simulation as an effective means to coordinate the responses of various agencies during a mass casualty incident (MCI). This specialized kind of simulation training was touted as one of the reasons for an integrated local response to the Pulse Nightclub shooting in Orlando in 2016, and it is likely to be used more heavily in future EMS training programs.[3][7]

A survey of 389 paramedic programs found all programs have access to some kind of simulation tool (and very often to a wide variety of such tools), meaning simulation is universally available in EMS education. Unfortunately, despite this availability, several barriers prevent the appropriate use of the resources at hand. In approximately one-third of surveyed EMS programs, some portion of available simulation tools were found to sit idly without regular use, most commonly because of a lack of educator familiarity and training in the use of these tools. In programs using advanced mannequins, 19% of teaching faculty had no formal training with the equipment. Addressing this neglect may lead to improved efficacy of simulation training down the road.[4]

Curriculum Development

The NREMT is the governing body accountable for certifying trainees in EMS. To become certified, candidates must pass a 2-hour computer-adaptive multiple-choice question exam. At this time, there is no other skill assessment involved. Training programs that consistently had higher than a 75% first-time pass rate were interviewed with the intent of identifying the keys to the success of their graduates. The researchers identified 12 strategies common among these high-performing programs. Although simulation-based training was not explicitly mentioned as one of these strategies, most interviewed directors revealed the regular use of simulation as part of their curricula.[5][4]

When developing a strong curriculum, directors should consider many different theories of adult learning. Miller’s pyramid is one model that references simulation as an essential component of the learning process. In this model, a learner progresses from Knowledge (e.g., gathering facts) to Competence (i.e., knowing how), to Performance (i.e., showing how), and finally to Action (e.g., integration of new skills into actual practice).[8] Simulation falls into the Competence level of the pyramid, allowing trainees to practice procedures (especially rare ones) without risk of patient harm before they progress to performing the procedure on an actual patient.

Not just any simulation will allow learners to successfully move from Miller’s third level to the final one. A quality simulation-based training session consists of several important components. First, the topic to be simulated, as well as the goals of learning, should be well-defined. The topic can be anything from a pediatric MCI to a single-patient dyspnea call, while the learning goals can be successful triage or successfully recognizing the need for and completing intubation. Second, the type of simulation tools to be used to achieve the learning goals should be identified. Third, checklist-based evaluation tools for learners and educators should be available.[9] Finally, there should be a plan in place for a debriefing session following the simulation activity.[1]

Procedural Skills Assessment

Simulation is also widely used as either a supplement or replacement for clinical skills assessment in EMS education. For example, a paper on the state of EMS training and skills in under-resourced areas like Kenya used observation of simulation scenarios as part of its assessment of the skills of EMS personnel.[10] Another study on the effect of teamwork on medical errors used simulation as the sole method of data collection.[11] One other review demonstrates that paramedics who were taught cricothyrotomy on a task trainer were proficient in the procedure on the same device 12 weeks later. More research is needed to determine if those results accurately reflect the trainees’ skills in the field.[12]

A statistical analysis examining the validity of simulation as an accurate assessment of clinical competence in the field found that in five of seven dimensions considered essential paramedic skills (situation awareness, history gathering, patient assessment, decision making, and communication), trainees scored comparably when observed in simulation and the field.  In the remaining two dimensions (resource utilization and procedural skill), trainee performance scores during simulation did not significantly correlate with scores obtained in the field. This study is critical to understanding the use of simulation in the assessment of EMS skills. Evaluation of clinical skills by simulation is overall a reliable means of evaluating clinical competence but does not guarantee skill level in the field or replace assessment in the field altogether.[2]

Clinical Significance

Simulation, the imitation of clinical experience, is being used both to train and test EMS personnel. Quality simulation experiences are beneficial when teaching and evaluating skills and scenarios that rarely happen in the field.[6][3][7] These experiences should consist of defined learning goals, identifiable simulation tools, a clear checklist for evaluation, and a debriefing session.[9][1] There are some significant barriers to simulation as an educational tool, however, including the lack of training for educators in the available equipment. It is also unclear if procedural competence during simulated scenarios translates into competence in the field.[2] Despite these shortcomings, simulation is still considered a valuable tool in EMS training programs and will continue to be so as technology advances.

Enhancing Healthcare Team Outcomes

The International Network for Simulation-Based Pediatric Innovation, Research & Education (INSPIRE), a research network focused on the transferability of simulation skills to clinical practice, is an organization to watch in the future as the application of simulation evolves and its prevalence in EMS education expands.[13] It is also likely that telesimulation will become a more popular educational tool as technology continues to advance. A recent feasibility study analyzing telesimulation using Google Glass concluded that it is possible to conduct an intercontinental MCI simulation and that participants were favorable to the process.[14]

Goals going forward within the EMS simulation community include increasing educator familiarity with simulation tools to encourage utilization, as well as further investigation into how simulation training translates to real-world skills.[4]