Abstract
Significance: Although current patient simulators have demonstrated improved learning
outcomes in medical training, there is a significant lack of realism. Thus, they do not effectively
provoke a realistic emotional response in trainees. This significantly limits their educational value
to the emergency medical service (EMS) training agencies, as does – in the case of mannequins
– their cost, reliance on electricity, and lack of portability. To address these significant limitations
of the current medical patient simulators, the PI developed PerSim, a commercial patient
simulator product using mixed reality (MR), which includes HAZMAT signs and symptoms.
However, additional research and development is needed to effectively support HAZMAT
treatments. Commercial Need: Since being released in 4th quarter 2017, there are over 100
institutions that have purchased PerSim for $20-30K each, on average, including a $12K per year
subscription fee, and are using the system for emergency medicine and HAZMAT training. Based
on interviews with our customers and individuals at emergency medicine training agencies, MR-
based simulated HAZMAT treatments will address a critical need in HAZMAT education.
Preliminary Data: The PI developed PerSim, an MR-based patient simulator that can be used in
person or remotely over the internet. Via the Microsoft HoloLens 2 MR display, the system projects
high-resolution, realistic animations of a patient onto any surface a trainee chooses such as low-
fidelity mannequin as a physical reference for haptic input during procedures. The instructor uses
a handheld tablet as both a controller for the simulation and an automated assessment system to
track trainee performance. The system utilizes another tablet to act as a defibrillator and a
physiologic monitor to provide real-time vital sign and heart rhythm data. The system’s control
interfaces and registration algorithms are patented. Specific Aims: This project proposes to
develop and evaluate interactive, virtual autoinjectors and patches for HAZMAT treatments in the
PI's innovative MR-based patient simulator, PerSim. In Specific Aim 1, the PI will work with
medical artists and a HAZMAT educator co-I to create realistic treatments and integrate them with
the PerSim system. The PI plans to develop autoinjector and patches textures and models based
on NFPA 472 Standard for Competence of Responders to Hazardous Materials, specifically to
treat poisonous gas inhalation, corrosive materials, and poisonous materials. In Specific Aim 2,
the PI will evaluate the usability and realism of the HAZMAT treatments with HAZMAT instructors
and students.