Using the latest in AR technology and 3D UI/UX research, the team designed holograms for visualizing real-time environment data to convey actionable information to first responders (e.g., firefighters, EMS, and law enforcement personnel). Our AR solution includes holograms for incident command perspective and heads-up displays (HUD) for a wildfire scenario. This video showcases the first responder on-device experience.
EMERGENCY RESPONSE FOR THE HEALTH CARE SYSTEM
INNOVATION CHALLENGE
Team A1R Proposal
An Augmented Reality based Communication Technology for providers internally and externally within a health care system to share information and collaborate with each other.
In the design of our proposal, we interviewed multiple subject matter experts to identify the key challenges for first responders and the results came back unanimously – clear communication of critical information.
Thus we propose using augmented reality to improve communication and coordination of situational information between emergency team members and Emergency Healthcare Command Centers to prevent on-site confusion. Additionally, improve response times and effective management and faster decision-making to prevent and mitigate first responder and civilian injury and to save more lives.
First Responders will use smartglass headsets and/or mobile devices (e.g. smartphones or tablets) for receiving and sending information through voice commands or via hand gestures.
A1R Heads Up Display (HUD) User Interface (UI) comprises simple graphic elements to convey critical information to the first responders, such as vitals, navigation, placemarks for HazMat, team requests or commands, messages, warnings, and tasks.
A1R Emergency Healthcare Command System will convey critical information to the incident commander such as the location and status of deployed resources and personnel, messages and warnings. Emergency Healthcare Commander could be able to use smartglass as UI in future implementations.
AR based A1R solution offers a state-of-the art user interface (UI) to send and receive clear communication of information about the emergency response team; collect and analyze the real-time environment data; and identify and assess the resources at risk, and assist healthcare personnel in making decisions to take effective actions in chaotic situations to improve crisis outcomes and reduce the number of lives lost.
HoloTRIAGE represents a new paradigm for first response and disaster medicine that augments and expands the current medical and healthcare training industries. Using the convergence of AI, Avatars, Multi-Haptics and XR into one integrated holistic platform. XR allows virtual victims and rescue equipment in real context. AI enables automated training of protocols and assessment of trainees. Avatars allow remote instructors to record themselves and be present in realtime. Haptics enable trainees to feel sensory and motor feedback.
HoloTRIAGE reduces costs, vastly simplifies deployment, expands scale, enhances efficiency, saves time, massively portable, and democratizes access to training for professionals and non-medical communities.
