Complete and Resilient Documentation for Operational Medical Environments Leveraging Mobile Hands-free Technology in a Systems Approach: Experimental Study.
JMIR mHealth and uHealth · 2021-10-12 · Method & validation
Abstract
BACKGROUND: Prehospitalization documentation is a challenging task and prone to loss of information, as paramedics operate under disruptive environments requiring their constant attention to the patients. OBJECTIVE: The aim of this study is to develop a mobile platform for hands-free prehospitalization documentation to assist first responders in operational medical environments by aggregating all existing solutions for noise resiliency and domain adaptation. METHODS: The platform was built to extract meaningful medical information from the real-time audio streaming at the point of injury and transmit complete documentation to a field hospital prior to patient arrival. To this end, the state-of-the-art automatic speech recognition (ASR) solutions with the following modular improvements were thoroughly explored: noise-resilient ASR, multi-style training, customized lexicon, and speech enhancement. The development of the platform was strictly guided by qualitative research and simulation-based evaluation to address the relevant challenges through progressive improvements at every process step of the end-to-end solution. The primary performance metrics included medical word error rate (WER) in machine-transcribed text output and an F1 score calculated by comparing the autogenerated documentation to manual documentation by physicians. RESULTS: The total number of 15,139 individual words necessary for completing the documentation were identified from all conversations that occurred during the physician-supervised simulation drills. The baseline model presented a suboptimal performance with a WER of 69.85% and an F1 score of 0.611. The noise-resilient ASR, multi-style training, and customized lexicon improved the overall performance; the finalized platform achieved a medical WER of 33.3% and an F1 score of 0.81 when compared to manual documentation. The speech enhancement degraded performance with medical WER increased from 33.3% to 46.33% and the corresponding F1 score decreased from 0.81 to 0.78. All changes in performance were statistically significant (P<.001). CONCLUSIONS: This study presented a fully functional mobile platform for hands-free prehospitalization documentation in operational medical environments and lessons learned from its implementation.
Abstract © the authors or publisher, via PubMed. Reuse and removal
Tags
Communication & handover · Paramedics & EMTs · Telemedicine
Related articles
- Speech recognition technology in prehospital documentation: A scoping review. (Int J Med Inform, 2025)
- Designing an App to Overcome Language Barriers in the Delivery of Emergency Medical Services: Participatory Development Process. (JMIR Mhealth Uhealth, 2021)
- Implementation phase of a multicentre prehospital telemedicine system to support paramedics: feasibility and possible limitations. (Scand J Trauma Resusc Emerg Med, 2013)
- Real-time medical control using a wireless audio-video transmission device in a pre-hospital emergency service in Korea. (J Telemed Telecare, 2009)
- A Smart Glass Telemedicine Application for Prehospital Communication: User-Centered Design Study. (J Med Internet Res, 2024)
- Overcoming language barriers in paramedic care: a study protocol of the interventional trial 'DICTUM rescue' evaluating an app designed to improve communication between paramedics and foreign-language patients. (BMC Health Serv Res, 2020)