An inter-rater reliability study of a modified version of SATS as a prehospital triage tool.
Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine · 2026-06-12 · Method & validation
Abstract
BACKGROUND: Triage systems play an essential role in allocating patients to an appropriate level of care. Several triage systems are used worldwide, all of which require scientific evaluation of their reliability and validity. Evidence regarding prehospital triage systems remains limited. The South African Triage Scale (SATS) has been adapted for local use in several regions, but modified versions require independent evaluation. The objective of this study was to examine the reliability of a modified version of the triage system, SATS, when it is used in the emergency medical services (EMS) in a region in Sweden. The study also investigated whether triage performance differs among registered nurses with varying experience and competence levels. METHODS: This prospective cross-sectional inter-rater reliability study included 34 registered nurses (RNs) working in the regional EMS. The participants independently triaged 30 prehospital case vignettes via a digital questionnaire, resulting in 1,010 triage assessments. Descriptive data were used. Inter-rater reliability was assessed via Krippendorff's alpha (α) and percentage agreement. Mixed effects logistic regression was performed to explore associations between triage assignment and RN characteristics, including gender, years of experience and specialist education. RESULTS: This study indicated insufficient inter-rater agreement when a modified version of SATS was used in a prehospital setting. Krippendorff's α was 0.60, suggesting poor agreement when triage levels were treated as ordinal data. Full agreement was observed in three case vignettes, whereas agreement across the remaining cases ranged from 32% to 94%. Manual up-triage occurred in 25 of the 30 vignettes, with frequencies ranging from 6% to 74%. No associations were found between assigned triage level and gender, years of EMS experience or specialist education. CONCLUSION: This modified version of SATS demonstrated low inter-rater reliability when applied in a prehospital setting. Agreement varied substantially across patient scenarios, particularly in cases characterized by nonspecific symptoms and near-normal vital signs. These findings underscore the importance of systematic evaluation of modified triage systems to support consistent decision-making and patient safety in prehospital care.
Abstract © the authors or publisher, via PubMed. Reuse and removal
Tags
Ambulance & prehospital nurses · Triage instruments
Related articles
- Implementation of the South African Triage Scale (SATS) in a New Ambulance System in Beira, Mozambique: A Retrospective Observational Study. (Int J Environ Res Public Health, 2022)
- Do prehospital providers and emergency nurses agree on triage assignment?: an efficacy study. (Eur J Emerg Med, 2019)
- Interrater agreement of Canadian Emergency Department Triage and Acuity Scale scores assigned by base hospital and emergency department nurses. (CJEM, 2010)
- The performance of the EMS triage (RETTS-p) and the agreement between the field assessment and final hospital diagnosis: a prospective observational study among children < 16 years. (BMC Pediatr, 2019)
- Pre-hospital triage performance and emergency medical services nurse's field assessment in an unselected patient population attended to by the emergency medical services: a prospective observational study. (Scand J Trauma Resusc Emerg Med, 2020)
- Triage decisions of prehospital emergency health care providers, using a multiple casualty scenario paper exercise. (Emerg Med J, 2002)