Reliability and validity of the Manchester Triage System in a general emergency department patient population in the Netherlands: results of a simulation study

I van der Wulp, M E van Baar, A J P Schrijvers
Emergency Medicine Journal: EMJ 2008, 25 (7): 431-4

OBJECTIVE: To assess the reliability and validity of the Manchester Triage System (MTS) in a general emergency department patient population.

METHODS: A prospective evaluation study was conducted in two general hospitals in the Netherlands. Emergency department nurses from both hospitals triaged 50 patient vignettes into one of five triage categories in the MTS. Triage ratings were compared with the ratings of two Dutch MTS experts to measure inter-rater reliability. Nineteen days after triaging the patient vignettes, triage nurses were asked to rate the same vignettes again to measure test-retest reliability. Reliability in relation to the work experience of emergency department nurses was also studied. Validity was assessed by calculating percentages for overtriage, undertriage, sensitivity and specificity.

RESULTS: Inter-rater reliability was "substantial" (weighted kappa 0.62 (95% CI 0.60 to 0.65)) and test-retest reliability was high (intraclass correlation coefficient 0.75 (95% CI 0.72 to 0.77)). No significant association was found between the experience of emergency department nurses and the reliability score (kappa). Undertriage occurred more frequently than overtriage, especially in elderly patients (25.3% vs 7.6%). Sensitivity for urgent patients in the MTS was 53.2% and specificity was 95.1%. The patient vignettes representing children aged <16 years revealed a higher sensitivity (83.3%).

CONCLUSIONS: Inter-rater reliability is "moderate" to "substantial" and test-retest reliability is high. The reliability of the MTS is not influenced by nurses' work experience. Undertriage mainly occurs in the MTS categories orange and yellow. The MTS is more sensitive for children who need immediate or urgent care than for other patients in the emergency department.

Full Text Links

Find Full Text Links for this Article


You are not logged in. Sign Up or Log In to join the discussion.

Trending Papers

Remove bar
Read by QxMD icon Read

Save your favorite articles in one place with a free QxMD account.


Search Tips

Use Boolean operators: AND/OR

diabetic AND foot
diabetes OR diabetic

Exclude a word using the 'minus' sign

Virchow -triad

Use Parentheses

water AND (cup OR glass)

Add an asterisk (*) at end of a word to include word stems

Neuro* will search for Neurology, Neuroscientist, Neurological, and so on

Use quotes to search for an exact phrase

"primary prevention of cancer"
(heart or cardiac or cardio*) AND arrest -"American Heart Association"