Evaluation of a Web-Based Tool for Labelling Potential Hospital Outbreaks, a Mixed Methods Study.

BACKGROUND: Labelling outbreaks in surveillance data is necessary to train advanced analytical methods for outbreak detection, but there is a lack of software tools dedicated to this task.

AIM: The goal of this study was to evaluate the usability of a web-based tool by infection control practitioners for labelling potential outbreaks.

METHODS: A mixed-methods design was used to evaluate how 25 experts from France and Canada interacted with a web-based application to identify potential outbreaks. Each expert used the application to retrospectively review eleven to twelve one-year incidence time series from 23 different types of microorganisms. The interactions between the users and the application were recorded and analysed using mixed-effect models. The users' comments were analysed via qualitative methods.

FINDINGS: Over the 240 reviews completed, 439 potential outbreaks were labelled, about half of with a high probability. A significant heterogeneity was observed between users regarding their answers and behaviours (evaluation time, usage of the different options). A significant learning effect was also observed on the experts' interactions with the tool, but it did not seem to impact their answers. The content analysis of the comments highlighted the difficulty of early outbreak identification for practitioners, but also the potential utility of web applications such as the one evaluated for routine surveillance.

CONCLUSION: The interactive web application was both usable and useful for infection control practitioners. Its implementation in routine practice could help professionals identify potential outbreaks while creating data to train automated detection algorithms.