Applying pragmatic approaches to complex program evaluation: a case study of implementation of the New South Wales Get Healthy at Work program.

ISSUE ADDRESSED: Complex health promotion programs, which can have multi-levels of implementation and multi-components with non-linear causal pathways, present many evaluation challenges. Traditional evaluation methods often fail to account for the complexity inherent in assessing these programs. In real-world settings, evaluations of complex programs are often beset by additional constraints of limited budgets and short timeframes. Determining whether a complex program is successful and how a program worked, requires evaluators of complex programs to adopt a level of pragmatism.

METHODS: This paper describes a pragmatic evaluation approach used to evaluate the Get Healthy at Work workplace health promotion program, implemented in New South Wales, Australia. Using the program as a case study, we describe some key principles for applying a pragmatic evaluation approach and use these principles to develop an appropriate evaluation strategy.

RESULTS: The evaluation includes multiple research methods to assess program outputs and implementation; and identify emergent program impacts, within constrained resources. The evaluation was guided by epistemological flexibility, methodological comprehensiveness and operational practicality.

CONCLUSION: Health promotion programs, such as state-wide obesity prevention programs, requires appropriate evaluation methods which addresses their inherent complexity amidst the real-world evaluation constraints, and focuses on the essential evaluation needs.

SO WHAT: The main complex program evaluation principles are applicable to other multilevel health promotion programs, challenged by methodological and practical or political constraints. This article is protected by copyright. All rights reserved.