Statistical visualization for assessing performance of methods for safety surveillance using electronic databases

Xiaochun Li, Siu Hui, Patrick Ryan, Marc Rosenman, Marc Overhage
Pharmacoepidemiology and Drug Safety 2013, 22 (5): 503-9

PURPOSE: The success of an epidemiological study for drug safety surveillance or comparative effectiveness depends largely on design and analysis strategies besides data quality. The Observational Medical Outcomes Partnership (OMOP) methods community implemented a collection of statistical methods with extensive parameters allowing a wide variety of designs and analyses. Our objective was to develop a visualization tool to explore which parameter settings may enable better predictive properties for a given method in a database.

METHODS: Performance measures were produced for each setting, including sensitivity (recall), specificity (1-FPR), AUC, MAP, and P(k). Multiple regressions with relevant parameters as main effects were run for performance measures on all test cases and subgroups. Heatmaps with sequential palettes to indicate the parameters' impacts on performance measures were generated based on matrices of the standardized coefficients (t-statistics) by parameter settings and test case subgroups.

RESULTS: Heatmaps help researchers to explore design and analysis options of methods for evaluating a variety of drug-outcome relationships and also to explore data issues.

CONCLUSIONS: Statistical visualization through heatmaps is a useful tool for summarizing and presenting method performance results and for the exploration of the parameter settings for method performance characteristics and data limitations.

Full Text Links

Find Full Text Links for this Article


You are not logged in. Sign Up or Log In to join the discussion.

Related Papers

Remove bar
Read by QxMD icon Read

Save your favorite articles in one place with a free QxMD account.


Search Tips

Use Boolean operators: AND/OR

diabetic AND foot
diabetes OR diabetic

Exclude a word using the 'minus' sign

Virchow -triad

Use Parentheses

water AND (cup OR glass)

Add an asterisk (*) at end of a word to include word stems

Neuro* will search for Neurology, Neuroscientist, Neurological, and so on

Use quotes to search for an exact phrase

"primary prevention of cancer"
(heart or cardiac or cardio*) AND arrest -"American Heart Association"