Start Submission Become a Reviewer

Reading: Statistical Power for Postlicensure Medical Product Safety Data Mining

Download

A- A+
dyslexia friendly

Empirical research

Statistical Power for Postlicensure Medical Product Safety Data Mining

Authors:

Judith C. Maro ,

Harvard Medical School and Harvard Pilgrim Health Care Institute
About Judith C.
PhD
X close

Michael D. Nguyen,

U.S. Food and Drug Administration
About Michael D.
MD
X close

Inna Dashevsky,

Harvard Medical School and Harvard Pilgrim Health Care Institute
About Inna
MS
X close

Meghan A. Baker,

Harvard Medical School and Harvard Pilgrim Health Care Institute
About Meghan A.
MD, PhD
X close

Martin Kulldorff

Harvard Medical School and Brigham and Women's Hospital
About Martin
PhD
X close

Abstract

Objective: To perform sample size calculations when using tree-based scan statistics in longitudinal observational databases.

Methods: Tree-based scan statistics enable data mining on epidemiologic datasets where thousands of disease outcomes are organized into hierarchical tree structures with automatic adjustment for multiple testing. We show how to evaluate the statistical power of the unconditional and conditional Poisson versions. The null hypothesis is that there is no increase in the risk for any of the outcomes. The alternative is that one or more outcomes have an excess risk. We varied the excess risk, total sample size, frequency of the underlying event rate, and the level of across-the-board health care utilization. We also quantified the reduction in statistical power resulting from specifying a risk window that was too long or too short.

Results: For 500,000 exposed people, we had at least 98 percent power to detect an excess risk of 1 event per 10,000 exposed for all outcomes. In the presence of potential temporal confounding due to across-the-board elevations of health care utilization in the risk window, the conditional tree-based scan statistic controlled type I error well, while the unconditional version did not.

Discussion: Data mining analyses using tree-based scan statistics expand the pharmacovigilance toolbox, ensuring adequate monitoring of thousands of outcomes of interest while controlling for multiple hypothesis testing. These power evaluations enable investigators to design and optimize implementation of retrospective data mining analyses.

How to Cite: Maro JC, Nguyen MD, Dashevsky I, Baker MA, Kulldorff M. Statistical Power for Postlicensure Medical Product Safety Data Mining. eGEMs (Generating Evidence & Methods to improve patient outcomes). 2017;5(1):6. DOI: http://doi.org/10.13063/egems.1264
4
Views
Published on 12 Jun 2017.
Peer Reviewed

Downloads

  • PDF (EN)