We have located links that may give you full text access.
JOURNAL ARTICLE
REVIEW
SYSTEMATIC REVIEW
The Fragility of Statistically Significant Results in Pediatric Orthopaedic Randomized Controlled Trials as Quantified by the Fragility Index: A Systematic Review.
Journal of Pediatric Orthopedics 2018 September
BACKGROUND: The randomized controlled trial (RCT) is the gold standard study design allowing critical comparison of clinical outcomes while minimizing bias. Traditionally clinical trials are evaluated through statistical significance, expressed by P-values and confidence intervals. However, until recently, the robustness of a study's conclusions has been given little attention. A new metric, the fragility index, quantifies the number of patients theoretically required to switch outcomes in order to reverse the study conclusions. The primary aim of our work was to determine the fragility index of RCTs in the pediatric orthopaedic literature. The secondary aim was to determine study factors associated with lower fragility index.
METHODS: Pubmed and Embase were systematically searched for pediatric orthopaedic RCTs published September 1, 2006 to September 1, 2016. Two independent reviewers screened titles, abstracts, and manuscripts to identify studies published in English involving 2 treatment arms. Trials without dichotomous primary or secondary outcomes or with patients >18 years were excluded. Data were extracted from each eligible article in duplicate and the fragility index was determined using Fisher exact test, with previously published methods. Univariate analysis was used to determine factors associated with lower fragility index.
RESULTS: Seventeen trials were eligible for inclusion. The median treatment arm size was 58 and overall sample size was 116 patients. The median fragility index was 3 (range, 0 to 18). A fragility index of 3 means that just 3 patients would need to switch treatment outcomes in order for the trial results to become statistically nonsignificant. In 1 study, the number of patients lost to follow-up exceeded the fragility index, such that the study conclusions could be completely reversed purely depending on the outcomes of the patients lost to follow-up. Lower fragility index was associated with smaller patient sample sizes and greater P-values.
CONCLUSIONS: The fragility index is a useful adjunct metric to the P-value and confidence intervals, allowing analysis of the robustness of study conclusions. RCTs in pediatric orthopaedics often have small sample sizes, many with low fragility indices. Future efforts could focus on encouraging institutional collaboration and patient recruitment with the ultimate goal of improving RCT sample sizes, and potentially improving the robustness of RCT results.
LEVEL OF EVIDENCE: Level I.
METHODS: Pubmed and Embase were systematically searched for pediatric orthopaedic RCTs published September 1, 2006 to September 1, 2016. Two independent reviewers screened titles, abstracts, and manuscripts to identify studies published in English involving 2 treatment arms. Trials without dichotomous primary or secondary outcomes or with patients >18 years were excluded. Data were extracted from each eligible article in duplicate and the fragility index was determined using Fisher exact test, with previously published methods. Univariate analysis was used to determine factors associated with lower fragility index.
RESULTS: Seventeen trials were eligible for inclusion. The median treatment arm size was 58 and overall sample size was 116 patients. The median fragility index was 3 (range, 0 to 18). A fragility index of 3 means that just 3 patients would need to switch treatment outcomes in order for the trial results to become statistically nonsignificant. In 1 study, the number of patients lost to follow-up exceeded the fragility index, such that the study conclusions could be completely reversed purely depending on the outcomes of the patients lost to follow-up. Lower fragility index was associated with smaller patient sample sizes and greater P-values.
CONCLUSIONS: The fragility index is a useful adjunct metric to the P-value and confidence intervals, allowing analysis of the robustness of study conclusions. RCTs in pediatric orthopaedics often have small sample sizes, many with low fragility indices. Future efforts could focus on encouraging institutional collaboration and patient recruitment with the ultimate goal of improving RCT sample sizes, and potentially improving the robustness of RCT results.
LEVEL OF EVIDENCE: Level I.
Full text links
Related Resources
Trending Papers
Challenges in Septic Shock: From New Hemodynamics to Blood Purification Therapies.Journal of Personalized Medicine 2024 Februrary 4
Molecular Targets of Novel Therapeutics for Diabetic Kidney Disease: A New Era of Nephroprotection.International Journal of Molecular Sciences 2024 April 4
Perioperative echocardiographic strain analysis: what anesthesiologists should know.Canadian Journal of Anaesthesia 2024 April 11
The 'Ten Commandments' for the 2023 European Society of Cardiology guidelines for the management of endocarditis.European Heart Journal 2024 April 18
Get seemless 1-tap access through your institution/university
For the best experience, use the Read mobile app
All material on this website is protected by copyright, Copyright © 1994-2024 by WebMD LLC.
This website also contains material copyrighted by 3rd parties.
By using this service, you agree to our terms of use and privacy policy.
Your Privacy Choices
You can now claim free CME credits for this literature searchClaim now
Get seemless 1-tap access through your institution/university
For the best experience, use the Read mobile app