We have located links that may give you full text access.
Journal Article
Review
Cherry-picking by trialists and meta-analysts can drive conclusions about intervention efficacy.
Journal of Clinical Epidemiology 2017 November
OBJECTIVES: The objective of this study was to determine whether disagreements among multiple data sources affect systematic reviews of randomized clinical trials (RCTs).
STUDY DESIGN AND SETTING: Eligible RCTs examined gabapentin for neuropathic pain and quetiapine for bipolar depression, reported in public (e.g., journal articles) and nonpublic sources (clinical study reports [CSRs] and individual participant data [IPD]).
RESULTS: We found 21 gabapentin RCTs (74 reports, 6 IPD) and 7 quetiapine RCTs (50 reports, 1 IPD); most were reported in journal articles (18/21 [86%] and 6/7 [86%], respectively). When available, CSRs contained the most trial design and risk of bias information. CSRs and IPD contained the most results. For the outcome domains "pain intensity" (gabapentin) and "depression" (quetiapine), we found single trials with 68 and 98 different meta-analyzable results, respectively; by purposefully selecting one meta-analyzable result for each RCT, we could change the overall result for pain intensity from effective (standardized mean difference [SMD] = -0.45; 95% confidence interval [CI]: -0.63 to -0.27) to ineffective (SMD = -0.06; 95% CI: -0.24 to 0.12). We could change the effect for depression from a medium effect (SMD = -0.55; 95% CI: -0.85 to -0.25) to a small effect (SMD = -0.26; 95% CI: -0.41 to -0.1).
CONCLUSIONS: Disagreements across data sources affect the effect size, statistical significance, and interpretation of trials and meta-analyses.
STUDY DESIGN AND SETTING: Eligible RCTs examined gabapentin for neuropathic pain and quetiapine for bipolar depression, reported in public (e.g., journal articles) and nonpublic sources (clinical study reports [CSRs] and individual participant data [IPD]).
RESULTS: We found 21 gabapentin RCTs (74 reports, 6 IPD) and 7 quetiapine RCTs (50 reports, 1 IPD); most were reported in journal articles (18/21 [86%] and 6/7 [86%], respectively). When available, CSRs contained the most trial design and risk of bias information. CSRs and IPD contained the most results. For the outcome domains "pain intensity" (gabapentin) and "depression" (quetiapine), we found single trials with 68 and 98 different meta-analyzable results, respectively; by purposefully selecting one meta-analyzable result for each RCT, we could change the overall result for pain intensity from effective (standardized mean difference [SMD] = -0.45; 95% confidence interval [CI]: -0.63 to -0.27) to ineffective (SMD = -0.06; 95% CI: -0.24 to 0.12). We could change the effect for depression from a medium effect (SMD = -0.55; 95% CI: -0.85 to -0.25) to a small effect (SMD = -0.26; 95% CI: -0.41 to -0.1).
CONCLUSIONS: Disagreements across data sources affect the effect size, statistical significance, and interpretation of trials and meta-analyses.
Full text links
Related Resources
Get seemless 1-tap access through your institution/university
For the best experience, use the Read mobile app
All material on this website is protected by copyright, Copyright © 1994-2024 by WebMD LLC.
This website also contains material copyrighted by 3rd parties.
By using this service, you agree to our terms of use and privacy policy.
Your Privacy Choices
You can now claim free CME credits for this literature searchClaim now
Get seemless 1-tap access through your institution/university
For the best experience, use the Read mobile app