We have located links that may give you full text access.
Use of ROC curve analysis for prediction gives fallacious results: Use predictivity-based indices.
Journal of Postgraduate Medicine 2024 April 19
The area under the ROC curve is frequently used for assessing the predictive efficacy of a model, and the Youden index is commonly used to provide the optimal cut-off. Both are misleading tools for predictions. A ROC curve is drawn for the sensitivity of a quantitative test against its (1 - specificity) at different values of the test. Both sensitivity and specificity are retrospective in nature as these are indicators of correct classification of already known conditions. They are not indicators of future events and are not valid for predictions. Predictivity intimately depends on the prevalence which may be ignored by sensitivity and specificity. We explain this fallacy in detail and illustrate with several examples that the actual predictivity could differ greatly from the ROC curve-based predictivity reported by many authors. The predictive efficacy of a test or a model is best assessed by the percentage correctly predicted in a prospective framework. We propose predictivity-based ROC curves as tools for providing predictivities at varying prevalence in different populations. For optimal cut-off for prediction, in place of the Youden index, we propose a P-index where the sum of positive and negative predictivities is maximum after subtracting 1. To conclude, for correctly assessing adequacy of a prediction models, predictivity-based ROC curves should be used instead of the usual sensitivity-specificity-based ROC curves and the P-index should replace the Youden index.
Full text links
Related Resources
Trending Papers
Angiotensin Receptor Blocker-Neprilysin Inhibitor for Heart Failure with Reduced Ejection Fraction.Pharmacological Research : the Official Journal of the Italian Pharmacological Society 2024 May 12
Hemodynamic Support in Sepsis.Anesthesiology 2024 June 2
The Therapy and Management of Heart Failure with Preserved Ejection Fraction: New Insights on Treatment.Cardiac Failure Review 2024
European Respiratory Society Clinical Practice Guideline on symptom management for adults with serious respiratory illness.European Respiratory Journal 2024 May 9
Axillary Surgery for Breast Cancer in 2024.Cancers 2024 April 24
Get seemless 1-tap access through your institution/university
For the best experience, use the Read mobile app
All material on this website is protected by copyright, Copyright © 1994-2024 by WebMD LLC.
This website also contains material copyrighted by 3rd parties.
By using this service, you agree to our terms of use and privacy policy.
Your Privacy Choices
You can now claim free CME credits for this literature searchClaim now
Get seemless 1-tap access through your institution/university
For the best experience, use the Read mobile app