CLINICAL TRIAL
COMPARATIVE STUDY
JOURNAL ARTICLE
MULTICENTER STUDY
Add like
Add dislike
Add to saved papers

A comparison of performance of mathematical predictive methods for medical diagnosis: identifying acute cardiac ischemia among emergency department patients.

BACKGROUND: There is increasing interest in mathematical methods for the prediction of medical outcomes. Three methods have attracted particular attention: logistic regression, classification trees (such as ID3 and CART), and neural networks. To compare their relative performance, we used a large clinical database to develop and compare models using these methods.

METHODS: Each modeling method was used to generate predictive instruments for acute cardiac ischemia (which includes acute myocardial infarction and unstable angina pectoris), using prospectivel-collected clinical data on 5773 patients, who presented over a two year period to six hospitals' emergency departments with chest pain or symptoms suggesting acute ischemia. This data set was then split into training (n = 3453) and test (n = 2320) sets. Of 200 available variables, modeling was restricted to those available within the first 10 minutes of emergency department care (history, physical exam, and electrocardiogram).

RESULTS: When the number of variables was limited to eight, representing a practical number for input in the real-time clinical setting, the logistic regression's receiver-operating characteristic (ROC) curve area, as a measure of diagnostic performance, was 0.887; the classification tree model's ROC curve area was 0.858, and the neural network's ROC curve area was 0.902. When the number of variables used by a model was not limited, the logistic regression's ROC area was 0.905, the classification tree model's 0.861, and the neural network's 0.923. Among these models the neural networks had noticeably poorer calibration. When the outputs from each of these unrestricted models were presented to each of the other methods as an additional independent variable, the ROC areas of the new "hybrid" models were not significantly better than the original unlimited models (ROC areas 0.858 to 0.920).

CONCLUSIONS: Logistic regression, classification tree, and neural network models all can provide excellent predictive performance of medical outcomes for clinical decision aids and policy models. Their ultimate limitations seem due to the availability of the information in data (a "data barrier") rather than their respective intrinsic properties. Choices between these methods would seem to be most appropriately based on the needs of the specific application, rather than on the premise that any one of these methods is intrinsically more powerful.

Full text links

We have located links that may give you full text access.
Can't access the paper?
Try logging in through your university/institutional subscription. For a smoother one-click institutional access experience, please use our mobile app.

For the best experience, use the Read mobile app

Mobile app image

Get seemless 1-tap access through your institution/university

For the best experience, use the Read mobile app

All material on this website is protected by copyright, Copyright © 1994-2024 by WebMD LLC.
This website also contains material copyrighted by 3rd parties.

By using this service, you agree to our terms of use and privacy policy.

Your Privacy Choices Toggle icon

You can now claim free CME credits for this literature searchClaim now

Get seemless 1-tap access through your institution/university

For the best experience, use the Read mobile app