Nomogram for Predicting Pulmonary Hypertension in Patients without Pulmonary Embolism
Editor:
We read with considerable interest the article by Dr Aviram and colleagues in the October 2015 issue of Radiology entitled “Pulmonary Hypertension: A Nomogram Based on CT Pulmonary Angiographic Data for Prediction in Patients without Pulmonary Embolism” (1). They showed that cardiovascular data derived from computed tomographic (CT) pulmonary angiography were associated with pulmonary hypertension (PH), and they created a nomogram based on patient age and CT pulmonary angiographic data that may facilitate identification of PH in patients who do not have acute pulmonary embolism.
The nomogram is a mathematically simple approach with the ability to reduce statistical predictive models into a single numeric estimate of the probability of an outcome (eg, presence of a disease), facilitating clinical decision making. The generation of these estimates enables the nomogram to be tailored to the personalized profile of a patient (2). Dr Aviram and colleagues reported a good predicting performance of their constructed model; however, the traditional biostatistical methods they used for evaluating models focus solely on accuracy, calibration, and discrimination using metrics such as sensitivity, specificity, or area under the receiver operating characteristic curve (AUC). Although these methods are mathematically simple and generally have an intuitive interpretation, they have little clinical relevance. For example, one cannot tell how high an AUC must be to justify clinical use of a prediction model (3). Its clinical usefulness should be prospectively validated in an independent cohort before its clinical implementation; however, the large sample size needed for prospective validation may make relative research daunting.
To address this issue, decision curve analysis (DCA) might be the desirable method for evaluating the clinical usefulness of a predictive model. DCA is a method for evaluating the benefits of a diagnostic test across a range of patient preferences for accepting risk of undertreatment (false-negative findings) and overtreatment (false-positive findings) to facilitate decisions about test selection and use. The key concept of DCA is that of a “probability threshold,” which indicates a level of diagnostic certainty above which the patient would choose to be treated (4). It can be applied directly to a data set without the need for the sort of external data on costs, benefits, and preferences typically required by traditional decision analytic techniques (5).
Disclosures of Conflicts of Interest: Y.H. disclosed no relevant relationships. C.L. disclosed no relevant relationships. Z.L. disclosed no relevant relationships.References
- 1. . Pulmonary hypertension: a nomogram based on CT pulmonary angiographic data for prediction in patients without pulmonary embolism. Radiology 2015;277(1):236–246. Link, Google Scholar
- 2. . How to build and interpret a nomogram for cancer prognosis. J Clin Oncol 2008;26(8):1364–1370. Crossref, Medline, Google Scholar
- 3. . Extensions to decision curve analysis, a novel method for evaluating diagnostic tests, prediction models and molecular markers. BMC Med Inform Decis Making 2008;8:53. Crossref, Medline, Google Scholar
- 4. . Decision curve analysis. JAMA 2015;313(4):409–410. Crossref, Medline, Google Scholar
- 5. . Decision curve analysis: a novel method for evaluating prediction models. Medical Decision Making 2006;26(6):565–574. Crossref, Medline, Google Scholar
References
- 1. . A nomogram based on CT pulmonary angiography for prediction of pulmonary hypertension in patients without pulmonary embolism. Radiology 2015;277(1):236–246. Link, Google Scholar
- 2. . Decision curve analysis. JAMA 2015;313(4):409–410. Crossref, Medline, Google Scholar
- 3. . Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making 2006;26(6):565–574. Crossref, Medline, Google Scholar
- 4. . Clinical epidemiology: the essentials. Baltimore, Md: Lippincott Williams & Wilkins, 2012. Google Scholar
References
| 1. | Aviram G, Shmueli H, Adam SZ, . Pulmonary hypertension: a nomogram based on CT pulmonary angiographic data for prediction in patients without pulmonary embolism. Radiology 2015;277(1):236–246. Link, Google Scholar |
| 2. | Iasonos A, Schrag D, Raj GV, Panageas KS. How to build and interpret a nomogram for cancer prognosis. J Clin Oncol 2008;26(8):1364–1370. Crossref, Medline, Google Scholar |
| 3. | Vickers AJ, Cronin AM, Elkin EB, Gonen M. Extensions to decision curve analysis, a novel method for evaluating diagnostic tests, prediction models and molecular markers. BMC Med Inform Decis Making 2008;8:53. Crossref, Medline, Google Scholar |
| 4. | Fitzgerald M, Saville BR, Lewis RJ. Decision curve analysis. JAMA 2015;313(4):409–410. Crossref, Medline, Google Scholar |
| 5. | Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Medical Decision Making 2006;26(6):565–574. Crossref, Medline, Google Scholar |
Response
We thank Dr Huang and colleagues for their interest in our article (1), in which we proposed a simple prediction model that can be used as a screening tool for PH among patients whose images from CT pulmonary angiography were negative for pulmonary embolism. The model is based on the patient’s age and four CT-derived measurements (ie, right atrial volume, reflux grade, pulmonary artery diameter, and the ratio between the diameter of the pulmonary artery and the aorta) (1). We built this model on one cohort of patients who underwent CT pulmonary angiography and echocardiography within 24 hours of each other and tested it on another cohort who met the same inclusion criteria and found very similar results (1).
The idea behind the nomogram model is to take advantage of unused quantitative and semi-quantitative data generated by CT pulmonary angiography, which had already been performed for the diagnosis of pulmonary embolism, in order to use it as a screening tool that can alert the clinicians to the possible presence of an alternative diagnosis that could explain the patient’s symptoms (eg, PH).
Dr Huang and colleagues claim that the biostatistical model used should have been based on DCA (2). DCA is a method for evaluating the benefits of a diagnostic test that incorporates clinical consequences of under- or overtreatment (2,3). This is not applicable to the proposed screening tool for PH, which requires high sensitivity (4).
Following the application of the proposed nomogram, it can be expected that clinicians will refer their patients, who show a probability of having PH, to echocardiography for further evaluation rather than directly decide on treatment based on the nomogram alone. We note that our nomogram should be considered as a primary diagnostic tool only after additional experience with its use in a large cohorts of patients. Currently, our prediction model can serve as a screening tool that may alert the clinicians to the presence of PH after exclusion of pulmonary embolism with CT pulmonary angiography.
Disclosures of Conflicts of Interest: G.A. disclosed no relevant relationships. S.B. disclosed no relevant relationships. Y.T. disclosed no relevant relationships. T.Z. disclosed no relevant relationships.References
| 1. | Aviram G, Shmueli H, Adam SZ, . A nomogram based on CT pulmonary angiography for prediction of pulmonary hypertension in patients without pulmonary embolism. Radiology 2015;277(1):236–246. Link, Google Scholar |
| 2. | Fitzgerald M, Saville BR, Lewis RJ. Decision curve analysis. JAMA 2015;313(4):409–410. Crossref, Medline, Google Scholar |
| 3. | Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making 2006;26(6):565–574. Crossref, Medline, Google Scholar |
| 4. | Fletcher RH, Fletcher SW, Fletcher GS. Clinical epidemiology: the essentials. Baltimore, Md: Lippincott Williams & Wilkins, 2012. Google Scholar |
Article History
Published online: June 20 2016Published in print: July 2016







