Neuroradiology

Intracranial Aneurysms at MR Angiography: Effect of Computer-aided Diagnosis on Radiologists' Detection Performance

Published Online:Nov 1 2005https://doi.org/10.1148/radiol.2372041734

Abstract

PURPOSE: To retrospectively evaluate the effect of computer-aided detection (CAD) on radiologists' performance in detection of intracranial aneurysms with magnetic resonance (MR) angiography.

MATERIALS AND METHODS: The institutional review board approved this study and did not require patient informed consent. Fifty maximum intensity projection MR angiograms in 50 patients were used for observer performance study. The group included 22 patients (age range, 43–86 years; mean, 60.2 years; 6 men and 16 women) with intracranial aneurysms and 28 patients (age range, 32–80 years; mean, 58.8 years; 10 men and 18 women) without aneurysms. The MR angiograms were obtained with three-dimensional time-of-flight 1.5-T MR imaging. Fifteen radiologists, including eight neuroradiologists and seven general radiologists, participated in the observer performance test. They interpreted the angiograms first without and then with the aid of the computer output by using an automated computerized scheme. The observers' performance without and with the computer output was evaluated with receiver operating characteristic analysis.

RESULTS: For all 15 observers, average area under the receiver operating characteristic curve (A_z) value for detection of aneurysms was increased significantly from 0.931 to 0.983 (P = .001) when they used the computer output. A_z values for general radiologists and neuroradiologists increased from 0.894 to 0.983 (P = .022) and from 0.963 to 0.984 (P = .014), respectively. Improvement in the performance of general radiologists in terms of the A_z value was much greater than that of neuroradiologists. Performance of general radiologists with CAD (A_z = 0.983) slightly exceeded that of neuroradiologists without CAD (A_z = 0.963) (P = .048).

CONCLUSION: CAD improved neuroradiologists' and general radiologists' performance for detection of intracranial aneurysms with MR angiography; improvement was greater for general radiologists than it was for neuroradiologists.

References

1 WardlawJM, White PM. The detection and management of unruptured intracranial aneurysms. Brain2000;123:205–221.
Medline Google Scholar
2 International Study of Unruptured Intracranial Aneurysms Investigators. Unruptured intracranial aneurysms: risk of rupture and risks of surgical intervention. N Engl J Med 1998; 339:1725–1733.
Medline Google Scholar
3 ChangHS, Kirino T. Quantification of operative benefit for unruptured cerebral aneurysms: a theoretical approach. J Neurosurg1995;83:413–420.
Medline Google Scholar
4 LeblancR, Worsley KJ. Surgery of unruptured, asymptomatic aneurysms: a decision analysis. Can J Neurol Sci1995;22:30–35.
Medline Google Scholar
5 International Study of Unruptured Intracranial Aneurysms Investigators. Unruptured intracranial aneurysms: natural history, clinical outcome, and risks of surgical and endovascular treatment. Lancet 2003; 362:103–110.
Medline Google Scholar
6 WhitePM, Wardlaw JM, Easton V. Can noninvasive imaging accurately depict intracranial aneurysms? a systematic review. Radiology2000;217:361–370.
Google Scholar
7 RuggieriPM, Poulos N, Masaryk TJ, et al. Occult intracranial aneurysms in polycystic kidney disease: screening with MR angiography. Radiology1994;191:33–39.
Google Scholar
8 RonkainenA, Puranen MI, Hernesniemi JA, et al. Intracranial aneurysms: MR angiographic screening in 400 asymptomatic individuals with increased familial risk. Radiology1995;195:35–40.
Google Scholar
9 RaaymakersTW, Buys PC, Verbeeten B Jr, et al. MR angiography as a screening tool for intracranial aneurysms: feasibility, test characteristics, and interobserver agreement. AJR Am J Roentgenol1999;173:1469–1475.
Medline Google Scholar
10 BabaY, Takahashi M, Korogi Y. Cost-effectiveness of screening unruptured cerebral aneurysms in Japan. Eur Radiol2000; 10:S362–S365.
Medline Google Scholar
11 KorogiY, Takahashi M, Mabuchi N, et al. Intracranial aneurysms: diagnostic accuracy of three-dimensional, Fourier transform, time-of-flight MR angiography. Radiology1994;193:181–186.
Google Scholar
12 KorogiY, Takahashi M, Mabuchi N, et al. Intracranial aneurysms: diagnostic accuracy of MR angiography with evaluation of maximum intensity projection and source images. Radiology1996;199:199–207.
Google Scholar
13 FreerTW, Ulissey MJ. Screening mammography with computer-aided detection: prospective study of 12,860 patients in a community breast center. Radiology2001;220:781–786.
Google Scholar
14 DestounisSV, DiNitto P, Logan-Young W, Bonaccio E, Zuley ML, Willison KM. Can computer-aided detection with double reading of screening mammograms help decrease the false-negative rate? initial experience. Radiology2004;232:578–584.
Google Scholar
15 MacMahonH, Engelmann R, Behlen FM, et al. Computer-aided diagnosis of pulmonary nodules: results of a large-scale observer test. Radiology1999;213:723–726.
Google Scholar
16 ShiraishiJ, Abe H, Engelmann R, Aoyama M, MacMahon H, Doi K. Computer-aided diagnosis to distinguish benign from malignant solitary pulmonary nodules on radiographs: ROC analysis of radiologists' performance—initial experience. Radiology2003;227:469–474.
Google Scholar
17 AwaiK, Murao K, Ozawa A, et al. Pulmonary nodules at chest CT: effect of computer-aided diagnosis on radiologists' detection performance. Radiology2004;230:347–352.
Google Scholar
18 ArimuraH, Li Q, Korogi Y, et al. Automated computerized scheme for detection of unruptured intracranial aneurysms in three-dimensional MRA. Acad Radiol2004;11:1093–1104.
Medline Google Scholar
19 KobayashiT, Xu XW, MacMahon H, Metz CE, Doi K. Effect of a computer-aided diagnosis scheme on radiologists' performance in detection of lung nodules on radiographs. Radiology1996;199:843–848.
Google Scholar
20 MetzCE, Herman BA, Shen JH. Maximum-likelihood estimation of receiver operating (ROC) characteristic curves from continuously-distributed data. Stat Med1998;17:1033–1053.
Medline Google Scholar

Article History

Published in print: Nov 2005

Vol. 237, No. 2

Metrics

Altmetric Score

PDF download