Original ResearchFree Access

Computer-aided Detection of Masses at Mammography: Interactive Decision Support versus Prompts

Published Online:https://doi.org/10.1148/radiol.12120218

The interactive use of the results from computer-aided detection (CAD) as decision support for detection of malignant masses on mammograms may be more effective than the current use of CAD, which is aimed at prevention of perceptual oversights.

Purpose

To compare effectiveness of an interactive computer-aided detection (CAD) system, in which CAD marks and their associated suspiciousness scores remain hidden unless their location is queried by the reader, with the effect of traditional CAD prompts used in current clinical practice for the detection of malignant masses on full-field digital mammograms.

Materials and Methods

The requirement for institutional review board approval was waived for this retrospective observer study. Nine certified screening radiologists and three residents who were trained in breast imaging read 200 studies (63 studies containing at least one screen-detected mass, 17 false-negative studies, 20 false-positive studies, and 100 normal studies) twice, once with CAD prompts and once with interactive CAD. Localized findings were reported and scored by the readers. In the prompted mode, findings were recorded before and after activation of CAD. The partial area under the location receiver operating characteristic (ROC) curve for an interval of low false-positive fractions typical for screening, from 0 to 0.2, was computed for each reader and each mode. Differences in reader performance were analyzed by using software.

Results

The average partial area under the location ROC curve with unaided reading was 0.57, and it increased to 0.62 with interactive CAD, while it remained unaffected by prompts. The difference in reader performance for unaided reading versus interactive CAD was statistically significant (P = .009).

Conclusion

When used as decision support, interactive use of CAD for malignant masses on mammograms may be more effective than the current use of CAD, which is aimed at the prevention of perceptual oversights.

© RSNA, 2012

References

  • 1 Gilbert FJ, Astley SM, Gillan MG et al.. Single reading with computer-aided detection for screening mammography. N Engl J Med 2008;359(16):1675–1684. Crossref, MedlineGoogle Scholar
  • 2 Morton MJ, Whaley DH, Brandt KR, Amrami KK. Screening mammograms: interpretation with computer-aided detection—prospective evaluation. Radiology 2006;239(2):375–383. LinkGoogle Scholar
  • 3 Dean JC, Ilvento CC. Improved cancer detection using computer-aided detection with diagnostic and screening mammography: prospective study of 104 cancers. AJR Am J Roentgenol 2006;187(1):20–28. Crossref, MedlineGoogle Scholar
  • 4 Nishikawa RM. Current status and future directions of computer-aided diagnosis in mammography. Comput Med Imaging Graph 2007;31(4-5):224–235. Crossref, MedlineGoogle Scholar
  • 5 Fenton JJ, Abraham L, Taplin SH et al.. Effectiveness of computer-aided detection in community mammography practice. J Natl Cancer Inst 2011;103(15):1152–1161. Crossref, MedlineGoogle Scholar
  • 6 Taylor P, Potts HW. Computer aids and human second reading as interventions in screening mammography: two systematic reviews to compare effects on cancer detection and recall rate. Eur J Cancer 2008;44(6):798–807. Crossref, MedlineGoogle Scholar
  • 7 Fenton JJ, Taplin SH, Carney PA et al.. Influence of computer-aided detection on performance of screening mammography. N Engl J Med 2007;356(14):1399–1409. Crossref, MedlineGoogle Scholar
  • 8 Gur D, Stalder JS, Hardesty LA et al.. Computer-aided detection performance in mammographic examination of masses: assessment. Radiology 2004;233(2):418–423. LinkGoogle Scholar
  • 9 Houssami N, Given-Wilson R, Ciatto S. Early detection of breast cancer: overview of the evidence on computer-aided detection in mammography screening. J Med Imaging Radiat Oncol 2009;53(2):171–176. Crossref, MedlineGoogle Scholar
  • 10 Alberdi E, Povyakalo AA, Strigini L, Ayton P, Given-Wilson R. CAD in mammography: lesion-level versus case-level analysis of the effects of prompts on human decisions. Int J CARS 2008;3(1-2):115–122. CrossrefGoogle Scholar
  • 11 Blanks RG, Wallis MG, Given-Wilson RM. Observer variability in cancer detection during routine repeat (incident) mammographic screening in a study of two versus one view mammography. J Med Screen 1999;6(3):152–158. Crossref, MedlineGoogle Scholar
  • 12 Mello-Thoms C. Perception of breast cancer: eye-position analysis of mammogram interpretation. Acad Radiol 2003;10(1):4–12. Crossref, MedlineGoogle Scholar
  • 13 Karssemeijer N, Otten JD, Verbeek AL et al.. Computer-aided detection versus independent double reading of masses on mammograms. Radiology 2003;227(1):192–200. LinkGoogle Scholar
  • 14 Karssemeijer N, Otten JD, Rijken H, Holland R. Computer aided detection of masses in mammograms as decision support. Br J Radiol 2006;79(Spec No 2):S123–S126. Crossref, MedlineGoogle Scholar
  • 15 Horsch K, Giger ML, Vyborny CJ, Lan L, Mendelson EB, Hendrick RE. Classification of breast lesions with multimodality computer-aided diagnosis: observer study results on an independent clinical data set. Radiology 2006;240(2):357–368. LinkGoogle Scholar
  • 16 Tourassi GD, Harrawood B, Singh S, Lo JY, Floyd CE. Evaluation of information-theoretic similarity measures for content-based retrieval and detection of masses in mammograms. Med Phys 2007;34(1):140–150. Crossref, MedlineGoogle Scholar
  • 17 Zheng B, Mello-Thoms C, Wang XH et al.. Interactive computer-aided diagnosis of breast masses: computerized selection of visually similar image sets from a reference library. Acad Radiol 2007;14(8):917–927. Crossref, MedlineGoogle Scholar
  • 18 Samulski M, Hupse R, Boetes C, Mus RD, den Heeten GJ, Karssemeijer N. Using computer-aided detection in mammography as a decision support. Eur Radiol 2010;20(10):2323–2330. Crossref, MedlineGoogle Scholar
  • 19 Karssemeijer N, Bluekens AM, Beijerinck D et al.. Breast cancer screening results 5 years after introduction of digital mammography in a population-based screening program. Radiology 2009;253(2):353–358. LinkGoogle Scholar
  • 20 Samulski MR, Snoeren PR, Platel B et al.. Computer-aided detection as a decision assistant in chest radiography. In: Editor A, Editor B, eds. Proceedings of SPIE: medical imaging 2011—title. Vol 7966. Bellingham, Wash: SPIE–The International Society for Optical Engineering, 2011; 796614. CrossrefGoogle Scholar
  • 21 Hupse R, Karssemeijer N. The use of contextual information for computer aided detection of masses in mammograms. In: Editor A, Editor B, eds. Proceedings of SPIE: medical imaging 2009—title. Vol 7260. Bellingham, Wash: SPIE–The International Society for Optical Engineering, 2009; 72600Q. CrossrefGoogle Scholar
  • 22 Kallenberg M, Karssemeijer N. Computer-aided detection of masses in full-field digital mammography using screen-film mammograms for training. Phys Med Biol 2008;53(23):6879–6891. Crossref, MedlineGoogle Scholar
  • 23 Zheng B, Tan J, Ganott MA, Chough DM, Gur D. Matching breast masses depicted on different views a comparison of three methods. Acad Radiol 2009;16(11):1338–1347. Crossref, MedlineGoogle Scholar
  • 24 van Engeland S, Karssemeijer N. Combining two mammographic projections in a computer aided mass detection method. Med Phys 2007;34(3):898–905. Crossref, MedlineGoogle Scholar
  • 25 Chang YH, Good WF, Sumkin JH, Zheng B, Gur D. Computerized localization of breast lesions from two views. An experimental comparison of two methods. Invest Radiol 1999;34(9):585–588. Crossref, MedlineGoogle Scholar
  • 26 Roelofs A, van Woudenberg S, Hendriks J, Evertsz C, Karssemeijer N. Effects of computer-aided diagnosis on radiologists’ detection of breast masses. IWDM: Proceedings of the 7th International Workshop on Digital Mammography, 2004; 219–224. Google Scholar
  • 27 Dorfman DD, Berbaum KS, Metz CE. Receiver operating characteristic rating analysis. Generalization to the population of readers and patients with the jackknife method. Invest Radiol 1992;27(9):723–731. Crossref, MedlineGoogle Scholar
  • 28 Beiden SV, Wagner RF, Doi K et al.. Independent versus sequential reading in ROC studies of computer-assist modalities: analysis of components of variance. Acad Radiol 2002;9(9):1036–1043. Crossref, MedlineGoogle Scholar

Article History

Received February 7, 2012; revision requested March 26; revision received May 28; accepted June 6; final version accepted June 18.
Published online: Jan 2013
Published in print: Jan 2013