"skipMainNavigation"
closeDrawerMenuopenDrawerMenu
Search
Quick Search in Journals
Quick Search anywhere
Advanced Search
Radiology
Menu
  • Information
    • Previous
    Next
    Original Research

    Prostate Cancer: Interobserver Agreement and Accuracy with the Revised Prostate Imaging Reporting and Data System at Multiparametric MR Imaging

    Published Online:Jun 18 2015https://doi.org/10.1148/radiol.2015142818

    Abstract

    The Prostate Imaging Reporting and Data System (PI-RADS) is an important standardization tool for reporting multiparametric MR imaging results; in this study the authors show that, like the first version of PIRADS, the second version is only moderately reproducible.

    Purpose

    To evaluate accuracy and interobserver variability with the use of the Prostate Imaging Reporting and Data System (PI-RADS) version 2.0 for detection of prostate cancer at multiparametric magnetic resonance (MR) imaging in a biopsy-naïve patient population.

    Materials and Methods

    This retrospective HIPAA-compliant study was approved by the local ethics committee, and written informed consent was obtained from all patients for use of their imaging and histopathologic data in future research studies. In 101 biopsy-naïve patients with elevated prostate-specific antigen levels who underwent multiparametric MR imaging of the prostate and subsequent transrectal ultrasonography (US)–MR imaging fusion–guided biopsy, suspicious lesions detected at multiparametric MR imaging were scored by five readers who were blinded to pathologic results by using to the newly revised PI-RADS and the scoring system developed in-house. Interobserver agreement was evaluated by using κ statistics, and the correlation of pathologic results with each of the two scoring systems was evaluated by using the Kendall τ correlation coefficient.

    Results

    Specimens of 162 lesions in 94 patients were sampled by means of transrectal US–MR imaging fusion biopsy. Results for 87 (54%) lesions were positive for prostate cancer. Kendall τ values with the PI-RADS and the in-house–developed scoring system, respectively, at T2-weighted MR imaging in the peripheral zone were 0.51 and 0.17 and in the transitional zone, 0.45 and −0.11; at diffusion-weighted MR imaging, 0.42 and 0.28; at dynamic contrast material–enhanced MR imaging, 0.23 and 0.24, and overall suspicion scores were 0.42 and 0.49. Median κ scores among all possible pairs of readers for PI-RADS and the in-house–developed scoring system, respectively, for T2-weighted MR images in the peripheral zone were 0.47 and 0.15; transitional zone, 0.37 and 0.07; diffusion-weighted MR imaging, 0.41 and 0.57; dynamic contrast-enhanced MR imaging, 0.48 and 0.41; and overall suspicion scores, 0.46 and 0.55.

    Conclusion

    Use of the revised PI-RADS provides moderately reproducible MR imaging scores for detection of clinically relevant disease.

    © RSNA, 2015

    Online supplemental material is available for this article.

    References

    • 1. Barentsz JO, Richenberg J, Clements R, et al. ESUR prostate MR guidelines 2012. Eur Radiol 2012;22(4):746–757. Crossref, Medline, Google Scholar
    • 2. Obenauer S, Hermann KP, Grabbe E. Applications and literature review of the BI-RADS classification. Eur Radiol 2005;15(5):1027–1036. Crossref, Medline, Google Scholar
    • 3. Baur AD, Maxeiner A, Franiel T, et al. Evaluation of the prostate imaging reporting and data system for the detection of prostate cancer by the results of targeted biopsy of the prostate. Invest Radiol 2014;49(6):411–420. Crossref, Medline, Google Scholar
    • 4. Junker D, Schäfer G, Edlinger M, et al. Evaluation of the PI-RADS scoring system for classifying mpMRI findings in men with suspicion of prostate cancer. Biomed Res Int 2013;2013:252939. Crossref, Medline, Google Scholar
    • 5. American College of Radiology. PIRADS v2. Reston, Va: American College of Radiology, 2014. Google Scholar
    • 6. Bomers JG, Barentsz JO. Standardization of multiparametric prostate MR imaging using PI-RADS. Biomed Res Int 2014;2014:431680. Crossref, Medline, Google Scholar
    • 7. Turkbey B, Mani H, Shah V, et al. Multiparametric 3T prostate magnetic resonance imaging to detect cancer: histopathological correlation using prostatectomy specimens processed in customized magnetic resonance imaging based molds. J Urol 2011;186(5):1818–1824. Crossref, Medline, Google Scholar
    • 8. Turkbey B, Pinto PA, Mani H, et al. Prostate cancer: value of multiparametric MR imaging at 3 T for detection—histopathologic correlation. Radiology 2010;255(1):89–99. Link, Google Scholar
    • 9. Pinto PA, Chung PH, Rastinehad AR, et al. Magnetic resonance imaging/ultrasound fusion guided prostate biopsy improves cancer detection following transrectal ultrasound biopsy and correlates with multiparametric magnetic resonance imaging. J Urol 2011;186(4):1281–1285. Crossref, Medline, Google Scholar
    • 10. Hong CW, Rais-Bahrami S, Walton-Diaz A, et al. Comparison of magnetic resonance imaging and ultrasound (MRI-US) fusion-guided prostate biopsies obtained from axial and sagittal approaches. BJU Int 2015;115(5):772–779. Crossref, Medline, Google Scholar
    • 11. Xu S, Kruecker J, Turkbey B, et al. Real-time MRI-TRUS fusion for guidance of targeted prostate biopsies. Comput Aided Surg 2008;13(5):255–264. Crossref, Medline, Google Scholar
    • 12. Rais-Bahrami S, Siddiqui MM, Turkbey B, et al. Utility of multiparametric magnetic resonance imaging suspicion levels for detecting prostate cancer. J Urol 2013;190(5):1721–1727. Crossref, Medline, Google Scholar
    • 13. Rastinehad AR, Turkbey B, Salami SS, et al. Improving detection of clinically significant prostate cancer: magnetic resonance imaging/transrectal ultrasound fusion guided prostate biopsy. J Urol 2014;191(6):1749–1754. Crossref, Medline, Google Scholar
    • 14. Turkbey B, Mani H, Aras O, et al. Prostate cancer: can multiparametric MR imaging help identify patients who are candidates for active surveillance? Radiology 2013;268(1):144–152. Link, Google Scholar
    • 15. Hollander M, Wolfe DA. Nonparametric statistical methods. 2nd ed. New York, NY: Wiley, 1999. Google Scholar
    • 16. Hoffman EB, Sen PK, Weinberg CR. Within-cluster resampling. Biometrika 2001;88(4):1121–1134. Crossref, Google Scholar
    • 17. Williamson JM, Datta S, Satten GA. Marginal analyses of clustered data when cluster size is informative. Biometrics 2003;59(1):36–42. Crossref, Medline, Google Scholar
    • 18. Team TRC. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. http://www.R-project.org/. Published 2014. Accessed December 6, uk 2014. Google Scholar
    • 19. Rosenkrantz AB, Lim RP, Haghighi M, Somberg MB, Babb JS, Taneja SS. Comparison of interreader reproducibility of the prostate imaging reporting and data system and likert scales for evaluation of multiparametric prostate MRI. AJR Am J Roentgenol 2013;201(4):W612–W618. Crossref, Medline, Google Scholar
    • 20. Rosenkrantz AB, Kim S, Lim RP, et al. Prostate cancer localization using multiparametric MR imaging: comparison of Prostate Imaging Reporting and Data System (PI-RADS) and Likert scales. Radiology 2013;269(2):482–492. Link, Google Scholar
    • 21. Schimmöller L, Quentin M, Arsov C, et al. Inter-reader agreement of the ESUR score for prostate MRI using in-bore MRI-guided biopsies as the reference standard. Eur Radiol 2013;23(11):3185–3190. Crossref, Medline, Google Scholar
    • 22. Schimmöller L, Quentin M, Arsov C, et al. Predictive power of the ESUR scoring system for prostate cancer diagnosis verified with targeted MR-guided in-bore biopsy. Eur J Radiol 2014;83(12):2103–2108. Crossref, Medline, Google Scholar
    • 23. Schimmöller L, Quentin M, Arsov C, et al. MR-sequences for prostate cancer diagnostics: validation based on the PI-RADS scoring system and targeted MR-guided in-bore biopsy. Eur Radiol 2014;24(10):2582–2589. Crossref, Medline, Google Scholar
    • 24. Roethke MC, Kuru TH, Schultze S, et al. Evaluation of the ESUR PI-RADS scoring system for multiparametric MRI of the prostate with targeted MR/TRUS fusion-guided biopsy at 3.0 Tesla. Eur Radiol 2014;24(2):344–352.
 Crossref, Medline, Google Scholar
    • 25. Portalez D, Mozer P, Cornud F, et al. Validation of the European Society of Urogenital Radiology scoring system for prostate cancer diagnosis on multiparametric magnetic resonance imaging in a cohort of repeat biopsy patients. Eur Urol 2012;62(6):986–996. Crossref, Medline, Google Scholar
    • 26. Hamoen EH, de Rooij M, Witjes JA, Barentsz JO, Rovers MM. Use of the Prostate Imaging Reporting and Data System (PI-RADS) for prostate cancer detection with multiparametric magnetic resonance imaging: a diagnostic meta-analysis. Eur Urol 2015;67(6):1112–1121. Crossref, Medline, Google Scholar
    • 27. Dickinson L, Ahmed HU, Allen C, et al. Magnetic resonance imaging for the detection, localisation, and characterisation of prostate cancer: recommendations from a European consensus meeting. Eur Urol 2011;59(4):477–494. Crossref, Medline, Google Scholar
    • 28. Siddiqui MM, Rais-Bahrami S, Truong H, et al. Magnetic resonance imaging/ultrasound-fusion biopsy significantly upgrades prostate cancer versus systematic 12-core transrectal ultrasound biopsy. Eur Urol 2013;64(5):713–719. Crossref, Medline, Google Scholar
    • 29. Rais-Bahrami S, Siddiqui MM, Vourganti S, et al. Diagnostic value of biparametric magnetic resonance imaging (MRI) as an adjunct to prostate-specific antigen (PSA)-based detection of prostate cancer in men without prior biopsies. BJU Int 2015;115(3):381–388. Crossref, Medline, Google Scholar

    Article History

    Received December 8, 2014; revision requested January 9, 2015; revision received February 16; accepted March 31; final version accepted April 17.
    Published online: June 18 2015
    Published in print: Dec 2015