Association of Study Quality with Completeness of Reporting: Have Completeness of Reporting and Quality of Systematic Reviews and Meta-Analyses in Major Radiology Journals Changed Since Publication of the PRISMA Statement?

Published Online:Nov 1 2013https://doi.org/10.1148/radiol.13130273

Abstract

Completeness of reporting is associated with quality of systematic reviews and meta-analyses in major radiology journals with a few deficient areas; complete reporting has improved modestly since publication of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement, and it is strongly correlated with study quality in these journals.

Purpose

To evaluate whether completeness of reporting of systematic reviews and meta-analyses in major radiology journals has changed since publication of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement; a secondary objective is to evaluate whether completeness of reporting (ie, PRISMA) is associated with study quality (ie, Assessing the Methodological Quality of Systematic Reviews [AMSTAR]).

Materials and Methods

Systematic reviews and meta-analyses published in major radiology journals between January 2007 and December 2011 were identified by searching MEDLINE with the modified Montori method. Studies were reviewed independently by two investigators and assessed for adherence to the AMSTAR and PRISMA checklists. The average results were analyzed to assess for change in mean score before and after PRISMA publication and to assess results over time; a Pearson correlation coefficient was calculated to assess for any association between PRISMA and AMSTAR results.

Results

Included were 130 studies from 11 journals. Average PRISMA and AMSTAR results were 21.8 of 27 and 7.2 of 11, respectively. The average result was higher after publication of PRISMA, and PRISMA-reported items were 22.6 of 27 after publication of PRISMA versus 20.9 of 27 before publication of PRISMA; AMSTAR results were 7.7 of 11 after publication of PRISMA versus 6.7 of 11 before publication of PRISMA. There was a strong positive correlation (r = 0.86) between the PRISMA and AMSTAR results. There was high variability between journals. Radiology had the highest PRISMA reported items (24.7 of 27), and American Journal of Neuroradiology had the lowest (19.6 of 27). Two major areas for improvement include study protocol registration and assessment of risk of bias across studies (ie, publication bias).

Conclusion

In major radiology journal studies, there was modest improvement in completeness of reporting of systematic reviews and meta-analyses, assessed by PRISMA, which was strongly associated with higher study quality, assessed by AMSTAR.

Supplemental material: S1

Erratum in: https://doi.org/10.1148/radiol.14144019

References

1. Ebell MH, Siwek J, Weiss BD, et al. Simplifying the language of evidence to improve patient care: Strength of recommendation taxonomy (SORT): a patient-centered approach to grading evidence in medical literature. J Fam Pract 2004;53(2):111–120. Medline, Google Scholar
2. Guyatt GH, Sackett DL, Sinclair JC, Hayward R, Cook DJ, Cook RJ. Users’ guides to the medical literature. IX. A method for grading health care recommendations. Evidence-Based Medicine Working Group. JAMA 1995;274(22):1800–1804. Crossref, Medline, Google Scholar
3. Kung J, Chiappelli F, Cajulis OO, et al. From systematic reviews to clinical recommendations for evidence-based health care: validation of Revised Assessment of Multiple Systematic Reviews (R-AMSTAR) for grading of clinical relevance. Open Dent J 2010;4:84–91. Medline, Google Scholar
4. Lohr KN, Carey TS. Assessing “best evidence”: issues in grading the quality of studies for systematic reviews. Jt Comm J Qual Improv 1999;25(9):470–479. Medline, Google Scholar
5. Smidt N, Rutjes AW, van der Windt DA, et al. Quality of reporting of diagnostic accuracy studies. Radiology 2005;235(2):347–353. Link, Google Scholar
6. Delaney A, Bagshaw SM, Ferland A, Laupland K, Manns B, Doig C. The quality of reports of critical care meta-analyses in the Cochrane Database of Systematic Reviews: an independent appraisal. Crit Care Med 2007;35(2):589–594. Crossref, Medline, Google Scholar
7. Delaney A, Bagshaw SM, Ferland A, Manns B, Laupland KB, Doig CJ. A systematic evaluation of the quality of meta-analyses in the critical care literature. Crit Care 2005;9(5):R575–R582. Crossref, Medline, Google Scholar
8. McDonough PG. The use of “MOOSE”. Fertil Steril 2002;78(6):1352. Crossref, Medline, Google Scholar
9. Vandenbroucke JP. STREGA, STROBE, STARD, SQUIRE, MOOSE, PRISMA, GNOSIS, TREND, ORION, COREQ, QUOROM, REMARK... and CONSORT: for whom does the guideline toll? J Clin Epidemiol 2009;62(6):594–596. Crossref, Medline, Google Scholar
10. Moher D, Altman DG, Liberati A, Tetzlaff J. PRISMA statement. Epidemiology 2011;22(1):128; author reply 128. Crossref, Medline, Google Scholar
11. Shea BJ, Grimshaw JM, Wells GA, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol 2007;7:10. Crossref, Medline, Google Scholar
12. Shea BJ, Hamel C, Wells GA, et al. AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. J Clin Epidemiol 2009;62(10):1013–1020. Crossref, Medline, Google Scholar
13. Bossuyt PM, Reitsma JB, Bruns DE, et al. The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Ann Intern Med 2003;138(1):W1–W12. Crossref, Medline, Google Scholar
14. Smidt N, Rutjes AW, van der Windt DA, et al. Reproducibility of the STARD checklist: an instrument to assess the quality of reporting of diagnostic accuracy studies. BMC Med Res Methodol 2006;6:12. Crossref, Medline, Google Scholar
15. Bossuyt PM. STARD statement: still room for improvement in the reporting of diagnostic accuracy studies. Radiology 2008;248(3):713–714. Link, Google Scholar
16. Clarke M. The QUORUM statement. Lancet 2000;355(9205):756–757. Crossref, Medline, Google Scholar
17. Sequeira-Byron P, Fedorowicz Z, Jagannath VA, Sharif MO. An AMSTAR assessment of the methodological quality of systematic reviews of oral healthcare interventions published in the Journal of Applied Oral Science (JAOS). J Appl Oral Sci 2011;19(5):440–447. Crossref, Medline, Google Scholar
18. Smidt N, Rutjes AW, van der Windt DA, et al. The quality of diagnostic accuracy studies since the STARD statement: has it improved? Neurology 2006;67(5):792–797. Crossref, Medline, Google Scholar
19. Dijkman BG, Abouali JA, Kooistra BW, et al. Twenty years of meta-analyses in orthopaedic surgery: has quality kept up with quantity? J Bone Joint Surg Am 2010;92(1):48–57. Crossref, Medline, Google Scholar
20. Shojania KG, Bero LA. Taking advantage of the explosion of systematic reviews: an efficient MEDLINE search strategy. Eff Clin Pract 2001;4(4):157–162. Medline, Google Scholar
21. Kwee TC, Kwee RM. MR angiography in the follow-up of intracranial aneurysms treated with Guglielmi detachable coils: systematic review and meta-analysis. Neuroradiology 2007;49(9):703–713. Crossref, Medline, Google Scholar
22. Heijmink SWTPJ, Barentsz JO. Contrast-enhanced versus systematic transrectal ultrasound-guided prostate cancer detection: an overview of techniques and a systematic review. Eur J Radiol 2007;63(3):310–316. Crossref, Medline, Google Scholar
23. Vanhoenacker PK, Heijenbrok-Kal MH, Van Heste R, et al. Diagnostic performance of multidetector CT angiography for assessment of coronary artery disease: meta-analysis. Radiology 2007;244(2):419–428. Link, Google Scholar
24. Autti T, Joensuu R, Aberg L. Decreased T2 signal in the thalami may be a sign of lysosomal storage disease. Neuroradiology 2007;49(7):571–578. Crossref, Medline, Google Scholar
25. Liu J, Xu Y, Wang J. Ultrasonography, computed tomography and magnetic resonance imaging for diagnosis of ovarian carcinoma. Eur J Radiol 2007;62(3):328–334. Crossref, Medline, Google Scholar
26. Joshi U, Raijmakers PG, Riphagen II, Teule GJ, van Lingen A, Hoekstra OS. Attenuation-corrected vs. nonattenuation-corrected 2-deoxy-2-[F-18]fluoro-D-glucose-positron emission tomography in oncology: a systematic review. Mol Imaging Biol 2007;9(3):99–105. Crossref, Medline, Google Scholar
27. Semelka RC, Armao DM, Elias J Jr, Huda W. Imaging strategies to reduce the risk of radiation in CT studies, including selective substitution with MRI. J Magn Reson Imaging 2007;25(5):900–909. Crossref, Medline, Google Scholar
28. van Eerde AM, Meutgeert MH, de Jong TP, Giltay JC. Vesico-ureteral reflux in children with prenatally detected hydronephrosis: a systematic review. Ultrasound Obstet Gynecol 2007;29(4):463–469. Crossref, Medline, Google Scholar
29. Williams GJ, Macaskill P, Chan SF, et al. Comparative accuracy of renal duplex sonographic parameters in the diagnosis of renal artery stenosis: paired and unpaired analysis. AJR Am J Roentgenol 2007;188(3):798–811. Crossref, Medline, Google Scholar
30. Sampson FC, Goodacre SW, Thomas SM, van Beek EJ. The accuracy of MRI in diagnosis of suspected deep vein thrombosis: systematic review and meta-analysis. Eur Radiol 2007;17(1):175–181. Crossref, Medline, Google Scholar
31. Medina LS, Bernal B, Ruiz J. Role of functional MR in determining language dominance in epilepsy and nonepilepsy populations: a Bayesian analysis. Radiology 2007;242(1):94–100. Link, Google Scholar
32. Pakos EE, Trikalinos TA, Fotopoulos AD, Ioannidis JP. Prosthesis infection: diagnosis after total joint arthroplasty with antigranulocyte scintigraphy with 99mTc-labeled monoclonal antibodies—a meta-analysis. Radiology 2007;242(1):101–108. Link, Google Scholar
33. Wijers SC, Boelens JJ, Raphael MF, Beek FJ, de Jong PA. Does high-resolution CT has diagnostic value in patients presenting with respiratory symptoms after hematopoietic stem cell transplantation? Eur J Radiol 2011;80(3):e536–e543. Crossref, Medline, Google Scholar
34. Dong MJ, Zhao K, Liu ZF, Wang GL, Yang SY, Zhou GJ. A meta-analysis of the value of fluorodeoxyglucose-PET/PET-CT in the evaluation of fever of unknown origin. Eur J Radiol 2011;80(3):834–844. Crossref, Medline, Google Scholar
35. de Vasconcelos Sobreira Guedes B, da Rocha AJ, Gama HP, da Silva CJ. Dural metastases from prostate carcinoma: a systematic review of the literature apropos of six patients. Eur J Radiol 2011;80(2):236–240. Crossref, Medline, Google Scholar
36. Qu X, Huang X, Wu L, Huang G, Ping X, Yan W. Comparison of virtual cystoscopy and ultrasonography for bladder cancer detection: a meta-analysis. Eur J Radiol 2011;80(2):188–197. Crossref, Medline, Google Scholar
37. Wu L, Cao Y, Liao C, Huang J, Gao F. Diagnostic performance of USPIO-enhanced MRI for lymph-node metastases in different body regions: a meta-analysis. Eur J Radiol 2011;80(2):582–589. Crossref, Medline, Google Scholar
38. Yang HL, Liu T, Wang XM, Xu Y, Deng SM. Diagnosis of bone metastases: a meta-analysis comparing ¹⁸FDG PET, CT, MRI and bone scintigraphy. Eur Radiol 2011;21(12):2604–2617. Crossref, Medline, Google Scholar
39. Bertot LC, Sato M, Tateishi R, Yoshida H, Koike K. Mortality and complication rates of percutaneous ablative techniques for the treatment of liver tumors: a systematic review. Eur Radiol 2011;21(12):2584–2596. Crossref, Medline, Google Scholar
40. Robertson C, Ragupathy SK, Boachie C, et al. Surveillance mammography for detecting ipsilateral breast tumour recurrence and metachronous contralateral breast cancer: a systematic review. Eur Radiol 2011;21(12):2484–2491. Crossref, Medline, Google Scholar
41. McInnes MD, Kielar AZ, Macdonald DB. Percutaneous image-guided biopsy of the spleen: systematic review and meta-analysis of the complication rate and diagnostic accuracy. Radiology 2011;260(3):699–708. Link, Google Scholar
42. Heinrich A, Szostek A, Nees F, Meyer P, Semmler W, Flor H. Effects of static magnetic fields on cognition, vital signs, and sensory perception: a meta-analysis. J Magn Reson Imaging 2011;34(4):758–763. Crossref, Medline, Google Scholar
43. Jeve Y, Rana R, Bhide A, Thangaratinam S. Accuracy of first-trimester ultrasound in the diagnosis of early embryonic demise: a systematic review. Ultrasound Obstet Gynecol 2011;38(5):489–496. Crossref, Medline, Google Scholar
44. Schlattmann P, Schuetz GM, Dewey M. Influence of coronary artery disease prevalence on predictive values of coronary CT angiography: a meta-regression analysis. Eur Radiol 2011;21(9):1904–1913. Crossref, Medline, Google Scholar
45. Chan YY, Jayaprakasan K, Tan A, Thornton JG, Coomarasamy A, Raine-Fenning NJ. Reproductive outcomes in women with congenital uterine anomalies: a systematic review. Ultrasound Obstet Gynecol 2011;38(4):371–382. Crossref, Medline, Google Scholar
46. Bodily KD, Cloft HJ, Lanzino G, Fiorella DJ, White PM, Kallmes DF. Stent-assisted coiling in acutely ruptured intracranial aneurysms: a qualitative, systematic review of the literature. AJNR Am J Neuroradiol 2011;32(7):1232–1236. Crossref, Medline, Google Scholar
47. Dym RJ, Burns J, Freeman K, Lipton ML. Is functional MR imaging assessment of hemispheric language dominance as good as the Wada test?: a meta-analysis. Radiology 2011;261(2):446–455. Link, Google Scholar
48. Salvesen KA. Ultrasound in pregnancy and non-right handedness: meta-analysis of randomized trials. Ultrasound Obstet Gynecol 2011;38(3):267–271. Crossref, Medline, Google Scholar
49. de Haan MC, van Gelder RE, Graser A, Bipat S, Stoker J. Diagnostic value of CT-colonography as compared to colonoscopy in an asymptomatic screening population: a meta-analysis. Eur Radiol 2011;21(8):1747–1763. Crossref, Medline, Google Scholar
50. Dorrius MD, Jansen-van der Weide MC, van Ooijen PM, Pijnappel RM, Oudkerk M. Computer-aided detection in breast MRI: a systematic review and meta-analysis. Eur Radiol 2011;21(8):1600–1608. Crossref, Medline, Google Scholar
51. Lim AC, Hegeman MA, Huis In ’T Veld MA, Opmeer BC, Bruinse HW, Mol BW. Cervical length measurement for the prediction of preterm birth in multiple pregnancies: a systematic review and bivariate meta-analysis. Ultrasound Obstet Gynecol 2011;38(1):10–17. Crossref, Medline, Google Scholar
52. Brennan ME, Turner RM, Ciatto S, et al. Ductal carcinoma in situ at core-needle biopsy: meta-analysis of underestimation and predictors of invasive breast cancer. Radiology 2011;260(1):119–128. Link, Google Scholar
53. Wu LM, Gu HY, Zheng J, et al. Diagnostic value of whole-body magnetic resonance imaging for bone metastases: a systematic review and meta-analysis. J Magn Reson Imaging 2011;34(1):128–135. Crossref, Medline, Google Scholar
54. Kunadian V, Zaman A, Spyridopoulos I, Qiu W. Sodium bicarbonate for the prevention of contrast induced nephropathy: a meta-analysis of published clinical trials. Eur J Radiol 2011;79(1):48–55. Crossref, Medline, Google Scholar
55. Pinto A, Acampora C, Pinto F, Kourdioukova E, Romano L, Verstraete K. Learning from diagnostic errors: a good way to improve education in radiology. Eur J Radiol 2011;78(3):372–376. Crossref, Medline, Google Scholar
56. Krishan S, Panditaratne N, Verma R, Robertson R. Incremental value of CT venography combined with pulmonary CT angiography for the detection of thromboembolic disease: systematic review and meta-analysis. AJR Am J Roentgenol 2011;196(5):1065–1072. Crossref, Medline, Google Scholar
57. Pickhardt PJ, Hassan C, Halligan S, Marmo R. Colorectal cancer: CT colonography and colonoscopy for detection—systematic review and meta-analysis. Radiology 2011;259(2):393–405. Link, Google Scholar
58. Tang S, Huang G, Liu J, et al. Usefulness of ¹⁸F-FDG PET, combined FDG-PET/CT and EUS in diagnosing primary pancreatic carcinoma: a meta-analysis. Eur J Radiol 2011;78(1):142–150. Crossref, Medline, Google Scholar
59. Boland GW, Dwamena BA, Jagtiani Sangwaiya M, et al. Characterization of adrenal masses by using FDG PET: a systematic review and meta-analysis of diagnostic test performance. Radiology 2011;259(1):117–126. Link, Google Scholar
60. Smith TO, Hilton G, Toms AP, Donell ST, Hing CB. The diagnostic accuracy of acetabular labral tears using magnetic resonance imaging and magnetic resonance arthrography: a meta-analysis. Eur Radiol 2011;21(4):863–874. Crossref, Medline, Google Scholar
61. Hudelist G, English J, Thomas AE, Tinelli A, Singer CF, Keckstein J. Diagnostic accuracy of transvaginal ultrasound for non-invasive diagnosis of bowel endometriosis: systematic review and meta-analysis. Ultrasound Obstet Gynecol 2011;37(3):257–263. Crossref, Medline, Google Scholar
62. Torp-Pedersen S, Bartels EM, Wilhjelm J, Bliddal H. Articular cartilage thickness measured with US is not as easy as it appears: a systematic review of measurement techniques and image interpretation. Ultraschall Med 2011;32(1):54–61. Crossref, Medline, Google Scholar
63. Morris RK, Malin G, Robson SC, Kleijnen J, Zamora J, Khan KS. Fetal umbilical artery Doppler to predict compromise of fetal/neonatal wellbeing in a high-risk population: systematic review and bivariate meta-analysis. Ultrasound Obstet Gynecol 2011;37(2):135–142. Crossref, Medline, Google Scholar
64. Westerlaan HE, van Dijk JM, Jansen-van der Weide MC, et al. Intracranial aneurysms in patients with subarachnoid hemorrhage: CT angiography as a primary examination tool for diagnosis—systematic review and meta-analysis. Radiology 2011;258(1):134–145. Link, Google Scholar
65. Bohte AE, van Werven JR, Bipat S, Stoker J. The diagnostic accuracy of US, CT, MRI and 1H-MRS for the evaluation of hepatic steatosis compared with liver biopsy: a meta-analysis. Eur Radiol 2011;21(1):87–97. Crossref, Medline, Google Scholar
66. Greenberg ED, Gold R, Reichman M, et al. Diagnostic accuracy of CT angiography and CT perfusion for cerebral vasospasm: a meta-analysis. AJNR Am J Neuroradiol 2010;31(10):1853–1860. Crossref, Medline, Google Scholar
67. Niekel MC, Bipat S, Stoker J. Diagnostic imaging of colorectal liver metastases with CT, MR imaging, FDG PET, and/or FDG PET/CT: a meta-analysis of prospective studies including patients who have not previously undergone treatment. Radiology 2010;257(3):674–684. Link, Google Scholar
68. Alomari AI, Orbach DB, Mulliken JB, et al. Klippel-Trenaunay syndrome and spinal arteriovenous malformations: an erroneous association. AJNR Am J Neuroradiol 2010;31(9):1608–1612. Crossref, Medline, Google Scholar
69. Krille L, Hammer GP, Merzenich H, Zeeb H. Systematic review on physician’s knowledge about radiation doses and radiation risks of computed tomography. Eur J Radiol 2010;76(1):36–41. Crossref, Medline, Google Scholar
70. de Zwart IM, de Roos A. MRI for the evaluation of gastric physiology. Eur Radiol 2010;20(11):2609–2616. Crossref, Medline, Google Scholar
71. Jansen-van der Weide MC, Greuter MJ, Jansen L, Oosterwijk JC, Pijnappel RM, de Bock GH. Exposure to low-dose radiation and the risk of breast cancer among women with a familial or genetic predisposition: a meta-analysis. Eur Radiol 2010;20(11):2547–2556. Crossref, Medline, Google Scholar
72. Naggara ON, White PM, Guilbert F, Roy D, Weill A, Raymond J. Endovascular treatment of intracranial unruptured aneurysms: systematic review and meta-analysis of the literature on safety and efficacy. Radiology 2010;256(3):887–897. Link, Google Scholar
73. Li Y, Poulos A, McLean D, Rickard M. A review of methods of clinical image quality evaluation in mammography. Eur J Radiol 2010;74(3):e122–e131. Crossref, Medline, Google Scholar
74. Dave M, Elmunzer BJ, Dwamena BA, Higgins PD. Primary sclerosing cholangitis: meta-analysis of diagnostic performance of MR cholangiopancreatography. Radiology 2010;256(2):387–396. Link, Google Scholar
75. Thayyil S, Chandrasekaran M, Chitty LS, et al. Diagnostic accuracy of post-mortem magnetic resonance imaging in fetuses, children and adults: a systematic review. Eur J Radiol 2010;75(1):e142–e148. Crossref, Medline, Google Scholar
76. Xia D, Jing J, Shen H, Wu J. Value of diffusion-weighted magnetic resonance images for discrimination of focal benign and malignant hepatic lesions: a meta-analysis. J Magn Reson Imaging 2010;32(1):130–137. Crossref, Medline, Google Scholar
77. Menke J. Diagnostic accuracy of multidetector CT in acute mesenteric ischemia: systematic review and meta-analysis. Radiology 2010;256(1):93–101. Link, Google Scholar
78. Hamon M, Fau G, Née G, Ehtisham J, Morello R, Hamon M. Meta-analysis of the diagnostic performance of stress perfusion cardiovascular magnetic resonance for detection of coronary artery disease. J Cardiovasc Magn Reson 2010;12(1):29. Crossref, Medline, Google Scholar
79. Yuan Y, Chen XS, Liu SY, Shen KW. Accuracy of MRI in prediction of pathologic complete remission in breast cancer after preoperative therapy: a meta-analysis. AJR Am J Roentgenol 2010;195(1):260–268. Crossref, Medline, Google Scholar
80. Mullassery D, Ba’ath ME, Jesudason EC, Losty PD. Value of liver herniation in prediction of outcome in fetal congenital diaphragmatic hernia: a systematic review and meta-analysis. Ultrasound Obstet Gynecol 2010;35(5):609–614. Crossref, Medline, Google Scholar
81. Oba Y, Zaza T. Abandoning daily routine chest radiography in the intensive care unit: meta-analysis. Radiology 2010;255(2):386–395. Link, Google Scholar
82. Maarse W, Bergé SJ, Pistorius L, et al. Diagnostic accuracy of transabdominal ultrasound in detecting prenatal cleft lip and palate: a systematic review. Ultrasound Obstet Gynecol 2010;35(4):495–502. Crossref, Medline, Google Scholar
83. Zijta FM, Bipat S, Stoker J. Magnetic resonance (MR) colonography in the detection of colorectal lesions: a systematic review of prospective studies. Eur Radiol 2010;20(5):1031–1046. Crossref, Medline, Google Scholar
84. Bouzeghrane F, Naggara O, Kallmes DF, Berenstein A, Raymond J; International Consortium of Neuroendovascular Centres. In vivo experimental intracranial aneurysm models: a systematic review. AJNR Am J Neuroradiol 2010;31(3):418–423. Crossref, Medline, Google Scholar
85. Kwee RM. Prediction of tumor response to neoadjuvant therapy in patients with esophageal cancer with use of ¹⁸F FDG PET: a systematic review. Radiology 2010;254(3):707–717. Link, Google Scholar
86. Chlapoutakis K, Theocharopoulos N, Yarmenitis S, Damilakis J. Performance of computed tomographic urography in diagnosis of upper urinary tract urothelial carcinoma, in patients presenting with hematuria: Systematic review and meta-analysis. Eur J Radiol 2010;73(2):334–338. Crossref, Medline, Google Scholar
87. Sun Z, Almutairi AM. Diagnostic accuracy of 64 multislice CT angiography in the assessment of coronary in-stent restenosis: a meta-analysis. Eur J Radiol 2010;73(2):266–273. Crossref, Medline, Google Scholar
88. Dani KA, Muir KW. Do iodinated contrast agents impair fibrinolysis in acute stroke? A systematic review. AJNR Am J Neuroradiol 2010;31(1):170–174. Crossref, Medline, Google Scholar
89. Sotiriadis A, Papatheodorou S, Kavvadias A, Makrydimas G. Transvaginal cervical length measurement for prediction of preterm birth in women with threatened preterm labor: a meta-analysis. Ultrasound Obstet Gynecol 2010;35(1):54–64. Crossref, Medline, Google Scholar
90. Floriani I, Torri V, Rulli E, et al. Performance of imaging modalities in diagnosis of liver metastases from colorectal cancer: a systematic review and meta-analysis. J Magn Reson Imaging 2010;31(1):19–31. Crossref, Medline, Google Scholar
91. Goergen SK, Rumbold G, Compton G, Harris C. Systematic review of current guidelines, and their evidence base, on risk of lactic acidosis after administration of contrast medium for patients receiving metformin. Radiology 2010;254(1):261–269. Link, Google Scholar
92. Mazhar SM, Shiehmorteza M, Kohl CA, Middleton MS, Sirlin CB. Nephrogenic systemic fibrosis in liver disease: a systematic review. J Magn Reson Imaging 2009;30(6):1313–1322. Crossref, Medline, Google Scholar
93. Scholing M, Saltzherr TP, Fung Kon Jin PH, et al. The value of postmortem computed tomography as an alternative for autopsy in trauma victims: a systematic review. Eur Radiol 2009;19(10):2333–2341. Crossref, Medline, Google Scholar
94. Provenzale JM, Sarikaya B. Comparison of test performance characteristics of MRI, MR angiography, and CT angiography in the diagnosis of carotid and vertebral artery dissection: a review of the medical literature. AJR Am J Roentgenol 2009;193(4):1167–1174. Crossref, Medline, Google Scholar
95. Springer I, Dewey M. Comparison of multislice computed tomography with intravascular ultrasound for detection and characterization of coronary artery plaques: a systematic review. Eur J Radiol 2009;71(2):275–282. Crossref, Medline, Google Scholar
96. Menke J. Diagnostic accuracy of contrast-enhanced MR angiography in severe carotid stenosis: meta-analysis with metaregression of different techniques. Eur Radiol 2009;19(9):2204–2216. Crossref, Medline, Google Scholar
97. Goodman CS, Hur JY, Adajar MA, Coulam CH. How well does CT predict the need for laparotomy in hemodynamically stable patients with penetrating abdominal injury? A review and meta-analysis. AJR Am J Roentgenol 2009;193(2):432–437. Crossref, Medline, Google Scholar
98. Gu P, Pan LL, Wu SQ, Sun L, Huang G. CA 125, PET alone, PET-CT, CT and MRI in diagnosing recurrent ovarian carcinoma: a systematic review and meta-analysis. Eur J Radiol 2009;71(1):164–174. Crossref, Medline, Google Scholar
99. Kranz PG, Eastwood JD. Does diffusion-weighted imaging represent the ischemic core? An evidence-based systematic review. AJNR Am J Neuroradiol 2009;30(6):1206–1212. Crossref, Medline, Google Scholar
100. Warren R, Ciatto S, Macaskill P, Black R, Houssami N. Technical aspects of breast MRI—do they affect outcomes? Eur Radiol 2009;19(7):1629–1638. Crossref, Medline, Google Scholar
101. de Jesus JO, Parker L, Frangos AJ, Nazarian LN. Accuracy of MRI, MR arthrography, and ultrasound in the diagnosis of rotator cuff tears: a meta-analysis. AJR Am J Roentgenol 2009;192(6):1701–1707. Crossref, Medline, Google Scholar
102. Horsthuis K, Bipat S, Stokkers PC, Stoker J. Magnetic resonance imaging for evaluation of disease activity in Crohn’s disease: a systematic review. Eur Radiol 2009;19(6):1450–1460. Crossref, Medline, Google Scholar
103. Torloni MR, Vedmedovska N, Merialdi M, et al. Safety of ultrasonography in pregnancy: WHO systematic review of the literature and meta-analysis. Ultrasound Obstet Gynecol 2009;33(5):599–608. Crossref, Medline, Google Scholar
104. Vinnicombe S, Pinto Pereira SM, McCormack VA, Shiel S, Perry N, Dos Santos Silva IM. Full-field digital versus screen-film mammography: comparison within the UK breast screening program and systematic review of published data. Radiology 2009;251(2):347–358. Link, Google Scholar
105. Miller E, Uleryk E, Doria AS. Evidence-based outcomes of studies addressing diagnostic accuracy of MRI of juvenile idiopathic arthritis. AJR Am J Roentgenol 2009;192(5):1209–1218. Crossref, Medline, Google Scholar
106. Niemann T, Egelhof T, Bongartz G. Transthoracic sonography for the detection of pulmonary embolism—a meta-analysis. Ultraschall Med 2009;30(2):150–156. Crossref, Medline, Google Scholar
107. Sun Z, Davidson R, Lin CH. Multi-detector row CT angiography in the assessment of coronary in-stent restenosis: a systematic review. Eur J Radiol 2009;69(3):489–495. Crossref, Medline, Google Scholar
108. Vente MA, Wondergem M, van der Tweel I, et al. Yttrium-90 microsphere radioembolization for the treatment of liver malignancies: a structured meta-analysis. Eur Radiol 2009;19(4):951–959. Crossref, Medline, Google Scholar
109. Yuan Y, Gu ZX, Wei WS. Fluorodeoxyglucose-positron-emission tomography, single-photon emission tomography, and structural MR imaging for prediction of rapid conversion to Alzheimer disease in patients with mild cognitive impairment: a meta-analysis. AJNR Am J Neuroradiol 2009;30(2):404–410. Crossref, Medline, Google Scholar
110. White PM, Raymond J. Endovascular coiling of cerebral aneurysms using “bioactive” or coated-coil technologies: a systematic review of the literature. AJNR Am J Neuroradiol 2009;30(2):219–226. Crossref, Medline, Google Scholar
111. Kwee TC, Kwee RM. Combined FDG-PET/CT for the detection of unknown primary tumors: systematic review and meta-analysis. Eur Radiol 2009;19(3):731–744. Crossref, Medline, Google Scholar
112. Kok M, Cnossen J, Gravendeel L, Van Der Post JA, Mol BW. Ultrasound factors to predict the outcome of external cephalic version: a meta-analysis. Ultrasound Obstet Gynecol 2009;33(1):76–84. Crossref, Medline, Google Scholar
113. Heinrich MC, Häberle L, Müller V, Bautz W, Uder M. Nephrotoxicity of iso-osmolar iodixanol compared with nonionic low-osmolar contrast media: meta-analysis of randomized controlled trials. Radiology 2009;250(1):68–86. Link, Google Scholar
114. Gaitini DE, Brenner B. Do we need a cancer screening in patients with idiopathic deep vein thrombosis? Ultraschall Med 2008;29(Suppl 5):220–225. Crossref, Medline, Google Scholar
115. Meijer AB, O YL, Geleijns J, Kroft LJ. Meta-analysis of 40- and 64-MDCT angiography for assessing coronary artery stenosis. AJR Am J Roentgenol 2008;191(6):1667–1675. Crossref, Medline, Google Scholar
116. Krug B, Crott R, Lonneux M, Baurain JF, Pirson AS, Vander Borght T. Role of PET in the initial staging of cutaneous malignant melanoma: systematic review. Radiology 2008;249(3):836–844. Link, Google Scholar
117. Wiesmann M, Schöpf V, Jansen O, Brückmann H. Stent-protected angioplasty versus carotid endarterectomy in patients with carotid artery stenosis: meta-analysis of randomized trial data. Eur Radiol 2008;18(12):2956–2966. Crossref, Medline, Google Scholar
118. Shah QA, Zeeshan Memon M, Vazquez G, et al. Clinical and radiological outcomes of acute ischemic stroke patients without angiographic occlusion on digital subtraction angiogram. A pooled analysis of case series. Neuroradiology 2008;50(11):963–968. Crossref, Medline, Google Scholar
119. Laméris W, van Randen A, Bipat S, Bossuyt PM, Boermeester MA, Stoker J. Graded compression ultrasonography and computed tomography in acute colonic diverticulitis: meta-analysis of test accuracy. Eur Radiol 2008;18(11):2498–2511. Crossref, Medline, Google Scholar
120. Shapiro M, Babb J, Becske T, Nelson PK. Safety and efficacy of adjunctive balloon remodeling during endovascular treatment of intracranial aneurysms: a literature review. AJNR Am J Neuroradiol 2008;29(9):1777–1781. Crossref, Medline, Google Scholar
121. van Randen A, Bipat S, Zwinderman AH, Ubbink DT, Stoker J, Boermeester MA. Acute appendicitis: meta-analysis of diagnostic performance of CT and graded compression US related to prevalence of disease. Radiology 2008;249(1):97–106. Link, Google Scholar
122. Provenzale JM, Shah K, Patel U, McCrory DC. Systematic review of CT and MR perfusion imaging for assessment of acute cerebrovascular disease. AJNR Am J Neuroradiol 2008;29(8):1476–1482. Crossref, Medline, Google Scholar
123. Cronin P, Dwamena BA, Kelly AM, Bernstein SJ, Carlos RC. Solitary pulmonary nodules and masses: a meta-analysis of the diagnostic utility of alternative imaging tests. Eur Radiol 2008;18(9):1840–1856. Crossref, Medline, Google Scholar
124. Clarke M. Systematic review of reviews of risk factors for intracranial aneurysms. Neuroradiology 2008;50(8):653–664. Crossref, Medline, Google Scholar
125. Niemann T, Kollmann T, Bongartz G. Diagnostic performance of low-dose CT for the detection of urolithiasis: a meta-analysis. AJR Am J Roentgenol 2008;191(2):396–401. Crossref, Medline, Google Scholar
126. Cahir JG, Toms AP. Regional migratory osteoporosis. Eur J Radiol 2008;67(1):2–10. Crossref, Medline, Google Scholar
127. Sun Z, Lin C, Davidson R, Dong C, Liao Y. Diagnostic value of 64-slice CT angiography in coronary artery disease: a systematic review. Eur J Radiol 2008;67(1):78–84. Crossref, Medline, Google Scholar
128. Seror P. Sonography and electrodiagnosis in carpal tunnel syndrome diagnosis, an analysis of the literature. Eur J Radiol 2008;67(1):146–152. Crossref, Medline, Google Scholar
129. Hamon M, Lepage O, Malagutti P, et al. Diagnostic performance of 16- and 64-section spiral CT for coronary artery bypass graft assessment: meta-analysis. Radiology 2008;247(3):679–686. Link, Google Scholar
130. Crane JM, Hutchens D. Transvaginal sonographic measurement of cervical length to predict preterm birth in asymptomatic women at increased risk: a systematic review. Ultrasound Obstet Gynecol 2008;31(5):579–587. Crossref, Medline, Google Scholar
131. Horsthuis K, Bipat S, Bennink RJ, Stoker J. Inflammatory bowel disease diagnosed with US, MR, scintigraphy, and CT: meta-analysis of prospective studies. Radiology 2008;247(1):64–79. Link, Google Scholar
132. Chao AS, Chao A, Wang TH, et al. Outcome of antenatally diagnosed cardiac rhabdomyoma: case series and a meta-analysis. Ultrasound Obstet Gynecol 2008;31(3):289–295. Crossref, Medline, Google Scholar
133. Achten E, Deblaere K. Health technology assessment on the use of magnetic resonance imaging (MRI) and computed tomography (CT) in the diagnosis of multiple sclerosis (MS) and clinically isolated syndromes (CIS). Eur J Radiol 2008;65(2):211–213. Crossref, Medline, Google Scholar
134. Cronin P, Dwamena BA, Kelly AM, Carlos RC. Solitary pulmonary nodules: meta-analytic comparison of cross-sectional imaging modalities for diagnosis of malignancy. Radiology 2008;246(3):772–782. Link, Google Scholar
135. Janne d’Othée B, Siebert U, Cury R, Jadvar H, Dunn EJ, Hoffmann U. A systematic review on diagnostic accuracy of CT-based detection of significant coronary artery disease. Eur J Radiol 2008;65(3):449–461. Crossref, Medline, Google Scholar
136. Hamon M, Champ-Rigot L, Morello R, Riddell JW, Hamon M. Diagnostic accuracy of in-stent coronary restenosis detection with multislice spiral computed tomography: a meta-analysis. Eur Radiol 2008;18(2):217–225. Crossref, Medline, Google Scholar
137. Robinson C, Halligan S, Taylor SA, Mallett S, Altman DG. CT colonography: a systematic review of standard of reporting for studies of computer-aided detection. Radiology 2008;246(2):426–433. Link, Google Scholar
138. Sosna J, Sella T, Sy O, et al. Critical analysis of the performance of double-contrast barium enema for detecting colorectal polyps > or = 6 mm in the era of CT colonography. AJR Am J Roentgenol 2008;190(2):374–385. Crossref, Medline, Google Scholar
139. Fakhran S, Escott EJ. Pineocytoma mimicking a pineal cyst on imaging: true diagnostic dilemma or a case of incomplete imaging? AJNR Am J Neuroradiol 2008;29(1):159–163. Crossref, Medline, Google Scholar
140. Peters NH, Borel Rinkes IH, Zuithoff NP, Mali WP, Moons KG, Peeters PH. Meta-analysis of MR imaging in the diagnosis of breast lesions. Radiology 2008;246(1):116–124. Link, Google Scholar
141. Hamon M, Morello R, Riddell JW, Hamon M. Coronary arteries: diagnostic performance of 16- versus 64-section spiral CT compared with invasive coronary angiography—meta-analysis. Radiology 2007; 245(3):720–731. Link, Google Scholar
142. Pakos EE, Koumoulis HD, Fotopoulos AD, Ioannidis JP. Osteomyelitis: antigranulocyte scintigraphy with 99mTC radiolabeled monoclonal antibodies for diagnosis— meta-analysis. Radiology 2007;245(3):732–741. Link, Google Scholar
143. Ba’ath ME, Jesudason EC, Losty PD. How useful is the lung-to-head ratio in predicting outcome in the fetus with congenital diaphragmatic hernia? A systematic review and meta-analysis. Ultrasound Obstet Gynecol 2007;30(6):897–906. Crossref, Medline, Google Scholar
144. de Bondt RB, Nelemans PJ, Hofman PA, et al. Detection of lymph node metastases in head and neck cancer: a meta-analysis comparing US, USgFNAC, CT and MR imaging. Eur J Radiol 2007;64(2):266–272. Crossref, Medline, Google Scholar
145. Heijenbrok-Kal MH, Kock MC, Hunink MG. Lower extremity arterial disease: multidetector CT angiography meta-analysis. Radiology 2007;245(2):433–439. Link, Google Scholar
146. Visser JJ, van Sambeek MR, Hamza TH, Hunink MG, Bosch JL. Ruptured abdominal aortic aneurysms: endovascular repair versus open surgery—systematic review. Radiology 2007;245(1):122–129. Link, Google Scholar
147. Berghella V, Keeler SM, To MS, Althuisius SM, Rust OA. Effectiveness of cerclage according to severity of cervical length shortening: a meta-analysis. Ultrasound Obstet Gynecol 2010;35(4):468–473. Crossref, Medline, Google Scholar
148. Hillman SC, Pretlove S, Coomarasamy A, et al. Additional information from array comparative genomic hybridization technology over conventional karyotyping in prenatal diagnosis: a systematic review and meta-analysis. Ultrasound Obstet Gynecol 2011;37(1):6–14. Crossref, Medline, Google Scholar
149. Morris RK, Ruano R, Kilby MD. Effectiveness of fetal cystoscopy as a diagnostic and therapeutic intervention for lower urinary tract obstruction: a systematic review. Ultrasound Obstet Gynecol 2011;37(6):629–637. Crossref, Medline, Google Scholar
150. Roberts D, Gates S, Kilby M, Neilson JP. Interventions for twin-twin transfusion syndrome: a Cochrane review. Ultrasound Obstet Gynecol 2008;31(6):701–711. Crossref, Medline, Google Scholar
151. Fleming PS, Seehr J, Polychronopoulou A, Fedorowicz Z, Pandis N. A PRISMA assessment of the reporting quality of systematic reviews in orthodontics. Angle Orthod 2013;83(1):158–163. Crossref, Medline, Google Scholar
152. JAMA Instructions for Authors. Journal of the American Medical Association. http://jama.jamanetwork.com/public/instructionsForAuthors.aspx#CategoriesofArticles. Accessed November 1, 2012. Google Scholar
153. PROSPERO - International prospective register of systematic reviews. NHS National Institute for Health Research. http://www.crd.york.ac.uk/prospero/. Accessed November 1, 2012. Google Scholar
154. Systematic Reviews Journal. Biomed Central. http://www.systematicreviewsjournal.com/. Accessed November 1, 2012. Google Scholar
155. Deeks JJ, Macaskill P, Irwig L. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol 2005;58(9):882–893. Crossref, Medline, Google Scholar
156. Handbook for DTA Reviews. Diagnostic Test Accuracy Working Group. http://srdta.cochrane.org/handbook-dta-reviews. Published 2013. Google Scholar

Article History

Received February 1, 2013; revision requested March 29; revision received April 18; accepted April 27; final version accepted May 1.
Published online: Nov 2013
Published in print: Nov 2013

Vol. 269, No. 2

Supplemental Material

Abbreviations

Abbreviations:
AMSTAR	Assessing the Methodological Quality of Systematic Reviews
PRISMA	Preferred Reporting Items for Systematic Reviews and Meta-Analyses
QUOROM	Quality of Reporting of Meta-Analyses
STARD	Standards for the Reporting of Diagnostic Accuracy Studies

Metrics

Altmetric Score

PDF download