Accuracy and Reliability Assessment of CT and MR Perfusion Analysis Software Using a Digital Phantom
Abstract
Our phantom analysis revealed that all commercial programs for CT perfusion and perfusion-weighted imaging studied showed delay-induced errors and/or insufficient correlations with true values, while all academic programs for perfusion-weighted imaging studied showed better correlations with true values.
Purpose
To design a digital phantom data set for computed tomography (CT) perfusion and perfusion-weighted imaging on the basis of the widely accepted tracer kinetic theory in which the true values of cerebral blood flow (CBF), cerebral blood volume (CBV), mean transit time (MTT), and tracer arrival delay are known and to evaluate the accuracy and reliability of postprocessing programs using this digital phantom.
Materials and Methods
A phantom data set was created by generating concentration-time curves reflecting true values for CBF (2.5–87.5 mL/100 g per minute), CBV (1.0–5.0 mL/100 g), MTT (3.4–24 seconds), and tracer delays (0–3.0 seconds). These curves were embedded in human brain images. The data were analyzed by using 13 algorithms each for CT and magnetic resonance (MR), including five commercial vendors and five academic programs. Accuracy was assessed by using the Pearson correlation coefficient (r) for true values. Delay-, MTT-, or CBV-dependent errors and correlations between time to maximum of residue function (Tmax) were also evaluated.
Results
In CT, CBV was generally well reproduced (r > 0.9 in 12 algorithms), but not CBF and MTT (r > 0.9 in seven and four algorithms, respectively). In MR, good correlation (r > 0.9) was observed in one-half of commercial programs, while all academic algorithms showed good correlations for all parameters. Most algorithms had delay-dependent errors, especially for commercial software, as well as CBV dependency for CBF or MTT calculation and MTT dependency for CBV calculation. Correlation was good in Tmax except for one algorithm.
Conclusion
The digital phantom readily evaluated the accuracy and characteristics of the CT and MR perfusion analysis software. All commercial programs had delay-induced errors and/or insufficient correlations with true values, while academic programs for MR showed good correlations with true values.
© RSNA, 2012
Supplemental material: http://radiology.rsna.org/lookup/suppl/doi:10.1148/radiol.12112618/-/DC1
References
- 1 . Perfusion measurements of the brain: using dynamic CT for the quantitative assessment of cerebral ischemia in acute stroke. Eur J Radiol 1999;30(3):170–184.
- 2 . Dynamic CT perfusion imaging of acute stroke. AJNR Am J Neuroradiol 2000;21(8):1441–1449.
- 3 . Utility of perfusion-weighted CT imaging in acute middle cerebral artery stroke treated with intra-arterial thrombolysis: prediction of final infarct volume and clinical outcome. Stroke 2001;32(9):2021–2028.
- 4 . Carotid perfusion CT with balloon occlusion and acetazolamide challenge test: feasibility. Radiology 2004;231(3):906–913.
- 5 . Dynamic CT perfusion imaging in subarachnoid hemorrhage-related vasospasm. AJNR Am J Neuroradiol 2006;27(3):624–631.
- 6 . A CT method to measure hemodynamics in brain tumors: validation and application of cerebral blood flow maps. AJNR Am J Neuroradiol 2000;21(3):462–470.
- 7 . Optimal Tmax threshold for predicting penumbral tissue in acute stroke. Stroke 2009;40(2):469–475.
- 8 . Advances in penumbra imaging with MR. Cerebrovasc Dis 2004;17(Suppl 3):23–27.
- 9 . Improved prediction of final infarct volume using bolus delay-corrected perfusion-weighted MRI: implications for the ischemic penumbra. Stroke 2004;35(11):2466–2471.
- 10 . Prediction of infarct volume and neurologic outcome by using automated multiparametric perfusion-weighted magnetic resonance imaging in a primate model of permanent middle cerebral artery occlusion. J Cereb Blood Flow Metab 2011;31(2):448–456.
- 11 . Difference in tracer delay-induced effect among deconvolution algorithms in CT perfusion analysis: quantitative evaluation with digital phantoms. Radiology 2009;251(1):241–249.
- 12 . Differences in CT perfusion maps generated by different commercial software: quantitative analysis by using identical source data of acute stroke patients. Radiology 2010;254(1):200–209.
- 13 . Comparison of 10 perfusion MRI parameters in 97 sub-6-hour stroke patients using voxel-based receiver operating characteristics analysis. Stroke 2009;40(6):2055–2061.
- 14 . Computed tomography and magnetic resonance perfusion imaging in ischemic stroke: definitions and thresholds. Ann Neurol 2011;70(3):384–401.
- 15 . Acute stroke imaging research roadmap. Stroke 2008;39(5):1621–1628.
- 16 . High resolution measurement of cerebral blood flow using intravascular tracer bolus passages. I. Mathematical approach and statistical analysis. Magn Reson Med 1996;36(5):715–725.
- 17 . Tracer arrival timing-insensitive technique for estimating flow in MR perfusion-weighted imaging using singular value decomposition with a block-circulant deconvolution matrix. Magn Reson Med 2003;50(1):164–174.
- 18 . On the theory of the indicator-dilution method for measurement of blood flow and volume. J Appl Physiol 1954;6(12):731–744.
- 19 . Effects of alteplase beyond 3 h after stroke in the Echoplanar Imaging Thrombolytic Evaluation Trial (EPITHET): a placebo-controlled randomised trial. Lancet Neurol 2008;7(4):299–309.
- 20 . Real-time diffusion-perfusion mismatch analysis in acute stroke. J Magn Reson Imaging 2010;32(5):1024–1037.
- 21 . The physiological significance of the time-to-maximum (Tmax) parameter in perfusion MRI. Stroke 2010;41(6):1169–1174.
- 22 . Bayesian estimation of cerebral perfusion using a physiological model of microvasculature. Neuroimage 2006;33(2):570–579.
Article History
Received December 8, 2011; revision requested February 3, 2012; final revision received July 5; accepted July 26; final version accepted September 7.Published online: Apr 2013
Published in print: Apr 2013