Generative adversarial network–based CT angiography (CTA) images of the neck or abdomen obtained without iodinated contrast agents had image quality comparable to that of real CTA images, and reasonable to good diagnostic accuracy.
Iodinated contrast agents (ICAs), which are widely used in CT angiography (CTA), may cause adverse effects in humans, and their use is time-consuming and costly.
To develop an ICA-free deep learning imaging model for synthesizing CTA-like images and to assess quantitative and qualitative image quality as well as the diagnostic accuracy of synthetic CTA (Syn-CTA) images.
Materials and Methods
A generative adversarial network (GAN)–based CTA imaging model was trained, validated, and tested on retrospectively collected pairs of noncontrast CT and CTA images of the neck and abdomen from January 2017 to June 2022, and further validated on an external data set. Syn-CTA image quality was evaluated using quantitative metrics. In addition, two senior radiologists scored the visual quality on a three-point scale (3 = good) and determined the vascular diagnosis. The validity of Syn-CTA images was evaluated by comparing the visual quality scores and diagnostic accuracy of aortic and carotid artery disease between Syn-CTA and real CTA scans.
CT scans from 1749 patients (median age, 60 years [IQR, 50–68 years]; 1057 male patients) were included in the internal data set: 1137 for training, 400 for validation, and 212 for testing. The external validation set comprised CT scans from 42 patients (median age, 67 years [IQR, 59–74 years]; 37 male patients). Syn-CTA images had high similarity to real CTA images (normalized mean absolute error, 0.011 and 0.013 for internal and external test set, respectively; peak signal-to-noise ratio, 32.07 dB and 31.58 dB; structural similarity, 0.919 and 0.906). The visual quality of Syn-CTA and real CTA images was comparable (internal test set, P = .35; external validation set, P > .99). Syn-CTA showed reasonable to good diagnostic accuracy for vascular diseases (internal test set: accuracy = 94%, macro F1 score = 91%; external validation set: accuracy = 86%, macro F1 score = 83%).
A GAN-based model that synthesizes neck and abdominal CTA-like images without the use of ICAs shows promise in vascular diagnosis compared with real CTA images.
Clinical trial registration no. NCT05471869
© RSNA, 2023
See also the editorial by Zhang and Turkbey in this issue.
- 1. . Computed tomographic angiography of the abdominal aorta. Radiol Clin North Am 2016;54(1):35–54. Crossref, Medline, Google Scholar
- 2. . Intravenous contrast medium administration and scan timing at CT: considerations and approaches. Radiology 2010;256(1):32–61. Link, Google Scholar
- 3. . Iodinated contrast media and the alleged “iodine allergy”: an inexact diagnosis leading to inferior radiologic management and adverse drug reactions. Rofo 2017;189(4):326–332. Crossref, Medline, Google Scholar
- 4. . Safe use of contrast media: what the radiologist needs to know. RadioGraphics 2015;35(6):1738–1750. Link, Google Scholar
- 5. . Radiocontrast media hypersensitivity in the Asia Pacific region. Asia Pac Allergy 2014;4(2):119–125. Crossref, Medline, Google Scholar
- 6. . Very deep convolutional networks for large-scale image recognition. arXiv 1409.1556 [preprint] https://arxiv.org/abs/1409.1556. Posted September 4, 2014. Updated April 10, 2015. Accessed November 20, 2021. Google Scholar
- 7. . CNNs and GANs in MRI-based cross-modality medical image estimation. arXiv 2106.02198 [preprint] https://arxiv.org/abs/2106.02198. Posted June 4, 2021. Accessed November 30, 2021. Google Scholar
- 8. . Synthesizing high-b-value diffusion-weighted imaging of the prostate using generative adversarial networks. Radiol Artif Intell 2021;3(5):e200237. Link, Google Scholar
- 9. . Deep-learning-based synthesis of post-contrast T1-weighted MRI for tumour response assessment in neuro-oncology: a multicentre, retrospective cohort study. Lancet Digit Health 2021;3(12):e784–e794. Crossref, Medline, Google Scholar
- 10. . Synthesis of gadolinium-enhanced liver tumors on nonenhanced liver MR images using pixel-level graph reinforcement learning. Med Image Anal 2021;69:101976. Crossref, Medline, Google Scholar
- 11. . Low-dose CT image denoising based on improved DD-Net and local filtered mechanism. Comput Intell Neurosci 2022;2022:2692301. Medline, Google Scholar
- 12. . A dual-encoder-single-decoder based low-dose CT denoising network. IEEE J Biomed Health Inform 2022;26(7):3251–3260. Crossref, Medline, Google Scholar
- 13. . Feasibility of utilizing ultra-low-dose contrast medium for pancreatic artery depiction using the combination of advanced virtual monoenergetic imaging and high-concentration contrast medium: an intra-patient study. Insights Imaging 2021;12(1):166. Crossref, Medline, Google Scholar
- 14. . Magnetic resonance image (MRI) synthesis from brain computed tomography (CT) images based on deep learning methods for magnetic resonance (MR)-guided radiotherapy. Quant Imaging Med Surg 2020;10(6):1223–1236. Crossref, Medline, Google Scholar
- 15. . ResViT: residual vision transformers for multimodal medical image synthesis. IEEE Trans Med Imaging 2022;41(10):2598–2614. Crossref, Medline, Google Scholar
- 16. . Image-to-image translation with conditional adversarial networks.
In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu, HI, 2017; 5967–5976. Google Scholar
- 17. . Unpaired image-to-image translation using cycle-consistent adversarial networks.
In: 2017 IEEE International Conference on Computer Vision (ICCV). Venice, Italy, 2017; 2242–2251. Google Scholar
- 18. . MedGAN: medical image translation using GANs. Comput Med Imaging Graph 2020;79:101684. Crossref, Medline, Google Scholar
- 19. . High-resolution image synthesis and semantic manipulation with conditional GANs.
In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City, Utah, 2018; 8798–8807. Google Scholar
- 20. . Multi-texture GAN: exploring the multi-scale texture translation for brain MR images. arXiv 2102.07225 [preprint] https://arxiv.org/abs/2102.07225. Posted February 14, 2021. Accessed March 30, 2022. Google Scholar
- 21. . Breaking the dilemma of medical image-to-image translation.
In: Advances in Neural Information Processing Systems 34 (NeurIPS 2021). 2021; 1964–1978. Google Scholar
- 22. . Deformable MR-CT image registration using an unsupervised, dual-channel network for neurosurgical guidance. Med Image Anal 2022;75:102292. Crossref, Medline, Google Scholar
- 23. . Hi-net: hybrid-fusion network for multi-modal MR image synthesis. IEEE Trans Med Imaging 2020;39(9):2772–2781. Crossref, Medline, Google Scholar
- 24. . Accelerating susceptibility-weighted imaging with deep learning by complex-valued convolutional neural network (ComplexNet): validation in clinical brain imaging. Eur Radiol 2022;32(8):5679–5687. Crossref, Medline, Google Scholar
- 25. . Rapid vessel segmentation and reconstruction of head and neck angiograms using 3D convolutional neural network. Nat Commun 2020;11(1):4829. Crossref, Medline, Google Scholar
- 26. . Deep learning-based post hoc CT denoising for myocardial delayed enhancement. Radiology 2022;305(1):82–91. Link, Google Scholar
- 27. . Bayesian noninferiority test for 2 binomial probabilities as the extension of Fisher exact test. Stat Med 2017;36(30):4789–4803. Crossref, Medline, Google Scholar
- 28. . Can virtual contrast enhancement in brain MRI replace gadolinium?: a feasibility study. Invest Radiol 2019;54(10):653–660. Crossref, Medline, Google Scholar
- 29. . Untargeted metabolomics identifies succinate as a biomarker and therapeutic target in aortic aneurysm and dissection. Eur Heart J 2021;42(42):4373–4385. Crossref, Medline, Google Scholar
- 30. . Sample size estimation in diagnostic test studies of biomedical informatics. J Biomed Inform 2014;48:193–204. Crossref, Medline, Google Scholar
- 31. . Synthetic FLAIR as a substitute for FLAIR sequence in acute ischemic stroke. Radiology 2022;303(1):153–159. Link, Google Scholar
- 32. . Generative adversarial networks to synthesize missing T1 and FLAIR MRI sequences for use in a multisequence brain tumor segmentation model. Radiology 2021;299(2):313–323. Link, Google Scholar
Article HistoryReceived: Mar 17 2023
Revision requested: May 15 2023
Revision received: Sept 28 2023
Accepted: Oct 4 2023
Published online: Nov 14 2023