Education, Science, Technology, Innovation and Life
Open Access
Sign In

Magnetic Resonance Image Super-Resolution via Multi-Resolution Learning

Download as PDF

DOI: 10.23977/phpm.2023.030307 | Downloads: 10 | Views: 374

Author(s)

Wang Wentao 1, Zhang Kaixiang 1

Affiliation(s)

1 Affiliated Hospital of Shandong University of Traditional Chinese Medicine, Jinan, China

Corresponding Author

Wang Wentao

ABSTRACT

High-resolution magnetic resonance images are of great significance for medical diagnosis. A convolutional neural network with multi-resolution learning is proposed for magnetic resonance image (MR) superresolution. The network is an improved deep residual network, which involves residual units for feature extraction, a deconvolution layer for multi-resolution up-sampling, and a multi-resolution learning layer. The proposed network performs the super-resolution task in the low-resolution space, which can accelerate the network. Multiresolution upsampling is put forward to integrate multiple residual unit information and to accelerate the network. Multi-resolution learning can adaptively determine the contributions of these upsampled high-dimensional feature maps to high-resolution MR image reconstruction. Experiment results indicate that the proposed method can achieve a good super-resolution reconstruction performance for magnetic resonance images, which is superior to the state-of-the-art deep learning methods.

KEYWORDS

Convolutional neural network; multi-resolution learning; magnetic resonance image; super-resolution reconstruction

CITE THIS PAPER

Wang Wentao, Zhang Kaixiang, Magnetic Resonance Image Super-Resolution via Multi-Resolution Learning. MEDS Public Health and Preventive Medicine (2023) Vol. 3: 43-51. DOI: http://dx.doi.org/10.23977/phpm.2023.030307.

REFERENCES

[1] Shi F, Cheng J, Wang L, Etal. LRTV: MR image super- resolution with low-rank and total variation regularizations [J]. IEEE Transactions on Medical Imaging, 2015, 34(12): 2459-2466.
[2] Plenge E, Poot D H J, Bernsen M, et al. Super-resolution methods in MRI: Can they improve the trade-off between resolution, signal-to-noise ratio, and acquisition time? [J]. Magnetic Resonance in Medicine, 2012, 68(6):1983-1993.
[3] Wu J, Cai N, Li F, etal. Automatic detonator code recognition via deep neural network [J]. Expert Systems with Applications, 2020, 145: 113121.
[4] Fu X, Cai N, Huang K, et al. M-net: a novel u-net with multstream feature fusion and multscale dilated convolutions for bile ducts and hepatolith segmentation [J]. IEEE Access, 2019, 7: 148645-148657.
[5] Wu J, Cai N, Chen W, etal. Automatic detection of hardhats worn by construction personnel: a deep learning approach and benchmark dataset [J]. Automation in Construction, 2019, 106: 102894.
[6] Weng S W, Peng Y H, Wei B, et al. A two-stage-video forgery based on inception-v3 network [J]. Journal of Guangdong University of Technology, 2019, 36(6): 16-23.
[7] Gao J Y, Liu W Y, Yang Z G. Object tracking combined with attention and feature fusion [J]. Journal of Guangdong
University of Technology, 2019, 36(4): 18-23.
[8] Ye W J, Gao H J, Weng S W, et al. A two-stage effect rendering method for art font based on CGAN network [J].Journal of Guangdong University of Technology, 2019, 36(3): 47-55.
[9] Haris M, Shakhnarovich G, Ukita N. Deep backprojection networks for superresolution [C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City: IEEE, 2018: 1664-1673.
[10] Pham C H, Ducournau A, Fablet R, et al. Brain MRI super-resolution using deep 3D convolutional networks [C] //2017 IEEE 14th International Symposium on Biomedical Imaging. Melbourne: IEEE, 2017: 197-200.
[11] Dong C, Loy C C, He K, et al. Learning a deep convolutional network for image super-resolution[C]//European Conference on Computer Vision. Amsterdam: Springer, Cham, 2014: 184-199.
[12] Dong C, Loy Cc, He K, et al. Image super-resolution us- ing deep convolutional networks [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 38(2): 295-307.
[13] Oktay O, Bai W, Lee M, et al. Multi-input cardiac image super-resolution using convolutional neural networks[C]// International Conference on Medical Image Computing and Computer-assisted Intervention. Istanbul: Springer, Cham, 2016: 246-254.
[14] Giannakidis A, Oktay A O, Keegan J. Super-resolution reconstruction of late gadolinium cardiovascular magnetic resonance images using a residual convolutional neual network 25th Scientific Meeting of the Int[C]//International Society for Magnetic Resonance in Medicine. Hawaii: [s.n.], 2017.
[15] Kim J, Kwon Lee J, Mu Lee K. Accurate image super- resolution using very deep convolutional networks [C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 1646-1654.
[16] Shi J, Li Z, Ying S, et al. MR image super-resolution via wide residual networks with fixed skip connection [J]. IEEE Journal of Biomedical and Health Informatics, 2018, 23(3): 1129-1140.
[17] Mcdonagh S, Hou B, Alansary A, et al. Context- sensitive super-resolution for fast fetal magnetic resonance imaging[C]//Molecular Imaging, Reconstruction and Analysis of Moving Body Organs, and Stroke Imaging and Treatment. Canada: Springer, Cham, 2017: 116-126.
[18] Dong C, Loy C C, Tang X. Accelerating the super-resolution convolutional neural network[C]//European Conference on Computer Vision. Amsterdam: Springer, Cham, 2016: 391-407.
[19] Tanno R, Worrall D E, Ghosh A, etal. Bayesian image quality transfer with CNNs: exploring uncertainty in dMRI super-resolution [C]//International Conference on Medical Image Computing and Computer-Assisted Intervention. Istanbul: Springer, Cham, 2017: 611-619.
[20] Shi W, Caballero J, Huszár F, etal. Real-time single image and video super-resolution using an efficient subpixel convolutional neural network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 1874-1883.
[21] Tai Y, Yang J, Liu X. Image super-resolution via deep recursive residual network[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Hawaii: IEEE, 2017: 3147-3155.
[22] He K, Zhang X, Ren S, etal. Deep residual learning for image recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 770-778.
[23] Wang Z, Bovik A C, Sheikh H R, et al. Image quality assessment: from error visibility to structural similarity [J]. IEEE Transactions on Image Processing, 2004, 13(4): 600-612.
[24] He K, Zhang X, Ren S, et al. Delving deep into recti- fiers: Surpassing human-level performance on image net classification[C]//Proceedings of the IEEE International Conference on Computer Vision. Boston: IEEE, 2015: 1026-1034.

Downloads: 1922
Visits: 86428

Sponsors, Associates, and Links


All published work is licensed under a Creative Commons Attribution 4.0 International License.

Copyright © 2016 - 2031 Clausius Scientific Press Inc. All Rights Reserved.