Artificial Intelligence Medical Ultrasound Equipment: Application of Breast Lesions Detection

Abstract

Breast cancer ranks first among cancers affecting women’s health. Our work aims to realize the intelligence of the medical ultrasound equipment with limited computational capability, which is used for the assistant detection of breast lesions. We embed the high-computational deep learning algorithm into the medical ultrasound equipment with limited computational capability by two techniques: (1) lightweight neural network: considering the limited computational capability of ultrasound equipment, a lightweight neural network is designed, which greatly reduces the amount of calculation. And we use the technique of knowledge distillation to train the low-precision network helped with the high-precision network; (2) asynchronous calculations: consider four frames of ultrasound images as a group; the image of the first frame of each group is used as the input of the network, and the result is respectively fused with the images of the fourth to seventh frames. An amount of computation of 30 GFLO/frame is required for the proposed lightweight neural network, about 1/6 of that of the large high-precision network. After trained from scratch using the knowledge distillation technique, the detection performance of the lightweight neural network (sensitivity = 89.25%, specificity = 96.33%, the average precision [AP] = 0.85) is close to that of the high-precision network (sensitivity = 98.3%, specificity = 88.33%, AP = 0.91). By asynchronous calculation, we achieve real-time automatic detection of 24 fps (frames per second) on the ultrasound equipment. Our work proposes a method to realize the intelligence of the low-computation-power ultrasonic equipment, and successfully achieves the real-time assistant detection of breast lesions. The significance of the study is as follows: (1) The proposed method is of practical significance in assisting doctors to detect breast lesions; (2) our method provides some practical and theoretical support for the development and engineering of intelligent equipment based on artificial intelligence algorithms.

Keywords

artificial intelligence algorithm medical ultrasound equipment breast lesions lightweight neural network real-time detection knowledge distillation

Get full access to this article

View all access options for this article.

References

Bray

Ferlay

Soerjomataram

Siegel

Torre

Jemal

. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin. 2018;68(6):394-424.

Cheng

Shan

Guo

Zhang

. Automated breast cancer detection and classification using ultrasound images: a survey. Pattern Recogn. 2010;43(1):299-317.

Zhang

Shu

Zheng

. Advantages and disadvantages of the X-ray and ultrasound examination for breast cancer diagnosis. J China Med Univ. 2010;39(6):485-6.

Stavros

Thickman

Rapp

Dennis

Parker

Sisney

. Solid breast nodules: use of sonography to distinguish between benign and malignant lesions. Radiology. 1995;196(1):123-34.

Han

Liu

Han

Santika

INT

Zhao

, et al. The LISS—a public database of common imaging signs of lung diseases for computer-aided detection and diagnosis research and medical education. IEEE Trans Biomed Eng. 2014;62(2):648-56.

Shin

Roth

Gao

, et al. Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging. 2016;35(5):1285-98.

Gubern-Mérida

Martí

Melendez

Hauth

Mann

Karssemeijer

, et al. Automated localization of breast cancer in DCE-MRI. Med Image Anal. 2015;20:265-74.

Ertas

Doran

Leach

. Computerized detection of breast lesions in multi-centre and multi-instrument DCE-MR data using 3D principal component maps and template matching. Phys Med Biol. 2011;56(24):7795-811.

Deng

Tang

Wang

Zhang

. Spatiotemporal breast mass detection network (MD-Net) in 4D DCE-MRI images. In: Shen

Liu

Peters

Staib

Essert

Zhou

, eds. International Conference on Medical Image Computing and Computer-Assisted Intervention. Cham: Springer; 2019. pp. 271-9.

10.

Cao

Duan

Yang

Yue

Chen

, et al. Breast tumor detection in ultrasound images using deep learning. In: Wu

Munsell

Zhan

Bai

Sanroma

Coupé

, eds. International Workshop on Patch-Based Techniques in Medical Imaging. Cham: Springer; 2017. vol. 10530. pp. 121-8.

11.

Vakanski

Xian

Freer

. Attention enriched deep learning model for breast tumor segmentation in ultrasound images. arXiv preprint arXiv:1910.08978, 2019.

12.

Moon

Huang

Y-S

Hsu

C-H

Chien

T-YC

Chang

Lee

, et al. Computer-aided tumor detection in automated breast ultrasound using a 3-D convolutional neural network. Comput Methods Programs Biomed. 2020;190:105360.

13.

Tadayyon

Gangeh

Sannachi

Trudeau

Pritchard

Ghandi

, et al. A priori prediction of breast tumour response to chemotherapy using quantitative ultrasound imaging and artificial neural networks. Oncotarget. 2019;10(39):3910-23.

14.

Houssami

Kirkpatrick-Jones

Noguchi

Lee

. Artificial Intelligence (AI) for the early detection of breast cancer: a scoping review to assess AI’s potential in breast screening practice. Expert Rev Med Devices. 2019;16(5):351-62.

15.

Jarosik

Lewandowski

. The feasibility of deep learning algorithms integration on a GPU-based ultrasound research scanner. In: IEEE International Ultrasonics Symposium (IUS), Washington, DC, 6-9 September 2017, pp. 1-4.

16.

Kong

Sun

Liu

Jiang

Shi

. FoveaBox: beyond anchor-based object detector. arXiv preprint arXiv:1904.03797, 2019.

17.

Liu

Huang

Wang

. Receptive field block net for accurate and fast object detection. In: Proceedings of the European Conference on Computer Vision (ECCV), Munich, 8-14 September 2018, pp. 385-400.

18.

Girshick

Donahue

Darrell

Malik

. Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, 23-28 June 2014, pp. 580-7.

19.

Ren

Girshick

Sun

. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2017;39:1137-49.

20.

Lin

T-Y

Dollár

Girshick

Hariharan

Belongie

. Feature pyramid networks for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, 21-26 July 2017, pp. 2117-25.

21.

Gkioxari

Dollár

Girshick

. Mask R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, Venice, 22-29 October 2017, pp. 2961-9.

22.

Pang

Chen

Shi

Feng

Ouyang

Lin

. Libra R-CNN: towards balanced learning for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, 15-20 June 2019, pp. 821-30.

23.

Singh

Davis

. An analysis of scale invariance in object detection—SNIP. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, 18-23 June 2018, pp. 3578-87.

24.

Redmon

Farhadi

. Yolov3: an incremental improvement. arXiv preprint arXiv:1804.02767, 2018.

25.

Liu

Anguelov

Erhan

Szegedy

Reed

C-Y

, et al. SSD: single shot multibox detector. In: European Conference on Computer Vision, Amsterdam, 11–14 October 2016, pp. 21-37.

26.

Denil

Shakibi

Dinh

Ranzato

de Freitas

. Predicting parameters in deep learning. In: Advances in Neural Information Processing Systems, 2013, pp.2148-56.

27.

Chen

Wilson

Tyree

Weinberger

Chen

. Compressing neural networks with the hashing trick. In: International Conference on Machine Learning, Lille, France, 6-11 July 2015, pp. 2285-94.

28.

Denton

Zaremba

Bruna

LeCun

Fergus

. Exploiting linear structure within convolutional networks for efficient evaluation. In: Ghahramani

Welling

Cortes

Lawrence

Weinberger

, eds. Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press; 2014. pp. 1269-77.

29.

Jaderberg

Vedaldi

Zisserman

. Speeding up convolutional neural networks with low rank expansions. arXiv preprint arXiv:1405.3866, 2014.

30.

Chen

Choi

Han

Chandraker

. Learning efficient object detection models with knowledge distillation. In: von Luxburg

Guyon

Bengio

Wallach

Fergus

, eds. Advances in Neural Information Processing Systems. Red Hook, NY: Curran Associates; 2017. pp. 742-51.

31.

Zhang

Zou

Sun

. Accelerating very deep convolutional networks for classification and detection. IEEE T Pattern Anal. 2015;38(10):1943-55.

32.

Zhang

Zou

Ming

Sin

. Efficient and accurate approximations of nonlinear convolutional networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, 7-12 June 2015, pp. 1984-92.

33.

Mishra

Marr

. Apprentice: using knowledge distillation techniques to improve low-precision network accuracy. arXiv preprint arXiv:1711.05852, 2017.

34.

Buciluǎ

Caruana

Niculescu-Mizil

. Model compression. In: Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Philadelphia, PA, August 2006, pp. 535-41.

35.

Hinton

Vinyals

Dean

. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531, 2015.

36.

Cao

Duan

Yang

Yue

Chen

, et al. Breast tumor detection in ultrasound images using deep learning. In: Wu

Munsell

Zhan

Bai

Sanroma

Coupé

, eds. International Workshop on Patch-Based Techniques in Medical Imaging. Cham: Springer; 2017. pp. 121-8.

37.

Jiang

Zhu

Kong

. Cascade convolutional neural networks for automatic detection of thyroid nodules in ultrasound images. Med Phys. 2017;44(5):1678-91.

38.

Lin

T-Y

Goyal

Girshick

Dollár

. Focal loss for dense object detection. In: Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy, 22-29 October 2017.

39.

Hinton

Vinyals

Dean

. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531, 2015.

40.

Jorda

Valero-Lara

Peña

. Performance evaluation of cuDNN convolution algorithms on NVIDIA Volta GPUs. IEEE Access. 2019;7:70461-73.