Breast cancer is one of the malignancies that endanger women’s health all over the world. Considering
that there is some noise and edge blurring in breast pathological images, it is easier to extract shallow features
of noise and redundant information when VGG16 network is used, which is affected by its relative shallow depth
and small convolution kernel. To improve the pathological diagnosis of breast cancers, we propose a classification
method for benign and malignant tumors in the breast pathological images which is based on feature concatenation
of VGG16 network. First, in order to improve the problems of small dataset size and unbalanced data samples, the
original BreakHis dataset is processed by data augmentation technologies, such as geometric transformation and
color enhancement. Then, to reduce noise and edge blurring in breast pathological images, we perform bilateral
filtering and denoising on the original dataset and sharpen the edge features by Sobel operator, which makes the
extraction of shallow features by VGG16 model more accurate. Based on transfer learning, the network model
trained with the expanded dataset is called VGG16-1, and another model trained with the image denoising and
sharpening and mixed with the original dataset is called VGG16-2. The features extracted by VGG16-1 and
VGG16-2 are concatenated, and then classified by support vector machine. The final experimental results show
that the average accuracy is 98.44%, 98.89%, 98.30% and 97.47%, respectively, when the proposed method is
tested with the breast pathological images of 40×, 100×, 200× and 400× on BreakHis dataset.
LIU Min (刘 敏), YI Ming (易 鸣), WU Minghu∗ (武明虎), WANG Juan (王 娟), HE Yu (何 宇)
. Breast Pathological Image Classification Based on VGG16 Feature Concatenation[J]. Journal of Shanghai Jiaotong University(Science), 2022
, 27(4)
: 473
-484
.
DOI: 10.1007/s12204-021-2398-x
[1] MASCARA M, CONSTANTINOU C. Global perceptions of women on breast cancer and barriers to screening [J]. Current Oncology Reports, 2021, 23(7): 1-9.
[2] ZHOU X T, SHEN S J, SUN Q. Current situation and progress of breast cancer screening in China [J].Chinese Journal of the Frontiers of Medical Science(Electronic Version), 2020, 12(3): 6-11 (in Chinese).
[3] TIAN J X, LIU G C, GU S S, et al. Deep learning in medical image analysis and its challenges [J]. Acta Automatica Sinica, 2018, 44(3): 401-424 (in Chinese).
[4] ZHANG L, ZHANG Y. Big data analysis by infinite deep neural networks [J]. Journal of Computer Re-search and Development, 2016, 53(1): 68-79 (in Chinese).
[5] SAXENA S, SHUKLA S, GYANCHANDANI M.Pretrained convolutional neural networks as feature extractors for diagnosis of breast cancer using histopathology [J]. International Journal of Imaging Systems and Technology, 2020, 30(3): 577-591.
[6] PAR VIN F, MEHEDI HASAN M A. A comparative study of different types of convolutional neural net-works for breast cancer histopathological image classification [C]//2020 IEEE Region 10 Symposium (TEN-SYMP). Dhaka: IEEE, 2020: 945-948.
[7] LING Y, SUN Z Q. Recognition algorithm of breast pathological images based on convolutional neural net-work [J]. Journal of Jiangsu University (Natural Science Edition), 2019, 40(5): 573-578 (in Chinese).
[8] Y U L T , X I A Y Q , Y A N Y S , e t a l . B r e a s t c a n c e rpathological image classification based on a convolutional neural network [J]. Journal of Harbin Engineering University, 2021, 42(4): 567-573 (in Chinese).
[9] SPANHOL F A, OLIVEIRA L S, PETITJEAN C, etal. A dataset for breast cancer histopathological im-age classification [J]. IEEE Transactions on Biomedical Engineering, 2016, 63(7): 1455-1462.
[10] SAINI M, SUSAN S B. Data augmentation of minority class with transfer learning for classification of imbalanced breast cancer dataset using inception-V3[M]//Pattern recognition and image analysis. Cham:Springer, 2019: 409-420.
[11] HUANG Y. Low illumination image enhance mentbased on bilateral filtering and improved CLAHE algorithm [D]. Xiangtan: Xiangtan University, 2019 (in Chinese).
[12] WANG Y Y, ZHOU Z G, LUO L K. Image enhancement algorithm based on sobel operator filtering [J].Computer Applications and Software, 2019, 36(12):184-188 (in Chinese).
[13] W ANG Y L. Study of algorithnm in image processing based on the bilateral filter [D]. Xi’an: Xidian University, 2010 (in Chinese).
[14] WANG Y, LEI B, ELAZAB A, et al. Breast cancer im-age classification via multi-network features and dual-network orthogonal low-rank learning [J]. IEEE Access, 2020, 8: 27779-27792.
[15] S H I N H C , R O T H H R , G A O M C , e t a l . D e e p c o n v o lutional neural networks for computer-aided detection:CNN architectures, dataset characteristics and trans-fer learning [J]. IEEE Transactions on Medical Imaging, 2016, 35(5): 1285-1298.
[16] ALKHALEEF AH M, MA S C, CHANG Y L, et al.Double-shot transfer learning for breast cancer classification from X-ray images [J]. Applied Sciences, 2020,10(11): 3999.
[17] SINGH R, AHMED T, KUMAR A, et al. Imbalanced breast cancer classification using transfer learning [J].IEEE/ACM Transactions on Computational Biologyand Bioinformatics, 2021, 18(1): 83-93.
[18] KUMAR A, KIM J, LYNDON D, et al. An ensemble of fine-tuned convolutional neural networks for medical image classification [J]. IEEE Journal of Biomedicaland Health Informatics, 2017, 21(1): 31-40.
[19] SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition [EB/OL]. (2015-04-10). https://arxiv.org/abs/1409.1556.
[20] SZEGEDY C, V ANHOUCKE V, IOFFE S, et al. Re-thinking the inception architecture for computer vision[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, NV: IEEE,2016: 2818-2826.
[21] SZEGEDY C, IOFFE S, V ANHOUCKE V, et al.Inception-v4, inception-resnet and the impact of residual connections on learning [EB/OL]. (2016-08-23).https://arxiv.org/abs/1602.07261.
[22] HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition [C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Las Vegas, NV: IEEE, 2016: 770-778.
[23] ZOU W K, LU H J, YE M C, et al. Breast cancer histopathological image classification using convolutional neural network [J]. Computer Engineering and Design, 2020, 41(6): 1749-1754 (in Chinese).
[24] GOUR M, JAIN S, SUNIL KUMAR T. Residual learning based CNN for breast cancer histopathological im-age classification [J]. International Journal of Imaging Systems and Technology, 2020, 30(3): 621-635.
[25] DENIZ E, S?ENG üR A, KADIRO ˇGLU Z, et al. Trans-fer learning based histopathologic image classification for breast cancer detection [J]. Health Information Science and Systems, 2018, 6(1): 1-7.
[26] SUN F Q, CONG C L, ZHANG K, et al. Benign and malignant diagnosis of breast cancer histopathological image based on multi-model neural network [J]. Journal of Chinese Computer Systems, 2020, 41(4): 732-735 (in Chinese).
