Novel Multi-Step Deep Learning Approach for Detection of Complex Defects in Solar Cells

doi:10.1007/s12204-023-2670-3

Abstract

Abstract: Solar cell defects exhibit significant variations and multiple types, with some defect data being difficult to acquire or having small scales, posing challenges in terms of small sample and small target in defect detection for solar cells. In order to address this issue, this paper proposes a multi-step approach for detecting the complex defects of solar cells. First, individual cell plates are extracted from electroluminescence images for block-by-block detection. Then, StyleGAN2-Ada is utilized for generative adversarial networks data augmentation to expand the number of defect samples in small sample defects. Finally, the fake dataset is combined with real dataset, and the improved YOLOv5 model is trained on this mixed dataset. Experimental results demonstrate that the proposed method achieves a superior performance in detecting the defects with small sample and small target, with the final recall rate reaching 99.7%, an increase of 3.9% compared with the unimproved model. Additionally, the precision and mean average precision are increased by 3.4% and 3.5%, respectively. Moreover, the experiments demonstrate that the improved network training on the mixed dataset can effectively enhance the detection performance of the model. The combination of these approaches significantly improves the network’s ability to detect solar cell defects.

Key words: intelligent manufacturing, intelligent defect recognition, deep learning, data augmentation, solar cells

摘要： 太阳能电池片的缺陷变化大且种类多，部分缺陷样本难以获取或者尺度较小，存在小样本与小目标的问题，为太阳能电池片缺陷检测带来了挑战。为了解决这一问题，本文提出了一种多阶段的太阳能电池复杂缺陷检测方法。首先提取电致发光图像中的单块细胞板进行逐块检测，再通过StyleGAN2-ada进行GAN数据增强，扩充小样本缺陷数量，最后在混合数据集上通过改进后的YOLOv5进行训练。通过实验证明该方法得到的模型面对小样本、小目标的缺陷表现更加优秀，最后结果召回率达到了99.7%，相较于未改进前提高了3.9%，同时精确率与平均精度均值也分别提高了3.4%、3.5%。并且实验表明，使用混合数据集训练与改进网络的方式可以提高模型的检测效果，两者共用有效地提高了网络对于太阳能电池缺陷的检测性能。

关键词: 智能制造，智能缺陷识别，深度学习，数据增强，太阳能电池

CLC Number:

TP391.4

JIANG Wenbo, ZHENG Hangbin, BAO Jinsong. Novel Multi-Step Deep Learning Approach for Detection of Complex Defects in Solar Cells[J]. J Shanghai Jiaotong Univ Sci, 2025, 30(5): 1050-1064.

References

[1] ZOU C N, ZHAO Q, ZHANG G S, et al. Energy revolution: From a fossil energy era to a new energy era [J]. Natural Gas Industry B, 2016, 3(1): 1-11.

[2] KANNAN N, VAKEESAN D. Solar energy for future world: - A review [J]. Renewable and Sustainable Energy Reviews, 2016, 62: 1092-1105.

[3] CHEN H Y, ZHAO H F, HAN D, et al. Accurate and robust crack detection using steerable evidence filtering in electroluminescence images of solar cells [J]. Optics and Lasers in Engineering, 2019, 118: 22-33.

[4] TSAI D M, WU S C, LI W C. Defect detection of solar cells in electroluminescence images using Fourier image reconstruction [J]. Solar Energy Materials and Solar Cells, 2012, 99: 250-262.

[5] DHIMISH M, HOLMES V. Solar cells micro crack detection technique using state-of-the-art electroluminescence imaging [J]. Journal of Science: Advanced Materials and Devices, 2019, 4(4): 499-508.

[6] LIU L X, ZHU Y F, UR RAHMAN M R, et al. Surface defect detection of solar cells based on feature pyramid network and GA-faster-RCNN [C]//2019 2nd China Symposium on Cognitive Computing and Hybrid Intelligence (CCHI). Xi'an: IEEE, 2019: 292-297.

[7] BARTLER A, MAUCH L, YANG B, et al. Automated detection of solar cell defects with deep learning [C]//2018 26th European Signal Processing Conference. Rome: IEEE, 2018: 2035-2039.

[8] BALZATEGUI J, ECIOLAZA L, MAESTRO-WATSON D. Anomaly detection and automatic labeling for solar cell quality inspection based on generative adversarial network [J]. Sensors, 2021, 21(13): 4361.

[9] TSAI D M, LI G N, LI W C, et al. Defect detection in multi-crystal solar cells using clustering with uniformity measures [J]. Advanced Engineering Informatics, 2015, 29(3): 419-430.

[10] SU B Y, CHEN H Y, ZHU Y F, et al. Classification of manufacturing defects in multicrystalline solar cells with novel feature descriptor [J]. IEEE Transactions on Instrumentation and Measurement, 2019, 68(12): 4675-4688.

[11] LUO Q W, SUN Y C, LI P C, et al. Generalized completed local binary patterns for time-efficient steel surface defect classification [J]. IEEE Transactions on Instrumentation and Measurement, 2019, 68(3): 667-679.

[12] ZHANG X, HAO Y W, SHANGGUAN H, et al. Detection of surface defects on solar cells by fusing Multi-channel convolution neural networks [J]. Infrared Physics & Technology, 2020, 108: 103334.

[13] ZHANG M, YIN L J. Solar cell surface defect detection based on improved YOLO v5 [J]. IEEE Access, 2022, 10: 80804-80815.

[14] TANG W Q, YANG Q, XIONG K X, et al. Deep learning based automatic defect identification of photovoltaic module using electroluminescence images [J]. Solar Energy, 2020, 201: 453-460.

[15] SU B Y, CHEN H Y, CHEN P, et al. Deep learning-based solar-cell manufacturing defect detection with complementary attention network [J]. IEEE Transactions on Industrial Informatics, 2021, 17(6): 4084-4095.

[16] KUMAR A. Computer-vision-based fabric defect detection: A survey [J]. IEEE Transactions on Industrial Electronics, 2008, 55(1): 348-363.

[17] LUO Q W, FANG X X, LIU L, et al. Automated visual defect detection for flat steel surface: A survey [J]. IEEE Transactions on Instrumentation and Measurement, 2020, 69(3): 626-644.

[18] ZENG N Y, WU P S, WANG Z D, et al. A small-sized object detection oriented multi-scale feature fusion approach with application to defect detection [J]. IEEE Transactions on Instrumentation and Measurement, 2022, 71: 1-14.

[19] LI X, ZHANG W, DING Q, et al. Intelligent rotating machinery fault diagnosis based on deep learning using data augmentation [J]. Journal of Intelligent Manufacturing, 2020, 31(2): 433-452.

[20] JAIN S, SETH G, PARUTHI A, et al. Synthetic data augmentation for surface defect detection and classification using deep learning [J]. Journal of Intelligent Manufacturing, 2022, 33(4): 1007-1020.

[21] GOODFELLOW I, POUGET-ABADIE J, MIRZA M, et al. Generative adversarial networks [J]. Communications of the ACM, 2020, 63(11): 139-144.

[22] REN S Q, HE K M, GIRSHICK R, et al. Faster R-CNN: Towards real-time object detection with region proposal networks [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6): 1137-1149.

[23] KARRAS T, AITTALA M, HELLSTEN J, et al. Training generative adversarial networks with limited data [C]//Proceedings of the 34th International Conference on Neural Information Processing Systems. New York: ACM, 2020: 12104-12114.

[24] WOO S, PARK J, LEE J Y, et al. CBAM: convolutional block attention module[M]//European conference on computer vision. Cham: Springer, 2018: 3-19.

[25] GE Z, LIU S T, WANG F, et al. YOLOX: Exceeding YOLO series in 2021 [DB/OL]. (2021-07-18). https://arxiv.org/abs/2107.08430

[26] LI H L, LI J, WEI H B, et al. Slim-neck by GSConv: A better design paradigm of detector architectures for autonomous vehicles [DB/OL]. (2022-06-06). https://arxiv.org/abs/2206.02424

[27] SOMEPALLI G, SINGLA V, GOLDBLUM M, et al. Diffusion art or digital forgery? investigating data replication in diffusion models [C]//2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition. Vancouver:. IEEE, 2023: 6048-6058.