J Shanghai Jiaotong Univ Sci ›› 2023, Vol. 28 ›› Issue (6): 717-727.doi: 10.1007/s12204-022-2471-0

• • 上一篇    下一篇

基于多重检测模型融合框架的印刷电路板缺陷检测

武 星1, 2*,张庆丰1, 王健嘉1, 2, 姚骏峰3, 郭毅可4,5   

  1. (1. 上海大学 计算机工程与科学学院,上海200444;2. 上海大学 先进通信与数据科学研究院,上海200444;3. 中国船舶集团海舟系统技术有限公司,上海200010;4. 香港科技大学,中国香港;5. 伦敦帝国理工学院数据科学研究所,英国伦敦SW7 2AZ)
  • 接受日期:2021-06-20 出版日期:2023-11-28 发布日期:2023-12-04

Multiple Detection Model Fusion Framework for Printed Circuit Board Defect Detection

WU Xing1,2*(武星),ZHANG Qingfeng1(张庆丰),WANG Jianjia1,2(王健嘉), YAO Junfeng3(姚骏峰),Guo Yike4.5(郭毅可)   

  1. (1. School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China; 2. Shanghai Institute for Advanced Communication and Data Science, Shanghai University, Shanghai 200444, China; 3. Shanghai Marine High-End Equipment Functional Platform Co., Ltd., Shanghai 201306, China; 4. Hong Kong Baptist University, Hong Kong, China; 5. Data Science Institute, Imperial College London, London SW7 2AZ, UK)
  • Accepted:2021-06-20 Online:2023-11-28 Published:2023-12-04

摘要: 印刷电路板(PCB)是电子产品不可或缺的组成部分,它决定了这些产品的质量。随着制造技术的发展和进步,PCB的布局和结构变得越来越复杂。然而,有效准确的PCB缺陷检测方法却很少。在实际生产环境中,对PCB缺陷检测的准确性有很高的要求,因此我们提出了两种包括多模型融合的PCB缺陷检测框架,包括多模型投票方法(DDMV)和多模型学习方法(DDML)的缺陷检测。为了减少错误和漏检,DDMV和DDML将多个具有不同融合策略的缺陷检测网络进行整合。通过对两个开源PCB数据集进行大量实验,验证了所提出框架的有效性和准确性。实验结果表明,所提出的DDMV和DDML在F1分数方面优于其他任何单独的最先进的PCB缺陷检测模型,而DDML的曲线下面积值也高于其他任何单独的检测模型。此外,与DDMV相比,使用自动机器学习方法的DDML在PCB缺陷检测方面达到了最好的性能,在两个数据集上的F1分数分别可达到99.7%和95.6%。

关键词: 印刷电路板(PCB), 缺陷检测, 模型融合, 目标检测模型

Abstract: The printed circuit board (PCB) is an indispensable component of electronic products, which determines the quality of these products. With the development and advancement of manufacturing technology, the layout and structure of PCB are getting complicated. However, there are few effective and accurate PCB defect detection methods. There are high requirements for the accuracy of PCB defect detection in the actual production environment, so we propose two PCB defect detection frameworks with multiple model fusion including the defect detection by multi-model voting method (DDMV) and the defect detection by multi-model learning method (DDML). With the purpose of reducing wrong and missing detection, the DDMV and DDML integrate multiple defect detection networks with different fusion strategies. The effectiveness and accuracy of the proposed framework are verified with extensive experiments on two open-source PCB datasets. The experimental results demonstrate that the proposed DDMV and DDML are better than any other individual state-of-the-art PCB defect detection model in F1-score, and the area under curve value of DDML is also higher than that of any other individual detection model. Furthermore, compared with DDMV, the DDML with an automatic machine learning method achieves the best performance in PCB defect detection, and the F1-score on the two datasets can reach 99.7% and 95.6% respectively.

中图分类号: