基于亮度突变性与密度特征检测的厚板T形接头焊缝轮廓识别

doi:10.16183/j.cnki.jsjtu.2020.068

上海交通大学学报 ›› 2021, Vol. 55 ›› Issue (6): 757-763.doi: 10.16183/j.cnki.jsjtu.2020.068

所属专题：《上海交通大学学报》2021年“金属学与金属工艺”专题；《上海交通大学学报》2021年12期专题汇总专辑

基于亮度突变性与密度特征检测的厚板T形接头焊缝轮廓识别

何银水(), 李岱泽, 赵梓宇, 钱韦旭

南昌大学资源环境与化工学院, 南昌 330031

收稿日期:2020-03-10 出版日期:2021-06-28 发布日期:2021-06-30
作者简介:何银水(1979-),男,安徽省安庆市人,讲师,主要从事机器人焊缝图像识别及其控制方面的研究工作.电话(Tel.):13767050849;E-mail: heyingshui117@163.com
基金资助:
国家自然科学基金(62066029);国家自然科学基金(51665037);南昌航空大学无损检测技术教育部重点实验室开放基金(EW201980090)

Weld Seam Profile Identification with T-Joints Based on Intensity Mutation and Density Feature Detection for Thick Plate Welding Process

HE Yinshui(), LI Daize, ZHAO Ziyu, QIAN Weixu

School of Resources Environmental and Chemical Engineering, Nanchang University, Nanchang 330031, China

Received:2020-03-10 Online:2021-06-28 Published:2021-06-30

摘要/Abstract

摘要：

基于激光视觉传感的厚板电弧焊接中,为实现自动化、智能化,焊接需要有效的焊缝轮廓提取方法.针对厚板T形接头熔化极活性气体保护焊中焊缝图像强烈的电弧干扰背景,提出了一种基于亮度突变性与密度特征检测的焊缝轮廓识别方法.首先,采用改进的Canny算法凸显焊缝轮廓边缘并抑制电弧干扰背景.然后,利用激光条纹在局部区域内存在亮度突变的特性,提出一种亮度突变检测方法对干扰背景进一步抑制.最后,在Otsu阈值分割处理的基础上,提出了基于带宽与密度特征逐列扫描去除干扰的算法,并将处理后的数据进行最近邻聚类,利用数据类的空间尺度特征识别焊缝轮廓.结果表明:提出的算法在处理电弧区域占图像面积近20%的强干扰时,能有效地提取不同填充阶段焊缝轮廓95%以上的整体信息,可为不同接头机器人自动化、智能化焊接的进一步实施提供参考.

关键词: 亮度突变性, 密度特征检测, 改进Canny算法, 焊缝轮廓识别, 视觉传感, T形接头

Abstract:

There is a need for the effective weld seam profile extraction method to realize the automatic and intelligent welding process with thick steel plates based on laser vision sensing. In this paper, a method was proposed to identify the variable weld seam profiles from the strong arc background based on intensity mutation and density feature detection for the thick plate welding process with T-joints. First, an improved Canny algorithm was used to magnify the weld seam profile and restrain interference. Next, an intensity mutation detection method was proposed to further strengthen the weld seam profile because there exists intensity mutation in the local region surrounding the weld seam profile. Finally, an algorithm based on the band-width and density feature scanning method was proposed to further eliminate the interference data after the strengthened image was binarized with the Otsu algorithm. The weld seam profile was identified as clusters with their spatial scale features after the nearest neighbor clustering was dealt with. The results show that this method can identify over 95% of the weld seam profiles from the arc interference background whose area is about 20% of the image. It provides valuable reference for promoting the automatic and intelligent welding process with different joints.

Key words: intensity mutation, density feature detection, improved Canny algorithm, weld seam profile identification, visual sensing, T-joints

中图分类号:

TG409

何银水, 李岱泽, 赵梓宇, 钱韦旭. 基于亮度突变性与密度特征检测的厚板T形接头焊缝轮廓识别[J]. 上海交通大学学报, 2021, 55(6): 757-763.

HE Yinshui, LI Daize, ZHAO Ziyu, QIAN Weixu. Weld Seam Profile Identification with T-Joints Based on Intensity Mutation and Density Feature Detection for Thick Plate Welding Process[J]. Journal of Shanghai Jiao Tong University, 2021, 55(6): 757-763.

图/表 14

图1

图2

图3

图4

图5

图6

图7

图8

图9

图10

图11

图12

图13

图14

参考文献 14

[1]	XU Y L, FANG G, CHEN S B, et al. Real-time image processing for vision-based weld seam tracking in robotic GMAW[J]. The International Journal of Advanced Manufacturing Technology, 2014, 73(9/12):1413-1425. doi: 10.1007/s00170-014-5925-1 URL
[2]	LIU F Q, WANG Z Y, JI Y. Precise initial weld position identification of a fillet weld seam using laser vision technology[J]. The International Journal of Advanced Manufacturing Technology, 2018, 99(5/8):2059-2068. doi: 10.1007/s00170-018-2574-9 URL
[3]	CHEN H Y, LIU W P, HUANG L Y, et al. The decoupling visual feature extraction of dynamic three-dimensional V-type seam for gantry welding robot[J]. The International Journal of Advanced Manufacturing Technology, 2015, 80(9/12):1741-1749. doi: 10.1007/s00170-015-7158-3 URL
[4]	FAN J F, JING F S, YANG L, et al. An initial point alignment method of narrow weld using laser vision sensor[J]. The International Journal of Advanced Manufacturing Technology, 2019, 102(1/4):201-212. doi: 10.1007/s00170-018-3184-2 URL
[5]	WU Q Q, LEE J P, PARK M H, et al. A study on the modified Hough algorithm for image processing in weld seam tracking[J]. Journal of Mechanical Science and Technology, 2015, 29(11):4859-4865. doi: 10.1007/s12206-015-1033-x URL
[6]	陈路路, 胡明华, 陈云霞, 等. 变极性等离子弧穿孔立焊双面图像处理与特征提取[J]. 上海交通大学学报, 2015, 49(3):361-365, 370.
	CHEN Lulu, HU Minghua, CHEN Yunxia, et al. Double-side image processing and feature extraction of variable polarity vertical-up plasma arc welding[J]. Journal of Shanghai Jiao Tong University, 2015, 49(3):361-365, 370.
[7]	SHAO W J, HUANG Y, ZHANG X L, et al. Double-sided weld seam detection system for aircraft T-joint welds by using vision sensor[C]// 2016 12th IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications (MESA) . Piscataway, NJ, USA: IEEE, 2016: 1-6.
[8]	LI N, WANG Z H, XU H, et al. Weld seam detection based on visual saliency for autonomous welding robots[C]// 2016 IEEE Workshop on Advanced Robotics and Its Social Impacts (ARSO) . Piscataway, NJ, USA: IEEE, 2016: 284-288.
[9]	HE Y S, XU Y L, CHEN Y X, et al. Weld seam profile detection and feature point extraction for multi-pass route planning based on visual attention model[J]. Robotics and Computer-Integrated Manufacturing, 2016, 37:251-261. doi: 10.1016/j.rcim.2015.04.005 URL
[10]	XIAO R Q, XU Y L, HOU Z, et al. An adaptive feature extraction algorithm for multiple typical seam tracking based on vision sensor in robotic arc welding[J]. Sensors and Actuators A: Physical, 2019, 297:111533. doi: 10.1016/j.sna.2019.111533 URL
[11]	秦涛, 张轲, 邓景煜, 等. 基于改进最小二乘法的焊缝特征直线提取方法[J]. 焊接学报, 2012, 33(2):33-36.
	QIN Tao, ZHANG Ke, DENG Jingyu, et al. Algorithm of extracting feature lines in welding seam image based on improved least-square method[J]. Transactions of the China Welding Institution, 2012, 33(2):33-36.
[12]	FANG Z J, XU D, TAN M. A vision-based self-tuning fuzzy controller for fillet weld seam tracking[J]. IEEE/ASME Transactions on Mechatronics, 2011, 16(3):540-550. doi: 10.1109/TMECH.2010.2045766 URL
[13]	WANG N F, ZHONG K F, SHI X D, et al. A robust weld seam recognition method under heavy noise based on structured-light vision[J]. Robotics and Computer-Integrated Manufacturing, 2020, 61:101821. doi: 10.1016/j.rcim.2019.101821 URL
[14]	刘端飞, 单宝明. 改进的Canny算法在不锈钢板焊缝识别中的应用[J]. 电子测量技术, 2019, 42(14):127-130.
	LIU Duanfei, SHAN Baoming. Application of improved Canny algorithm in seam recognition of stainless steel plate[J]. Electronic Measurement Technology, 2019, 42(14):127-130.

基于亮度突变性与密度特征检测的厚板T形接头焊缝轮廓识别

Weld Seam Profile Identification with T-Joints Based on Intensity Mutation and Density Feature Detection for Thick Plate Welding Process

RichHTML

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

图/表 14

参考文献 14

相关文章 3

编辑推荐

Metrics

本文评价

[1]	邱忠宇, 赵文龙, 高文, 潘洪涛, 史冉东. 动态视觉传感器的目标检测算法对比分析[J]. 空天防御, 2021, 4(4): 101-106.
[2]	沈鸿源1，2，陈华斌2，林涛2，陈善本2. 应用于铝合金焊接中的被动视觉获取[J]. 上海交通大学学报（自然版）, 2015, 49(03): 341-343.
[3]	黎文航1,2，高凯1，王加友1，何金桥1. 窄间隙旋转电弧熔化极活性气体保护焊视觉焊缝偏差检测[J]. 上海交通大学学报（自然版）, 2015, 49(03): 353-356.