A method for full-position welding pool identification and deviation measurement was proposed based on DeepLab-EMCAD. A lightweight MobileNetV3 network was adopted as the backbone of the model encoder, and the atrous spatial pyramid pooling(ASPP) module was optimized to reduce the model parameters and improve the segmentation efficiency. The EMCAD multi-attention mechanism was integrated into the decoder to enhance the segmentation accuracy of the welding pools. A deviation calculation method was proposed to quantitatively describe the deviation based on the segmentation results of the welding pools. Experimental results show that compared with the baseline model, the proposed model improves the average intersection over union and average pixel accuracy in welding pool segmentations by 5.72% and 5.5% respectively, and the inference time is reduced by 29.69 ms, with the number of parameters decreasing by 4.854×107. Compared with classic segmentation networks, the proposed model has the best performance in handling the edges of the welding pools. The deviation detection errors are controlled within 0.1 mm.
ROUTA, DEEPAKB B V L, BISWALB B. Advances in Weld Seam Tracking Techniques for Robotic Welding: a Review[J]. Robotics and Computer-Integrated Manufacturing, 2019, 56: 12-37.
[2]
WANGTianqi, MENGKaiquan, CUILiyang, et al. Weld Tracking Technology for All-position Welding of Pipes Based on Laser Vision[J]. Optics and Lasers in Engineering, 2025, 188: 108912.
[3]
HEYinshui, MAGuohong, CHENShanben. Autonomous Decision-making of Welding Position during Multipass GMAW with T-Joints: a Bayesian Network Approach[J]. IEEE Transactions on Industrial Electronics, 2022, 69(4): 3909-3917.
[4]
WANGBaicun, HUS J, SUNLei, et al. Intelligent Welding System Technologies: State-of-the-art Review and Perspectives[J]. Journal of Manufacturing Systems, 2020, 56: 373-391.
TANGKun, PENGHaibin, ZHUYongjian, et al. Unsupervised Visual Inspection of Surface Defects in Laser Welding Seams of Magnesium Alloy Based on Improved Reconstruction Network[J/OL]. China Mechanical Engineering, 2025: 1-12. [2025-02-14].
[7]
HONGYuxiang, JIANGYuxuan, YANGMingxuan, et al. Intelligent Seam Tracking in Foils Joining Based on Spatial-temporal Deep Learning from Molten Pool Serial Images[J]. Robotics and Computer-integrated Manufacturing, 2025, 91: 102840.
WANGLin, PANJun, HEQingchuan, et al. Welding Process Optimization on Robot Welding of the Backward Centrifugal Fan Impeller[J]. China Mechanical Engineering, 2020, 31(19): 2379-2387.
[10]
XIALei, ZHOUJianping, XUERuilei, et al. Real-time Seam Tracking during Narrow Gap GMAW Process Based on the Wide Dynamic Vision Sensing Method[J]. Journal of Manufacturing Processes, 2023, 101: 820-834.
WANGXiaogang, WANGZhongren, LIUHaisheng. Measurement Method for Simultaneous Visual Welding Deviation of Droplet-weld Seam[J]. Computer Integrated Manufacturing Systems, 2022, 28(5): 1352-1360.
[13]
HOUHuaishu, WANGTong, LIJinhao, et al. Vision-based Algorithm for Online TIG Welding Deviation Detection of Stainless Steel Welded Pipes[J]. Journal of the Optical Society of America A, 2024, 41(6): 1175-1184.
[14]
MOYujian, WUYan, YANGXinneng, et al. Review the State-of-the-art Technologies of Semantic Segmentation Based on Deep Learning[J]. Neurocomputing, 2022, 493: 626-646.
[15]
YURongwei, TANXiaxin, HEShen, et al. Monitoring of Robot Trajectory Deviation Based on Multimodal Fusion Perception in WAAM Process[J]. Measurement, 2024, 224: 113933.
JIANGYuxuan, LINKai, WANGYaoqi, et al. Improved ViT-based Method for Molten Pool Recognition and Online Detection of Welding Deviation[J]. Modern Manufacturing Engineering, 2024(10): 130-137.
[18]
CHENL C, ZHUYukun, PAPANDREOUG, et al. Encoder-decoder with Atrous Separable Convolution for Semantic Image Segmentation[C]∥Computer Vision – ECCV 2018. Cham: Springer, 2018: 833-851.
[19]
RAHMANM M, MUNIRM, MARCULESCUR. EMCAD: Efficient Multi-scale Convolutional Attention Decoding for Medical Image Segmentation[C]∥2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2024: 11769-11779.
[20]
HOWARDA, SANDLERM, CHENBo, et al. Searching for MobileNetV3[C]∥2019 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2019: 1314-1324.
[21]
DAIWei, LIDayong, TANGDing, et al. Deep Learning Assisted Vision Inspection of Resistance Spot Welds[J]. Journal of Manufacturing Processes, 2021, 62: 262-274.