To ensure the quality of endoscopic imaging for detecting surface defects in inner holes of complex shaft parts and to avoid collision and scratching between the endoscope and the workpiece, a method was proposed herein for detecting the pose of shaft-hole parts based on monocular endoscopic imaging. Considering the characteristics of monocular endoscope imaging with many interference contours, a method was proposed for removing interference contours based on length constraint and minimum enclosing circle constraint. The improved Otsu method was adopted for image threshold segmentation, the Suzuki contour extraction algorithm was chosen for edge contour extraction, the proposed interference contour removal method was used for target contour selection, and the radial search was employed to extract the contour point set of the target inner hole. Considering that the contour point set was discrete and contained error points, and that incomplete target contours were caused by uneven illumination when the endoscopic light source was significantly offset in position and orientation, an ellipse detection algorithm was proposed based on contour restoration. Finally, considering the ambiguity problem in pose solving, a disambiguation method was proposed based on angle constraint and grayscale distribution,which leveraged the characteristics of endoscopic imaging:only circular features, rich grayscale information, the part being moved by the manipulator during pose detection, and the center of the inner hole being close to the optical axis. Experimental results verify the effectiveness of the proposed pose detection algorithm herein. The position detection accuracy in the X and Y axis directions is 0.062 mm, and the attitude detection accuracy around the X and Y axes is within 1.4°, which meets the requirements of enterprises.
SUNLuping, ZHANGWenchang, WANGZhihua, et al. Measurement Method of Cabin Automatic Docking Based on 2D Laser Displacement Sensor[J]. China Mechanical Engineering, 2023, 34(9): 1120-1125.
CHENDong, LIShiqi, WANGJunfeng, et al. A Method for Fitting Pose of Cabins through Measured Key Features[J]. China Mechanical Engineering, 2019, 30(18): 2250-2256.
LUEnhui, GUOYaocun, LIShiwen, et al. Measurement of Grinding Surface Roughness Based on the Full-reference Color Image Quality Algorithm[J]. Chinese Journal of Scientific Instrument, 2023, 44(7): 252-259.
[7]
ZHANGHang, LIRong, ZOUDexiang, et al. An Automatic Defect Detection Method for TO56 Semiconductor Laser Using Deep Convolutional Neural Network[J]. Computers & Industrial Engineering, 2023, 179: 109148.
[8]
SUOXinyu, ZHANGJie, LIUJian, et al. Anomaly Detection in Annular Metal Turning Surfaces Based on a Priori Information and a Multi-scale Self-referencing Template[J]. Sensors, 2023, 23(15): 6807.
[9]
LIMengyuan, CHENNing, SUOXinyu, et al. An Efficient Defect Detection Method for Nuclear-fuel Rod Grooves through Weakly Supervised Learning[J]. Measurement, 2023, 222: 113708.
LIUJian, WANGYuanyuan. A Method of Image Perspective Distortion Correction in Ball Pose Detections[J]. China Mechanical Engineering, 2019, 30(18): 2242-2249.
FANGYuntao, WANGXiaodong, XUSong, et al. Miniature Thread Pairs Automatic Assembly System for Gimbals[J]. China Mechanical Engineering, 2022, 33(6): 698-706.
LILiangfu, FENGZuren, HEKailiang. An Improved Algorithm for Ellipses Detection Based on Randomized Hough Transform[J]. Pattern Recognition and Artificial Intelligence, 2005, 18(4): 459-464.
MIAOXikui, ZHUFeng, DINGQinghai, et al. Monocular Vision Pose Measurement Based on Docking Ring Component[J]. Acta Optica Sinica, 2013, 33(4): 412006.
[22]
MENGCai, LIZhaoxi, SUNHongchao, et al. Satellite Pose Estimation via Single Perspective Circle and Line[J]. IEEE Transactions on Aerospace and Electronic Systems, 2018, 54(6): 3084-3095.
[23]
ZHANGDezhi, YANGGuocai, JIJunhong, et al. Pose Measurement and Motion Estimation of Non-cooperative Satellite Based on Spatial Circle Feature[J]. Advances in Space Research, 2023, 71(3): 1721-1734.
[24]
HUANGBin, SUNYongrong, ZHUYunfeng, et al. Vision Pose Estimation from Planar Dual Circles in a Single Image[J]. Optik, 2016, 127(10): 4275-4280.
[25]
MAXin, FENGJunbing, LIYibin, et al. Active 6-D Position-pose Estimation of a Spatial Circle Using Monocular Eye-in-Hand System[J]. International Journal of Advanced Robotic Systems, 2018, 15: 1729881417753692.
YUChangzhi, ZHANGLianxin, SUNPengfei, et al. End-face Butt-joint Positioning Method with Back Against Vision Based on Normal Constraint[J]. Computer Engineering, 2022, 48(9): 213-222.
[30]
LIShunzhi, LIANGBin, GAOXuehai, et al. Pose Measurement Method of Non-cooperative Circular Feature Based on Line Structured Light[C]∥2016 IEEE International Conference on Information and Automation (ICIA).Changsha, 2016: 374-380.
[31]
MAYanqin, LIUXilong, XUDe. Precision Pose Measurement of an Object with Flange Based on Shadow Distribution[J]. IEEE Transactions on Instrumentation and Measurement, 2020, 69(5): 2003-2015.
YUHouyun, WANGHuiqing, ZHANGHui, et al. Automatic Calibration of Camera Pose in Visual Inspection of Product Surface Quality[J]. Journal of Southeast University (Natural Science Edition), 2020, 50(5): 942-949.
YANBei, WANGBin, LIYuan. Optimal Ellipse Fitting Method Based on Least-square Principle[J]. Journal of Beijing University of Aeronautics and Astronautics, 2008, 34(3): 295-298.