Objective In order to ensure perception of manipulator operations and enhance driving control accuracy, the multi-degree-of-freedom picking manipulator’s drive control module was optimally designed using multi-source information fusion technology. Methods Integrating joint degrees of freedom, kinematics, and dynamics into the manipulator’s structure constructed an equivalent model for the multi-degree-of-freedom picking manipulator. This model determined the placement of multi-source sensor equipment, collecting real-time operational data and pose information from within the manipulator. Information grouping, based on sensor spatial positions and interactions, facilitated information-level fusion to generate input values for feature-level fusion. This process extracted multi-source heterogeneous information features,accomplishing fusion operations through feature matching, resulting in real-time detection of manipulator operating parameters. Result For a given picking task, computation of required driving force and pose data for the picking robotic arm was conducted, determining driving control amounts by comparing with current data. Executable control instructions were generated using the installed driving controller to execute driving control. Comparative experiments with two control methods showed that the driving control method based on multi-source heterogeneous information fusion reduced the picking manipulator’s position control error by about 25 mm. The attitude angle and driving force control errors were decreased by 0.22 ° and 6.32 mm, respectively, resulting in significantly enhanced control data accuracy. Conclusion The utilization of multi-source heterogeneous information fusion technology proved advantageous in acquiring comprehensive and precise pose information and control data from multiple sources. This technology enables accurate fruit picking, minimizing damage to the fruits during the picking process. Its evident comparative advantages underscore its significant application value.
ZhuW Q. Electric control system of picking manipulator based on PLC and PSO[J]. Journal of Agricultural Mechanization Research, 2021, 43(12):238-241,246.
LiD Y, XuD G, GuiW H. Coordinated impedance control for dual-arm robots based on time delay estimation and adaptive fuzzy sliding mode controller[J]. Control and Decision, 2021, 36(6):1311-1323.
LiuY, LiX, JiangP Y, et al. Research on robot dynamic target tracking and obstacle avoidance control based on DDPG-PID[J]. Journal of Nanjing University of Aeronautics & Astronautics, 2022, 54(1):41-50.
XiaoG, YeP, ZhangX C, et al. Status and prospect of multi-source heterogeneous image fusion tracking[J]. Command Control & Simulation, 2020, 42(2):1-6, 11.
LiuH F, ZhangC, LuoJ, et al. Information fusion and mining technology in networking information-centric system of systems[J]. Journal of Command and Control, 2016,2(4):329-337.
DuanL X, LiT, TangY, et al. Mechanical fault diagnosis method based on multi-source heterogeneous information fusion[J]. China Petroleum Machinery, 2021,49(2):60-67,80.
HuY L, PiaoX L, SunY F, et al. Multi-source heterogeneous data fusion method and its application in object positioning and tracking[J]. Scientia Sinica(Informationis),2013,43(10):1288-1306.
PengL L, ZhangY F, ZhangW D, et al. Dynamic modeling of output characteristics of photovoltaic cells using multi-source heterogeneous information fusion[J]. Acta Energiae Solaris Sinica, 2023, 44(3): 425-434.
DingM, YuX, WuH L, et al. Modeling and control of multi-segment cable-driven continuum space manipulator[J]. Journal of Nanjing University of Science and Technology, 2022, 46(3):253-261.
ZhangX Y, WangY C, LiangF. Research on information feedback fusion method based on target tracking[J]. Innovation Science and Technology, 2018, 18(5):71-74.
LiJ, LiuJ Y. The multi-source heterogeneous data fusion of ballistic target tracking system based on fuzzy theory and UKF[J]. Journal of Anyang Normal University, 2013(5):44-48.
CongP C, FengX J, LiuJ J.Design of the wheel-legged robot with low-driven degree of freedom and strong obstacle-crossing ability[J]. Journal of Machine Design, 2021, 38(12):89-97.
ZengQ S, ZhouY S, TaoC C, et al. Active disturbance rejection robust Hamiltonian tracking control of electrically driven manipulator[J]. Journal of Zhengzhou University (Engineering Science), 2022, 43(4):1-7,15.
LiY B, DongP, ZhuH F. Application of improved particle filter interactive multi-model algorithm in the manipulator tracking and positioning[J]. Machine Tool & Hydraulics, 2020, 48(19):8-15.
WangX X, LiuC K, WangB F, et al. Fast and stable tracking method for space manipulator capturing dynamic target[J]. Chinese Space Science and Technology, 2018, 38(1):18-28.
YaoZ W, LiuY, GuoJ Q, et al. Multi-source heterogeneous information fusion algorithm for autonomous navigation based on factor graph[J]. Electronic Measurement Technology, 2021, 44(1):130-134.
ChenD M, ZhouF N, WangQ X. Fusion fault diagnosis method based on multi-source heterogeneous information transfer learning[J]. Journal of Information Engineering University, 2020, 21(2):153-158.
FanF B, WangR F, FuX. Research and application of on-line detection technology of flotation cleaned coal ash based on multi-source heterogeneous information fusion[J]. Coal Technology, 2023, 42(2):233-238.