张昭,男,博士,中国农业大学信息与电气工程学院教授,中国农业大学“杰出人才”,中国科协海智计划特聘专家,International Journal of Agricultural and Biological Engineering副主编,《农业工程学报》海外编委,《智慧农业》青年编委,Information Process in Agriculture编委。主要从事无人农场自主作业机器人的研发与应用,主持、在研课题6项。获美国农业与生物工程师协会“雨鸟奖”,“宿迁英才”雄英计划。在相关领域出版英文学术专著3部,授权美国专利1项,近年发表SCI、EI收录论文40余篇。(ORCID: 0000-0001-6353-4067),教授,博士生导师,主要从事智慧农业研究,E-mail: zhaozhangcau@cau.edu.cn
张昭,男,博士,中国农业大学信息与电气工程学院教授,中国农业大学“杰出人才”,中国科协海智计划特聘专家,International Journal of Agricultural and Biological Engineering副主编,《农业工程学报》海外编委,《智慧农业》青年编委,Information Process in Agriculture编委。主要从事无人农场自主作业机器人的研发与应用,主持、在研课题6项。获美国农业与生物工程师协会“雨鸟奖”,“宿迁英才”雄英计划。在相关领域出版英文学术专著3部,授权美国专利1项,近年发表SCI、EI收录论文40余篇。(ORCID: 0000-0001-6353-4067),教授,博士生导师,主要从事智慧农业研究,E-mail: zhaozhangcau@cau.edu.cn
收起
Maximum cross‐sectional diameter detection method based on the orientation of apples
To enhance the postharvest sorting precision of moving apples, a method for detecting the maximum cross-section diameter was devised based on the orientation of the apples.The RGB images of apples in various positions were captured and their orientations on the conveyor were acquired. Image distortion correction was performed using Zhang’s calibration method, and apple areas were isolated through color segmentation and morphological processing. The center of the apple peduncle/calyx region was determined using the gradient change of the R channel component, and apple orientation was assessed based on symmetry. The maximum diameter perpendicular to the orientation was then calculated as the maximum cross-sectional diameter. To address the projection distortion resulting from the increased camera projection angle, a projection correction equation was formulated to rectify the detection outcomes. The results reveal that: 1) Diameter detection was conducted on 720 images of 60 apples (Fuji and Yellow Marshal each have 30). Single image detection accuracy, defined within ±5 mm, was employed as the criterion. The proposed projection correction algorithm significantly increased the accuracy from 65.3% to 95.3%. 2) The diameter detection results of 12 images per apple were averaged to determine the final fruit diameter, which achieved a 100% accuracy rate. Notably, the 86.7% of Fuji and 93.3% of Yellow Marshal exhibited a detection diameter within ±2 mm with root mean square errors of 1.5 mm and 1.1 mm, respectively. Overall, the method proposed in this study accurately detects the diameter of apple fruits. It can offer valuable technical support for apple size grading and be used as a pertinent reference for sorting near-spherical fruits and vegetables.
张昭,男,博士,中国农业大学信息与电气工程学院教授,中国农业大学“杰出人才”,中国科协海智计划特聘专家,International Journal of Agricultural and Biological Engineering副主编,《农业工程学报》海外编委,《智慧农业》青年编委,Information Process in Agriculture编委。主要从事无人农场自主作业机器人的研发与应用,主持、在研课题6项。获美国农业与生物工程师协会“雨鸟奖”,“宿迁英才”雄英计划。在相关领域出版英文学术专著3部,授权美国专利1项,近年发表SCI、EI收录论文40余篇。(ORCID: 0000-0001-6353-4067),教授,博士生导师,主要从事智慧农业研究,E-mail: zhaozhangcau@cau.edu.cn
"}, bioImg=qgJ6JnVY4tL46BxYCli1BQ==, bioContent=
张昭,男,博士,中国农业大学信息与电气工程学院教授,中国农业大学“杰出人才”,中国科协海智计划特聘专家,International Journal of Agricultural and Biological Engineering副主编,《农业工程学报》海外编委,《智慧农业》青年编委,Information Process in Agriculture编委。主要从事无人农场自主作业机器人的研发与应用,主持、在研课题6项。获美国农业与生物工程师协会“雨鸟奖”,“宿迁英才”雄英计划。在相关领域出版英文学术专著3部,授权美国专利1项,近年发表SCI、EI收录论文40余篇。(ORCID: 0000-0001-6353-4067),教授,博士生导师,主要从事智慧农业研究,E-mail: zhaozhangcau@cau.edu.cn
ZhangZ, LuY, LuR. Development and evaluation of an apple infield grading and sorting system[J]. Postharvest Biology and Technology, 2021, 180: 111588
[2]
Abbaspour-GilandehY, AghabaraA, DavariM, MajaJ M. Feasibility of using computer vision and artificial intelligence techniques in detection of some apple pests and diseases[J]. Applied Sciences, 2022, 12(2): 906
[3]
FanS X, LiangX T, HuangW Q, ZhangV J L, PangQ, HeX, LiL J, ZhangC. Real-time defects detection for apple sorting using NIR cameras with pruning-based YOLOV4 network [J]. Computers and Electronics in Agriculture, 2022, 193: 106715
[4]
BhargavaA, BansalA. Fruits and vegetables quality evaluation using computer vision: A review[J]. Journal of King Saud University-Computer and Information Sciences, 2021, 33(3): 243-257
[5]
LuR, ZhangZ, PothulaA. Innovative technology for enhancing apple harvest and postharvest handling efficiency[J]. Fruit Q, 2017, 25(2): 11-14
HuangC, FeiJ Y. Online apple grading based on decision fusion of image features[J]. Transactions of the Chinese Society for Agricultural Engineering, 2017, 33(1): 285-291 (in Chinese)
ShenB G, WeiX H, YinJ J. Apple Diameter Detection Based on Minimum Circumcircle Method[J]. Journal of Agricultural Mechanization Research, 2011, 33(12):131-134 (in Chinese)
YueL X, LiW K, YangX F, LiH F, YangQ S. Apple detection and fruit diameter estimation method based on improved YOLOv4[J]. Laser Journal, 2022, 43(2):58-65 (in Chinese)
ZhaoD D, AiY. Research on apple size detection method based on computer vision[J]. Journal of Agricultural Mechanization Research, 2022, 44(7): 206-209, 214 (in Chinese)
[14]
张恩宇.苹果田间分级关键技术研究[D].杨凌:西北农林科技大学, 2020
[15]
ZhangE Y. Research on key technologies of apple field grading[D]. Yangling: Northwest A & F University, 2020 (in Chinese)
WangH Y, YanR Q, ZhouX L, MaS H, HuH X, XuH L. Apple shape index estimation method based on local point cloud[J]. Transactions of the Chinese Society for Agricultural Machinery, 2019, 50(5): 205-213 (in Chinese)
[18]
SofuM M, ErO, KayacanM C, CetişliB. Design of an automatic apple sorting system using machine vision[J]. Computers and Electronics in Agriculture, 2016, 127: 395-405
FengB, WangM H. Detecting method of fruit size based on computer vision[J]. Transactions of the Chinese Society for Agricultural Machinery, 2003, 34(1):73-75 (in Chinese)
[21]
GB/T 10651—2008鲜苹果 [S].北京:中国标准出版社,2008
[22]
GB/T 10651—2008 Fresh apple[S]. Beijing: China Standard Press, 2008 (in Chinese)
ChenY J, ZhangJ X, LiW, RenY X, TanY Z. Grading method of apple by maximum cross-sectional diameter based on computer vision[J]. Transactions of the Chinese Society of Agricultural Engineering, 2012, 28(2): 284-288 (in Chinese)
[25]
MizushimaA, LuR. A low-cost color vision system for automatic estimation of apple fruit orientation and maximum equatorial diameter[J]. Transactions of the ASABE, 2013, 56(3): 813-827
HeD J, YangQ, XueS P, ZhaoJ. Computer vision method for measuring defect area of sphere-fruits[J]. Transactions of the Chinese Society of Agricultural Engineering, 1997, 13(4):161-165 (in Chinese)
LiuT, RuiC J, LiH T, ZhangS Y. Image distortion control and experiment of spherical fruit surface plaque[J]. Transactions of the Chinese Society for Agricultural Machinery, 2019, 50(9):221-228 (in Chinese)
[30]
DuaneC B. Close-range camera calibration[J]. Photogramm. Engng, 1971, 37(8): 855-866
[31]
TsaiR. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses [J]. IEEE Journal on Robotics and Automation, 1987, 3(4): 323-344
[32]
ZhangZ. Flexible camera calibration by viewing a plane from unknown orientations[C]. In: Proceedings of the Seventh IEEE International Conference on Computer Vision. Kerkyra: IEEE, 1999: 666-673