PDF (15127K)
摘要
小流域河道整治中施工废水等会给河道水体带来污染,且工区往往沿长线性河道呈点状分布形态,交通不便,人工巡检难以保证施工水污染管控的时效性。目前通常采用智能巡检手段对水面漂浮物进行图像识别,但对于污水、水华等水污染的识别仍存在困难。针对上述问题提出基于无人机航拍与深度学习的河道施工水污染异常图像智能识别与定位方法。利用无人机巡检采集工区航拍图像,基于SENet注意力机制优化的MBConv模块,建立了施工水污染图像的智能快速识别分类EfficientNet-B0模型,并利用迁移学习方法进行模型训练,可以使模型提取的污染相关特征指向性更强,提升模型的训练速度及精度;同时,基于Grad-CAM(Class Activation Mapping,类激活热力图)方法和全连接条件随机场(Conditional Random Fields, CRF)方法得到的污染区域特征图,可修正错分区域,实现更为精细的污染区域快速标记定位。实例应用表明,水污染图像分类准确率可达98%,追踪标记评价指标ORI值可达96.91%。结果表明:研究成果能够为工程管理人员快速管控长线性河道整治工程的施工水污染提供了先进的技术手段。
Abstract
Construction wastewater of small watersheds regulation projects cause river pollution. As a long-line project, river regulation often shows a scattered distribution, with inconvenient transportation, manual inspection is difficult to guarantee the efficiency of construction water pollution control. At present, intelligent inspection is usually used to identify floating objects, which is difficult to identify water pollution such as sewage and water bloom. This paper proposed an intelligent recognition and positioning method for anomaly images of water pollution in river regulation projects based on UAV aerial photography and deep learning. The aerial images of working area are collected by UAV inspection, and an EfficientNet-B0 model of intelligent identification and classification of construction water pollution image is established based on the MBConv module optimized by the SENet attention mechanism. Transfer learning is used to train the model, which can make the pollution-related features extracted by the model more directional, and improve the training speed and accuracy of the model. Then, the feature map of pollution area based on Grad-CAM(Class Activation Mapping) and fully connected CRF(Conditional Random Fields) can modify the misclassification area that achieve more refined fast marking and positioning of pollution area.The practical application result show that the classification accuracy of water pollution images is 98% and the evaluation index ORI of the positioning method is 96.91%. This study can provide advanced technical means for project managers to quickly control the water pollution of long-line river regulation projects.
关键词
河道整治工程
/
施工水污染
/
图像识别
/
图像定位
/
无人机航拍
/
特征可视化
Key words
river regulation
/
construction-caused water pollution
/
image recognition
/
image positioning
/
UAV aerial photography
/
feature visualization
Author summay
[Author(id=1248676000541192754, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=hou_jiangang@ctg.com.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1248676000604107318, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, authorId=1248676000541192754, language=EN, stringName=Jiangang HOU, firstName=Jiangang, middleName=null, lastName=HOU, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1. Yangtze Three Gorges Technology and Economy Development Co., Ltd., Beijing 101100, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1248676000654438968, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, authorId=1248676000541192754, language=CN, stringName=侯建刚, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1.长江三峡技术经济发展有限公司, 北京 101100, bio={"content":"侯建刚(1971—), 男, 正高级工程师, 学士, 研究方向为水利水电工程。E-mail: hou_jiangang@ctg.com.cn
"}, bioImg=null, bioContent=侯建刚(1971—), 男, 正高级工程师, 学士, 研究方向为水利水电工程。E-mail: hou_jiangang@ctg.com.cn
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1248676000302117413, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, xref=null, ext=[AuthorCompanyExt(id=1248676000318894630, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, companyId=1248676000302117413, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1. Yangtze Three Gorges Technology and Economy Development Co., Ltd., Beijing 101100, China), AuthorCompanyExt(id=1248676000331477543, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, companyId=1248676000302117413, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1.长江三峡技术经济发展有限公司, 北京 101100)])]), Author(id=1248676000700576316, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1248676000763490881, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, authorId=1248676000700576316, language=EN, stringName=Ziru MA, firstName=Ziru, middleName=null, lastName=MA, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2. State Key Laboratory of Hydraulic Engineering Simulation and Safety, Tianjin University, Tianjin 300072, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1248676000809628228, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, authorId=1248676000700576316, language=CN, stringName=马子茹, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.天津大学 水利工程仿真与安全国家重点实验室, 天津 300072, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1248676000377614889, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, xref=null, ext=[AuthorCompanyExt(id=1248676000406975018, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, companyId=1248676000377614889, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2. State Key Laboratory of Hydraulic Engineering Simulation and Safety, Tianjin University, Tianjin 300072, China), AuthorCompanyExt(id=1248676000423752236, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, companyId=1248676000377614889, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.天津大学 水利工程仿真与安全国家重点实验室, 天津 300072)])]), Author(id=1248676000859959878, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, orderNo=2, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=liudh@tju.edu.cn, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1248676000922874442, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, authorId=1248676000859959878, language=EN, stringName=Donghai LIU, firstName=Donghai, middleName=null, lastName=LIU, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2. State Key Laboratory of Hydraulic Engineering Simulation and Safety, Tianjin University, Tianjin 300072, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1248676000973206093, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, authorId=1248676000859959878, language=CN, stringName=刘东海, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.天津大学 水利工程仿真与安全国家重点实验室, 天津 300072, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1248676000377614889, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, xref=null, ext=[AuthorCompanyExt(id=1248676000406975018, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, companyId=1248676000377614889, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2. State Key Laboratory of Hydraulic Engineering Simulation and Safety, Tianjin University, Tianjin 300072, China), AuthorCompanyExt(id=1248676000423752236, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, companyId=1248676000377614889, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.天津大学 水利工程仿真与安全国家重点实验室, 天津 300072)])]), Author(id=1248676001019343440, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, orderNo=3, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1248676001082258005, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, authorId=1248676001019343440, language=EN, stringName=Qi SHAO, firstName=Qi, middleName=null, lastName=SHAO, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2. State Key Laboratory of Hydraulic Engineering Simulation and Safety, Tianjin University, Tianjin 300072, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1248676001132589655, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, authorId=1248676001019343440, language=CN, stringName=邵琦, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2.天津大学 水利工程仿真与安全国家重点实验室, 天津 300072, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1248676000377614889, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, xref=null, ext=[AuthorCompanyExt(id=1248676000406975018, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, companyId=1248676000377614889, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2. State Key Laboratory of Hydraulic Engineering Simulation and Safety, Tianjin University, Tianjin 300072, China), AuthorCompanyExt(id=1248676000423752236, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, companyId=1248676000377614889, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2.天津大学 水利工程仿真与安全国家重点实验室, 天津 300072)])]), Author(id=1248676001182921305, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, orderNo=4, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1248676001241641564, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, authorId=1248676001182921305, language=EN, stringName=Junjie CHEN, firstName=Junjie, middleName=null, lastName=CHEN, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=3, address=3. Department of Real Estate and Construction, University of Hongkong, Hongkong 999077, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1248676001291973214, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, authorId=1248676001182921305, language=CN, stringName=陈俊杰, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=3, address=3.香港大学 房地产与建设系, 香港 999077, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1248676000465695277, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, xref=null, ext=[AuthorCompanyExt(id=1248676000482472494, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, companyId=1248676000465695277, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3. Department of Real Estate and Construction, University of Hongkong, Hongkong 999077, China), AuthorCompanyExt(id=1248676000495055407, tenantId=1045748351789510663, journalId=1221126710357164034, articleId=1248596673678029558, companyId=1248676000465695277, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=3.香港大学 房地产与建设系, 香港 999077)])])]
侯建刚,马子茹,刘东海,邵琦,陈俊杰.
基于无人机航拍的河道施工水污染图像智能识别与定位[J].
水利水电技术(中英文), 2025, 56(S1): 67-75 DOI:10.13928/j.cnki.wrahe.2025.S1.012
基金资助
中国长江三峡集团有限公司企业科研项目(202103551)