PDF (1059K)
摘要
安全运营中心正在把告警分诊、检测规则编写和代码审计交给大语言模型,判决环节一旦自动化,分析工具本身就变成了攻击目标.已有研究以模型是否服从指令作为攻击成功的判据,回答不了攻击面选择的操作性问题:载荷放在哪里、用什么方式隐蔽,效力最高.本文以防御判决劣化为度量对象,定义漏报率增量(Injection-induced False Negative rate,IFN)为主指标,构建包含 540 条载荷、45 个单元的注入矩阵,在 8 个模型配置上测量 3 类注入位置与 5 类隐蔽技术的效力差异.结果显示:工具返回位置效力最高,IFN 为 0.412,比被动数据源高 38.7%;语义伪装在效力与隐蔽性上综合最优,IFN 为 0.401 而自动检出率仅 12.6%;零宽字符最隐蔽但效力最低.跨载体复用率测量表明,工具返回位置与业务上下文解耦程度最高,换模型后仍有 81.4% 维持效力.跨任务测量中检测规则生成最脆弱,规则破坏率由 0.9% 升至 45.6%.
Abstract
The Security Operations Center is handing over alarm triage, detection rule writing, and code auditing to the big language model. Once the decision-making process is automated, the analysis tools themselves become attack targets. Previous studies have used whether the model obeys instructions as a criterion for successful attacks, but cannot answer the operational questions of attack surface selection: where to place the payload, how to conceal it, and the highest effectiveness. This article takes the degradation of defense judgments as the measurement object, defines the injection induced False Negative rate(IFN) as the main indicator, constructs an injection matrix containing 540 payloads and 45 units, and measures the effectiveness differences between 3 types of injection positions and 5 types of covert techniques on 8 model configurations. The results showed that the tool had the highest efficiency in returning to the position, with an IFN of 0.412, which was 38.7% higher than that of passive data sources; Semantic camouflage has the best combination of effectiveness and concealment, with an IFN of 0.401 and an automatic detection rate of only 12.6%; Zero width characters are the most concealed but have the lowest effectiveness. Cross carrier reuse rate measurement shows that the decoupling degree between tool return location and business context is the highest, with 81.4% maintaining effectiveness even after model switching. The generation of detection rules is the most fragile in cross task measurement, with a rule breaking rate increasing from 0.9% to 45.6%.
关键词
Key words
[Author(id=1330220074854339494, tenantId=1045748351789510663, journalId=1327663034936098855, articleId=1330177844555444856, orderNo=0, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1330220074917254058, tenantId=1045748351789510663, journalId=1327663034936098855, articleId=1330177844555444856, authorId=1330220074854339494, language=EN, stringName=Xiaofeng Meng, firstName=Xiaofeng, middleName=null, lastName=Meng, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1 Dongying Integrated Media Center, Dongying, Shandong, 257091, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1330220074967585708, tenantId=1045748351789510663, journalId=1327663034936098855, articleId=1330177844555444856, authorId=1330220074854339494, language=CN, stringName=孟小锋, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=1, address=1 东营市融媒体中心, 中国·山东 东营 257091, bio={"content":"孟小锋(1976-),男,中国山东广饶人,在职研究生,从事计算机及网络研究.
"}, bioImg=null, bioContent=孟小锋(1976-),男,中国山东广饶人,在职研究生,从事计算机及网络研究.
, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1330220074699150235, tenantId=1045748351789510663, journalId=1327663034936098855, articleId=1330177844555444856, xref=1, ext=[AuthorCompanyExt(id=1330220074715927452, tenantId=1045748351789510663, journalId=1327663034936098855, articleId=1330177844555444856, companyId=1330220074699150235, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 Dongying Integrated Media Center, Dongying, Shandong, 257091, China), AuthorCompanyExt(id=1330220074728510365, tenantId=1045748351789510663, journalId=1327663034936098855, articleId=1330177844555444856, companyId=1330220074699150235, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=1 东营市融媒体中心, 中国·山东 东营 257091)])]), Author(id=1330220075017917358, tenantId=1045748351789510663, journalId=1327663034936098855, articleId=1330177844555444856, orderNo=1, firstName=null, middleName=null, lastName=null, nameCn=null, orcid=null, stid=null, country=null, authorPic=null, dead=0, email=null, emailSecond=null, emailThird=null, correspondingAuthor=0, authorType=1, ext={EN=AuthorExt(id=1330220075080831922, tenantId=1045748351789510663, journalId=1327663034936098855, articleId=1330177844555444856, authorId=1330220075017917358, language=EN, stringName=Manjiang Li, firstName=Manjiang, middleName=null, lastName=Li, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2 Weifang Beida Qingniao Huaguang Phototypesetting Co., Ltd., Weifang, Shandong, 261061, China, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null), CN=AuthorExt(id=1330220075131163571, tenantId=1045748351789510663, journalId=1327663034936098855, articleId=1330177844555444856, authorId=1330220075017917358, language=CN, stringName=李满江, firstName=null, middleName=null, lastName=null, prefix=null, suffix=null, authorComment=null, nameInitials=null, affiliation=null, department=null, xref=2, address=2 潍坊北大青鸟华光照排有限公司, 中国·山东 潍坊 261061, bio=null, bioImg=null, bioContent=null, aboutCorrespAuthor=null)}, companyList=[AuthorCompany(id=1330220074774647711, tenantId=1045748351789510663, journalId=1327663034936098855, articleId=1330177844555444856, xref=2, ext=[AuthorCompanyExt(id=1330220074791424929, tenantId=1045748351789510663, journalId=1327663034936098855, articleId=1330177844555444856, companyId=1330220074774647711, language=EN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 Weifang Beida Qingniao Huaguang Phototypesetting Co., Ltd., Weifang, Shandong, 261061, China), AuthorCompanyExt(id=1330220074808202147, tenantId=1045748351789510663, journalId=1327663034936098855, articleId=1330177844555444856, companyId=1330220074774647711, language=CN, country=null, province=null, city=null, postcode=null, companyName=null, departmentName=null, remark=2 潍坊北大青鸟华光照排有限公司, 中国·山东 潍坊 261061)])])]
孟小锋,李满江.
大模型安全分析链路的间接提示注入攻击面测量[J].
信息科学与工程研究, 2026, 7(10): 38-40 DOI:10.12349/iser.v7i10.11964
| [1] |
人工智能安全治理框架2.0版[EB/OL]. 全国网络安全标准化技术委员会,(2025-09-15)
|
| [2] |
网络信息内容生态治理规定[EB/OL]. 中央网络安全和信息化委员会办公室,(2019-12-15)
|
| [3] |
生成式人工智能服务管理暂行办法[EB/OL]. 中央网络安全和信息化委员会办公室,(2023-07-10)
|
| [4] |
互联网信息服务深度合成管理规定[EB/OL]. 中央网络安全和信息化委员会办公室,(2022-11-25)
|
基金资助
山东省重点研发计划(2025TSGCXTHG029)
新闻出版A2A智能体全流程重塑工程