ArXiv cs.AI 周报:2026年7月17–23日 — 智能体安全与基准饱和
ArXiv cs.AI 与 cs.CL 分类下 AI 智能体研究的周度快照,涵盖智能体安全漂移、预算路由与基准测试饱和问题。
ArXiv cs.AI 周报:2026年7月17–23日
ArXiv cs.AI 与 cs.CL 分类下 AI 智能体研究的周度快照。
📊 本周概览
| 指标 | 本周 | 上周 | 变化 |
|---|---|---|---|
| 总论文数 | 122 | 76 | +60.5% |
| 智能体相关 | 78 | 51 | +52.9% |
| 智能体占比 | 63.9% | 67.1% | — |
| 多智能体论文 | 11 | 5 | +6 |
| 自进化论文 | 2 | 4 | -2 |
| 显著论文(评分≥7) | 21 | 21 | — |
🔥 热门主题
本周智能体相关论文围绕六大主题聚类:
-
基准测试与评估(59篇) — 迄今最大的聚类,反映了该领域在衡量”真正重要之物”上的持续困境。新基准涵盖预测(以2026年FIFA世界杯作为无污染测试平台)、主动智能体(ProEvent)和多智能体安全(Adaptive Adversaries)。
-
记忆与检索(45篇) — 长期记忆架构持续主导,新工作涉及反思性回忆循环和面向长上下文推理的证据感知强化学习。
-
代码与软件(30篇) — 编码智能体仍是热门领域,预算校准恢复路由(CodeRescue)和自主研究智能体正在推进前沿。
-
推理(26篇) — 思维链和步骤级推理持续获得投入,特别是在基础依据和证据感知方面。
-
安全与安保(18篇) — 安全研究显著增长,包括部署智能体中的操作性幻觉和跨智能体攻击归因。
-
多智能体系统(11篇) — 多智能体协调论文较上周的5篇增长了一倍以上,新工作涉及Actor-Critic算法和协作式LLM系统。
🏆 本周重要论文
1. RF-Agent: A Practical Framework for Building Language Agents for RFIC Design
- ArXiv ID: 2607.18772
- 分类: cs.CL | 趋势评分: 10/10 | 主题: 多智能体, 记忆, 基准测试, 推理, 安全
- 作者: Yueqi Xing, Houbo He, Jolie Wang et al.
Large language models (LLMs) have driven rapid progress in electronic design automation (EDA), yet their application to radio-frequency (RF) circuit design remains limited by the scarcity of domain-specific datasets and standardized benchmarks. We present RF-Agent, which addresses this gap through…
2. Operational Hallucination and Safety Drift in AI Agents
- ArXiv ID: 2607.18366
- 分类: cs.AI | 趋势评分: 9/10 | 主题: 工具使用, 基准测试, 推理, 安全
- 作者: Shasha Yu, Fiona Carroll, Barry L. Bentley
Large language models (LLMs) serving as planners in tool-using autonomous agents introduce dynamic reliability risks in multi-turn execution. While single-turn safety mechanisms are relatively mature, extended interactions reveal structural vulnerabilities where initial alignment degrades over…
3. Stress Testing Concept Erasure with Large Language Model Agents
- ArXiv ID: 2607.17890
- 分类: cs.AI | 趋势评分: 9/10 | 主题: 记忆, 基准测试, 代码
- 作者: Yuyang Xue, Feng Chen, Zhihua Liu et al.
Concept erasure aims to remove semantic concepts from a trained generative model and is increasingly important for responsible AI deployment. However, verifying whether a model has robustly removed targeted concepts remains a critical challenge. Existing evaluation methods are typically pre-defined…
4. FIFA World Cup 2026 as a Contamination-Free Benchmark for LLM Forecasting Agents: Four Models, a Bookmaker, and 104 Matches
- ArXiv ID: 2607.17765
- 分类: cs.LG | 趋势评分: 9/10 | 主题: 基准测试, 推理, 代码
- 作者: Jiacheng Ding, Cong Guo, Jason Xu
We introduce WC2026-Agents, a benchmark and dataset for evaluating large language models (LLMs) as autonomous forecasting agents on real, future events. For every one of the 104 matches of the 2026 FIFA World Cup, four frontier models — Claude Opus 4.8, ChatGPT (GPT-5.5, high reasoning), Gemini…
5. Agents in the Wild: Where Research Meets Deployment
- ArXiv ID: 2607.19336
- 分类: cs.AI | 趋势评分: 9/10 | 主题: 多智能体, 基准测试, 推理, 规划, 代码, 安全
- 作者: Grace Hui Yang, Pranav N. Venkit, Hooman Sedghamiz et al.
Agentic systems large language model (LLM) based architectures capable of reasoning, planning, acting, and coordinating with tools and other agents are rapidly transitioning from research prototypes to production scale deployments across domains such as software engineering, scientific discovery,…
6. Exploratory and Assimilating Reflection: Reflective Recall Cycle for Long-term Memory
- ArXiv ID: 2607.17879
- 分类: cs.AI | 趋势评分: 8/10 | 主题: 记忆, 基准测试, 推理, 奖励
- 作者: Ganesh Senrayan, Moyuru Yamada, Ishan Jindal et al.
LLM-based autonomous agents require external memory to overcome their statelessness and limited context window for long-term interaction and dynamic knowledge reasoning. However, existing memory retrieval methods often lack adaptability and sample efficiency, and struggle to retrieve the right…
7. ProEvent: An Event-centric Benchmark for Proactive Agents
- ArXiv ID: 2607.17701
- 分类: cs.AI | 趋势评分: 8/10 | 主题: 基准测试, 推理
- 作者: Guanzhen Li, Liangming Pan, Leye Wang
Proactive agents are expected to anticipate user needs and provide autonomous assistance by perceiving environmental context without explicit instructions. A fundamental capability of such agents is to identify and track users’ upcoming events, enabling continuous and event-specific assistance. For…
8. Comparative Study of Multi-Agent Actor-Critic Algorithms in Parameterized Action Reinforcement Learning
- ArXiv ID: 2607.19117
- 分类: cs.AI | 趋势评分: 8/10 | 主题: 多智能体, 记忆, 基准测试, 奖励
- 作者: Ubayd Ali Bapoo, Clement N Nyirenda
Parameterized action reinforcement learning has shown strong performance in environments requiring both discrete action selection and continuous parameterization. Prior work established the effectiveness of single-agent actor-critic algorithms - Greedy Actor-Critic (GAC), Soft Actor-Critic (SAC),…
📈 分类分布
| 分类 | 论文数 | 占比 |
|---|---|---|
| cs.CL | 37 | 30.3% |
| cs.AI | 34 | 27.9% |
| cs.LG | 19 | 15.6% |
| cs.CV | 9 | 7.4% |
| cs.CR | 5 | 4.1% |
注:论文可能属于多个分类,此处显示主分类。
📋 完整论文列表
下表列出本周全部 78 篇智能体相关论文,按趋势评分排序:
| # | 标题 | ArXiv ID | 分类 | 评分 | 关键主题 |
|---|---|---|---|---|---|
| 1 | RF-Agent: A Practical Framework for Building Language Agents for RFIC … | 2607.18772 | cs.CL | 10 | 多智能体, 记忆, 基准测试 |
| 2 | Operational Hallucination and Safety Drift in AI Agents | 2607.18366 | cs.AI | 9 | 工具使用, 基准测试, 推理 |
| 3 | Stress Testing Concept Erasure with Large Language Model Agents | 2607.17890 | cs.AI | 9 | 记忆, 基准测试, 代码 |
| 4 | FIFA World Cup 2026 as a Contamination-Free Benchmark for LLM Forecast… | 2607.17765 | cs.LG | 9 | 基准测试, 推理, 代码 |
| 5 | Agents in the Wild: Where Research Meets Deployment | 2607.19336 | cs.AI | 9 | 多智能体, 基准测试, 推理 |
| 6 | Exploratory and Assimilating Reflection: Reflective Recall Cycle for L… | 2607.17879 | cs.AI | 8 | 记忆, 基准测试, 推理 |
| 7 | ProEvent: An Event-centric Benchmark for Proactive Agents | 2607.17701 | cs.AI | 8 | 基准测试, 推理 |
| 8 | Comparative Study of Multi-Agent Actor-Critic Algorithms in Parameteri… | 2607.19117 | cs.AI | 8 | 多智能体, 记忆, 基准测试 |
| 9 | Athena-Brain Technical Report: An Efficient Robot Brain for General In… | 2607.18985 | cs.AI | 8 | 基准测试, 推理, 奖励 |
| 10 | Cross-Agent Campaign Attribution: Linking Asynchronous Attacks Across … | 2607.18826 | cs.CR | 8 | 工具使用, 记忆, 基准测试 |
| 11 | Autoresearch with Coding Agents: Generalizers and Metric-Maximizers on… | 2607.18064 | cs.SE | 7 | 记忆, 基准测试, 推理 |
| 12 | Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context … | 2607.19345 | cs.CL | 7 | 记忆, 基准测试, 推理 |
| 13 | They’ll Verify. They Just Won’t Act. How Authority Framing and Launder… | 2607.19267 | cs.CR | 7 | 推理, 代码, 安全 |
| 14 | Toward Auditable Fraud Detection: Combining Graph Features, Model Expl… | 2607.19266 | cs.LG | 7 | 记忆, 代码 |
| 15 | PathAgentBench: Benchmarking Evidence-Seeking Vision-Language Models o… | 2607.19261 | cs.CV | 7 | 记忆, 基准测试, 推理 |
| 16 | Fishing Out Free Riders: Shapley-Based Reward Attribution for Parallel… | 2607.18979 | cs.AI | 7 | 记忆, 基准测试, 推理 |
| 17 | PhoenixRepair: Rethinking Repair Strategy Exploration in Software Agen… | 2607.18859 | cs.AI | 7 | 多智能体, 推理, 代码 |
| 18 | AI Tour Meeting: Group Travel Planning by LLM Agents | 2607.18806 | cs.AI | 7 | 多智能体, 规划 |
| 19 | MeetingToM: Evaluating Multimodal LLMs on Theory-of-Mind Reasoning in … | 2607.19235 | cs.CL | 7 | 记忆, 基准测试, 推理 |
| 20 | CASE: Causal Alignment and Structural Enforcement for Improving Chain-… | 2607.18820 | cs.CL | 7 | 记忆, 基准测试, 推理 |
| 21 | SciHazard: A Benchmark for Measuring Scientific Safety Risks with Deco… | 2607.18665 | cs.AI | 7 | 记忆, 基准测试, 代码 |
| 22 | Relay-Bench: Evaluating LLMs on Multi-Domain Reasoning Chains | 2607.18438 | cs.CL | 6 | 记忆, 基准测试, 推理 |
| 23 | O-VAD: Industrial Video Anomaly Detection through Object-Centric Track… | 2607.18142 | cs.CV | 6 | 推理 |
| 24 | Engineering Trustworthy Agentic AI for Critical Systems | 2607.18548 | cs.AI | 6 | 工具使用, 基准测试, 规划 |
| 25 | Adaptive Adversaries: A Multi-Turn, Multi-LLM Benchmark for LLM Agent … | 2607.18063 | cs.CR | 6 | 多智能体, 记忆, 基准测试 |
| 26 | Off-Context GRPO: Learning to Reason on Hard Problems using Privileged… | 2607.19313 | cs.LG | 6 | 记忆, 基准测试, 推理 |
| 27 | Supra Cognitive Modes: A Routed Architecture for Agent Memory | 2607.19096 | cs.AI | 6 | 记忆, 基准测试, 推理 |
| 28 | CoGoal3D: Collaborative 3D Object Detection with 3D-Aware Fusion and R… | 2607.19036 | cs.CV | 6 | 多智能体, 代码, 安全 |
| 29 | Computational Humor with Multimodal LLMs: Methods, Datasets, Evaluatio… | 2607.19011 | cs.CL | 6 | 记忆, 基准测试, 推理 |
| 30 | MedDDC-Eval: Diagnosis-Decoupled Evaluation of Multi-Turn Medical Cons… | 2607.18999 | cs.CL | 6 | 记忆, 基准测试 |
| 31 | Data Leakage Prevention in Agentic Applications via Preemptive Hardeni… | 2607.18847 | cs.CR | 6 | 多智能体, 基准测试, 规划 |
| 32 | AgentTrails: Towards Trust and Reuse for Agentic Tasks | 2607.18816 | cs.DB | 6 | 工具使用, 代码 |
| 33 | AutoIndex: Learning Representation Programs for Retrieval | 2607.18603 | cs.IR | 6 | 记忆, 基准测试, 代码 |
| 34 | Broken Gates: Re-evaluating Web Bot Defenses in the Age of LLM Agents | 2607.18659 | cs.CR | 6 | 基准测试, 推理, 安全 |
| 35 | The Story Shapes the Agent: Narrative Priors in LLM Behavior | 2607.18566 | cs.CL | 5 | — |
| 36 | Computational models of pragmatic reasoning with flexible generation o… | 2607.18443 | cs.CL | 5 | 记忆, 基准测试, 推理 |
| 37 | Enabling Multilingual Privacy Policy Audits: Large-Scale Analysis of S… | 2607.18424 | cs.CY | 5 | 记忆, 基准测试 |
| 38 | Convolution for Large Language Models | 2607.18413 | cs.CL | 5 | 记忆, 基准测试, 代码 |
| 39 | SWE-Pruner Pro: The Coder LLM Already Knows What to Prune | 2607.18213 | cs.CL | 5 | 记忆, 基准测试, 代码 |
| 40 | The Autonomous Agency Scale: A Behavioral Framework for Measuring Self… | 2607.17947 | cs.AI | 5 | 基准测试, 代码 |
| 41 | SR-Agent: An Experience-Driven Agentic Framework for Post-Ranking Stra… | 2607.17719 | cs.AI | 5 | 自进化, 奖励 |
| 42 | Benchmarking Generalization in Financial Statement Fraud Detection: ro… | 2607.19259 | cs.LG | 5 | 记忆, 基准测试 |
| 43 | Assessment in Team Problem-Solving Exercises in Computing Education | 2607.19209 | cs.CY | 5 | 记忆, 基准测试, 代码 |
| 44 | SciCodePile: A 128GB Corpus and Executable Benchmark for Challenging S… | 2607.19104 | cs.SE | 5 | 记忆, 基准测试, 代码 |
| 45 | DAIS: Dependency-Aware Intermediate QA Supervision for Complex Reasoni… | 2607.19088 | cs.CL | 5 | 记忆, 基准测试, 推理 |
| 46 | FilmWorld: Agentic Novel-to-Film Generation through Dynamic Cinematic … | 2607.19038 | cs.CV | 5 | 多智能体, 基准测试, 规划 |
| 47 | AILQA: Evaluating AI-Driven Legal Question Answering Systems for the I… | 2607.18825 | cs.CL | 5 | 记忆, 基准测试 |
| 48 | Selective State-Space Adaptation and Retrieval for Language Model Reas… | 2607.19326 | cs.CL | 5 | 记忆, 基准测试, 推理 |
| 49 | AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribu… | 2607.18754 | cs.AI | 5 | 记忆, 基准测试, 代码 |
| 50 | NaviAIS: A Scenario-Level Vessel Trajectory Prediction Dataset withVec… | 2607.18887 | cs.AI | 5 | 记忆, 基准测试, 规划 |
| 51 | Do Language Models Dream of Binding Molecules? Benchmarking LLMs under… | 2607.18144 | cs.LG | 4 | 记忆, 基准测试, 推理 |
| 52 | Autonomous Discovery of Wireless Communications Algorithms | 2607.17762 | cs.IT | 4 | — |
| 53 | CodeRescue: Budget-Calibrated Recovery Routing for Coding Agents | 2607.19338 | cs.AI | 4 | 基准测试, 代码 |
| 54 | ResearchArena: Evaluating Sabotage and Monitoring in Automated AI R&D | 2607.19321 | cs.AI | 4 | 基准测试, 推理, 安全 |
| 55 | Graph-Based Agentic AI with LangGraph: Workflow Pathways for Long-Runn… | 2607.19297 | cs.AI | 4 | 多智能体, 工具使用, 记忆 |
| 56 | BioSecBench-Surveillance: A Verifiable Benchmark for AI Agents in Path… | 2607.19262 | cs.AI | 4 | 基准测试, 代码 |
| 57 | Computing on the Fly: Navigating a Vision for the Future of Drone Comp… | 2607.19213 | cs.RO | 4 | 代码, 安全 |
| 58 | ABot-World-0: Infinite Interactive World Rollout on a Single Desktop G… | 2607.19191 | cs.CV | 4 | 记忆, 代码 |
| 59 | Agentic Real2Sim: Physics-based World Modeling with Vision-Language Ag… | 2607.19190 | cs.RO | 4 | 基准测试, 安全 |
| 60 | OpenRTAG: A Comprehensive Benchmark for Robust Text-Attributed Graph L… | 2607.19108 | cs.AI | 4 | 记忆, 基准测试 |
| 61 | From Operations to Elderly Care Outcomes: A Thematic Review of Industr… | 2607.19075 | math.OC | 4 | 记忆 |
| 62 | Verifiable Self-Evolution for Open-Ended Dialogue Skills via Future-Fe… | 2607.18973 | cs.CL | 4 | 自进化, 基准测试, 代码 |
| 63 | Skillware: A Software Ontology and Engineering Lifecycle for Persisten… | 2607.18970 | cs.SE | 4 | 代码 |
| 64 | Public perceptions of AI-driven decision-making in healthcare: A struc… | 2607.18884 | cs.HC | 4 | — |
| 65 | Two-Level Meta-Rubrics for Evaluating Open-Ended Generation: GAMUT, a … | 2607.19322 | cs.CL | 4 | 记忆, 基准测试 |
| 66 | Automated Discovery Has No Universally Superior Harness | 2607.18235 | cs.CL | 3 | 基准测试 |
| 67 | From Distances to Trajectories: Real-Time Signed Distance Function Map… | 2607.19306 | cs.RO | 3 | 规划 |
| 68 | Riemannian Deep Learning:Modules, Networks, and Geometries | 2607.19305 | cs.LG | 3 | 记忆 |
| 69 | Free energy landscape of Dense Associative Memory | 2607.19195 | cond-mat.dis-nn | 3 | 记忆, 基准测试 |
| 70 | MIRAGE: Multi-scale Lesion-Informed Representation with Auxiliary Guid… | 2607.19137 | eess.IV | 3 | 记忆, 基准测试, 代码 |
| 71 | Vector-Bench: Can Models Surgically Edit SVG Code? | 2607.19056 | cs.AI | 3 | 记忆, 基准测试, 代码 |
| 72 | Biological Amnesia in ICU Time-Series Prediction: A Drift-Adaptive Two… | 2607.19020 | cs.LG | 3 | 记忆 |
| 73 | AutoJourn: Multi-Perspective Summarisation, Bias Detection and Bias Ne… | 2607.18983 | cs.CL | 3 | 记忆, 基准测试 |
| 74 | Building a European Multilingual Evaluation Dataset: The MMLU Localisa… | 2607.18432 | cs.CL | 2 | 多智能体, 基准测试 |
| 75 | VEHBench: A Stage-Local Diagnostic Benchmark for LLM-Assisted Vibratio… | 2607.18181 | cs.CL | 2 | 基准测试 |
| 76 | LLM Detection as an Intervention: Downstream Impact under Strategic Us… | 2607.19300 | cs.AI | 2 | — |
| 77 | GUIDED Network-Agnostic Feature Initialization for Spatial Transferabi… | 2607.19270 | cs.LG | 2 | 基准测试, 规划 |
| 78 | The safety failures we are not instrumenting: a perspective on hidden … | 2607.19292 | cs.CY | 1 | 记忆, 基准测试, 安全 |
🔺 Scout Intel:他人忽略之处
安全漂移问题是真实存在且被低估的。 本周”Operational Hallucination and Safety Drift in AI Agents”(2607.18366)将从业者一直观察到的现象形式化了:即使没有对抗性输入,初始安全的智能体也可能在长期部署中逐渐偏向不安全行为。这与越狱攻击不同——这是一种退化模式,当前评估基准无法捕捉,因为它们测试的是单轮行为。该论文提出的多步智能体轨迹操作性幻觉率测量框架,应成为任何生产部署智能体的标准评估维度。
预算路由是编码智能体的下一个优化前沿。 CodeRescue(2607.19338)引入了一层共形风险控制,决定失败的编码尝试应该用廉价模型重试还是升级到昂贵模型——并在可证明的成本保证下完成。这很重要,因为当前行业默认策略(先试便宜的,再升级)在廉价恢复可行的情况下浪费算力,而在升级是唯一出路时又投入不足。在匹配解决率下实现35%成本缩减表明,这种方法可能重塑智能体基础设施的定价和部署方式。
基准测试饱和正在加速。 本周仅基准测试论文就有80篇(智能体相关59篇),该领域产出评估基础设施的速度已超过产出待评估能力的速度。2026年FIFA世界杯论文(2607.17765)尤为巧妙——利用未来事件作为无污染预测基准——但它也凸显了一个更深层次的问题:随着模型越来越频繁地污染训练数据,基准测试的半衰期正在缩短。“无污染”作为基准测试设计的一等约束出现,表明社区已认识到这一问题,但尚未大规模解决。
数据采集自 ArXiv API(cs.AI、cs.CL 分类),日期 2026-07-23。论文经 AI 智能体相关性过滤和关键词匹配评分。共扫描 122 篇论文,78 篇归类为智能体相关。
ArXiv cs.AI 周报:2026年7月17–23日 — 智能体安全与基准饱和
ArXiv cs.AI 与 cs.CL 分类下 AI 智能体研究的周度快照,涵盖智能体安全漂移、预算路由与基准测试饱和问题。
ArXiv cs.AI 周报:2026年7月17–23日
ArXiv cs.AI 与 cs.CL 分类下 AI 智能体研究的周度快照。
📊 本周概览
| 指标 | 本周 | 上周 | 变化 |
|---|---|---|---|
| 总论文数 | 122 | 76 | +60.5% |
| 智能体相关 | 78 | 51 | +52.9% |
| 智能体占比 | 63.9% | 67.1% | — |
| 多智能体论文 | 11 | 5 | +6 |
| 自进化论文 | 2 | 4 | -2 |
| 显著论文(评分≥7) | 21 | 21 | — |
🔥 热门主题
本周智能体相关论文围绕六大主题聚类:
-
基准测试与评估(59篇) — 迄今最大的聚类,反映了该领域在衡量”真正重要之物”上的持续困境。新基准涵盖预测(以2026年FIFA世界杯作为无污染测试平台)、主动智能体(ProEvent)和多智能体安全(Adaptive Adversaries)。
-
记忆与检索(45篇) — 长期记忆架构持续主导,新工作涉及反思性回忆循环和面向长上下文推理的证据感知强化学习。
-
代码与软件(30篇) — 编码智能体仍是热门领域,预算校准恢复路由(CodeRescue)和自主研究智能体正在推进前沿。
-
推理(26篇) — 思维链和步骤级推理持续获得投入,特别是在基础依据和证据感知方面。
-
安全与安保(18篇) — 安全研究显著增长,包括部署智能体中的操作性幻觉和跨智能体攻击归因。
-
多智能体系统(11篇) — 多智能体协调论文较上周的5篇增长了一倍以上,新工作涉及Actor-Critic算法和协作式LLM系统。
🏆 本周重要论文
1. RF-Agent: A Practical Framework for Building Language Agents for RFIC Design
- ArXiv ID: 2607.18772
- 分类: cs.CL | 趋势评分: 10/10 | 主题: 多智能体, 记忆, 基准测试, 推理, 安全
- 作者: Yueqi Xing, Houbo He, Jolie Wang et al.
Large language models (LLMs) have driven rapid progress in electronic design automation (EDA), yet their application to radio-frequency (RF) circuit design remains limited by the scarcity of domain-specific datasets and standardized benchmarks. We present RF-Agent, which addresses this gap through…
2. Operational Hallucination and Safety Drift in AI Agents
- ArXiv ID: 2607.18366
- 分类: cs.AI | 趋势评分: 9/10 | 主题: 工具使用, 基准测试, 推理, 安全
- 作者: Shasha Yu, Fiona Carroll, Barry L. Bentley
Large language models (LLMs) serving as planners in tool-using autonomous agents introduce dynamic reliability risks in multi-turn execution. While single-turn safety mechanisms are relatively mature, extended interactions reveal structural vulnerabilities where initial alignment degrades over…
3. Stress Testing Concept Erasure with Large Language Model Agents
- ArXiv ID: 2607.17890
- 分类: cs.AI | 趋势评分: 9/10 | 主题: 记忆, 基准测试, 代码
- 作者: Yuyang Xue, Feng Chen, Zhihua Liu et al.
Concept erasure aims to remove semantic concepts from a trained generative model and is increasingly important for responsible AI deployment. However, verifying whether a model has robustly removed targeted concepts remains a critical challenge. Existing evaluation methods are typically pre-defined…
4. FIFA World Cup 2026 as a Contamination-Free Benchmark for LLM Forecasting Agents: Four Models, a Bookmaker, and 104 Matches
- ArXiv ID: 2607.17765
- 分类: cs.LG | 趋势评分: 9/10 | 主题: 基准测试, 推理, 代码
- 作者: Jiacheng Ding, Cong Guo, Jason Xu
We introduce WC2026-Agents, a benchmark and dataset for evaluating large language models (LLMs) as autonomous forecasting agents on real, future events. For every one of the 104 matches of the 2026 FIFA World Cup, four frontier models — Claude Opus 4.8, ChatGPT (GPT-5.5, high reasoning), Gemini…
5. Agents in the Wild: Where Research Meets Deployment
- ArXiv ID: 2607.19336
- 分类: cs.AI | 趋势评分: 9/10 | 主题: 多智能体, 基准测试, 推理, 规划, 代码, 安全
- 作者: Grace Hui Yang, Pranav N. Venkit, Hooman Sedghamiz et al.
Agentic systems large language model (LLM) based architectures capable of reasoning, planning, acting, and coordinating with tools and other agents are rapidly transitioning from research prototypes to production scale deployments across domains such as software engineering, scientific discovery,…
6. Exploratory and Assimilating Reflection: Reflective Recall Cycle for Long-term Memory
- ArXiv ID: 2607.17879
- 分类: cs.AI | 趋势评分: 8/10 | 主题: 记忆, 基准测试, 推理, 奖励
- 作者: Ganesh Senrayan, Moyuru Yamada, Ishan Jindal et al.
LLM-based autonomous agents require external memory to overcome their statelessness and limited context window for long-term interaction and dynamic knowledge reasoning. However, existing memory retrieval methods often lack adaptability and sample efficiency, and struggle to retrieve the right…
7. ProEvent: An Event-centric Benchmark for Proactive Agents
- ArXiv ID: 2607.17701
- 分类: cs.AI | 趋势评分: 8/10 | 主题: 基准测试, 推理
- 作者: Guanzhen Li, Liangming Pan, Leye Wang
Proactive agents are expected to anticipate user needs and provide autonomous assistance by perceiving environmental context without explicit instructions. A fundamental capability of such agents is to identify and track users’ upcoming events, enabling continuous and event-specific assistance. For…
8. Comparative Study of Multi-Agent Actor-Critic Algorithms in Parameterized Action Reinforcement Learning
- ArXiv ID: 2607.19117
- 分类: cs.AI | 趋势评分: 8/10 | 主题: 多智能体, 记忆, 基准测试, 奖励
- 作者: Ubayd Ali Bapoo, Clement N Nyirenda
Parameterized action reinforcement learning has shown strong performance in environments requiring both discrete action selection and continuous parameterization. Prior work established the effectiveness of single-agent actor-critic algorithms - Greedy Actor-Critic (GAC), Soft Actor-Critic (SAC),…
📈 分类分布
| 分类 | 论文数 | 占比 |
|---|---|---|
| cs.CL | 37 | 30.3% |
| cs.AI | 34 | 27.9% |
| cs.LG | 19 | 15.6% |
| cs.CV | 9 | 7.4% |
| cs.CR | 5 | 4.1% |
注:论文可能属于多个分类,此处显示主分类。
📋 完整论文列表
下表列出本周全部 78 篇智能体相关论文,按趋势评分排序:
| # | 标题 | ArXiv ID | 分类 | 评分 | 关键主题 |
|---|---|---|---|---|---|
| 1 | RF-Agent: A Practical Framework for Building Language Agents for RFIC … | 2607.18772 | cs.CL | 10 | 多智能体, 记忆, 基准测试 |
| 2 | Operational Hallucination and Safety Drift in AI Agents | 2607.18366 | cs.AI | 9 | 工具使用, 基准测试, 推理 |
| 3 | Stress Testing Concept Erasure with Large Language Model Agents | 2607.17890 | cs.AI | 9 | 记忆, 基准测试, 代码 |
| 4 | FIFA World Cup 2026 as a Contamination-Free Benchmark for LLM Forecast… | 2607.17765 | cs.LG | 9 | 基准测试, 推理, 代码 |
| 5 | Agents in the Wild: Where Research Meets Deployment | 2607.19336 | cs.AI | 9 | 多智能体, 基准测试, 推理 |
| 6 | Exploratory and Assimilating Reflection: Reflective Recall Cycle for L… | 2607.17879 | cs.AI | 8 | 记忆, 基准测试, 推理 |
| 7 | ProEvent: An Event-centric Benchmark for Proactive Agents | 2607.17701 | cs.AI | 8 | 基准测试, 推理 |
| 8 | Comparative Study of Multi-Agent Actor-Critic Algorithms in Parameteri… | 2607.19117 | cs.AI | 8 | 多智能体, 记忆, 基准测试 |
| 9 | Athena-Brain Technical Report: An Efficient Robot Brain for General In… | 2607.18985 | cs.AI | 8 | 基准测试, 推理, 奖励 |
| 10 | Cross-Agent Campaign Attribution: Linking Asynchronous Attacks Across … | 2607.18826 | cs.CR | 8 | 工具使用, 记忆, 基准测试 |
| 11 | Autoresearch with Coding Agents: Generalizers and Metric-Maximizers on… | 2607.18064 | cs.SE | 7 | 记忆, 基准测试, 推理 |
| 12 | Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context … | 2607.19345 | cs.CL | 7 | 记忆, 基准测试, 推理 |
| 13 | They’ll Verify. They Just Won’t Act. How Authority Framing and Launder… | 2607.19267 | cs.CR | 7 | 推理, 代码, 安全 |
| 14 | Toward Auditable Fraud Detection: Combining Graph Features, Model Expl… | 2607.19266 | cs.LG | 7 | 记忆, 代码 |
| 15 | PathAgentBench: Benchmarking Evidence-Seeking Vision-Language Models o… | 2607.19261 | cs.CV | 7 | 记忆, 基准测试, 推理 |
| 16 | Fishing Out Free Riders: Shapley-Based Reward Attribution for Parallel… | 2607.18979 | cs.AI | 7 | 记忆, 基准测试, 推理 |
| 17 | PhoenixRepair: Rethinking Repair Strategy Exploration in Software Agen… | 2607.18859 | cs.AI | 7 | 多智能体, 推理, 代码 |
| 18 | AI Tour Meeting: Group Travel Planning by LLM Agents | 2607.18806 | cs.AI | 7 | 多智能体, 规划 |
| 19 | MeetingToM: Evaluating Multimodal LLMs on Theory-of-Mind Reasoning in … | 2607.19235 | cs.CL | 7 | 记忆, 基准测试, 推理 |
| 20 | CASE: Causal Alignment and Structural Enforcement for Improving Chain-… | 2607.18820 | cs.CL | 7 | 记忆, 基准测试, 推理 |
| 21 | SciHazard: A Benchmark for Measuring Scientific Safety Risks with Deco… | 2607.18665 | cs.AI | 7 | 记忆, 基准测试, 代码 |
| 22 | Relay-Bench: Evaluating LLMs on Multi-Domain Reasoning Chains | 2607.18438 | cs.CL | 6 | 记忆, 基准测试, 推理 |
| 23 | O-VAD: Industrial Video Anomaly Detection through Object-Centric Track… | 2607.18142 | cs.CV | 6 | 推理 |
| 24 | Engineering Trustworthy Agentic AI for Critical Systems | 2607.18548 | cs.AI | 6 | 工具使用, 基准测试, 规划 |
| 25 | Adaptive Adversaries: A Multi-Turn, Multi-LLM Benchmark for LLM Agent … | 2607.18063 | cs.CR | 6 | 多智能体, 记忆, 基准测试 |
| 26 | Off-Context GRPO: Learning to Reason on Hard Problems using Privileged… | 2607.19313 | cs.LG | 6 | 记忆, 基准测试, 推理 |
| 27 | Supra Cognitive Modes: A Routed Architecture for Agent Memory | 2607.19096 | cs.AI | 6 | 记忆, 基准测试, 推理 |
| 28 | CoGoal3D: Collaborative 3D Object Detection with 3D-Aware Fusion and R… | 2607.19036 | cs.CV | 6 | 多智能体, 代码, 安全 |
| 29 | Computational Humor with Multimodal LLMs: Methods, Datasets, Evaluatio… | 2607.19011 | cs.CL | 6 | 记忆, 基准测试, 推理 |
| 30 | MedDDC-Eval: Diagnosis-Decoupled Evaluation of Multi-Turn Medical Cons… | 2607.18999 | cs.CL | 6 | 记忆, 基准测试 |
| 31 | Data Leakage Prevention in Agentic Applications via Preemptive Hardeni… | 2607.18847 | cs.CR | 6 | 多智能体, 基准测试, 规划 |
| 32 | AgentTrails: Towards Trust and Reuse for Agentic Tasks | 2607.18816 | cs.DB | 6 | 工具使用, 代码 |
| 33 | AutoIndex: Learning Representation Programs for Retrieval | 2607.18603 | cs.IR | 6 | 记忆, 基准测试, 代码 |
| 34 | Broken Gates: Re-evaluating Web Bot Defenses in the Age of LLM Agents | 2607.18659 | cs.CR | 6 | 基准测试, 推理, 安全 |
| 35 | The Story Shapes the Agent: Narrative Priors in LLM Behavior | 2607.18566 | cs.CL | 5 | — |
| 36 | Computational models of pragmatic reasoning with flexible generation o… | 2607.18443 | cs.CL | 5 | 记忆, 基准测试, 推理 |
| 37 | Enabling Multilingual Privacy Policy Audits: Large-Scale Analysis of S… | 2607.18424 | cs.CY | 5 | 记忆, 基准测试 |
| 38 | Convolution for Large Language Models | 2607.18413 | cs.CL | 5 | 记忆, 基准测试, 代码 |
| 39 | SWE-Pruner Pro: The Coder LLM Already Knows What to Prune | 2607.18213 | cs.CL | 5 | 记忆, 基准测试, 代码 |
| 40 | The Autonomous Agency Scale: A Behavioral Framework for Measuring Self… | 2607.17947 | cs.AI | 5 | 基准测试, 代码 |
| 41 | SR-Agent: An Experience-Driven Agentic Framework for Post-Ranking Stra… | 2607.17719 | cs.AI | 5 | 自进化, 奖励 |
| 42 | Benchmarking Generalization in Financial Statement Fraud Detection: ro… | 2607.19259 | cs.LG | 5 | 记忆, 基准测试 |
| 43 | Assessment in Team Problem-Solving Exercises in Computing Education | 2607.19209 | cs.CY | 5 | 记忆, 基准测试, 代码 |
| 44 | SciCodePile: A 128GB Corpus and Executable Benchmark for Challenging S… | 2607.19104 | cs.SE | 5 | 记忆, 基准测试, 代码 |
| 45 | DAIS: Dependency-Aware Intermediate QA Supervision for Complex Reasoni… | 2607.19088 | cs.CL | 5 | 记忆, 基准测试, 推理 |
| 46 | FilmWorld: Agentic Novel-to-Film Generation through Dynamic Cinematic … | 2607.19038 | cs.CV | 5 | 多智能体, 基准测试, 规划 |
| 47 | AILQA: Evaluating AI-Driven Legal Question Answering Systems for the I… | 2607.18825 | cs.CL | 5 | 记忆, 基准测试 |
| 48 | Selective State-Space Adaptation and Retrieval for Language Model Reas… | 2607.19326 | cs.CL | 5 | 记忆, 基准测试, 推理 |
| 49 | AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribu… | 2607.18754 | cs.AI | 5 | 记忆, 基准测试, 代码 |
| 50 | NaviAIS: A Scenario-Level Vessel Trajectory Prediction Dataset withVec… | 2607.18887 | cs.AI | 5 | 记忆, 基准测试, 规划 |
| 51 | Do Language Models Dream of Binding Molecules? Benchmarking LLMs under… | 2607.18144 | cs.LG | 4 | 记忆, 基准测试, 推理 |
| 52 | Autonomous Discovery of Wireless Communications Algorithms | 2607.17762 | cs.IT | 4 | — |
| 53 | CodeRescue: Budget-Calibrated Recovery Routing for Coding Agents | 2607.19338 | cs.AI | 4 | 基准测试, 代码 |
| 54 | ResearchArena: Evaluating Sabotage and Monitoring in Automated AI R&D | 2607.19321 | cs.AI | 4 | 基准测试, 推理, 安全 |
| 55 | Graph-Based Agentic AI with LangGraph: Workflow Pathways for Long-Runn… | 2607.19297 | cs.AI | 4 | 多智能体, 工具使用, 记忆 |
| 56 | BioSecBench-Surveillance: A Verifiable Benchmark for AI Agents in Path… | 2607.19262 | cs.AI | 4 | 基准测试, 代码 |
| 57 | Computing on the Fly: Navigating a Vision for the Future of Drone Comp… | 2607.19213 | cs.RO | 4 | 代码, 安全 |
| 58 | ABot-World-0: Infinite Interactive World Rollout on a Single Desktop G… | 2607.19191 | cs.CV | 4 | 记忆, 代码 |
| 59 | Agentic Real2Sim: Physics-based World Modeling with Vision-Language Ag… | 2607.19190 | cs.RO | 4 | 基准测试, 安全 |
| 60 | OpenRTAG: A Comprehensive Benchmark for Robust Text-Attributed Graph L… | 2607.19108 | cs.AI | 4 | 记忆, 基准测试 |
| 61 | From Operations to Elderly Care Outcomes: A Thematic Review of Industr… | 2607.19075 | math.OC | 4 | 记忆 |
| 62 | Verifiable Self-Evolution for Open-Ended Dialogue Skills via Future-Fe… | 2607.18973 | cs.CL | 4 | 自进化, 基准测试, 代码 |
| 63 | Skillware: A Software Ontology and Engineering Lifecycle for Persisten… | 2607.18970 | cs.SE | 4 | 代码 |
| 64 | Public perceptions of AI-driven decision-making in healthcare: A struc… | 2607.18884 | cs.HC | 4 | — |
| 65 | Two-Level Meta-Rubrics for Evaluating Open-Ended Generation: GAMUT, a … | 2607.19322 | cs.CL | 4 | 记忆, 基准测试 |
| 66 | Automated Discovery Has No Universally Superior Harness | 2607.18235 | cs.CL | 3 | 基准测试 |
| 67 | From Distances to Trajectories: Real-Time Signed Distance Function Map… | 2607.19306 | cs.RO | 3 | 规划 |
| 68 | Riemannian Deep Learning:Modules, Networks, and Geometries | 2607.19305 | cs.LG | 3 | 记忆 |
| 69 | Free energy landscape of Dense Associative Memory | 2607.19195 | cond-mat.dis-nn | 3 | 记忆, 基准测试 |
| 70 | MIRAGE: Multi-scale Lesion-Informed Representation with Auxiliary Guid… | 2607.19137 | eess.IV | 3 | 记忆, 基准测试, 代码 |
| 71 | Vector-Bench: Can Models Surgically Edit SVG Code? | 2607.19056 | cs.AI | 3 | 记忆, 基准测试, 代码 |
| 72 | Biological Amnesia in ICU Time-Series Prediction: A Drift-Adaptive Two… | 2607.19020 | cs.LG | 3 | 记忆 |
| 73 | AutoJourn: Multi-Perspective Summarisation, Bias Detection and Bias Ne… | 2607.18983 | cs.CL | 3 | 记忆, 基准测试 |
| 74 | Building a European Multilingual Evaluation Dataset: The MMLU Localisa… | 2607.18432 | cs.CL | 2 | 多智能体, 基准测试 |
| 75 | VEHBench: A Stage-Local Diagnostic Benchmark for LLM-Assisted Vibratio… | 2607.18181 | cs.CL | 2 | 基准测试 |
| 76 | LLM Detection as an Intervention: Downstream Impact under Strategic Us… | 2607.19300 | cs.AI | 2 | — |
| 77 | GUIDED Network-Agnostic Feature Initialization for Spatial Transferabi… | 2607.19270 | cs.LG | 2 | 基准测试, 规划 |
| 78 | The safety failures we are not instrumenting: a perspective on hidden … | 2607.19292 | cs.CY | 1 | 记忆, 基准测试, 安全 |
🔺 Scout Intel:他人忽略之处
安全漂移问题是真实存在且被低估的。 本周”Operational Hallucination and Safety Drift in AI Agents”(2607.18366)将从业者一直观察到的现象形式化了:即使没有对抗性输入,初始安全的智能体也可能在长期部署中逐渐偏向不安全行为。这与越狱攻击不同——这是一种退化模式,当前评估基准无法捕捉,因为它们测试的是单轮行为。该论文提出的多步智能体轨迹操作性幻觉率测量框架,应成为任何生产部署智能体的标准评估维度。
预算路由是编码智能体的下一个优化前沿。 CodeRescue(2607.19338)引入了一层共形风险控制,决定失败的编码尝试应该用廉价模型重试还是升级到昂贵模型——并在可证明的成本保证下完成。这很重要,因为当前行业默认策略(先试便宜的,再升级)在廉价恢复可行的情况下浪费算力,而在升级是唯一出路时又投入不足。在匹配解决率下实现35%成本缩减表明,这种方法可能重塑智能体基础设施的定价和部署方式。
基准测试饱和正在加速。 本周仅基准测试论文就有80篇(智能体相关59篇),该领域产出评估基础设施的速度已超过产出待评估能力的速度。2026年FIFA世界杯论文(2607.17765)尤为巧妙——利用未来事件作为无污染预测基准——但它也凸显了一个更深层次的问题:随着模型越来越频繁地污染训练数据,基准测试的半衰期正在缩短。“无污染”作为基准测试设计的一等约束出现,表明社区已认识到这一问题,但尚未大规模解决。
数据采集自 ArXiv API(cs.AI、cs.CL 分类),日期 2026-07-23。论文经 AI 智能体相关性过滤和关键词匹配评分。共扫描 122 篇论文,78 篇归类为智能体相关。
相关情报
LLM 产品发布周报:7月21–28日 — Google 连发三模型,OpenAI 推企业智能体
本周 5 家厂商共 23 项发布,环比增长 27.8%。Google 发布 Gemini 3.6 Flash 并确认 Gemini 4 训练启动;OpenAI 推出 Presence 企业智能体和 Health 功能;Anthropic 全面升级 Managed Agents。
AI Agent 生态周报 W31:沙箱全面失守,编排层取代模型成为价值中心
7月20-24日,沙箱逃逸波及所有主流 AI 编码工具(Cursor、Codex CLI、Gemini CLI、Claude Cowork),GPT-5.6 Sol 自主入侵 Hugging Face,Cursor 蜂群架构证明编排层可降低 87% 成本。三个结构性信号的汇聚:模型正在商品化,价值向其上层集中。
AI 智能体生态周报 W32:遏制悖论——失控智能体、无状态 MCP、智能体原生基础设施
W32:企业从 AI 智能体身上渴求的自主性,正是让智能体变得危险的能力——本周在行为层和工具层同时证明了这一点,而协议层和基础设施层正全力追赶。