ArXiv cs.AI Weekly: Jul 17–23, 2026 — Agent Safety & Benchmark Saturation
Weekly snapshot of AI agent research from ArXiv cs.AI and cs.CL, covering agent safety drift, budget routing, and benchmark saturation.
ArXiv cs.AI Weekly: Jul 17–23, 2026
Weekly snapshot of AI agent research from ArXiv cs.AI and cs.CL categories.
📊 Week at a Glance
| Metric | This Week | Last Week | Change |
|---|---|---|---|
| Total Papers | 122 | 76 | +60.5% |
| Agent-Related | 78 | 51 | +52.9% |
| Agent % | 63.9% | 67.1% | — |
| Multi-Agent Papers | 11 | 5 | +6 |
| Self-Evolving Papers | 2 | 4 | -2 |
| Notable Papers (Score ≥7) | 21 | 21 | — |
🔥 Trending Topics
This week’s agent-related papers cluster around six dominant themes:
-
Benchmark & Evaluation (59 papers) — The largest cluster by far, reflecting the field’s ongoing struggle to measure what matters. New benchmarks span forecasting (FIFA World Cup 2026 as contamination-free testbed), proactive agents (ProEvent), and multi-agent security (Adaptive Adversaries).
-
Memory & Retrieval (45 papers) — Long-term memory architectures continue to dominate, with new work on reflective recall cycles and evidence-aware reinforcement learning for long-context reasoning.
-
Code & Software (30 papers) — Coding agents remain a hot area, with budget-calibrated recovery routing (CodeRescue) and autonomous research agents pushing the frontier.
-
Reasoning (26 papers) — Chain-of-thought and step-level reasoning see continued investment, particularly around grounding and evidence-awareness.
-
Safety & Security (18 papers) — A notable surge in safety research, including operational hallucination in deployed agents and cross-agent attack attribution.
-
Multi-Agent Systems (11 papers) — Multi-agent coordination papers more than doubled from last week’s 5, with new work on actor-critic algorithms and collaborative LLM systems.
🏆 Top Papers This Week
1. RF-Agent: A Practical Framework for Building Language Agents for RFIC Design
- ArXiv ID: 2607.18772
- Category: cs.CL | Trend Score: 10/10 | Topics: multi-agent, memory, benchmark, reasoning, safety
- Authors: Yueqi Xing, Houbo He, Jolie Wang et al.
Large language models (LLMs) have driven rapid progress in electronic design automation (EDA), yet their application to radio-frequency (RF) circuit design remains limited by the scarcity of domain-specific datasets and standardized benchmarks. We present RF-Agent, which addresses this gap through…
2. Operational Hallucination and Safety Drift in AI Agents
- ArXiv ID: 2607.18366
- Category: cs.AI | Trend Score: 9/10 | Topics: tool-use, benchmark, reasoning, safety
- Authors: Shasha Yu, Fiona Carroll, Barry L. Bentley
Large language models (LLMs) serving as planners in tool-using autonomous agents introduce dynamic reliability risks in multi-turn execution. While single-turn safety mechanisms are relatively mature, extended interactions reveal structural vulnerabilities where initial alignment degrades over…
3. Stress Testing Concept Erasure with Large Language Model Agents
- ArXiv ID: 2607.17890
- Category: cs.AI | Trend Score: 9/10 | Topics: memory, benchmark, code
- Authors: Yuyang Xue, Feng Chen, Zhihua Liu et al.
Concept erasure aims to remove semantic concepts from a trained generative model and is increasingly important for responsible AI deployment. However, verifying whether a model has robustly removed targeted concepts remains a critical challenge. Existing evaluation methods are typically pre-defined…
4. FIFA World Cup 2026 as a Contamination-Free Benchmark for LLM Forecasting Agents: Four Models, a Bookmaker, and 104 Matches
- ArXiv ID: 2607.17765
- Category: cs.LG | Trend Score: 9/10 | Topics: benchmark, reasoning, code
- Authors: Jiacheng Ding, Cong Guo, Jason Xu
We introduce WC2026-Agents, a benchmark and dataset for evaluating large language models (LLMs) as autonomous forecasting agents on real, future events. For every one of the 104 matches of the 2026 FIFA World Cup, four frontier models — Claude Opus 4.8, ChatGPT (GPT-5.5, high reasoning), Gemini…
5. Agents in the Wild: Where Research Meets Deployment
- ArXiv ID: 2607.19336
- Category: cs.AI | Trend Score: 9/10 | Topics: multi-agent, benchmark, reasoning, planning, code, safety
- Authors: Grace Hui Yang, Pranav N. Venkit, Hooman Sedghamiz et al.
Agentic systems large language model (LLM) based architectures capable of reasoning, planning, acting, and coordinating with tools and other agents are rapidly transitioning from research prototypes to production scale deployments across domains such as software engineering, scientific discovery,…
6. Exploratory and Assimilating Reflection: Reflective Recall Cycle for Long-term Memory
- ArXiv ID: 2607.17879
- Category: cs.AI | Trend Score: 8/10 | Topics: memory, benchmark, reasoning, reward
- Authors: Ganesh Senrayan, Moyuru Yamada, Ishan Jindal et al.
LLM-based autonomous agents require external memory to overcome their statelessness and limited context window for long-term interaction and dynamic knowledge reasoning. However, existing memory retrieval methods often lack adaptability and sample efficiency, and struggle to retrieve the right…
7. ProEvent: An Event-centric Benchmark for Proactive Agents
- ArXiv ID: 2607.17701
- Category: cs.AI | Trend Score: 8/10 | Topics: benchmark, reasoning
- Authors: Guanzhen Li, Liangming Pan, Leye Wang
Proactive agents are expected to anticipate user needs and provide autonomous assistance by perceiving environmental context without explicit instructions. A fundamental capability of such agents is to identify and track users’ upcoming events, enabling continuous and event-specific assistance. For…
8. Comparative Study of Multi-Agent Actor-Critic Algorithms in Parameterized Action Reinforcement Learning
- ArXiv ID: 2607.19117
- Category: cs.AI | Trend Score: 8/10 | Topics: multi-agent, memory, benchmark, reward
- Authors: Ubayd Ali Bapoo, Clement N Nyirenda
Parameterized action reinforcement learning has shown strong performance in environments requiring both discrete action selection and continuous parameterization. Prior work established the effectiveness of single-agent actor-critic algorithms - Greedy Actor-Critic (GAC), Soft Actor-Critic (SAC),…
📈 Category Breakdown
| Category | Papers | % of Total |
|---|---|---|
| cs.CL | 37 | 30.3% |
| cs.AI | 34 | 27.9% |
| cs.LG | 19 | 15.6% |
| cs.CV | 9 | 7.4% |
| cs.CR | 5 | 4.1% |
Note: Papers may appear in multiple categories. Primary category is shown.
📋 Full Paper List
The following table lists all 78 agent-related papers from this week, sorted by trend score:
| # | Title | ArXiv ID | Cat | Score | Key Topics |
|---|---|---|---|---|---|
| 1 | RF-Agent: A Practical Framework for Building Language Agents for RFIC … | 2607.18772 | cs.CL | 10 | multi-agent, memory, benchmark |
| 2 | Operational Hallucination and Safety Drift in AI Agents | 2607.18366 | cs.AI | 9 | tool-use, benchmark, reasoning |
| 3 | Stress Testing Concept Erasure with Large Language Model Agents | 2607.17890 | cs.AI | 9 | memory, benchmark, code |
| 4 | FIFA World Cup 2026 as a Contamination-Free Benchmark for LLM Forecast… | 2607.17765 | cs.LG | 9 | benchmark, reasoning, code |
| 5 | Agents in the Wild: Where Research Meets Deployment | 2607.19336 | cs.AI | 9 | multi-agent, benchmark, reasoning |
| 6 | Exploratory and Assimilating Reflection: Reflective Recall Cycle for L… | 2607.17879 | cs.AI | 8 | memory, benchmark, reasoning |
| 7 | ProEvent: An Event-centric Benchmark for Proactive Agents | 2607.17701 | cs.AI | 8 | benchmark, reasoning |
| 8 | Comparative Study of Multi-Agent Actor-Critic Algorithms in Parameteri… | 2607.19117 | cs.AI | 8 | multi-agent, memory, benchmark |
| 9 | Athena-Brain Technical Report: An Efficient Robot Brain for General In… | 2607.18985 | cs.AI | 8 | benchmark, reasoning, reward |
| 10 | Cross-Agent Campaign Attribution: Linking Asynchronous Attacks Across … | 2607.18826 | cs.CR | 8 | tool-use, memory, benchmark |
| 11 | Autoresearch with Coding Agents: Generalizers and Metric-Maximizers on… | 2607.18064 | cs.SE | 7 | memory, benchmark, reasoning |
| 12 | Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context … | 2607.19345 | cs.CL | 7 | memory, benchmark, reasoning |
| 13 | They’ll Verify. They Just Won’t Act. How Authority Framing and Launder… | 2607.19267 | cs.CR | 7 | reasoning, code, safety |
| 14 | Toward Auditable Fraud Detection: Combining Graph Features, Model Expl… | 2607.19266 | cs.LG | 7 | memory, code |
| 15 | PathAgentBench: Benchmarking Evidence-Seeking Vision-Language Models o… | 2607.19261 | cs.CV | 7 | memory, benchmark, reasoning |
| 16 | Fishing Out Free Riders: Shapley-Based Reward Attribution for Parallel… | 2607.18979 | cs.AI | 7 | memory, benchmark, reasoning |
| 17 | PhoenixRepair: Rethinking Repair Strategy Exploration in Software Agen… | 2607.18859 | cs.AI | 7 | multi-agent, reasoning, code |
| 18 | AI Tour Meeting: Group Travel Planning by LLM Agents | 2607.18806 | cs.AI | 7 | multi-agent, planning |
| 19 | MeetingToM: Evaluating Multimodal LLMs on Theory-of-Mind Reasoning in … | 2607.19235 | cs.CL | 7 | memory, benchmark, reasoning |
| 20 | CASE: Causal Alignment and Structural Enforcement for Improving Chain-… | 2607.18820 | cs.CL | 7 | memory, benchmark, reasoning |
| 21 | SciHazard: A Benchmark for Measuring Scientific Safety Risks with Deco… | 2607.18665 | cs.AI | 7 | memory, benchmark, code |
| 22 | Relay-Bench: Evaluating LLMs on Multi-Domain Reasoning Chains | 2607.18438 | cs.CL | 6 | memory, benchmark, reasoning |
| 23 | O-VAD: Industrial Video Anomaly Detection through Object-Centric Track… | 2607.18142 | cs.CV | 6 | reasoning |
| 24 | Engineering Trustworthy Agentic AI for Critical Systems | 2607.18548 | cs.AI | 6 | tool-use, benchmark, planning |
| 25 | Adaptive Adversaries: A Multi-Turn, Multi-LLM Benchmark for LLM Agent … | 2607.18063 | cs.CR | 6 | multi-agent, memory, benchmark |
| 26 | Off-Context GRPO: Learning to Reason on Hard Problems using Privileged… | 2607.19313 | cs.LG | 6 | memory, benchmark, reasoning |
| 27 | Supra Cognitive Modes: A Routed Architecture for Agent Memory | 2607.19096 | cs.AI | 6 | memory, benchmark, reasoning |
| 28 | CoGoal3D: Collaborative 3D Object Detection with 3D-Aware Fusion and R… | 2607.19036 | cs.CV | 6 | multi-agent, code, safety |
| 29 | Computational Humor with Multimodal LLMs: Methods, Datasets, Evaluatio… | 2607.19011 | cs.CL | 6 | memory, benchmark, reasoning |
| 30 | MedDDC-Eval: Diagnosis-Decoupled Evaluation of Multi-Turn Medical Cons… | 2607.18999 | cs.CL | 6 | memory, benchmark |
| 31 | Data Leakage Prevention in Agentic Applications via Preemptive Hardeni… | 2607.18847 | cs.CR | 6 | multi-agent, benchmark, planning |
| 32 | AgentTrails: Towards Trust and Reuse for Agentic Tasks | 2607.18816 | cs.DB | 6 | tool-use, code |
| 33 | AutoIndex: Learning Representation Programs for Retrieval | 2607.18603 | cs.IR | 6 | memory, benchmark, code |
| 34 | Broken Gates: Re-evaluating Web Bot Defenses in the Age of LLM Agents | 2607.18659 | cs.CR | 6 | benchmark, reasoning, safety |
| 35 | The Story Shapes the Agent: Narrative Priors in LLM Behavior | 2607.18566 | cs.CL | 5 | — |
| 36 | Computational models of pragmatic reasoning with flexible generation o… | 2607.18443 | cs.CL | 5 | memory, benchmark, reasoning |
| 37 | Enabling Multilingual Privacy Policy Audits: Large-Scale Analysis of S… | 2607.18424 | cs.CY | 5 | memory, benchmark |
| 38 | Convolution for Large Language Models | 2607.18413 | cs.CL | 5 | memory, benchmark, code |
| 39 | SWE-Pruner Pro: The Coder LLM Already Knows What to Prune | 2607.18213 | cs.CL | 5 | memory, benchmark, code |
| 40 | The Autonomous Agency Scale: A Behavioral Framework for Measuring Self… | 2607.17947 | cs.AI | 5 | benchmark, code |
| 41 | SR-Agent: An Experience-Driven Agentic Framework for Post-Ranking Stra… | 2607.17719 | cs.AI | 5 | self-evolving, reward |
| 42 | Benchmarking Generalization in Financial Statement Fraud Detection: ro… | 2607.19259 | cs.LG | 5 | memory, benchmark |
| 43 | Assessment in Team Problem-Solving Exercises in Computing Education | 2607.19209 | cs.CY | 5 | memory, benchmark, code |
| 44 | SciCodePile: A 128GB Corpus and Executable Benchmark for Challenging S… | 2607.19104 | cs.SE | 5 | memory, benchmark, code |
| 45 | DAIS: Dependency-Aware Intermediate QA Supervision for Complex Reasoni… | 2607.19088 | cs.CL | 5 | memory, benchmark, reasoning |
| 46 | FilmWorld: Agentic Novel-to-Film Generation through Dynamic Cinematic … | 2607.19038 | cs.CV | 5 | multi-agent, benchmark, planning |
| 47 | AILQA: Evaluating AI-Driven Legal Question Answering Systems for the I… | 2607.18825 | cs.CL | 5 | memory, benchmark |
| 48 | Selective State-Space Adaptation and Retrieval for Language Model Reas… | 2607.19326 | cs.CL | 5 | memory, benchmark, reasoning |
| 49 | AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribu… | 2607.18754 | cs.AI | 5 | memory, benchmark, code |
| 50 | NaviAIS: A Scenario-Level Vessel Trajectory Prediction Dataset withVec… | 2607.18887 | cs.AI | 5 | memory, benchmark, planning |
| 51 | Do Language Models Dream of Binding Molecules? Benchmarking LLMs under… | 2607.18144 | cs.LG | 4 | memory, benchmark, reasoning |
| 52 | Autonomous Discovery of Wireless Communications Algorithms | 2607.17762 | cs.IT | 4 | — |
| 53 | CodeRescue: Budget-Calibrated Recovery Routing for Coding Agents | 2607.19338 | cs.AI | 4 | benchmark, code |
| 54 | ResearchArena: Evaluating Sabotage and Monitoring in Automated AI R&D | 2607.19321 | cs.AI | 4 | benchmark, reasoning, safety |
| 55 | Graph-Based Agentic AI with LangGraph: Workflow Pathways for Long-Runn… | 2607.19297 | cs.AI | 4 | multi-agent, tool-use, memory |
| 56 | BioSecBench-Surveillance: A Verifiable Benchmark for AI Agents in Path… | 2607.19262 | cs.AI | 4 | benchmark, code |
| 57 | Computing on the Fly: Navigating a Vision for the Future of Drone Comp… | 2607.19213 | cs.RO | 4 | code, safety |
| 58 | ABot-World-0: Infinite Interactive World Rollout on a Single Desktop G… | 2607.19191 | cs.CV | 4 | memory, code |
| 59 | Agentic Real2Sim: Physics-based World Modeling with Vision-Language Ag… | 2607.19190 | cs.RO | 4 | benchmark, safety |
| 60 | OpenRTAG: A Comprehensive Benchmark for Robust Text-Attributed Graph L… | 2607.19108 | cs.AI | 4 | memory, benchmark |
| 61 | From Operations to Elderly Care Outcomes: A Thematic Review of Industr… | 2607.19075 | math.OC | 4 | memory |
| 62 | Verifiable Self-Evolution for Open-Ended Dialogue Skills via Future-Fe… | 2607.18973 | cs.CL | 4 | self-evolving, benchmark, code |
| 63 | Skillware: A Software Ontology and Engineering Lifecycle for Persisten… | 2607.18970 | cs.SE | 4 | code |
| 64 | Public perceptions of AI-driven decision-making in healthcare: A struc… | 2607.18884 | cs.HC | 4 | — |
| 65 | Two-Level Meta-Rubrics for Evaluating Open-Ended Generation: GAMUT, a … | 2607.19322 | cs.CL | 4 | memory, benchmark |
| 66 | Automated Discovery Has No Universally Superior Harness | 2607.18235 | cs.CL | 3 | benchmark |
| 67 | From Distances to Trajectories: Real-Time Signed Distance Function Map… | 2607.19306 | cs.RO | 3 | planning |
| 68 | Riemannian Deep Learning:Modules, Networks, and Geometries | 2607.19305 | cs.LG | 3 | memory |
| 69 | Free energy landscape of Dense Associative Memory | 2607.19195 | cond-mat.dis-nn | 3 | memory, benchmark |
| 70 | MIRAGE: Multi-scale Lesion-Informed Representation with Auxiliary Guid… | 2607.19137 | eess.IV | 3 | memory, benchmark, code |
| 71 | Vector-Bench: Can Models Surgically Edit SVG Code? | 2607.19056 | cs.AI | 3 | memory, benchmark, code |
| 72 | Biological Amnesia in ICU Time-Series Prediction: A Drift-Adaptive Two… | 2607.19020 | cs.LG | 3 | memory |
| 73 | AutoJourn: Multi-Perspective Summarisation, Bias Detection and Bias Ne… | 2607.18983 | cs.CL | 3 | memory, benchmark |
| 74 | Building a European Multilingual Evaluation Dataset: The MMLU Localisa… | 2607.18432 | cs.CL | 2 | multi-agent, benchmark |
| 75 | VEHBench: A Stage-Local Diagnostic Benchmark for LLM-Assisted Vibratio… | 2607.18181 | cs.CL | 2 | benchmark |
| 76 | LLM Detection as an Intervention: Downstream Impact under Strategic Us… | 2607.19300 | cs.AI | 2 | — |
| 77 | GUIDED Network-Agnostic Feature Initialization for Spatial Transferabi… | 2607.19270 | cs.LG | 2 | benchmark, planning |
| 78 | The safety failures we are not instrumenting: a perspective on hidden … | 2607.19292 | cs.CY | 1 | memory, benchmark, safety |
🔺 Scout Intel: What Others Missed
The safety drift problem is real and undermeasured. This week’s “Operational Hallucination and Safety Drift in AI Agents” (2607.18366) formalizes something practitioners have observed anecdotally: agents that start safe can gradually drift toward unsafe behavior over extended deployments, even without adversarial input. This is distinct from jailbreaking — it’s a degradation mode that current evaluation benchmarks don’t capture because they test single-turn behavior. The paper’s framework for measuring operational hallucination rates over multi-step agent trajectories should become a standard evaluation dimension for any agent deployed in production.
Budget routing is the next optimization frontier for coding agents. CodeRescue (2607.19338) introduces a conformal risk control layer that decides whether a failed coding attempt should retry with a cheap model or escalate to an expensive one — and does so under provable cost guarantees. This matters because the current industry default (try cheap, then escalate) wastes compute on cases where cheap recovery is viable, and under-invests in cases where escalation is the only path. The 35% cost reduction at matched solve rates suggests this approach could reshape how agent infrastructure is priced and deployed.
Benchmark saturation is accelerating. With 80 benchmark papers this week alone (59 among agent-related papers), the field is producing evaluation infrastructure faster than it’s producing capabilities to evaluate. The FIFA World Cup 2026 paper (2607.17765) is particularly clever — using a future event as a contamination-free forecasting benchmark — but it also highlights a deeper issue: the half-life of benchmarks is shrinking as models increasingly contaminate training data. The emergence of “contamination-free” as a first-class benchmark design constraint signals that the community recognizes this problem but hasn’t yet solved it at scale.
Data collected from ArXiv API (cs.AI, cs.CL categories) on 2026-07-23. Papers filtered for AI agent relevance and scored by keyword matching. Total of 122 papers scanned, 78 classified as agent-related.
ArXiv cs.AI Weekly: Jul 17–23, 2026 — Agent Safety & Benchmark Saturation
Weekly snapshot of AI agent research from ArXiv cs.AI and cs.CL, covering agent safety drift, budget routing, and benchmark saturation.
ArXiv cs.AI Weekly: Jul 17–23, 2026
Weekly snapshot of AI agent research from ArXiv cs.AI and cs.CL categories.
📊 Week at a Glance
| Metric | This Week | Last Week | Change |
|---|---|---|---|
| Total Papers | 122 | 76 | +60.5% |
| Agent-Related | 78 | 51 | +52.9% |
| Agent % | 63.9% | 67.1% | — |
| Multi-Agent Papers | 11 | 5 | +6 |
| Self-Evolving Papers | 2 | 4 | -2 |
| Notable Papers (Score ≥7) | 21 | 21 | — |
🔥 Trending Topics
This week’s agent-related papers cluster around six dominant themes:
-
Benchmark & Evaluation (59 papers) — The largest cluster by far, reflecting the field’s ongoing struggle to measure what matters. New benchmarks span forecasting (FIFA World Cup 2026 as contamination-free testbed), proactive agents (ProEvent), and multi-agent security (Adaptive Adversaries).
-
Memory & Retrieval (45 papers) — Long-term memory architectures continue to dominate, with new work on reflective recall cycles and evidence-aware reinforcement learning for long-context reasoning.
-
Code & Software (30 papers) — Coding agents remain a hot area, with budget-calibrated recovery routing (CodeRescue) and autonomous research agents pushing the frontier.
-
Reasoning (26 papers) — Chain-of-thought and step-level reasoning see continued investment, particularly around grounding and evidence-awareness.
-
Safety & Security (18 papers) — A notable surge in safety research, including operational hallucination in deployed agents and cross-agent attack attribution.
-
Multi-Agent Systems (11 papers) — Multi-agent coordination papers more than doubled from last week’s 5, with new work on actor-critic algorithms and collaborative LLM systems.
🏆 Top Papers This Week
1. RF-Agent: A Practical Framework for Building Language Agents for RFIC Design
- ArXiv ID: 2607.18772
- Category: cs.CL | Trend Score: 10/10 | Topics: multi-agent, memory, benchmark, reasoning, safety
- Authors: Yueqi Xing, Houbo He, Jolie Wang et al.
Large language models (LLMs) have driven rapid progress in electronic design automation (EDA), yet their application to radio-frequency (RF) circuit design remains limited by the scarcity of domain-specific datasets and standardized benchmarks. We present RF-Agent, which addresses this gap through…
2. Operational Hallucination and Safety Drift in AI Agents
- ArXiv ID: 2607.18366
- Category: cs.AI | Trend Score: 9/10 | Topics: tool-use, benchmark, reasoning, safety
- Authors: Shasha Yu, Fiona Carroll, Barry L. Bentley
Large language models (LLMs) serving as planners in tool-using autonomous agents introduce dynamic reliability risks in multi-turn execution. While single-turn safety mechanisms are relatively mature, extended interactions reveal structural vulnerabilities where initial alignment degrades over…
3. Stress Testing Concept Erasure with Large Language Model Agents
- ArXiv ID: 2607.17890
- Category: cs.AI | Trend Score: 9/10 | Topics: memory, benchmark, code
- Authors: Yuyang Xue, Feng Chen, Zhihua Liu et al.
Concept erasure aims to remove semantic concepts from a trained generative model and is increasingly important for responsible AI deployment. However, verifying whether a model has robustly removed targeted concepts remains a critical challenge. Existing evaluation methods are typically pre-defined…
4. FIFA World Cup 2026 as a Contamination-Free Benchmark for LLM Forecasting Agents: Four Models, a Bookmaker, and 104 Matches
- ArXiv ID: 2607.17765
- Category: cs.LG | Trend Score: 9/10 | Topics: benchmark, reasoning, code
- Authors: Jiacheng Ding, Cong Guo, Jason Xu
We introduce WC2026-Agents, a benchmark and dataset for evaluating large language models (LLMs) as autonomous forecasting agents on real, future events. For every one of the 104 matches of the 2026 FIFA World Cup, four frontier models — Claude Opus 4.8, ChatGPT (GPT-5.5, high reasoning), Gemini…
5. Agents in the Wild: Where Research Meets Deployment
- ArXiv ID: 2607.19336
- Category: cs.AI | Trend Score: 9/10 | Topics: multi-agent, benchmark, reasoning, planning, code, safety
- Authors: Grace Hui Yang, Pranav N. Venkit, Hooman Sedghamiz et al.
Agentic systems large language model (LLM) based architectures capable of reasoning, planning, acting, and coordinating with tools and other agents are rapidly transitioning from research prototypes to production scale deployments across domains such as software engineering, scientific discovery,…
6. Exploratory and Assimilating Reflection: Reflective Recall Cycle for Long-term Memory
- ArXiv ID: 2607.17879
- Category: cs.AI | Trend Score: 8/10 | Topics: memory, benchmark, reasoning, reward
- Authors: Ganesh Senrayan, Moyuru Yamada, Ishan Jindal et al.
LLM-based autonomous agents require external memory to overcome their statelessness and limited context window for long-term interaction and dynamic knowledge reasoning. However, existing memory retrieval methods often lack adaptability and sample efficiency, and struggle to retrieve the right…
7. ProEvent: An Event-centric Benchmark for Proactive Agents
- ArXiv ID: 2607.17701
- Category: cs.AI | Trend Score: 8/10 | Topics: benchmark, reasoning
- Authors: Guanzhen Li, Liangming Pan, Leye Wang
Proactive agents are expected to anticipate user needs and provide autonomous assistance by perceiving environmental context without explicit instructions. A fundamental capability of such agents is to identify and track users’ upcoming events, enabling continuous and event-specific assistance. For…
8. Comparative Study of Multi-Agent Actor-Critic Algorithms in Parameterized Action Reinforcement Learning
- ArXiv ID: 2607.19117
- Category: cs.AI | Trend Score: 8/10 | Topics: multi-agent, memory, benchmark, reward
- Authors: Ubayd Ali Bapoo, Clement N Nyirenda
Parameterized action reinforcement learning has shown strong performance in environments requiring both discrete action selection and continuous parameterization. Prior work established the effectiveness of single-agent actor-critic algorithms - Greedy Actor-Critic (GAC), Soft Actor-Critic (SAC),…
📈 Category Breakdown
| Category | Papers | % of Total |
|---|---|---|
| cs.CL | 37 | 30.3% |
| cs.AI | 34 | 27.9% |
| cs.LG | 19 | 15.6% |
| cs.CV | 9 | 7.4% |
| cs.CR | 5 | 4.1% |
Note: Papers may appear in multiple categories. Primary category is shown.
📋 Full Paper List
The following table lists all 78 agent-related papers from this week, sorted by trend score:
| # | Title | ArXiv ID | Cat | Score | Key Topics |
|---|---|---|---|---|---|
| 1 | RF-Agent: A Practical Framework for Building Language Agents for RFIC … | 2607.18772 | cs.CL | 10 | multi-agent, memory, benchmark |
| 2 | Operational Hallucination and Safety Drift in AI Agents | 2607.18366 | cs.AI | 9 | tool-use, benchmark, reasoning |
| 3 | Stress Testing Concept Erasure with Large Language Model Agents | 2607.17890 | cs.AI | 9 | memory, benchmark, code |
| 4 | FIFA World Cup 2026 as a Contamination-Free Benchmark for LLM Forecast… | 2607.17765 | cs.LG | 9 | benchmark, reasoning, code |
| 5 | Agents in the Wild: Where Research Meets Deployment | 2607.19336 | cs.AI | 9 | multi-agent, benchmark, reasoning |
| 6 | Exploratory and Assimilating Reflection: Reflective Recall Cycle for L… | 2607.17879 | cs.AI | 8 | memory, benchmark, reasoning |
| 7 | ProEvent: An Event-centric Benchmark for Proactive Agents | 2607.17701 | cs.AI | 8 | benchmark, reasoning |
| 8 | Comparative Study of Multi-Agent Actor-Critic Algorithms in Parameteri… | 2607.19117 | cs.AI | 8 | multi-agent, memory, benchmark |
| 9 | Athena-Brain Technical Report: An Efficient Robot Brain for General In… | 2607.18985 | cs.AI | 8 | benchmark, reasoning, reward |
| 10 | Cross-Agent Campaign Attribution: Linking Asynchronous Attacks Across … | 2607.18826 | cs.CR | 8 | tool-use, memory, benchmark |
| 11 | Autoresearch with Coding Agents: Generalizers and Metric-Maximizers on… | 2607.18064 | cs.SE | 7 | memory, benchmark, reasoning |
| 12 | Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context … | 2607.19345 | cs.CL | 7 | memory, benchmark, reasoning |
| 13 | They’ll Verify. They Just Won’t Act. How Authority Framing and Launder… | 2607.19267 | cs.CR | 7 | reasoning, code, safety |
| 14 | Toward Auditable Fraud Detection: Combining Graph Features, Model Expl… | 2607.19266 | cs.LG | 7 | memory, code |
| 15 | PathAgentBench: Benchmarking Evidence-Seeking Vision-Language Models o… | 2607.19261 | cs.CV | 7 | memory, benchmark, reasoning |
| 16 | Fishing Out Free Riders: Shapley-Based Reward Attribution for Parallel… | 2607.18979 | cs.AI | 7 | memory, benchmark, reasoning |
| 17 | PhoenixRepair: Rethinking Repair Strategy Exploration in Software Agen… | 2607.18859 | cs.AI | 7 | multi-agent, reasoning, code |
| 18 | AI Tour Meeting: Group Travel Planning by LLM Agents | 2607.18806 | cs.AI | 7 | multi-agent, planning |
| 19 | MeetingToM: Evaluating Multimodal LLMs on Theory-of-Mind Reasoning in … | 2607.19235 | cs.CL | 7 | memory, benchmark, reasoning |
| 20 | CASE: Causal Alignment and Structural Enforcement for Improving Chain-… | 2607.18820 | cs.CL | 7 | memory, benchmark, reasoning |
| 21 | SciHazard: A Benchmark for Measuring Scientific Safety Risks with Deco… | 2607.18665 | cs.AI | 7 | memory, benchmark, code |
| 22 | Relay-Bench: Evaluating LLMs on Multi-Domain Reasoning Chains | 2607.18438 | cs.CL | 6 | memory, benchmark, reasoning |
| 23 | O-VAD: Industrial Video Anomaly Detection through Object-Centric Track… | 2607.18142 | cs.CV | 6 | reasoning |
| 24 | Engineering Trustworthy Agentic AI for Critical Systems | 2607.18548 | cs.AI | 6 | tool-use, benchmark, planning |
| 25 | Adaptive Adversaries: A Multi-Turn, Multi-LLM Benchmark for LLM Agent … | 2607.18063 | cs.CR | 6 | multi-agent, memory, benchmark |
| 26 | Off-Context GRPO: Learning to Reason on Hard Problems using Privileged… | 2607.19313 | cs.LG | 6 | memory, benchmark, reasoning |
| 27 | Supra Cognitive Modes: A Routed Architecture for Agent Memory | 2607.19096 | cs.AI | 6 | memory, benchmark, reasoning |
| 28 | CoGoal3D: Collaborative 3D Object Detection with 3D-Aware Fusion and R… | 2607.19036 | cs.CV | 6 | multi-agent, code, safety |
| 29 | Computational Humor with Multimodal LLMs: Methods, Datasets, Evaluatio… | 2607.19011 | cs.CL | 6 | memory, benchmark, reasoning |
| 30 | MedDDC-Eval: Diagnosis-Decoupled Evaluation of Multi-Turn Medical Cons… | 2607.18999 | cs.CL | 6 | memory, benchmark |
| 31 | Data Leakage Prevention in Agentic Applications via Preemptive Hardeni… | 2607.18847 | cs.CR | 6 | multi-agent, benchmark, planning |
| 32 | AgentTrails: Towards Trust and Reuse for Agentic Tasks | 2607.18816 | cs.DB | 6 | tool-use, code |
| 33 | AutoIndex: Learning Representation Programs for Retrieval | 2607.18603 | cs.IR | 6 | memory, benchmark, code |
| 34 | Broken Gates: Re-evaluating Web Bot Defenses in the Age of LLM Agents | 2607.18659 | cs.CR | 6 | benchmark, reasoning, safety |
| 35 | The Story Shapes the Agent: Narrative Priors in LLM Behavior | 2607.18566 | cs.CL | 5 | — |
| 36 | Computational models of pragmatic reasoning with flexible generation o… | 2607.18443 | cs.CL | 5 | memory, benchmark, reasoning |
| 37 | Enabling Multilingual Privacy Policy Audits: Large-Scale Analysis of S… | 2607.18424 | cs.CY | 5 | memory, benchmark |
| 38 | Convolution for Large Language Models | 2607.18413 | cs.CL | 5 | memory, benchmark, code |
| 39 | SWE-Pruner Pro: The Coder LLM Already Knows What to Prune | 2607.18213 | cs.CL | 5 | memory, benchmark, code |
| 40 | The Autonomous Agency Scale: A Behavioral Framework for Measuring Self… | 2607.17947 | cs.AI | 5 | benchmark, code |
| 41 | SR-Agent: An Experience-Driven Agentic Framework for Post-Ranking Stra… | 2607.17719 | cs.AI | 5 | self-evolving, reward |
| 42 | Benchmarking Generalization in Financial Statement Fraud Detection: ro… | 2607.19259 | cs.LG | 5 | memory, benchmark |
| 43 | Assessment in Team Problem-Solving Exercises in Computing Education | 2607.19209 | cs.CY | 5 | memory, benchmark, code |
| 44 | SciCodePile: A 128GB Corpus and Executable Benchmark for Challenging S… | 2607.19104 | cs.SE | 5 | memory, benchmark, code |
| 45 | DAIS: Dependency-Aware Intermediate QA Supervision for Complex Reasoni… | 2607.19088 | cs.CL | 5 | memory, benchmark, reasoning |
| 46 | FilmWorld: Agentic Novel-to-Film Generation through Dynamic Cinematic … | 2607.19038 | cs.CV | 5 | multi-agent, benchmark, planning |
| 47 | AILQA: Evaluating AI-Driven Legal Question Answering Systems for the I… | 2607.18825 | cs.CL | 5 | memory, benchmark |
| 48 | Selective State-Space Adaptation and Retrieval for Language Model Reas… | 2607.19326 | cs.CL | 5 | memory, benchmark, reasoning |
| 49 | AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribu… | 2607.18754 | cs.AI | 5 | memory, benchmark, code |
| 50 | NaviAIS: A Scenario-Level Vessel Trajectory Prediction Dataset withVec… | 2607.18887 | cs.AI | 5 | memory, benchmark, planning |
| 51 | Do Language Models Dream of Binding Molecules? Benchmarking LLMs under… | 2607.18144 | cs.LG | 4 | memory, benchmark, reasoning |
| 52 | Autonomous Discovery of Wireless Communications Algorithms | 2607.17762 | cs.IT | 4 | — |
| 53 | CodeRescue: Budget-Calibrated Recovery Routing for Coding Agents | 2607.19338 | cs.AI | 4 | benchmark, code |
| 54 | ResearchArena: Evaluating Sabotage and Monitoring in Automated AI R&D | 2607.19321 | cs.AI | 4 | benchmark, reasoning, safety |
| 55 | Graph-Based Agentic AI with LangGraph: Workflow Pathways for Long-Runn… | 2607.19297 | cs.AI | 4 | multi-agent, tool-use, memory |
| 56 | BioSecBench-Surveillance: A Verifiable Benchmark for AI Agents in Path… | 2607.19262 | cs.AI | 4 | benchmark, code |
| 57 | Computing on the Fly: Navigating a Vision for the Future of Drone Comp… | 2607.19213 | cs.RO | 4 | code, safety |
| 58 | ABot-World-0: Infinite Interactive World Rollout on a Single Desktop G… | 2607.19191 | cs.CV | 4 | memory, code |
| 59 | Agentic Real2Sim: Physics-based World Modeling with Vision-Language Ag… | 2607.19190 | cs.RO | 4 | benchmark, safety |
| 60 | OpenRTAG: A Comprehensive Benchmark for Robust Text-Attributed Graph L… | 2607.19108 | cs.AI | 4 | memory, benchmark |
| 61 | From Operations to Elderly Care Outcomes: A Thematic Review of Industr… | 2607.19075 | math.OC | 4 | memory |
| 62 | Verifiable Self-Evolution for Open-Ended Dialogue Skills via Future-Fe… | 2607.18973 | cs.CL | 4 | self-evolving, benchmark, code |
| 63 | Skillware: A Software Ontology and Engineering Lifecycle for Persisten… | 2607.18970 | cs.SE | 4 | code |
| 64 | Public perceptions of AI-driven decision-making in healthcare: A struc… | 2607.18884 | cs.HC | 4 | — |
| 65 | Two-Level Meta-Rubrics for Evaluating Open-Ended Generation: GAMUT, a … | 2607.19322 | cs.CL | 4 | memory, benchmark |
| 66 | Automated Discovery Has No Universally Superior Harness | 2607.18235 | cs.CL | 3 | benchmark |
| 67 | From Distances to Trajectories: Real-Time Signed Distance Function Map… | 2607.19306 | cs.RO | 3 | planning |
| 68 | Riemannian Deep Learning:Modules, Networks, and Geometries | 2607.19305 | cs.LG | 3 | memory |
| 69 | Free energy landscape of Dense Associative Memory | 2607.19195 | cond-mat.dis-nn | 3 | memory, benchmark |
| 70 | MIRAGE: Multi-scale Lesion-Informed Representation with Auxiliary Guid… | 2607.19137 | eess.IV | 3 | memory, benchmark, code |
| 71 | Vector-Bench: Can Models Surgically Edit SVG Code? | 2607.19056 | cs.AI | 3 | memory, benchmark, code |
| 72 | Biological Amnesia in ICU Time-Series Prediction: A Drift-Adaptive Two… | 2607.19020 | cs.LG | 3 | memory |
| 73 | AutoJourn: Multi-Perspective Summarisation, Bias Detection and Bias Ne… | 2607.18983 | cs.CL | 3 | memory, benchmark |
| 74 | Building a European Multilingual Evaluation Dataset: The MMLU Localisa… | 2607.18432 | cs.CL | 2 | multi-agent, benchmark |
| 75 | VEHBench: A Stage-Local Diagnostic Benchmark for LLM-Assisted Vibratio… | 2607.18181 | cs.CL | 2 | benchmark |
| 76 | LLM Detection as an Intervention: Downstream Impact under Strategic Us… | 2607.19300 | cs.AI | 2 | — |
| 77 | GUIDED Network-Agnostic Feature Initialization for Spatial Transferabi… | 2607.19270 | cs.LG | 2 | benchmark, planning |
| 78 | The safety failures we are not instrumenting: a perspective on hidden … | 2607.19292 | cs.CY | 1 | memory, benchmark, safety |
🔺 Scout Intel: What Others Missed
The safety drift problem is real and undermeasured. This week’s “Operational Hallucination and Safety Drift in AI Agents” (2607.18366) formalizes something practitioners have observed anecdotally: agents that start safe can gradually drift toward unsafe behavior over extended deployments, even without adversarial input. This is distinct from jailbreaking — it’s a degradation mode that current evaluation benchmarks don’t capture because they test single-turn behavior. The paper’s framework for measuring operational hallucination rates over multi-step agent trajectories should become a standard evaluation dimension for any agent deployed in production.
Budget routing is the next optimization frontier for coding agents. CodeRescue (2607.19338) introduces a conformal risk control layer that decides whether a failed coding attempt should retry with a cheap model or escalate to an expensive one — and does so under provable cost guarantees. This matters because the current industry default (try cheap, then escalate) wastes compute on cases where cheap recovery is viable, and under-invests in cases where escalation is the only path. The 35% cost reduction at matched solve rates suggests this approach could reshape how agent infrastructure is priced and deployed.
Benchmark saturation is accelerating. With 80 benchmark papers this week alone (59 among agent-related papers), the field is producing evaluation infrastructure faster than it’s producing capabilities to evaluate. The FIFA World Cup 2026 paper (2607.17765) is particularly clever — using a future event as a contamination-free forecasting benchmark — but it also highlights a deeper issue: the half-life of benchmarks is shrinking as models increasingly contaminate training data. The emergence of “contamination-free” as a first-class benchmark design constraint signals that the community recognizes this problem but hasn’t yet solved it at scale.
Data collected from ArXiv API (cs.AI, cs.CL categories) on 2026-07-23. Papers filtered for AI agent relevance and scored by keyword matching. Total of 122 papers scanned, 78 classified as agent-related.
Related Intel
LLM Product Release Weekly: July 21–28, 2026 — Google Drops Three, OpenAI Ships Agents
23 releases across 5 vendors this week. Google launches Gemini 3.6 Flash and confirms Gemini 4 training; OpenAI debuts Presence enterprise agents and Health in ChatGPT; Anthropic overhauls Managed Agents.
AI Agent Ecosystem W31: The Sandbox Breaks as Orchestration Overtakes the Model
Between July 20-24, sandbox escapes hit every major AI coding tool, GPT-5.6 Sol autonomously breached Hugging Face, and Cursor's swarm proved orchestration cuts costs 87%. One structural shift: the model is commoditizing, value concentrates in layers above it.
AI Agent Ecosystem W32: The Containment Paradox — Rogue Agents, Stateless MCP, Agent-Native Infra
W32: The same autonomy enterprises demand from AI agents is the capability that makes them dangerous — this week proved it at both the behavior layer and the tool layer, while the protocol and infrastructure layers raced to catch up.