AgentScout Logo Agent Scout

ArXiv cs.AI Weekly: Jul 17–23, 2026 — Agent Safety & Benchmark Saturation

Weekly snapshot of AI agent research from ArXiv cs.AI and cs.CL, covering agent safety drift, budget routing, and benchmark saturation.

AgentScout ·
#arxiv #cs.AI #ai-agents #weekly-tracker #research-papers

ArXiv cs.AI Weekly: Jul 17–23, 2026

Weekly snapshot of AI agent research from ArXiv cs.AI and cs.CL categories.

📊 Week at a Glance

MetricThis WeekLast WeekChange
Total Papers12276+60.5%
Agent-Related7851+52.9%
Agent %63.9%67.1%
Multi-Agent Papers115+6
Self-Evolving Papers24-2
Notable Papers (Score ≥7)2121

This week’s agent-related papers cluster around six dominant themes:

  1. Benchmark & Evaluation (59 papers) — The largest cluster by far, reflecting the field’s ongoing struggle to measure what matters. New benchmarks span forecasting (FIFA World Cup 2026 as contamination-free testbed), proactive agents (ProEvent), and multi-agent security (Adaptive Adversaries).

  2. Memory & Retrieval (45 papers) — Long-term memory architectures continue to dominate, with new work on reflective recall cycles and evidence-aware reinforcement learning for long-context reasoning.

  3. Code & Software (30 papers) — Coding agents remain a hot area, with budget-calibrated recovery routing (CodeRescue) and autonomous research agents pushing the frontier.

  4. Reasoning (26 papers) — Chain-of-thought and step-level reasoning see continued investment, particularly around grounding and evidence-awareness.

  5. Safety & Security (18 papers) — A notable surge in safety research, including operational hallucination in deployed agents and cross-agent attack attribution.

  6. Multi-Agent Systems (11 papers) — Multi-agent coordination papers more than doubled from last week’s 5, with new work on actor-critic algorithms and collaborative LLM systems.

🏆 Top Papers This Week

1. RF-Agent: A Practical Framework for Building Language Agents for RFIC Design

  • ArXiv ID: 2607.18772
  • Category: cs.CL | Trend Score: 10/10 | Topics: multi-agent, memory, benchmark, reasoning, safety
  • Authors: Yueqi Xing, Houbo He, Jolie Wang et al.

Large language models (LLMs) have driven rapid progress in electronic design automation (EDA), yet their application to radio-frequency (RF) circuit design remains limited by the scarcity of domain-specific datasets and standardized benchmarks. We present RF-Agent, which addresses this gap through…

2. Operational Hallucination and Safety Drift in AI Agents

  • ArXiv ID: 2607.18366
  • Category: cs.AI | Trend Score: 9/10 | Topics: tool-use, benchmark, reasoning, safety
  • Authors: Shasha Yu, Fiona Carroll, Barry L. Bentley

Large language models (LLMs) serving as planners in tool-using autonomous agents introduce dynamic reliability risks in multi-turn execution. While single-turn safety mechanisms are relatively mature, extended interactions reveal structural vulnerabilities where initial alignment degrades over…

3. Stress Testing Concept Erasure with Large Language Model Agents

  • ArXiv ID: 2607.17890
  • Category: cs.AI | Trend Score: 9/10 | Topics: memory, benchmark, code
  • Authors: Yuyang Xue, Feng Chen, Zhihua Liu et al.

Concept erasure aims to remove semantic concepts from a trained generative model and is increasingly important for responsible AI deployment. However, verifying whether a model has robustly removed targeted concepts remains a critical challenge. Existing evaluation methods are typically pre-defined…

4. FIFA World Cup 2026 as a Contamination-Free Benchmark for LLM Forecasting Agents: Four Models, a Bookmaker, and 104 Matches

  • ArXiv ID: 2607.17765
  • Category: cs.LG | Trend Score: 9/10 | Topics: benchmark, reasoning, code
  • Authors: Jiacheng Ding, Cong Guo, Jason Xu

We introduce WC2026-Agents, a benchmark and dataset for evaluating large language models (LLMs) as autonomous forecasting agents on real, future events. For every one of the 104 matches of the 2026 FIFA World Cup, four frontier models — Claude Opus 4.8, ChatGPT (GPT-5.5, high reasoning), Gemini…

5. Agents in the Wild: Where Research Meets Deployment

  • ArXiv ID: 2607.19336
  • Category: cs.AI | Trend Score: 9/10 | Topics: multi-agent, benchmark, reasoning, planning, code, safety
  • Authors: Grace Hui Yang, Pranav N. Venkit, Hooman Sedghamiz et al.

Agentic systems large language model (LLM) based architectures capable of reasoning, planning, acting, and coordinating with tools and other agents are rapidly transitioning from research prototypes to production scale deployments across domains such as software engineering, scientific discovery,…

6. Exploratory and Assimilating Reflection: Reflective Recall Cycle for Long-term Memory

  • ArXiv ID: 2607.17879
  • Category: cs.AI | Trend Score: 8/10 | Topics: memory, benchmark, reasoning, reward
  • Authors: Ganesh Senrayan, Moyuru Yamada, Ishan Jindal et al.

LLM-based autonomous agents require external memory to overcome their statelessness and limited context window for long-term interaction and dynamic knowledge reasoning. However, existing memory retrieval methods often lack adaptability and sample efficiency, and struggle to retrieve the right…

7. ProEvent: An Event-centric Benchmark for Proactive Agents

  • ArXiv ID: 2607.17701
  • Category: cs.AI | Trend Score: 8/10 | Topics: benchmark, reasoning
  • Authors: Guanzhen Li, Liangming Pan, Leye Wang

Proactive agents are expected to anticipate user needs and provide autonomous assistance by perceiving environmental context without explicit instructions. A fundamental capability of such agents is to identify and track users’ upcoming events, enabling continuous and event-specific assistance. For…

8. Comparative Study of Multi-Agent Actor-Critic Algorithms in Parameterized Action Reinforcement Learning

  • ArXiv ID: 2607.19117
  • Category: cs.AI | Trend Score: 8/10 | Topics: multi-agent, memory, benchmark, reward
  • Authors: Ubayd Ali Bapoo, Clement N Nyirenda

Parameterized action reinforcement learning has shown strong performance in environments requiring both discrete action selection and continuous parameterization. Prior work established the effectiveness of single-agent actor-critic algorithms - Greedy Actor-Critic (GAC), Soft Actor-Critic (SAC),…

📈 Category Breakdown

CategoryPapers% of Total
cs.CL3730.3%
cs.AI3427.9%
cs.LG1915.6%
cs.CV97.4%
cs.CR54.1%

Note: Papers may appear in multiple categories. Primary category is shown.

📋 Full Paper List

The following table lists all 78 agent-related papers from this week, sorted by trend score:

#TitleArXiv IDCatScoreKey Topics
1RF-Agent: A Practical Framework for Building Language Agents for RFIC …2607.18772cs.CL10multi-agent, memory, benchmark
2Operational Hallucination and Safety Drift in AI Agents2607.18366cs.AI9tool-use, benchmark, reasoning
3Stress Testing Concept Erasure with Large Language Model Agents2607.17890cs.AI9memory, benchmark, code
4FIFA World Cup 2026 as a Contamination-Free Benchmark for LLM Forecast…2607.17765cs.LG9benchmark, reasoning, code
5Agents in the Wild: Where Research Meets Deployment2607.19336cs.AI9multi-agent, benchmark, reasoning
6Exploratory and Assimilating Reflection: Reflective Recall Cycle for L…2607.17879cs.AI8memory, benchmark, reasoning
7ProEvent: An Event-centric Benchmark for Proactive Agents2607.17701cs.AI8benchmark, reasoning
8Comparative Study of Multi-Agent Actor-Critic Algorithms in Parameteri…2607.19117cs.AI8multi-agent, memory, benchmark
9Athena-Brain Technical Report: An Efficient Robot Brain for General In…2607.18985cs.AI8benchmark, reasoning, reward
10Cross-Agent Campaign Attribution: Linking Asynchronous Attacks Across …2607.18826cs.CR8tool-use, memory, benchmark
11Autoresearch with Coding Agents: Generalizers and Metric-Maximizers on…2607.18064cs.SE7memory, benchmark, reasoning
12Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context …2607.19345cs.CL7memory, benchmark, reasoning
13They’ll Verify. They Just Won’t Act. How Authority Framing and Launder…2607.19267cs.CR7reasoning, code, safety
14Toward Auditable Fraud Detection: Combining Graph Features, Model Expl…2607.19266cs.LG7memory, code
15PathAgentBench: Benchmarking Evidence-Seeking Vision-Language Models o…2607.19261cs.CV7memory, benchmark, reasoning
16Fishing Out Free Riders: Shapley-Based Reward Attribution for Parallel…2607.18979cs.AI7memory, benchmark, reasoning
17PhoenixRepair: Rethinking Repair Strategy Exploration in Software Agen…2607.18859cs.AI7multi-agent, reasoning, code
18AI Tour Meeting: Group Travel Planning by LLM Agents2607.18806cs.AI7multi-agent, planning
19MeetingToM: Evaluating Multimodal LLMs on Theory-of-Mind Reasoning in …2607.19235cs.CL7memory, benchmark, reasoning
20CASE: Causal Alignment and Structural Enforcement for Improving Chain-…2607.18820cs.CL7memory, benchmark, reasoning
21SciHazard: A Benchmark for Measuring Scientific Safety Risks with Deco…2607.18665cs.AI7memory, benchmark, code
22Relay-Bench: Evaluating LLMs on Multi-Domain Reasoning Chains2607.18438cs.CL6memory, benchmark, reasoning
23O-VAD: Industrial Video Anomaly Detection through Object-Centric Track…2607.18142cs.CV6reasoning
24Engineering Trustworthy Agentic AI for Critical Systems2607.18548cs.AI6tool-use, benchmark, planning
25Adaptive Adversaries: A Multi-Turn, Multi-LLM Benchmark for LLM Agent …2607.18063cs.CR6multi-agent, memory, benchmark
26Off-Context GRPO: Learning to Reason on Hard Problems using Privileged…2607.19313cs.LG6memory, benchmark, reasoning
27Supra Cognitive Modes: A Routed Architecture for Agent Memory2607.19096cs.AI6memory, benchmark, reasoning
28CoGoal3D: Collaborative 3D Object Detection with 3D-Aware Fusion and R…2607.19036cs.CV6multi-agent, code, safety
29Computational Humor with Multimodal LLMs: Methods, Datasets, Evaluatio…2607.19011cs.CL6memory, benchmark, reasoning
30MedDDC-Eval: Diagnosis-Decoupled Evaluation of Multi-Turn Medical Cons…2607.18999cs.CL6memory, benchmark
31Data Leakage Prevention in Agentic Applications via Preemptive Hardeni…2607.18847cs.CR6multi-agent, benchmark, planning
32AgentTrails: Towards Trust and Reuse for Agentic Tasks2607.18816cs.DB6tool-use, code
33AutoIndex: Learning Representation Programs for Retrieval2607.18603cs.IR6memory, benchmark, code
34Broken Gates: Re-evaluating Web Bot Defenses in the Age of LLM Agents2607.18659cs.CR6benchmark, reasoning, safety
35The Story Shapes the Agent: Narrative Priors in LLM Behavior2607.18566cs.CL5
36Computational models of pragmatic reasoning with flexible generation o…2607.18443cs.CL5memory, benchmark, reasoning
37Enabling Multilingual Privacy Policy Audits: Large-Scale Analysis of S…2607.18424cs.CY5memory, benchmark
38Convolution for Large Language Models2607.18413cs.CL5memory, benchmark, code
39SWE-Pruner Pro: The Coder LLM Already Knows What to Prune2607.18213cs.CL5memory, benchmark, code
40The Autonomous Agency Scale: A Behavioral Framework for Measuring Self…2607.17947cs.AI5benchmark, code
41SR-Agent: An Experience-Driven Agentic Framework for Post-Ranking Stra…2607.17719cs.AI5self-evolving, reward
42Benchmarking Generalization in Financial Statement Fraud Detection: ro…2607.19259cs.LG5memory, benchmark
43Assessment in Team Problem-Solving Exercises in Computing Education2607.19209cs.CY5memory, benchmark, code
44SciCodePile: A 128GB Corpus and Executable Benchmark for Challenging S…2607.19104cs.SE5memory, benchmark, code
45DAIS: Dependency-Aware Intermediate QA Supervision for Complex Reasoni…2607.19088cs.CL5memory, benchmark, reasoning
46FilmWorld: Agentic Novel-to-Film Generation through Dynamic Cinematic …2607.19038cs.CV5multi-agent, benchmark, planning
47AILQA: Evaluating AI-Driven Legal Question Answering Systems for the I…2607.18825cs.CL5memory, benchmark
48Selective State-Space Adaptation and Retrieval for Language Model Reas…2607.19326cs.CL5memory, benchmark, reasoning
49AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribu…2607.18754cs.AI5memory, benchmark, code
50NaviAIS: A Scenario-Level Vessel Trajectory Prediction Dataset withVec…2607.18887cs.AI5memory, benchmark, planning
51Do Language Models Dream of Binding Molecules? Benchmarking LLMs under…2607.18144cs.LG4memory, benchmark, reasoning
52Autonomous Discovery of Wireless Communications Algorithms2607.17762cs.IT4
53CodeRescue: Budget-Calibrated Recovery Routing for Coding Agents2607.19338cs.AI4benchmark, code
54ResearchArena: Evaluating Sabotage and Monitoring in Automated AI R&D2607.19321cs.AI4benchmark, reasoning, safety
55Graph-Based Agentic AI with LangGraph: Workflow Pathways for Long-Runn…2607.19297cs.AI4multi-agent, tool-use, memory
56BioSecBench-Surveillance: A Verifiable Benchmark for AI Agents in Path…2607.19262cs.AI4benchmark, code
57Computing on the Fly: Navigating a Vision for the Future of Drone Comp…2607.19213cs.RO4code, safety
58ABot-World-0: Infinite Interactive World Rollout on a Single Desktop G…2607.19191cs.CV4memory, code
59Agentic Real2Sim: Physics-based World Modeling with Vision-Language Ag…2607.19190cs.RO4benchmark, safety
60OpenRTAG: A Comprehensive Benchmark for Robust Text-Attributed Graph L…2607.19108cs.AI4memory, benchmark
61From Operations to Elderly Care Outcomes: A Thematic Review of Industr…2607.19075math.OC4memory
62Verifiable Self-Evolution for Open-Ended Dialogue Skills via Future-Fe…2607.18973cs.CL4self-evolving, benchmark, code
63Skillware: A Software Ontology and Engineering Lifecycle for Persisten…2607.18970cs.SE4code
64Public perceptions of AI-driven decision-making in healthcare: A struc…2607.18884cs.HC4
65Two-Level Meta-Rubrics for Evaluating Open-Ended Generation: GAMUT, a …2607.19322cs.CL4memory, benchmark
66Automated Discovery Has No Universally Superior Harness2607.18235cs.CL3benchmark
67From Distances to Trajectories: Real-Time Signed Distance Function Map…2607.19306cs.RO3planning
68Riemannian Deep Learning:Modules, Networks, and Geometries2607.19305cs.LG3memory
69Free energy landscape of Dense Associative Memory2607.19195cond-mat.dis-nn3memory, benchmark
70MIRAGE: Multi-scale Lesion-Informed Representation with Auxiliary Guid…2607.19137eess.IV3memory, benchmark, code
71Vector-Bench: Can Models Surgically Edit SVG Code?2607.19056cs.AI3memory, benchmark, code
72Biological Amnesia in ICU Time-Series Prediction: A Drift-Adaptive Two…2607.19020cs.LG3memory
73AutoJourn: Multi-Perspective Summarisation, Bias Detection and Bias Ne…2607.18983cs.CL3memory, benchmark
74Building a European Multilingual Evaluation Dataset: The MMLU Localisa…2607.18432cs.CL2multi-agent, benchmark
75VEHBench: A Stage-Local Diagnostic Benchmark for LLM-Assisted Vibratio…2607.18181cs.CL2benchmark
76LLM Detection as an Intervention: Downstream Impact under Strategic Us…2607.19300cs.AI2
77GUIDED Network-Agnostic Feature Initialization for Spatial Transferabi…2607.19270cs.LG2benchmark, planning
78The safety failures we are not instrumenting: a perspective on hidden …2607.19292cs.CY1memory, benchmark, safety

🔺 Scout Intel: What Others Missed

The safety drift problem is real and undermeasured. This week’s “Operational Hallucination and Safety Drift in AI Agents” (2607.18366) formalizes something practitioners have observed anecdotally: agents that start safe can gradually drift toward unsafe behavior over extended deployments, even without adversarial input. This is distinct from jailbreaking — it’s a degradation mode that current evaluation benchmarks don’t capture because they test single-turn behavior. The paper’s framework for measuring operational hallucination rates over multi-step agent trajectories should become a standard evaluation dimension for any agent deployed in production.

Budget routing is the next optimization frontier for coding agents. CodeRescue (2607.19338) introduces a conformal risk control layer that decides whether a failed coding attempt should retry with a cheap model or escalate to an expensive one — and does so under provable cost guarantees. This matters because the current industry default (try cheap, then escalate) wastes compute on cases where cheap recovery is viable, and under-invests in cases where escalation is the only path. The 35% cost reduction at matched solve rates suggests this approach could reshape how agent infrastructure is priced and deployed.

Benchmark saturation is accelerating. With 80 benchmark papers this week alone (59 among agent-related papers), the field is producing evaluation infrastructure faster than it’s producing capabilities to evaluate. The FIFA World Cup 2026 paper (2607.17765) is particularly clever — using a future event as a contamination-free forecasting benchmark — but it also highlights a deeper issue: the half-life of benchmarks is shrinking as models increasingly contaminate training data. The emergence of “contamination-free” as a first-class benchmark design constraint signals that the community recognizes this problem but hasn’t yet solved it at scale.


Data collected from ArXiv API (cs.AI, cs.CL categories) on 2026-07-23. Papers filtered for AI agent relevance and scored by keyword matching. Total of 122 papers scanned, 78 classified as agent-related.

ArXiv cs.AI Weekly: Jul 17–23, 2026 — Agent Safety & Benchmark Saturation

Weekly snapshot of AI agent research from ArXiv cs.AI and cs.CL, covering agent safety drift, budget routing, and benchmark saturation.

AgentScout ·
#arxiv #cs.AI #ai-agents #weekly-tracker #research-papers

ArXiv cs.AI Weekly: Jul 17–23, 2026

Weekly snapshot of AI agent research from ArXiv cs.AI and cs.CL categories.

📊 Week at a Glance

MetricThis WeekLast WeekChange
Total Papers12276+60.5%
Agent-Related7851+52.9%
Agent %63.9%67.1%
Multi-Agent Papers115+6
Self-Evolving Papers24-2
Notable Papers (Score ≥7)2121

This week’s agent-related papers cluster around six dominant themes:

  1. Benchmark & Evaluation (59 papers) — The largest cluster by far, reflecting the field’s ongoing struggle to measure what matters. New benchmarks span forecasting (FIFA World Cup 2026 as contamination-free testbed), proactive agents (ProEvent), and multi-agent security (Adaptive Adversaries).

  2. Memory & Retrieval (45 papers) — Long-term memory architectures continue to dominate, with new work on reflective recall cycles and evidence-aware reinforcement learning for long-context reasoning.

  3. Code & Software (30 papers) — Coding agents remain a hot area, with budget-calibrated recovery routing (CodeRescue) and autonomous research agents pushing the frontier.

  4. Reasoning (26 papers) — Chain-of-thought and step-level reasoning see continued investment, particularly around grounding and evidence-awareness.

  5. Safety & Security (18 papers) — A notable surge in safety research, including operational hallucination in deployed agents and cross-agent attack attribution.

  6. Multi-Agent Systems (11 papers) — Multi-agent coordination papers more than doubled from last week’s 5, with new work on actor-critic algorithms and collaborative LLM systems.

🏆 Top Papers This Week

1. RF-Agent: A Practical Framework for Building Language Agents for RFIC Design

  • ArXiv ID: 2607.18772
  • Category: cs.CL | Trend Score: 10/10 | Topics: multi-agent, memory, benchmark, reasoning, safety
  • Authors: Yueqi Xing, Houbo He, Jolie Wang et al.

Large language models (LLMs) have driven rapid progress in electronic design automation (EDA), yet their application to radio-frequency (RF) circuit design remains limited by the scarcity of domain-specific datasets and standardized benchmarks. We present RF-Agent, which addresses this gap through…

2. Operational Hallucination and Safety Drift in AI Agents

  • ArXiv ID: 2607.18366
  • Category: cs.AI | Trend Score: 9/10 | Topics: tool-use, benchmark, reasoning, safety
  • Authors: Shasha Yu, Fiona Carroll, Barry L. Bentley

Large language models (LLMs) serving as planners in tool-using autonomous agents introduce dynamic reliability risks in multi-turn execution. While single-turn safety mechanisms are relatively mature, extended interactions reveal structural vulnerabilities where initial alignment degrades over…

3. Stress Testing Concept Erasure with Large Language Model Agents

  • ArXiv ID: 2607.17890
  • Category: cs.AI | Trend Score: 9/10 | Topics: memory, benchmark, code
  • Authors: Yuyang Xue, Feng Chen, Zhihua Liu et al.

Concept erasure aims to remove semantic concepts from a trained generative model and is increasingly important for responsible AI deployment. However, verifying whether a model has robustly removed targeted concepts remains a critical challenge. Existing evaluation methods are typically pre-defined…

4. FIFA World Cup 2026 as a Contamination-Free Benchmark for LLM Forecasting Agents: Four Models, a Bookmaker, and 104 Matches

  • ArXiv ID: 2607.17765
  • Category: cs.LG | Trend Score: 9/10 | Topics: benchmark, reasoning, code
  • Authors: Jiacheng Ding, Cong Guo, Jason Xu

We introduce WC2026-Agents, a benchmark and dataset for evaluating large language models (LLMs) as autonomous forecasting agents on real, future events. For every one of the 104 matches of the 2026 FIFA World Cup, four frontier models — Claude Opus 4.8, ChatGPT (GPT-5.5, high reasoning), Gemini…

5. Agents in the Wild: Where Research Meets Deployment

  • ArXiv ID: 2607.19336
  • Category: cs.AI | Trend Score: 9/10 | Topics: multi-agent, benchmark, reasoning, planning, code, safety
  • Authors: Grace Hui Yang, Pranav N. Venkit, Hooman Sedghamiz et al.

Agentic systems large language model (LLM) based architectures capable of reasoning, planning, acting, and coordinating with tools and other agents are rapidly transitioning from research prototypes to production scale deployments across domains such as software engineering, scientific discovery,…

6. Exploratory and Assimilating Reflection: Reflective Recall Cycle for Long-term Memory

  • ArXiv ID: 2607.17879
  • Category: cs.AI | Trend Score: 8/10 | Topics: memory, benchmark, reasoning, reward
  • Authors: Ganesh Senrayan, Moyuru Yamada, Ishan Jindal et al.

LLM-based autonomous agents require external memory to overcome their statelessness and limited context window for long-term interaction and dynamic knowledge reasoning. However, existing memory retrieval methods often lack adaptability and sample efficiency, and struggle to retrieve the right…

7. ProEvent: An Event-centric Benchmark for Proactive Agents

  • ArXiv ID: 2607.17701
  • Category: cs.AI | Trend Score: 8/10 | Topics: benchmark, reasoning
  • Authors: Guanzhen Li, Liangming Pan, Leye Wang

Proactive agents are expected to anticipate user needs and provide autonomous assistance by perceiving environmental context without explicit instructions. A fundamental capability of such agents is to identify and track users’ upcoming events, enabling continuous and event-specific assistance. For…

8. Comparative Study of Multi-Agent Actor-Critic Algorithms in Parameterized Action Reinforcement Learning

  • ArXiv ID: 2607.19117
  • Category: cs.AI | Trend Score: 8/10 | Topics: multi-agent, memory, benchmark, reward
  • Authors: Ubayd Ali Bapoo, Clement N Nyirenda

Parameterized action reinforcement learning has shown strong performance in environments requiring both discrete action selection and continuous parameterization. Prior work established the effectiveness of single-agent actor-critic algorithms - Greedy Actor-Critic (GAC), Soft Actor-Critic (SAC),…

📈 Category Breakdown

CategoryPapers% of Total
cs.CL3730.3%
cs.AI3427.9%
cs.LG1915.6%
cs.CV97.4%
cs.CR54.1%

Note: Papers may appear in multiple categories. Primary category is shown.

📋 Full Paper List

The following table lists all 78 agent-related papers from this week, sorted by trend score:

#TitleArXiv IDCatScoreKey Topics
1RF-Agent: A Practical Framework for Building Language Agents for RFIC …2607.18772cs.CL10multi-agent, memory, benchmark
2Operational Hallucination and Safety Drift in AI Agents2607.18366cs.AI9tool-use, benchmark, reasoning
3Stress Testing Concept Erasure with Large Language Model Agents2607.17890cs.AI9memory, benchmark, code
4FIFA World Cup 2026 as a Contamination-Free Benchmark for LLM Forecast…2607.17765cs.LG9benchmark, reasoning, code
5Agents in the Wild: Where Research Meets Deployment2607.19336cs.AI9multi-agent, benchmark, reasoning
6Exploratory and Assimilating Reflection: Reflective Recall Cycle for L…2607.17879cs.AI8memory, benchmark, reasoning
7ProEvent: An Event-centric Benchmark for Proactive Agents2607.17701cs.AI8benchmark, reasoning
8Comparative Study of Multi-Agent Actor-Critic Algorithms in Parameteri…2607.19117cs.AI8multi-agent, memory, benchmark
9Athena-Brain Technical Report: An Efficient Robot Brain for General In…2607.18985cs.AI8benchmark, reasoning, reward
10Cross-Agent Campaign Attribution: Linking Asynchronous Attacks Across …2607.18826cs.CR8tool-use, memory, benchmark
11Autoresearch with Coding Agents: Generalizers and Metric-Maximizers on…2607.18064cs.SE7memory, benchmark, reasoning
12Copy Less, Ground More: Overcoming Repetitive Copying in Long-Context …2607.19345cs.CL7memory, benchmark, reasoning
13They’ll Verify. They Just Won’t Act. How Authority Framing and Launder…2607.19267cs.CR7reasoning, code, safety
14Toward Auditable Fraud Detection: Combining Graph Features, Model Expl…2607.19266cs.LG7memory, code
15PathAgentBench: Benchmarking Evidence-Seeking Vision-Language Models o…2607.19261cs.CV7memory, benchmark, reasoning
16Fishing Out Free Riders: Shapley-Based Reward Attribution for Parallel…2607.18979cs.AI7memory, benchmark, reasoning
17PhoenixRepair: Rethinking Repair Strategy Exploration in Software Agen…2607.18859cs.AI7multi-agent, reasoning, code
18AI Tour Meeting: Group Travel Planning by LLM Agents2607.18806cs.AI7multi-agent, planning
19MeetingToM: Evaluating Multimodal LLMs on Theory-of-Mind Reasoning in …2607.19235cs.CL7memory, benchmark, reasoning
20CASE: Causal Alignment and Structural Enforcement for Improving Chain-…2607.18820cs.CL7memory, benchmark, reasoning
21SciHazard: A Benchmark for Measuring Scientific Safety Risks with Deco…2607.18665cs.AI7memory, benchmark, code
22Relay-Bench: Evaluating LLMs on Multi-Domain Reasoning Chains2607.18438cs.CL6memory, benchmark, reasoning
23O-VAD: Industrial Video Anomaly Detection through Object-Centric Track…2607.18142cs.CV6reasoning
24Engineering Trustworthy Agentic AI for Critical Systems2607.18548cs.AI6tool-use, benchmark, planning
25Adaptive Adversaries: A Multi-Turn, Multi-LLM Benchmark for LLM Agent …2607.18063cs.CR6multi-agent, memory, benchmark
26Off-Context GRPO: Learning to Reason on Hard Problems using Privileged…2607.19313cs.LG6memory, benchmark, reasoning
27Supra Cognitive Modes: A Routed Architecture for Agent Memory2607.19096cs.AI6memory, benchmark, reasoning
28CoGoal3D: Collaborative 3D Object Detection with 3D-Aware Fusion and R…2607.19036cs.CV6multi-agent, code, safety
29Computational Humor with Multimodal LLMs: Methods, Datasets, Evaluatio…2607.19011cs.CL6memory, benchmark, reasoning
30MedDDC-Eval: Diagnosis-Decoupled Evaluation of Multi-Turn Medical Cons…2607.18999cs.CL6memory, benchmark
31Data Leakage Prevention in Agentic Applications via Preemptive Hardeni…2607.18847cs.CR6multi-agent, benchmark, planning
32AgentTrails: Towards Trust and Reuse for Agentic Tasks2607.18816cs.DB6tool-use, code
33AutoIndex: Learning Representation Programs for Retrieval2607.18603cs.IR6memory, benchmark, code
34Broken Gates: Re-evaluating Web Bot Defenses in the Age of LLM Agents2607.18659cs.CR6benchmark, reasoning, safety
35The Story Shapes the Agent: Narrative Priors in LLM Behavior2607.18566cs.CL5
36Computational models of pragmatic reasoning with flexible generation o…2607.18443cs.CL5memory, benchmark, reasoning
37Enabling Multilingual Privacy Policy Audits: Large-Scale Analysis of S…2607.18424cs.CY5memory, benchmark
38Convolution for Large Language Models2607.18413cs.CL5memory, benchmark, code
39SWE-Pruner Pro: The Coder LLM Already Knows What to Prune2607.18213cs.CL5memory, benchmark, code
40The Autonomous Agency Scale: A Behavioral Framework for Measuring Self…2607.17947cs.AI5benchmark, code
41SR-Agent: An Experience-Driven Agentic Framework for Post-Ranking Stra…2607.17719cs.AI5self-evolving, reward
42Benchmarking Generalization in Financial Statement Fraud Detection: ro…2607.19259cs.LG5memory, benchmark
43Assessment in Team Problem-Solving Exercises in Computing Education2607.19209cs.CY5memory, benchmark, code
44SciCodePile: A 128GB Corpus and Executable Benchmark for Challenging S…2607.19104cs.SE5memory, benchmark, code
45DAIS: Dependency-Aware Intermediate QA Supervision for Complex Reasoni…2607.19088cs.CL5memory, benchmark, reasoning
46FilmWorld: Agentic Novel-to-Film Generation through Dynamic Cinematic …2607.19038cs.CV5multi-agent, benchmark, planning
47AILQA: Evaluating AI-Driven Legal Question Answering Systems for the I…2607.18825cs.CL5memory, benchmark
48Selective State-Space Adaptation and Retrieval for Language Model Reas…2607.19326cs.CL5memory, benchmark, reasoning
49AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribu…2607.18754cs.AI5memory, benchmark, code
50NaviAIS: A Scenario-Level Vessel Trajectory Prediction Dataset withVec…2607.18887cs.AI5memory, benchmark, planning
51Do Language Models Dream of Binding Molecules? Benchmarking LLMs under…2607.18144cs.LG4memory, benchmark, reasoning
52Autonomous Discovery of Wireless Communications Algorithms2607.17762cs.IT4
53CodeRescue: Budget-Calibrated Recovery Routing for Coding Agents2607.19338cs.AI4benchmark, code
54ResearchArena: Evaluating Sabotage and Monitoring in Automated AI R&D2607.19321cs.AI4benchmark, reasoning, safety
55Graph-Based Agentic AI with LangGraph: Workflow Pathways for Long-Runn…2607.19297cs.AI4multi-agent, tool-use, memory
56BioSecBench-Surveillance: A Verifiable Benchmark for AI Agents in Path…2607.19262cs.AI4benchmark, code
57Computing on the Fly: Navigating a Vision for the Future of Drone Comp…2607.19213cs.RO4code, safety
58ABot-World-0: Infinite Interactive World Rollout on a Single Desktop G…2607.19191cs.CV4memory, code
59Agentic Real2Sim: Physics-based World Modeling with Vision-Language Ag…2607.19190cs.RO4benchmark, safety
60OpenRTAG: A Comprehensive Benchmark for Robust Text-Attributed Graph L…2607.19108cs.AI4memory, benchmark
61From Operations to Elderly Care Outcomes: A Thematic Review of Industr…2607.19075math.OC4memory
62Verifiable Self-Evolution for Open-Ended Dialogue Skills via Future-Fe…2607.18973cs.CL4self-evolving, benchmark, code
63Skillware: A Software Ontology and Engineering Lifecycle for Persisten…2607.18970cs.SE4code
64Public perceptions of AI-driven decision-making in healthcare: A struc…2607.18884cs.HC4
65Two-Level Meta-Rubrics for Evaluating Open-Ended Generation: GAMUT, a …2607.19322cs.CL4memory, benchmark
66Automated Discovery Has No Universally Superior Harness2607.18235cs.CL3benchmark
67From Distances to Trajectories: Real-Time Signed Distance Function Map…2607.19306cs.RO3planning
68Riemannian Deep Learning:Modules, Networks, and Geometries2607.19305cs.LG3memory
69Free energy landscape of Dense Associative Memory2607.19195cond-mat.dis-nn3memory, benchmark
70MIRAGE: Multi-scale Lesion-Informed Representation with Auxiliary Guid…2607.19137eess.IV3memory, benchmark, code
71Vector-Bench: Can Models Surgically Edit SVG Code?2607.19056cs.AI3memory, benchmark, code
72Biological Amnesia in ICU Time-Series Prediction: A Drift-Adaptive Two…2607.19020cs.LG3memory
73AutoJourn: Multi-Perspective Summarisation, Bias Detection and Bias Ne…2607.18983cs.CL3memory, benchmark
74Building a European Multilingual Evaluation Dataset: The MMLU Localisa…2607.18432cs.CL2multi-agent, benchmark
75VEHBench: A Stage-Local Diagnostic Benchmark for LLM-Assisted Vibratio…2607.18181cs.CL2benchmark
76LLM Detection as an Intervention: Downstream Impact under Strategic Us…2607.19300cs.AI2
77GUIDED Network-Agnostic Feature Initialization for Spatial Transferabi…2607.19270cs.LG2benchmark, planning
78The safety failures we are not instrumenting: a perspective on hidden …2607.19292cs.CY1memory, benchmark, safety

🔺 Scout Intel: What Others Missed

The safety drift problem is real and undermeasured. This week’s “Operational Hallucination and Safety Drift in AI Agents” (2607.18366) formalizes something practitioners have observed anecdotally: agents that start safe can gradually drift toward unsafe behavior over extended deployments, even without adversarial input. This is distinct from jailbreaking — it’s a degradation mode that current evaluation benchmarks don’t capture because they test single-turn behavior. The paper’s framework for measuring operational hallucination rates over multi-step agent trajectories should become a standard evaluation dimension for any agent deployed in production.

Budget routing is the next optimization frontier for coding agents. CodeRescue (2607.19338) introduces a conformal risk control layer that decides whether a failed coding attempt should retry with a cheap model or escalate to an expensive one — and does so under provable cost guarantees. This matters because the current industry default (try cheap, then escalate) wastes compute on cases where cheap recovery is viable, and under-invests in cases where escalation is the only path. The 35% cost reduction at matched solve rates suggests this approach could reshape how agent infrastructure is priced and deployed.

Benchmark saturation is accelerating. With 80 benchmark papers this week alone (59 among agent-related papers), the field is producing evaluation infrastructure faster than it’s producing capabilities to evaluate. The FIFA World Cup 2026 paper (2607.17765) is particularly clever — using a future event as a contamination-free forecasting benchmark — but it also highlights a deeper issue: the half-life of benchmarks is shrinking as models increasingly contaminate training data. The emergence of “contamination-free” as a first-class benchmark design constraint signals that the community recognizes this problem but hasn’t yet solved it at scale.


Data collected from ArXiv API (cs.AI, cs.CL categories) on 2026-07-23. Papers filtered for AI agent relevance and scored by keyword matching. Total of 122 papers scanned, 78 classified as agent-related.

04pcx9u9ofropfmf7vdt4zn████1k8flsl8b9443fng1ixm6wyo1whmmtxo8████xpc4cfi9ehoiips9xx7htrwtb498sfqtq████70ch40uhn6shbzs3rbl27qk9cc6y44a░░░ic2nepcdaa64k0yfc2fgosa6brsoe4mf░░░oexn8hyp3w8b6qtoa12p7i55xujrxtble████pv8y1eav8aho0ksokozrct70n2f1bfs████298n0ibzillgdrq2f898vbks4fqvi9j4████ezs9gwja69yu9d0kq0s0tpxflnl3kh7c████hqelo6am7uvwnrnvycikvmdi5x8dw3hms████phken0y54tr7tziumsrjtjo5ljcjyaunp████fs8r9mhs8hw2aheh8xt34phq4z0awwblw████mpt744dp1dl2gvsdk8go9ksfs57bmosr████xmap2dwgib8clzupowyu1fwltcm3v4ak████hdwi9lydufrc7l154hfvg5f8s78123dy8░░░ycs7snipukpry88han1kd28t5zdimrye░░░3hnh599xelp4r7awtn9pw3y3e32ksfvn░░░53jxn2uo1qeuctpiqr5swx7148h6gelg░░░p1xdo0p97xjai2v0vhls2ab5rct2h0384████132v2jf09y3la4pyc403xoqppr02agw7████yrzs9w2szb7fqa8ootezp7wbsdxjzvc░░░dbf5itq9j3x5oete0cha56j2daqp8d░░░hht3flqvchlckmca9lgt8p96db6t5lqu████23zufdvyuadonvq3yl5zinnkxoip31cf████3s3vmg48e48ajcd1gkesf73wfwy3qf6ru░░░e24ypgji8hpqyr1kn7gd644ll5vsoujc████risb4m8d4big0f07kjv69771auyi9dwrh████fd6m39oyxornhi1oyi7qjfg1tbpy2gg7████xulza81xvafd06klmnqru840jhf1c74u1████bjeq5edamr91unu6uohefoj0amheic162ga░░░kyjp93egfy5m3njt5ecz2ul0buz39p5k░░░wi9enaxogxg22c3ghk4efdasj0uk5jkk░░░9ndwe2rer1oijmz9tjvbaw9dp8zij18░░░4ojrx1twj49hmv1f72buvvivg5qn6e0u░░░i7os9w6ztrkcwzxhod1w2nc7lnroht5l░░░sk2kzg339gdk1wyy392gn2l4pd4tl4e░░░m0n5hb9r2rxz0mqjq2v5k8ktz3b5vo8i████bhgexps29anpqmhyhoqp5eeeya6t053e████9b5x2xxtpkhi2lp1beqe18sgg65r8vw8████ce9evee7j6dhlk879eo7vkjsq5jmlguif████acfr95002c88wnvb8hg6la0qabiivaicsd████ovt5pfo9ha9xqwr9l1pp8xaj2y2kfe6p░░░hxaayxnt2as00i6zop6grf5v5t3pfo29x░░░ybx19adl9tadz70bj13bq4dbdmh8mqvnd████wis9u4lw9cnx572wkjnttpvsus5noaz████mcvvtqj4xtldmnwzc3x6ck1pq99p3xg░░░7stf042zjkwwh42ip3v54kx4k5ue50qo░░░uypevr59el04ry350vl4sypi3nzy9og8░░░yg16g2vex9qmqh0ql5ryo0htrpryvf60m████we0lfzgi8me2wjiujosbkvpew3z83ufif░░░pwysjptukqc