---
title: "自我改进智能体的脆弱性：方差、任务顺序与规格不足"
source: "arXiv AI/CL/LG（论文）"
source_tier: "t2"
url: "https://arxiv.org/abs/2608.18066v1"
permalink: "https://feed.astralor.com/items/itm_4834099cf3a1da05c98908c0"
published: "2026-08-18T17:55:07.000Z"
score: 76
channel: "ai"
tags: ["arXiv","Evaluation Protocol","Memory Bank","Self-Improving Agents","Underspecification"]
---

# 自我改进智能体的脆弱性：方差、任务顺序与规格不足

## AI 点评

> 这篇值得所有做Agent自我改进的人停下来看一眼——它用最朴素的实验（多次运行+打乱顺序）戳破了'稳定提升'的幻觉。对开发记忆型Agent的团队来说，不报告方差和顺序敏感性的结果都可能站不住脚；对评估基准设计者，这是明确的方法论警钟。

## 速览

近期研究显示，基于记忆库的自我改进智能体虽可在线学习并逐步提升，但其可靠性问题被严重忽视。本论文重新评估了两种基于记忆的方法，引入多次运行以量化方差，并随机打乱任务顺序以考察任务顺序影响。结果发现：智能体评估在复杂多步任务中固有噪声，自我改进循环会进一步放大噪声；改进效果高度依赖任务顺序，先前工作默认顺序形成隐式课程，成为成功的隐性前提。作者通过人工检查记忆，提出任务与环境规格不足是脆弱性来源之一，并通过加入详细规则和环境反馈部分缓解性能下降，但仍有显著差距。论文呼吁采用更严格的评估协议，并强调需设计支持人类有效监督的系统。

## 关键点

- 通过多次运行和随机任务顺序重评两种记忆型自我改进智能体，暴露其可靠性问题
- 自我改进循环会放大复杂多步任务中的评估噪声，智能体改进高度依赖任务顺序
- 任务与环境规格不足是脆弱性来源；加入详细规则和环境反馈仅能部分弥补性能差距
- 呼吁更严格的评估协议（多运行、压力测试）并推动人类有效监督机制设计

## 全文

Memory-based self-improving agents--those that learn from an online stream of tasks and improve over time by maintaining a textual memory bank--have shown great promise in recent literature. However, the reliability aspects of these methods have been critically overlooked. In this work, we conduct a comprehensive re-evaluation of two memory-based methods, broadening the scope of evaluation along two axes: (1) including multiple runs to quantify variance, and (2) randomly shuffling the tasks to investigate the effect of task order. Through these experiments, we make two observations that expose the fragility of current methods: First, agent evaluation is inherently noisy in complex environments and on multi-step tasks, and stacking a self-improving loop on top can further amplify this noise. Second, the agent's improvement is highly dependent on task order. Prior works often adopt default orderings that impose an implicit curriculum, acting as a hidden prerequisite for success. To better understand this fragility, we manually examine the agents' memory and hypothesize that task and environment underspecification contribute to this fragility. We validate this hypothesis by incorporating information that enables better specification, such as detailed rubrics and environment feedback, into the memory construction process. While this added information partially closes the performance degradation in previous experiments, significant gaps still remain, suggesting that other uncharacterized factors contribute to this fragility. Looking ahead, our work advocates for more rigorous evaluation protocols for self-improving agents by reporting results across multiple runs and stress-testing them under challenging conditions. Moreover, our findings on underspecification call for systems and interfaces that enable effective human oversight, preventing agents from failing in unforeseeable ways.

---

引用前请核对原文;本文由星际流动整理:https://feed.astralor.com/items/itm_4834099cf3a1da05c98908c0