K-文化的一切——从回归到 K-美妆，发送到您的邮箱订阅邮件

METAL MEDIA

Ouroboros: A Self-Developing Frontier Coding Agent with Reviewed Core Evolution

arXiv:2608.083112026-08-07

一个能不断修改自己代码的AI编程智能体,在多项基准测试中刷新最高纪录

Ouroboros是一个可以自行修改工具、提示词乃至核心实现代码的编程智能体,修改经过审核后成为后续任务运行的基础环境。它在Terminal-Bench 2.1、OSWorld-Verified、CL-Bench三项基准上都取得了目前公开报告中的最高分,而持续运行161天的公开部署实例Hope展示了人类反馈和智能体自我发现的问题如何变成经过审核的结构性改动。由于该智能体能改写自己的代码并选择调用哪个模型接口,论文把运营方的控制机制当作核心设计问题来处理。

METAL MEDIA 解读图

Ouroboros的自我演化审核流程

证据状态已报告实测结果

  1. 执行任务智能体执行编程任务、基准测试任务以及与人类的对话
  2. 发现问题或改进思路漏洞、低效之处、人类反馈或智能体自身的反思暴露出潜在的改进方向
  3. 智能体自主决策由智能体本身决定哪些建议的改动值得真正推进,而非提出建议的人类
  4. 经审核的提交关卡改动需通过多模型代码审核、指纹校验和法定人数要求后才能被批准
  5. 成为后续任务的运行基础获批的改动成为运行后续任务的系统本身,而/panic和支出上限等运营方控制机制则始终独立生效
这是 METAL MEDIA 制作的解读图，并非论文作者提供的原图。

他们做了什么

  1. 研究团队构建了一套“经审核的核心演化”架构,智能体可以修改自己的工具、提示词和核心实现代码,变更通过类似人工审核的流程后,会成为后续任务运行所依赖的运行环境。
  2. 核心演化分两种模式:一种是递归自由演化,即把“自我改进”本身当作一项任务,一次改进完成后可以自动安排下一次改进任务;另一种是经验驱动演化,通过日常工作和与人的对话中暴露出的漏洞和低效之处,触发经审核的结构性修复。
  3. 在Terminal-Bench 2.1上,基于Opus 5的运行经过轨迹审计后得分86.74%,是该基准目前报告的最高成绩;在OSWorld-Verified上达到90.69%,超过此前公开的最高分;在CL-Bench上,五轮实验取得归一化奖励0.2301,创下新纪录。
  4. 名为Hope的公开部署实例已持续运行161天,通过网页聊天、语音、Telegram、Discord、Twitter/X、网站评论和邮件七个渠道与人互动,同时持续修改自身实现;人类可以指出问题,但最终是否采纳改动由智能体自己决定。
  5. 由于该智能体能够改写自己的代码,甚至选择调用哪个模型接口,论文将运营方控制机制——比如可立即中止所有进程的/panic指令、支出上限、多模型代码审核——当作必须在系统持续演化中始终保持有效的关键设计要素。
Figure 1: Ouroboros architecture. One supervised runtime dispatches work to admitted workspaces, task trees, and benchmark adapters. Child patches return to the parent; self-repository changes then pass the reviewed gate. External deliverables and benchmark evidence remain separate artifacts.
Figure 1: Ouroboros architecture. One supervised runtime dispatches work to admitted workspaces, task trees, and benchmark adapters. Child patches return to the parent; self-repository changes then pass the reviewed gate. External deliverables and benchmark evidence remain separate artifacts.
Table 1: Boundary of evolution in related systems. “Core code” means the agent can change the harness implementation that later runs tasks. “Reviewed commits” means changes are serialized through an auditable version-control gate before adoption.
SystemPromptsTools/skillsWorkflowCore codeReviewed commitsDeployment state
Voyager✓✓––––
Live-SWE-agent✓✓––––
Autogenesis✓✓✓partialspecified protocolpartial
Darwin Gödel Machine✓✓✓✓benchmark selection–
Hermes Agent✓✓✓––✓
OpenClaw / ClawBench✓✓✓–––
Ouroboros✓✓✓✓✓✓
Figure 2: Subagent patch-integration protocol. Acting children write in isolated worktrees; the parent verifies lineage and touched paths and remains the sole committer.
Figure 2: Subagent patch-integration protocol. Acting children write in isolated worktrees; the parent verifies lineage and touched paths and remains the sole committer.
Table 2: Model–harness results across five benchmark families. Links to traces, manifests, and submissions appear in the corresponding benchmark paragraphs.
BenchmarkModelOuroborosNamed baselines
Terminal-Bench 2.1Opus 5 high86.97% raw; 86.74% auditedClaude Code + Fable 5: 83.8%
Terminal-Bench 2.1GPT-5.584.3%Codex CLI: 83.1%
Terminal-Bench 2.1Grok 4.584.94% auditedCursor: 79.3%; Hermes: 77.53%
OSWorld-VerifiedOpus 590.69%Intelligence-Indeed: 90.19%; Mythos Preview: 85.4%
CL-BenchSonnet 4.60.2301ICL: 0.1960; Claude Code: 0.1855
SWE-bench ProGPT-5.6 Luna58.2%Codex: 59.4%, p=0.40
GAIASonnet 578.2%Claude Code: 78.8%
Figure 3: Task-tree view of a live Ouroboros session: nested planning and acting roles with per-node status, note counts, and child counts.
Figure 3: Task-tree view of a live Ouroboros session: nested planning and acting roles with per-node status, note counts, and child counts.
Table 3: Scaffold disclosures for the reported benchmark rows. Exact provider routes, efforts, seed commits, task selection, and runtime attestations are preserved in the linked run artifacts.
BenchmarkScaffold disclosure
Terminal-Bench 2.1Declared model; fresh trial state; delegation off with planning scouts disclosed; agent web off; blocking review; evolution off.
OSWorld-VerifiedDeclared model; empty memory across tasks; delegation off; task-configured proxy and GUI shell disclosed; feasibility pass; evolution off.
CL-BenchSonnet 4.6; persistent memory per rollout; delegation, web, and vision off; one blocking improvement pass; evolution off.
SWE-bench ProGPT-5.6 Luna; private memory per instance; delegation off; network exposure audited; fixed harness; evolution off.
GAIASonnet 5; private memory per sample; delegation off; same-model native search; anti-lookup and leakage audit.
Figure 4: Results on Terminal-Bench 2.1, OSWorld-Verified, and CL-Bench against named published baselines. Red bars mark Ouroboros, gray bars mark baselines, and outlined bars are audit-adjusted scores. Terminal-Bench whiskers show ±1 binomial standard error over 445 trials; OSWorld and CL-Bench report single scored campaigns. Axes are truncated to the competitive range.
Figure 4: Results on Terminal-Bench 2.1, OSWorld-Verified, and CL-Bench against named published baselines. Red bars mark Ouroboros, gray bars mark baselines, and outlined bars are audit-adjusted scores. Terminal-Bench whiskers show ±1 binomial standard error over 445 trials; OSWorld and CL-Bench report single scored campaigns. Axes are truncated to the competitive range.

研究结果

  • 在Terminal-Bench 2.1上,Opus 5运行原始得分86.97%(387/445),经轨迹审计后为86.74%(386/445),是该基准目前报告的最高成绩,比最强基线Claude Code配合Fable 5(83.8%)高出约两个标准误。
  • 在OSWorld-Verified上,Opus 5运行得分90.69%(327.39/361),超过此前排行榜第一的Intelligence-Indeed智能体(90.19%)。
  • 在CL-Bench上,基于Sonnet 4.6的五轮实验取得归一化奖励0.2301,高于基准作者报告的最强基线——纯上下文学习方法(ICL,Sonnet 4.6下为0.1960)。
  • 在SWE-bench Pro上,对称剔除任一方已获得参考答案的实例后,在655个配对任务中Ouroboros解决率为58.2%,Codex为59.4%,差异在统计上不显著(McNemar检验p=0.40);在GAIA上Ouroboros得分78.2%,配合Sonnet 5的Claude Code得分78.8%。
  • 在为期161天的Hope部署中,轨迹审计发现了消息重复发送的漏洞以及因审核上下文过载导致自我审查失败的问题,两者均被追踪并通过经审核的结构性修复(重复发送防护机制、基于连接度的有界上下文构建方式)加以解决。
Figure 5: Operational control boundaries. Public interactions enter one ordered log and bounded digests; budget and routing controls use the authenticated operator path, while /panic halts the process tree before agent handling. Diff review remains active in both context modes; whole-repository scope review runs only in max mode.
Figure 5: Operational control boundaries. Public interactions enter one ordered log and bounded digests; budget and routing controls use the authenticated operator path, while /panic halts the process tree before agent handling. Diff review remains active in both context modes; whole-repository scope review runs only in max mode.

可应用场景

  • 为需要长时间自主运行的编程智能体设计运行框架时,可参考这种对工具、提示词、代码变更进行审核后再采用的流程,而非采用固定不变的配置。
  • 为多渠道(聊天、语音、社交媒体、邮件)长期运行的AI服务设计将用户反馈和已发现的问题转化为系统改进的流程。
  • 为可自我修改的AI系统设计运营安全机制,例如紧急停止指令、外部支出上限和多模型代码审核。
Figure 6: Hope public deployment series through 6 August 2026. Axes start at zero; February and August are partial months. Values are monthly endpoints from the public evolution feed.
Figure 6: Hope public deployment series through 6 August 2026. Axes start at zero; February and August are partial months. Values are monthly endpoints from the public evolution feed.

局限与待验证事项

  • 该部署研究只观察了一条长期运行的单一演化谱系,而非多个独立演化的智能体群体,结论的普适性有限。
  • SWE-bench Pro受到公开参考答案泄露和任务本身缺陷的影响,结果解读需谨慎。
  • 基于大语言模型的审核者可能与被审核的智能体共享相同的盲点,且在低审核模式下会完全跳过全仓库范围的审核。
  • 基准测试使用的是固定的系统快照,而实际部署的Hope在独立的分支上持续演化,因此基准得分并不直接代表当前实时运行系统的状态。
Figure 7: Ouroboros interface surfaces. The complete project view shows a live visual-verification task, its conversation, generated artifact, and runtime controls. The skills view exposes installable tools, routes, and widgets outside the base runtime.
Figure 7: Ouroboros interface surfaces. The complete project view shows a live visual-verification task, its conversation, generated artifact, and runtime controls. The skills view exposes installable tools, routes, and widgets outside the base runtime.

为什么重要

这项工作表明,不仅底层模型能力在提升,围绕智能体的整个执行框架本身也可以在真实部署中持续自我改进,并有具体的基准测试和长期部署证据支撑。它还为“能改写自己代码的AI系统需要怎样的安全控制机制”提供了一个具体的设计范例。

本文术语

  • 运行框架(harness) · 让AI模型能够调用工具、执行任务的外层软件系统
  • 经审核的提交(reviewed commit) · 代码改动必须通过审核流程才能被应用到实际运行的系统中
  • Terminal-Bench 2.1 / OSWorld-Verified / CL-Bench · 分别用于评测终端任务完成能力、电脑屏幕操作能力和持续学习能力的AI智能体基准测试
  • 归一化奖励 · 将不同任务的得分换算到同一尺度上,便于比较的标准化分数
  • /panic · 运营方用来立即终止智能体全部进程的指令

论文原文摘要（英文）

We present Ouroboros, a self-developing agent harness whose tools, prompts, context assembly, and core implementation improve through reviewed commits that become the runtime for later work. Core evolution proceeds in two modes. In recursive free evolution, improvement is itself a task, and completing one evolution cycle can schedule the next. In experience-driven core evolution, ordinary work and social interaction expose bugs, rough edges, and inefficient context construction that lead to reviewed structural changes. On Terminal-Bench 2.1, an Opus 5 run scores 86.74%, the best result reported on the benchmark. On OSWorld-Verified, an Opus 5 run reaches 90.69%, exceeding the best previously reported score. A five-rollout CL-Bench campaign achieves a normalized reward of 0.2301, setting a new state of the art. Hope is the longest-running publicly documented Ouroboros deployment. It is a 161-day living agent experiment in free evolution under governed human communication across seven surfaces. Human interaction surfaces faults and generates proposals, but the agent decides which changes to pursue. Because a self-developing agent may rewrite its own code and select new model APIs, operational safety becomes a primary design problem: guardrails must remain authoritative under evolutionary and public social pressure. Benchmark campaigns use frozen system snapshots, while Hope continues live evolution on a separate lineage.

作者 · Anton Razzhigaev

在 arXiv 阅读

最新论文

全部论文 →

METAL MEDIA 最新报道

图片来源： Anton Razzhigaev et al., arXiv:2608.08311, CC BY 4.0