Ouroboros: A Self-Developing Frontier Coding Agent with Reviewed Core Evolution
A coding AI agent that keeps rewriting its own code sets new state-of-the-art benchmark scores
Ouroboros is a coding agent whose tools, prompts, and even core implementation are modified by itself, with changes passing a review gate before becoming the runtime for later work. It set new best-reported scores on Terminal-Bench 2.1, OSWorld-Verified, and CL-Bench, and its 161-day live deployment 'Hope' shows how human feedback and self-detected bugs turn into reviewed structural changes. Because the agent can rewrite its own code and pick its own model APIs, the paper treats operator control mechanisms as a core design problem, not an afterthought.
METAL MEDIA explanatory visual
How Ouroboros evolves itself under review
Evidence statusMeasured results reported
- Doing workThe agent performs coding tasks, benchmark tasks, and conversations with people
- Surfacing a fault or ideaBugs, inefficiencies, human feedback, or the agent's own reflection reveal a candidate improvement
- Agent decidesThe agent itself decides which suggested changes are worth pursuing, not the human proposing them
- Reviewed commit gateMulti-model diff review, fingerprint checks, and quorum requirements must be passed before a change is approved
- New runtime for later workApproved changes become the system that runs subsequent tasks, while operator controls like /panic and spending limits stay independently enforced
What they did
- The researchers built a 'reviewed core evolution' architecture where the agent can modify its own tools, prompts, and core implementation, and once a change passes human-style review, it becomes the runtime that later tasks run on.
- Core evolution works in two modes: recursive free evolution, where finishing one self-improvement task can automatically schedule the next; and experience-driven evolution, where bugs and inefficiencies surfaced during ordinary work or human conversation lead to reviewed structural fixes.
- On Terminal-Bench 2.1 an Opus 5 run scored 86.74% after trajectory audit, the best reported result on that benchmark; on OSWorld-Verified it reached 90.69%, above the previous best published score; and on CL-Bench a five-rollout campaign achieved a normalized reward of 0.2301, a new state of the art.
- Hope, a 161-day public deployment, is a persistent agent that has interacted with people across seven surfaces (web chat, voice, Telegram, Discord, Twitter/X, website comments, email) while continuously modifying its own implementation; humans can flag problems, but the agent decides which changes to actually make.
- Because the agent can rewrite its own code and even choose which model API to route to, the design treats operator controls -- like a /panic command that halts everything, spending limits, and multi-model diff review -- as safeguards that must remain authoritative even as the system keeps evolving.
| System | Prompts | Tools/skills | Workflow | Core code | Reviewed commits | Deployment state |
|---|---|---|---|---|---|---|
| Voyager | ✓ | ✓ | – | – | – | – |
| Live-SWE-agent | ✓ | ✓ | – | – | – | – |
| Autogenesis | ✓ | ✓ | ✓ | partial | specified protocol | partial |
| Darwin Gödel Machine | ✓ | ✓ | ✓ | ✓ | benchmark selection | – |
| Hermes Agent | ✓ | ✓ | ✓ | – | – | ✓ |
| OpenClaw / ClawBench | ✓ | ✓ | ✓ | – | – | – |
| Ouroboros | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
| Benchmark | Model | Ouroboros | Named baselines |
|---|---|---|---|
| Terminal-Bench 2.1 | Opus 5 high | 86.97% raw; 86.74% audited | Claude Code + Fable 5: 83.8% |
| Terminal-Bench 2.1 | GPT-5.5 | 84.3% | Codex CLI: 83.1% |
| Terminal-Bench 2.1 | Grok 4.5 | 84.94% audited | Cursor: 79.3%; Hermes: 77.53% |
| OSWorld-Verified | Opus 5 | 90.69% | Intelligence-Indeed: 90.19%; Mythos Preview: 85.4% |
| CL-Bench | Sonnet 4.6 | 0.2301 | ICL: 0.1960; Claude Code: 0.1855 |
| SWE-bench Pro | GPT-5.6 Luna | 58.2% | Codex: 59.4%, p=0.40 |
| GAIA | Sonnet 5 | 78.2% | Claude Code: 78.8% |

| Benchmark | Scaffold disclosure |
|---|---|
| Terminal-Bench 2.1 | Declared model; fresh trial state; delegation off with planning scouts disclosed; agent web off; blocking review; evolution off. |
| OSWorld-Verified | Declared model; empty memory across tasks; delegation off; task-configured proxy and GUI shell disclosed; feasibility pass; evolution off. |
| CL-Bench | Sonnet 4.6; persistent memory per rollout; delegation, web, and vision off; one blocking improvement pass; evolution off. |
| SWE-bench Pro | GPT-5.6 Luna; private memory per instance; delegation off; network exposure audited; fixed harness; evolution off. |
| GAIA | Sonnet 5; private memory per sample; delegation off; same-model native search; anti-lookup and leakage audit. |
Findings
- On Terminal-Bench 2.1, the Opus 5 run scored 86.97% raw (387/445) and 86.74% (386/445) after trajectory audit, the best reported result on this benchmark, roughly two standard errors above the strongest baseline, Claude Code with Fable 5 at 83.8%.
- On OSWorld-Verified, the Opus 5 run scored 90.69% (327.39/361), exceeding the previous leaderboard leader, the Intelligence-Indeed agent, at 90.19%.
- On CL-Bench, a five-rollout campaign with Sonnet 4.6 reached a normalized reward of 0.2301, above the strongest published baseline of plain in-context learning (0.1960 with Sonnet 4.6).
- On SWE-bench Pro, after symmetrically removing instances where either system reached the reference solution, Ouroboros resolved 58.2% versus Codex's 59.4% on 655 paired tasks, a difference not statistically significant (McNemar's test, p=0.40); on GAIA, Ouroboros scored 78.2% versus Claude Code with Sonnet 5 at 78.8%.
- During the 161-day Hope deployment, trajectory audits found a duplicate-message-send bug and a review-context-overflow bug that caused self-review failures; both were traced and fixed with reviewed structural changes, including a bounded, connectivity-aware context assembly method.
Where it can be used
- Designing harnesses for long-horizon coding agents that need a reviewed pipeline for tools, prompts, and code changes rather than a fixed, frozen configuration.
- Building multi-channel AI deployments (chat, voice, social media, email) that need a structured process for turning user feedback and observed bugs into system improvements.
- Designing operational safety mechanisms -- such as emergency stop commands, external spending caps, and multi-model review -- for self-modifying AI systems.
Limits and open work
- The deployment study observed a single long-running lineage rather than a controlled population of independently evolving agents, limiting generalization.
- SWE-bench Pro results are affected by public reference-solution leakage and known task defects, requiring careful interpretation.
- LLM-based reviewers may share blind spots with the agent being reviewed, and low review mode skips whole-repository scope review entirely.
- Benchmark campaigns run on frozen system snapshots while the live Hope deployment keeps evolving on a separate lineage, so benchmark scores do not directly represent the current live system.

Why it matters
This shows that not just the underlying model but the entire execution harness around an AI agent can keep improving itself in a deployed, live system, backed by concrete benchmark and long-running deployment evidence. It also offers a concrete blueprint for what operational safety controls look like when the agent being controlled can rewrite its own code.
Terms in this paper
- harness · the surrounding software that lets an AI model use tools, follow instructions, and complete tasks
- reviewed commit · a code change that must pass a review process before it is applied to the live system
- Terminal-Bench 2.1 / OSWorld-Verified / CL-Bench · benchmarks that test terminal task completion, computer-screen operation, and continual learning ability respectively
- normalized reward · a standardized score that lets different task results be compared on the same scale
- /panic · an operator command that immediately halts every process the agent is running
Original abstract (English)
We present Ouroboros, a self-developing agent harness whose tools, prompts, context assembly, and core implementation improve through reviewed commits that become the runtime for later work. Core evolution proceeds in two modes. In recursive free evolution, improvement is itself a task, and completing one evolution cycle can schedule the next. In experience-driven core evolution, ordinary work and social interaction expose bugs, rough edges, and inefficient context construction that lead to reviewed structural changes. On Terminal-Bench 2.1, an Opus 5 run scores 86.74%, the best result reported on the benchmark. On OSWorld-Verified, an Opus 5 run reaches 90.69%, exceeding the best previously reported score. A five-rollout CL-Bench campaign achieves a normalized reward of 0.2301, setting a new state of the art. Hope is the longest-running publicly documented Ouroboros deployment. It is a 161-day living agent experiment in free evolution under governed human communication across seven surfaces. Human interaction surfaces faults and generates proposals, but the agent decides which changes to pursue. Because a self-developing agent may rewrite its own code and select new model APIs, operational safety becomes a primary design problem: guardrails must remain authoritative under evolutionary and public social pressure. Benchmark campaigns use frozen system snapshots, while Hope continues live evolution on a separate lineage.
Read on arXivLatest papers
- SWE-bench Science: Can Coding Agents Resolve Engineering Tasks in Science?AI coding agents were tested on fixing real scientific software, and even the best one failed more than half the time
- FlashPrefill V2: Block-Sparse Prefill Attention for Long-Context LLM ServingMaking sparse attention fast enough and accurate enough for real LLM serving, not just papers
- PolicyGuide: From Guarding One Action to Guiding the Whole Workflow for Policy-Compliant LLM AgentsMaking customer-service AI agents follow the whole procedure, not just avoid one bad action
- EXIMO: VLM Guided Exploration of VLA PoliciesTeaching a robot new chores without human teleoperation, by letting a chatty AI supervise it
- EnvHarness: Awakening Static Worlds for Agent LearningInstead of building new training worlds from scratch, this work adds a plug-in layer that reshapes existing ones around each agent's actual weaknesses
- Bounded Sovereignty and the Control Tax: Pricing AI Oversight When the Deployer Does Not Own the ModelCompanies that rent AI instead of owning it can only do half of AI safety oversight
- Beyond Imitation: Filtering On-Policy Distillation by Reasoning ProgressA fix for AI models that get penalized by their teacher even when they're reasoning correctly
- PersonalBench: Measuring the Authorship Gap in LLM PersonalizationAI can be prompted to write 'like someone,' but its own voice never fully disappears
Latest from METAL MEDIA
Figures: Anton Razzhigaev et al., arXiv:2608.08311, CC BY 4.0