Modelspublished

Nvidia’s AVO Clears ARC-AGI-3’s Public Set. Withheld Tests Still Matter.

The result makes a strong case that long-running agent design can change benchmark outcomes. It does not yet show whether AVO transfers to ARC-AGI-3’s withheld competition environments.

By 3 min read
Nvidia’s AVO Clears ARC-AGI-3’s Public Set. Withheld Tests Still Matter.

Listen to this story

The audio brief

About 1:46
0:001:46
Read transcript
Nvidia says its AVO system completed all 183 levels in ARC-AGI-3’s public benchmark, across 25 interactive environments, earning a perfect 100.00 RHAE score. That is more than a completion claim: RHAE also rewards using fewer actions than first-time human players. AVO finished in 6,624 environment actions, while still relying on Claude Opus 5 as its underlying model. The important development is the system around that model. AVO carries persistent memory across work, uses software tools and an execution loop, and has a supervisor that can redirect the agent when progress stalls. In other words, the system can continue a long-running search after one model context ends, preserving earlier implementations, test results, and reasoning. Nvidia originally developed this approach for GPU-kernel optimization, then connected the same general architecture to ARC-AGI-3 without adding an ARC-specific world model. Nvidia compares AVO’s action count with VISTA, another Claude Opus 5 setup that also completed the public set. But that is not a controlled comparison: the systems use different backends, memory and context handling, and different inputs. AVO receives exact 64-by-64 text grids, while VISTA’s main setup uses rendered 512-by-512 images. So the public result supports a narrower conclusion: long-horizon agent design can materially change benchmark outcomes. The decisive constraint is that Nvidia did not run AVO on ARC-AGI-3’s withheld semi-private or private tests, leaving transfer beyond the public set unresolved.

Story brief

3 key points

Nvidia’s AVO, built around Claude Opus 5, completed ARC-AGI-3’s 183-level public set across 25 environments, using 6,624 environment actions and earning a perfect 100.00 RHAE score. The more consequential result is architectural: persistent memory, executable tools, iterative control, and supervisory redirection let work continue beyond one model context. But the benchmark’s semi-private and private tests were not...

  1. 01

    AVO completed every public level; RHAE also rewards action efficiency against first-time human baselines, so completion alone does not explain the score.

  2. 02

    Nvidia used exact 64×64 text grids; VISTA’s primary setup uses 512×512 rendered PNGs, complicating direct action-count comparisons.

  3. 03

    AVO’s architecture originated in GPU-kernel search, where Nvidia reports up to 3.5% over cuDNN and 10.5% over FlashAttention-4.

Nvidia says its AVO agent system completed every level in ARC-AGI-3’s public benchmark set, reaching a 100.00 Relative Human Action Efficiency score with Claude Opus 5 underneath it. The result is a vivid demonstration of how much an agent’s memory, tools and control loop can matter—but it stops before the benchmark’s semi-private and private tests.

AVO cleared 183 levels across 25 interactive environments in 6,624 environment actions, according to Nvidia. ARC-AGI-3 puts agents into unfamiliar game-like settings without instructions, stated rules or stated goals; they must experiment, infer the environment and use actions efficiently as levels become harder.

RHAE combines task completion with action efficiency relative to first-time human baselines, then aggregates performance across levels and environments. Clearing levels alone is not enough: the metric also rewards reaching them with fewer interactions.

The system keeps working after one model context ends

AVO is Nvidia’s general-purpose coding-agent system. Around the language model, it adds persistent memory, software tools, an execution loop and a supervisor that can redirect work when progress stalls. The arrangement is designed to carry prior results and reasoning across work that outlasts a single model context.

In its evolutionary-search work, AVO replaces a predefined variation step with an agent that chooses what to inspect, change, test and commit next. For ARC-AGI-3, Nvidia connected that same agent architecture to a different task interface rather than building an ARC-specific world-model layer.

What AVO adds around Claude Opus 5

  • Persistent memory retains prior implementations, evaluation results and accumulated reasoning for later work.
  • Tools and an execution loop let the system inspect code, make changes, run commands and validate outcomes through execution.
  • Supervision monitors the broader search trajectory and can push the main agent toward another strategy after stagnation.
Public-set result
100.00RHAE score

Nvidia says AVO achieved a 100.00 RHAE score on the 25-environment ARC-AGI-3 public set.

183Levels completed

The run completed all 183 public-set levels.

6,624Environment actions

Nvidia says the system used 6,624 environment actions to finish the public set.

An efficiency gap with too many moving parts

Nvidia compares AVO’s 6,624 actions with 7,542 actions reported by VISTA, another Claude Opus 5 harness that also completed the 183 public levels. That is approximately 12% fewer actions for AVO, but Nvidia explicitly says it is not a controlled ablation: the systems differ in their agent backends, observation formats, memory and context management.

The input path is one concrete difference. AVO gave the model exact 64-by-64 text grids, with no images or image tokens. Nvidia says VISTA’s primary configuration uses a rendered 512-by-512 PNG, though VISTA has also explored text-grid representations.

A transfer from kernel work, not proof of broad generalization

Nvidia first used AVO for GPU-kernel optimization, where an agent must inspect implementations, change code, test it on hardware and revise its approach. In one seven-day attention-kernel experiment, Nvidia says AVO explored more than 500 optimization directions and committed 40 kernel versions.

On Nvidia DGX B200 systems, the company says those multihead-attention kernels outperformed cuDNN by up to 3.5% and FlashAttention-4 by up to 10.5% across the evaluated configurations. Nvidia says AVO then adapted the evolved kernel to grouped-query attention in about 30 minutes of further autonomous work.

The public-set sweep supports Nvidia’s narrower conclusion: its long-horizon architecture can be adapted from software engineering to an interactive reasoning task. It cannot yet establish how the system performs on ARC-AGI-3’s semi-private or fully private competition sets, which Nvidia did not test.

Sources

  1. developer.nvidia.comNVIDIA AVO Reaches 100% on ARC-AGI-3, Demonstrating a Frontier-Level General-Purpose Architecture for Long-Horizon Autonomous Agents | NVIDIA Technical Blog