Nvidia AVO hit 100% on ARC-AGI-3. The harness did it.
Claude Opus 5 scores ~30% on ARC-AGI-3 alone. Wrapped in Nvidia's AVO harness it hit 100%. The agent harness is the part you should be building.
The same model, two scores: about 30% and 100%. Nvidia published results on August 21 showing its research agent architecture, AVO, clearing every level of the ARC-AGI-3 public set — running on Claude Opus 5, the model that scores roughly 30% on that benchmark by itself. Nothing about the model changed. The agent harness around it did all the work.
What actually happened
Per Nvidia's technical blog, AVO — Agentic Variation Operators — posted a 100.00 RHAE score across all 25 environments in the ARC-AGI-3 public set, completing all 183 levels. Claude Opus 5 at high reasoning effort lands near 30% on the same set unassisted. AVO used 6,624 environment actions against 7,542 for VISTA, the prior top result, roughly 12% fewer.
Three pieces do the lifting. Persistent memory that carries prior attempts, evaluation results, and profiler output across iterations. An inspect-plan-implement-evaluate loop that runs until something passes. And a supervisor watching the whole trajectory for stagnation and repeated unproductive cycles, so the agent gets pulled out of a loop instead of burning tokens inside it.
The same architecture spent seven days on GPU kernel optimization, explored more than 500 directions, and committed 40 kernel versions — beating cuDNN by up to 3.5% and FlashAttention-4 by up to 10.5% on the configurations tested.
Two caveats Nvidia states plainly and the headlines drop: this is the public set, not the semi-private or private competition sets, and the VISTA comparison is not a controlled ablation. There is no open-source release. AVO is a research result, not something you can install.
Why the agent harness matters for your business
Stop shopping for models. Start building scaffolding. A 30-to-100 delta from architecture alone is the clearest statement yet that most teams are tuning the wrong layer. If your agent is failing on multi-step work, the next model release probably will not fix it.
Persistent memory is not a vector database. What AVO carries forward is structured: what was tried, what the evaluator said, what the tooling printed. That is a run log with a schema, not embeddings of your docs. It is also the cheapest thing on this list to build.
The supervisor is the part nobody builds and everybody needs. An agent that retries the same failing approach eleven times costs real money and produces nothing. A loop counter, a no-progress detector, and a hard stop are an afternoon of work. We ship them by default now because we have paid the other bill.
Write the evaluator first. AVO works because it can tell pass from fail without a human. If your task has no automatic check — no test, no diff, no validator — you do not have an agent task yet. You have a draft generator with a person on the end.
Key takeaways
- Nvidia's AVO scored 100.00 RHAE on the ARC-AGI-3 public set, all 183 levels across 25 environments
- Same underlying model, Claude Opus 5, scores about 30% unassisted at high reasoning effort
- 12% fewer environment actions than VISTA: 6,624 vs 7,542
- Architecture: persistent structured memory, an inspect-plan-implement-evaluate loop, and a stagnation supervisor
- Public set only, no controlled ablation against VISTA, and no open-source release
- The transferable lesson is cheap to copy: memory, an automatic evaluator, and a hard stop on unproductive loops
The harness is the product. The model is a dependency. We build agent systems where the loop, the memory, and the stop conditions are your code — so swapping models is a config change, not a rewrite. See how we build agent systems, or tell us what your agent keeps failing at.
Sources: NVIDIA Technical Blog, TechCrunch.
- #agent-harness
- #ai-agents
- #nvidia
- #benchmarks
- #automation
Tommy Rush — Founder, Rush Commerce
Operator turned builder. 15+ years running operations — now shipping the systems businesses run on. More
Get The Rush Report weekly — one email, zero fluff.
Keep reading
Serval Catalyst GA: your ticket history is the asset
Serval's Catalyst went GA August 20, compiling IT ticket history and SOPs into working automations. The lesson for small operators: the log is the training data.
Read itOura's accuracy suit: don't ship a number you can't defend
A class action says Oura advertised 95% sleep-staging accuracy for an AI estimate. If you market an AI feature with a precision claim, read this first.
Read it