Salesforce Introduces DarwinX, Reporting a Browser-Agent Score Jump to 93%

The framework searches for better prompts, tools and workflows around a fixed model. Its large benchmark gains depend on a harder operational requirement: reliable tests that catch regressions.

By 3 min read
Salesforce Introduces DarwinX, Reporting a Browser-Agent Score Jump to 93%
Salesforce Introduces DarwinX, Reporting a Browser-Agent Score Jump to 93%

Listen to this story

The audio brief

About 1:36
0:001:36
Read transcript
Salesforce researchers say they raised a browser agent’s success rate from 43.5% to 93% without changing the underlying model. The system, called DarwinX, searches for better prompts, tools, skills, and workflows around a fixed GPT-5.5 model. In other words, it improves the agent’s operating layer, or harness, rather than retraining the model itself. DarwinX evolved its browser harness using 300 synthetic intents, then tested the result on 1,260 unseen tasks with deterministic verifiers. The reported gains appeared across all four benchmarks: they ranged from 3.4 percentage points on SWE-bench Verified to 49.5 points on WebArena-Infinity. The key design choice is how DarwinX searches. Instead of keeping one supposedly best agent and patching its failures, it maintains a population of harness variants. That helps avoid path dependence, where an early decision constrains every later improvement, and cross-task interference, where fixing one task damages another. Merged changes have to pass regression checks, including tasks earlier versions had already solved. There is also a result on Terminal-Bench 2.1. Salesforce’s Monet agent improved from 75.5% to 83.2%, while an evolved harness reached 84.7% with a stronger base model. But the practical limit is evaluation: these coding and browser tasks had relatively clear success tests. Ambiguous enterprise workflows may be much harder to judge reliably. The open question is whether dependable evaluators can make this kind of harness evolution work outside controlled benchmarks.

Story brief

3 key points

Salesforce’s DarwinX results suggest agent performance can improve substantially through systematic changes to prompts, tools, skills, and workflows rather than model retraining. In reported tests, an evolved browser harness reached 93% from a 43.5% baseline, while gains appeared across four benchmarks, including a 49.5-point increase on WebArena-Infinity. The approach’s practical value depends on reliable task...

  1. 01

    DarwinX evolved harnesses using 300 synthetic intents, then evaluated them on 1,260 unseen browser tasks with deterministic verifiers.

  2. 02

    Reported benchmark gains ranged from 3.4 points on SWE-bench Verified to 49.5 points on WebArena-Infinity.

  3. 03

    Population-based search preserves alternative harnesses and tests merged changes for regressions and previously solved tasks.

Salesforce researchers report that they raised a GPT-5.5-based browser agent’s score from 43.5% to 93% without changing the model underneath it. The intervention was DarwinX: a system that evolves the prompts, tools, skills and workflows surrounding an agent, then tests whether each improvement breaks work the agent had already learned to do.

The result puts attention on the agent harness, the operating layer that tells a language model what context to use, which tools it can call and how to carry out a task. DarwinX keeps model weights frozen and modifies that surrounding layer instead, a potentially useful approach for application teams using hosted models without their own training pipelines.

A search process designed not to forget

A common self-improvement loop takes the current best agent, studies failures and patches it. Salesforce’s researchers argue that this can produce path dependence: an early, locally useful change becomes the foundation for every later change, even if another branch would have proved more valuable. It can also cause cross-task interference, where a fix for one job makes another worse.

DarwinX takes a population-based approach. It keeps multiple harness variants, retains branches with specialized strengths and can merge complementary changes. A merged candidate must still pass preservation and confirmation testing, including checks on tasks its parent versions had already solved.

Diagram of the DarwinX framework’s harness-evolution process
DarwinX preserves alternative harness variants and tests merged changes before advancing them. Source: venturebeat.com.

The gains extend beyond one browser test

The researchers report improvements across all four benchmarks they tested, ranging from 3.4 percentage points on SWE-bench Verified to 49.5 points on WebArena-Infinity. On Terminal-Bench 2.1, a GPT-5.5-based version of Salesforce’s proprietary Monet agent rose from 75.5% to 83.2%; the evolved harness reached 84.7% with a stronger base model.

Those results do not show that extra agent effort was applied indiscriminately. On tasks both versions already completed, median turns increased from 12 to 13. On six newly solved tasks, the median rose from 11 to 22 turns, suggesting the evolved harness used more verification and retries selectively in these tests.

A promising result with an evaluation burden

DarwinX also showed a limited transfer result. A harness evolved on Terminal-Bench scored 84.2% on SWE-bench Verified, versus 80.8% for a reference harness, without receiving SWE-bench feedback during evolution. That is evidence that some learned harness behavior can travel across benchmarks, but the paper tests transfer in only one direction.

The central constraint is the evaluator. DarwinX can select a better variant only when it has a credible way to determine task success and detect regressions. That was relatively tractable in these coding and browser experiments; turning changing, ambiguous enterprise work into dependable tests remains the practical challenge behind the framework’s promise.

Sources

  1. venturebeat.comSalesforce researchers took an AI agent from finishing 43.5% of browser tasks to 93% without touching the model

Loading discussion...

Salesforce Introduces DarwinX, Reporting a Browser-Agent Score Jump to 93% | Superpower Daily