Cognition Releases SWE-2 for Devin, Claiming Lower-Cost Coding Performance

The new model is available in Devin Desktop and the command-line interface. Cognition says it can approach leading coding results at lower reported rollout cost, but the headline comparisons come from the company’s own evaluations.

By 3 min read
Cognition Releases SWE-2 for Devin, Claiming Lower-Cost Coding Performance
Cognition Releases SWE-2 for Devin, Claiming Lower-Cost Coding Performance

Listen to this story

The audio brief

About 1:49
0:001:49
Read transcript
Cognition has released SWE-2, a new coding model for its Devin agent, and it’s now available in Devin Desktop and the command-line interface. The pitch is straightforward: get coding agents to make useful changes sooner, while spending less on each task. In Cognition’s evaluation, SWE-2 scored 50.0 percent on FrontierCode 1.1 Main. That’s close to Fable 5.1 at 50.9 percent, and below GPT-6 Astra at 53.3 percent. But Cognition says SWE-2 cost 64 percent less than Fable, and roughly one-quarter as much as GPT-6 Astra. Those are company-reported comparisons, not a universal ranking across coding work. The results also vary sharply by test. SWE-2 scored 92.8 percent on Terminal-Bench 2.1, but just 27.3 percent on Terminal-Bench 4. That gap matters because coding agents face very different kinds of repository and terminal work. Cognition says SWE-2 was post-trained from Kimi K3, a 2.8-trillion-parameter model, with reinforcement learning across multiple reasoning-effort levels. Medium effort is meant to move quickly on simpler tasks. High and maximum effort spend more time planning, inspecting code, and verifying uncertain changes. Compared with SWE-1.7, medium-effort runs cut average FrontierCode steps from 127 to 53, and brought the first substantive edit forward from 48 steps to 18. Cognition reports 58 percent fewer turns and 81 percent lower cost in that test. The key question now is whether faster, cheaper trajectories produce dependable accepted changes when SWE-2 reaches Devin Web and Fusion.

Story brief

3 key points

Cognition is positioning SWE-2 as a cost-optimized model for Devin, with behavior tuned to act quickly on simpler coding tasks and spend more effort when work is uncertain. In Cognition’s testing, medium-effort runs reduced average FrontierCode steps from 127 to 53 and cost 81% less than SWE-1.7. The tradeoff is uneven performance: SWE-2 reached 50.0% on FrontierCode 1.1 Main and 92.8% on Terminal-Bench 2.1, but...

  1. 01

    SWE-2 scored 50.0% on FrontierCode 1.1 Main, versus 50.9% for Fable 5.1 and 53.3% for GPT-6 Astra.

  2. 02

    Cognition reports SWE-2 cost 64% less than Fable 5.1 and roughly one-quarter as much as GPT-6 Astra.

  3. 03

    Medium-effort runs cut average FrontierCode steps 58%, while the first substantive edit arrived after 18 steps instead of 48.

Cognition has released SWE-2, a new coding model for its Devin agent, with availability now in Devin Desktop and the command-line interface. The company says the model narrows the gap with leading coding systems while cutting the cost and detours of an agent’s work.

Devin Web and Fusion are next: Cognition says SWE-2 is rolling out to those products. The release is aimed at a familiar problem with coding agents: a model can spend a long time reading files, planning, and revisiting the same repository before it makes a useful change.

A cheaper result, by Cognition’s measure

Cognition reports a 50.0% score for SWE-2 on FrontierCode 1.1 Main, compared with 50.9% for Fable 5.1 and 53.3% for GPT-6 Astra. It says SWE-2 was 64% cheaper than Fable 5.1 on that evaluation and cost about one-quarter as much as GPT-6 Astra.

Those numbers describe Cognition’s reported benchmark results, not a settled ranking across every coding workload. The company’s own table also shows a mixed picture: SWE-2 scored 92.8% on Terminal-Bench 2.1, but 27.3% on Terminal-Bench 4. A model can be competitive on one kind of agent task without matching the same rivals everywhere.

Cognition’s reported benchmark results
50.0%FrontierCode 1.1 Main score

Cognition reports SWE-2 at 50.0% on its FrontierCode 1.1 Main evaluation.

64% lowerReported cost versus Fable 5.1

Cognition says SWE-2’s mean rollout cost was 64% lower than Fable 5.1’s on this comparison.

27.3%Terminal-Bench 4 score

Cognition’s published results show a 27.3% score for SWE-2 on Terminal-Bench 4.

Training the agent to move sooner

Cognition says SWE-2 was post-trained from Kimi K3, a 2.8-trillion-parameter model, then tuned with a reinforcement-learning approach that trains multiple reasoning-effort levels in one run. The training objective applies different cost penalties to different effort levels, seeking better solve rates without freely extending each task’s trajectory.

The intended behavior differs by setting. Cognition says medium effort should start work faster on simple and intermediate tasks. High and maximum effort are designed to spend more time planning, inspecting the codebase, and verifying uncertain or complex work.

What Cognition says changed in medium effort

  • Average steps per FrontierCode task fell from 127 with SWE-1.7 to 53 with SWE-2 medium.
  • The median first substantive edit arrived after 18 steps, down from 48 for SWE-1.7.
  • Cognition says SWE-2 medium scored higher than SWE-1.7 while taking 58% fewer turns and costing 81% less on average in that test.

The practical test is accepted work

Fewer exploratory steps could make an agent cheaper to run and easier to supervise. But faster action also puts more weight on whether the model chooses the right files, writes a complete change, and verifies it before stopping. Cognition says SWE-2 shows stronger test coverage and verification discipline in its internal testing; those behavioral claims will need to prove useful in ordinary Devin work.

For now, the release offers a concrete choice rather than a universal performance verdict: use a lower-effort mode intended to act quickly, or spend more on longer planning and verification when the job demands it. The critical measure is not simply a benchmark point, but whether those settings help teams reach dependable accepted changes at a lower cost.

Sources

  1. cognition.comIntroducing SWE-2: Pushing the Pareto Frontier

Loading discussion...