← Tuesday, September 29, 2026AgentsBenchmark

WideSWE coding-agent success ranges from 10.83% to 42.50% on cross-repo tasks

huggingface.co by Baoyi Wang et al. Editor score 8/10

WideSWE evaluates 120 real-world tasks across 103 software ecosystems; seven agent configurations achieve 10.83%–42.50% full success. The benchmark exposes coordination and completion failures that single-repository coding-agent evaluations miss.

What

WideSWE evaluates coding agents on real-world tasks that require coordinated changes across multiple repositories.

How

Across seven agent configurations, full task success ranged from 10.83% to 42.50%; failures included omitted or unfinished changes.

Why it matters

The benchmark exposes cross-repository coordination as a distinct challenge for engineers evaluating coding agents.

Read on huggingface.co → Code

Headline, summary, brief and diagram are written by a model from the source's own text; the link, byline and numbers come from the source. Read the original before relying on a claim.