← Thursday, October 1, 2026AgentsPaper

Agent Error Dataset contains 50,228 diagnosis pairs across 33 environments

huggingface.co by Kunlun Zhu et al. Editor score 8/10

The dataset preserves traces and execution metadata, and matched replays show proposed corrections raising verifier pass rates from 18.4% to 51.1%. The evidence-backed error pipeline offers a concrete way to turn agent failures into diagnosis and recovery training data.

What

The Agent Error Dataset contains 50,228 error-diagnosis pairs from 9,961 tasks across 33 environments, 19 harness families, and 23 policy models.

Method

Its AET pipeline collects failures, generates diagnoses and proposed corrections, and checks them against recorded evidence; replay compares corrections with retries.

Why it matters

Across 3,062 matched replay pairs, first-proposal corrections raise verifier pass rates from 18.4% to 51.1%, supporting evidence-checked agent recovery.

Read on huggingface.co →

Headline, summary, brief and diagram are written by a model from the source's own text; the link, byline and numbers come from the source. Read the original before relying on a claim.