← Wednesday, September 30, 2026AgentsPaper

EngiWorld finds frontier agents struggle with professional engineering tasks

huggingface.co by Hongcheng Gao et al. Editor score 8/10

EngiWorld evaluates 1,301 tasks across six engineering domains and 26 software platforms; the strongest model scores 44.3, and only 3.6% of multi-software attempts succeed. Its artifact-based verification offers a concrete way to measure agent reliability in consequential workflows.

What

EngiWorld benchmarks agents on 1,301 expert-curated tasks across six engineering domains and 26 professional software platforms.

Method

Its artifact-centric evaluation checks geometric validity, physical feasibility, and rule compliance; the strongest tested model scores 44.3, with 3.6% of multi-software attempts succeeding.

Why it matters

The benchmark exposes the gap between general-purpose computer use and reliable automation of end-to-end professional engineering work.

Read on huggingface.co → Code · 17 stars

Headline, summary, brief and diagram are written by a model from the source's own text; the link, byline and numbers come from the source. Read the original before relying on a claim.