← Saturday, October 17, 2026AgentsPaper

OpenGCUA moves computer-use observations and task decisions into the model

huggingface.co by Hanzhang Zhou et al. Editor score 8/10

OpenGCUA’s first release uses code execution for computer interaction and transfers selected observation and task-state decisions from fixed harness rules to the model; its full configuration improves scores across all eight evaluated models. The open stack offers concrete harness design choices for computer-use agents.

What
OpenGCUA is an open-stack project for generalist computer-use agents that work through visual and programmatic interfaces.
Method
Its design uses code execution for intermediate results and transfers some observation and task-state decisions from fixed harness rules to the model.
Why it matters
On OSWorld-v2, the full configuration raised mean partial score by 19.6 points and reduced reported steps per task by 53% versus batched GUI-only execution.
observe or act operations execute code intermediate results model visualinterfaces programmaticinterfaces Code execution
The model uses computer interfaces and code execution, with results informing later operations. Sketched from the article's own text.

Discussion

Discussion is not switched on yet. Use Note above to keep your own thoughts on this story.

Headline, summary, brief and diagram are written by a model from the source's own text; the link, byline and numbers come from the source. Read the original before relying on a claim.

Your note

Private to you. Stored in this browser, and synced to your account when you are signed in.