← Sunday, October 18, 2026ResearchPaper
RoTA-Bench finds a large human-model gap in interactive 3D alignment
On RoTA-Bench's 100-task test set, GPT-5.6-Sol succeeds on 17% of tasks while 20 participants collectively complete the set four times with 100% success; model image-space progress also diverges from pose alignment more often than humans. The benchmark exposes concrete limits in interactive spatial reasoning and control.
- What
- RoTA-Bench evaluates whether vision-language models can align a 3D object's projection with a target silhouette through interactive rotations.
- Method
- GPT-5.6-Sol succeeded on 17% of tasks versus 100% for undergraduate participants; removing interaction history sharply reduced model success.
- Why it matters
- The results highlight challenges in translating visual input into precise 3D control, a key capability for interactive AI systems.
Read on huggingface.co → Code · 4 stars
Discussion
Discussion is not switched on yet. Use Note above to keep your own thoughts on this story.
Headline, summary, brief and diagram are written by a model from the source's own text; the link, byline and numbers come from the source. Read the original before relying on a claim.