← Wednesday, October 7, 2026InferenceTool

OpenTPU runs modern models on an FPGA accelerator with bit-exact simulator output

github.com 8 min read Editor score 8/10

OpenTPU runs ten models with real weights on a Kintex-7 FPGA and produces tokens matching its simulator bit for bit; the project reports decode and prefill throughput. Its end-to-end hardware, compiler, and software stack offers a concrete way to study inference accelerators.

What

openTPU is an open-source AI accelerator that runs modern models on an FPGA.

How

Its monorepo includes hardware design, an instruction set, a bit-exact simulator, a kernel language and compiler, and host software; FPGA output matched the simulator bit for bit.

Why it matters

The end-to-end project lets engineers inspect accelerator implementation from a Python matmul down to the wires.

Read on github.com → Hacker News · 331 comments

Headline, summary, brief and diagram are written by a model from the source's own text; the link, byline and numbers come from the source. Read the original before relying on a claim.