← Saturday, October 17, 2026InferenceDeep dive

Muse Spark Open reaches 36 tokens per second across four Mac Studios with MLX

machinelearning.apple.com 13 min read Editor score 8/10

Apple reports over 36 tokens per second for the nearly trillion-parameter Muse Spark Open on four Mac Studios, using MLX and RDMA over Thunderbolt at an 8,192-token context. The setup offers a concrete reference for distributed inference on unified-memory hardware.

What: Apple’s MLX framework runs the nearly trillion-parameter Muse Spark Open model on a cluster of four Mac Studios.
How: The setup uses RDMA over Thunderbolt to scale across Macs; the post reports over 36 tokens per second on four Mac Studios.
Why it matters: Local inference on unified-memory hardware gives engineers another way to experiment with large models on their own infrastructure.

MLX distributes inference across Mac Studio computers using RDMA over Thunderbolt. Sketched from the article's own text.

Read on machinelearning.apple.com → Hacker News · 144 comments

Discussion

Discussion is not switched on yet. Use Note above to keep your own thoughts on this story.

Headline, summary, brief and diagram are written by a model from the source's own text; the link, byline and numbers come from the source. Read the original before relying on a claim.