← Sunday, October 4, 2026InferencePaper

HeteroFold transfers KV caches across model families without prefill

huggingface.co by Vincent-Daniel Yun et al. Editor score 8/10

HeteroFold maps and calibrates a frozen sender's KV cache for a frozen receiver, handling differences in tokenization and model structure. At 32K context, one reported transfer is 10.7 times faster than native prefill and 1.18–1.47 times faster than prior prefill-free baselines.

What

- HeteroFold transfers KV caches across model families without requiring receiver prefill, while keeping sender and receiver models frozen.

Method

- It aligns model structures, maps the sender cache into the receiver space, and calibrates it to preserve receiver behavior.

Why it matters

- At 32K context, one reported transfer was 10.7 times faster than Native Prefill, reducing redundant work in multi-agent systems.

Read on huggingface.co →

Headline, summary, brief and diagram are written by a model from the source's own text; the link, byline and numbers come from the source. Read the original before relying on a claim.