← Wednesday, October 7, 2026Models & trainingRelease
Transformers v5.19.0 adds multimodal EmbeddingGemma 2 and exposes MoE router logits
EmbeddingGemma 2 maps text, images, audio and video into a shared 768-dimensional vector space, with shorter Matryoshka output options; MoE models also expose router logits. The release offers concrete retrieval capabilities and changes that may affect model integrations.
- What
- EmbeddingGemma 2 adds multimodal embeddings to Transformers v5.19.0.
- How
- It encodes text, images, audio, and video into a shared 768-dimensional vector space, with optional embedding truncation and tower disabling.
- Why it matters
- Engineers can reduce memory by disabling unused towers; MoE callers should read router logits from the updated output classes when requested.
Discussion
Discussion is not switched on yet. Use Note above to keep your own thoughts on this story.
Headline, summary, brief and diagram are written by a model from the source's own text; the link, byline and numbers come from the source. Read the original before relying on a claim.
