Introducing EmbeddingGemma 2! 🚀 Our lightweight, multimodal embedding model maps text, code, images, video, and audio into a single, unified embedding space. Optimized for on-device use cases, it features:
- 740M parameter form factor with modular encoders
- Flexible dimension sizes (768dim-128dim) via Matryoshka Representation Learning (MRL)
- 8K context window (4x larger than text-only EmbeddingGemma)
- A commercially permissive Apache 2.0 license
00:00
source & further reading
twitter.com — original article