DFKI

Soofi S 31.6B, an open-weights hybrid Mamba-MoE foundation model with 31.6 billion total parameters and 3.2 billion active per token, was released by the German Soofi consortium after pretraining on r…

The Soofi Consortium, coordinated by KI Bundesverband and funded by the German Federal Ministry for Economic Affairs and Energy, released Soofi S 30B-A3B, an open hybrid Mamba-Transformer Mixture-of-E…