Soofi S 30B-A3B

A German research consortium released Soofi S 30B-A3B, an open language model trained on Deutsche Telekom's cloud infrastructure in Munich. The model uses a hybrid architecture that activates only a f…

Researchers released Soofi S 30B-A3B, a sovereign open-source foundation model for German and English that uses a Mixture-of-Experts hybrid Mamba Transformer design, activating only 3B of 30B paramete…