aleph-alpha-inference

Aleph Alpha's Kolibri-1, a 78-billion-parameter mixture-of-experts model with about 3.46B active parameters per token, requires roughly 78GB of FP8 weights and real-world serving of about 140GB of VRA…