RTX 6000 Ada

DeepSeek released V4 Flash, a 284B-parameter MoE model with 13B active parameters per token, featuring FP4+FP8 hybrid attention and 1M native context. The open-weight model, available under MIT licens…

The author quit their FAANG job in 2024 to become an independent researcher and built a $48K GPU server called "grumbl" with six RTX 6000 Ada GPUs. They chose these GPUs over A100s and H100s based on …