Nvidia is developing its proprietary CMX platform to improve AI inference economics by offloading KV cache to SSDs via BlueField DPUs, while the open CXL standard offers a vendor-agnostic alternative.…
DDN launched the A1400X3M storage appliance, delivering up to 160 million IOPS per rack, and introduced KV Cache software integrated with Nvidia Dynamo to accelerate AI inference. The new hardware and…
SGLang achieved a 5x throughput improvement for serving DeepSeek-V4 on NVIDIA GB300 hardware since its Day-0 launch, reaching ~11,200 tok/s/GPU at 50 tok/s/user through kernel and runtime optimization…
Fortinet announced an expanded integration of its FortiAIGate solution with Nvidia's AI platforms on May 12, embedding zero-trust security directly into Nvidia's Blackwell and Hopper GPUs to protect a…
IBM, Supermicro, and Nvidia engineers published an IBM Redbook detailing a reference architecture that uses IBM Storage Scale Erasure Coding Edition on Supermicro servers as an external shared storage…
NVIDIA has introduced Dynamo Snapshot, a checkpoint/restore approach for AI inference workloads on Kubernetes that reduces cold-start latency from minutes to near-instantaneous startup times. The solu…