Meta has released MetaRoCE, a new RDMA transport protocol designed for AI workloads on commodity Ethernet, through the Open Compute Project (OCP), including a specification, reference software impleme…
NVIDIA's NVLink and NVSwitch technologies form a scale-up fabric that connects GPUs tightly enough to behave as a single machine, contrasting with scale-out fabrics like InfiniBand and RoCE that link …
LongCat-2.0, a 1.6 trillion parameter Mixture of Experts (MoE) architecture, introduces a hierarchical routing mechanism and hybrid parallelism to scale model capacity while maintaining deployment fea…
Canonical published an explainer on RDMA over Converged Ethernet (RoCE), a technology that runs the RDMA programming model over standard Ethernet networks to bypass the kernel and reduce CPU involveme…
NVIDIA's DGX Spark workstation can be linked via a single 200 GbE cable to form a two-node AI cluster, aggregating 256 GB of unified memory to run frontier-scale models like Llama 3.1 405B locally. Th…