Speeding Up AI: Bringing Google Colossus to PyTorch via GCSFS and Rapid Bucket
Google Cloud announced a performance boost for AI/ML workloads on PyTorch by integrating its Colossus-powered Rapid Storage directly via the fsspec interface and gcsfs. The new Rapid Bucket solution bypasses legacy REST …