{"slug": "speeding-up-ai-bringing-google-colossus-to-pytorch-via-gcsfs-and-rapid-bucket", "title": "Speeding Up AI: Bringing Google Colossus to PyTorch via GCSFS and Rapid Bucket", "summary": "Google Cloud announced a performance boost for AI/ML workloads on PyTorch by integrating its Colossus-powered Rapid Storage directly via the fsspec interface and gcsfs. The new Rapid Bucket solution bypasses legacy REST APIs using persistent gRPC bidirectional streams, achieving up to 4.8x faster reads and 2.8x faster writes, resulting in a 23% reduction in total training time for a benchmark workload. Developers can leverage these gains without code changes by simply switching to a Rapid Bucket and updating the `gcsfs` library.", "body_md": "Today, we are announcing a major performance boost for AI/ML workloads using the PyTorch ecosystem on Google Cloud. By integrating Rapid Storage, powered by Google’s Colossus storage architecture, directly with PyTorch via the industry-standard fsspec\ninterface, we are enabling researchers and developers to keep their GPUs busier than ever before.\nAs model sizes grow, data loading and checkpointing often become the primary bottlenecks in training. Data preparation activities to train models involve fetching and processing terabytes and petabytes of data from remote storage mechanisms like object storage. Standard REST-based storage access can struggle to meet the extreme throughput and low-latency requirements of modern distributed training, wasting valuable GPU resources.\nOur new Rapid Bucket solution provides high-performance object storage in dedicated zonal buckets. By bypassing legacy REST APIs and utilizing persistent gRPC bidirectional streams, we’ve brought the power of Colossus, filesystem stateful protocols that power YouTube and Google Search, directly to the PyTorch ecosystem.\nfsspec\nis the pervasive Pythonic interface for file systems in the PyTorch ecosystem. It is already used for:\nThere are various backend implementations of fsspec for many different storage systems, which can all be integrated under a single layer, eliminating the need to write specific code for each backend. By integrating Rapid Storage with gcsfs\n(the Google Cloud Storage implementation of fsspec), developers can leverage speed gains provided by Rapid with a simple fsspec.open()\ncall — no complex code rewrites required.\nTo achieve a performance boost with Rapid Buckets, we optimized the entire data path:\nus-central1-a\n), we eliminate cross-zone latency. Prior to Rapid buckets, data in a regional bucket and compute(accelerators) can be in different zones and access the data induced latency.fsspec\nAPI while entirely upgrading internal traffic from HTTP to BiDi-gRPC for Rapid buckets. By adding bucket-type auto-detection to gcsfs, PyTorch and other fsspec\nclients transparently utilize Rapid with zero manual configuration.A dataset of 134M rows totaling around 451GB was loaded onto 16 GKE nodes, each containing eight A4 GPUs. Training was conducted in 100 steps, with a checkpoint after every 25 steps using PyTorch Lightning. We benchmarked the performance of total training time, including the data load times, and we observed a performance gain of 23% using Rapid Bucket compared with Standard regional bucket.\nMicrobenchmarking — that is, measuring the performance of a building block like I/O or resource usage — confirms these gains. Throughput improved by 4.8x for reads (both sequential and random) and 2.8x for writes. These tests used 16MB IO sizes across 48 processes. You can find more details at GCSFS-performance-benchmarks.\nGetting started with GCSFS on Rapid Bucket is easy. Your existing code and scripts remain the same. You just need to change the bucket to a Rapid Bucket to take advantage of the performance boost.\nTo install:\nRapid Bucket integration is available from version 2026.3.0.\npip install gcsfs\nCode sample to read/write from GCS Rapid:\nimport gcsfs\n# Initialize the filesystem\nfs = gcsfs.GCSFileSystem()\n# Writing to a Rapid bucket\nwith fs.open('my-zonal-rapid-bucket/data/checkpoint.pt', 'wb') as f:\nf.write(b\"model data...\")\n# Appending to an existing object (Native Rapid feature)\nwith fs.open('my-zonal-rapid-bucket/data/checkpoint.pt', 'ab') as f:\nf.write(b\"appended data...\")", "url": "https://wpnews.pro/news/speeding-up-ai-bringing-google-colossus-to-pytorch-via-gcsfs-and-rapid-bucket", "canonical_source": "https://developers.googleblog.com/speeding-up-ai-bringing-google-colossus-to-pytorch-via-gcsfs-and-rapid-bucket/", "published_at": "2026-05-20 03:12:20.625553+00:00", "updated_at": "2026-05-20 03:12:24.647695+00:00", "lang": "en", "topics": ["artificial-intelligence", "machine-learning", "cloud-computing", "developer-tools", "data"], "entities": ["Google Cloud", "PyTorch", "Colossus", "Rapid Storage", "Rapid Bucket", "gcsfs", "fsspec", "Google"], "alternates": {"html": "https://wpnews.pro/news/speeding-up-ai-bringing-google-colossus-to-pytorch-via-gcsfs-and-rapid-bucket", "markdown": "https://wpnews.pro/news/speeding-up-ai-bringing-google-colossus-to-pytorch-via-gcsfs-and-rapid-bucket.md", "text": "https://wpnews.pro/news/speeding-up-ai-bringing-google-colossus-to-pytorch-via-gcsfs-and-rapid-bucket.txt", "jsonld": "https://wpnews.pro/news/speeding-up-ai-bringing-google-colossus-to-pytorch-via-gcsfs-and-rapid-bucket.jsonld"}}