Scale Before the Spike: Predictive Autoscaling for GPU Workloads on Kubernetes
A developer's team at an unnamed company built a predictive autoscaling system for GPU workloads on Kubernetes after a production outage caused by reactive scaling. The system uses a Bi-LSTM model emb…