- DeepInfra's Toronto facility delivers 1.7MW of capacity with 1,000+ NVIDIA Blackwell B300 GPUs — the company's first deployment outside the U.S. [1] - The site is DeepInfra's ninth data center, built on leased capacity at an undisclosed third-party colocation facility [3] - DeepInfra closed a $107 million Series B in May 2026, following an $18 million Series A in April 2025 [3] - The platform now processes nearly five trillion tokens per week across 200+ open-source models [2] - Additional international deployments are under evaluation as enterprise inference demand grows
[2] DeepInfra, a Palo Alto-based GPU inference platform, has opened a 1.7MW data center in Toronto housing more than 1,000 NVIDIA Blackwell B300 GPUs. Announced July 8, the facility is the company's first deployment outside the United States and its ninth data center overall [1].
The Toronto cluster occupies leased capacity at an undisclosed third-party colocation facility, according to Data Center Dynamics [3]. DeepInfra did not name the colocation partner or disclose specific cooling or networking configurations. The deployment is designed to reduce inference latency for Canadian and international enterprise customers
.
[2]The expansion comes two months after DeepInfra closed a $107 million Series B funding round, building on an $18 million Series A raised in April 2025 [3]. Founded in 2022, the company operates a managed inference platform supporting more than 200 open-source AI models and processes nearly five trillion tokens per week
.
[2]## The Facility The Toronto site draws 1.7MW of power and hosts over 1,000 NVIDIA Blackwell B300 GPUs. The B300 is NVIDIA's latest Blackwell-architecture accelerator, designed for higher inference throughput and improved energy efficiency compared to previous Hopper-generation hardware [1].
DeepInfra owns and operates its GPU infrastructure but leases the underlying data center space. The specific colocation partner, cooling system, and network topology were not disclosed. The company holds SOC 2 and ISO 27001 certifications and maintains a zero data retention policy for enterprise customers [2].
Why Toronto #
Canada's largest city offers proximity to a growing base of enterprise AI adopters, along with a relatively abundant power grid and established colocation ecosystem. For DeepInfra, the Toronto deployment addresses latency concerns for customers who need inference endpoints geographically closer to Canadian and cross-border users [2].
The move also positions DeepInfra to serve enterprises with data residency requirements that mandate processing within Canadian borders. The company's zero data retention policy and compliance certifications are designed to address those concerns [2].
Operator Background #
DeepInfra was founded in 2022 and is headquartered in Palo Alto, California. The company competes in the neocloud inference market alongside players like Together AI, Fireworks AI, and Groq, offering API-based access to open-source models at scale [1].
The $107 million Series B closed in May 2026 significantly expanded DeepInfra's capital base from its earlier $18 million Series A. The company has not disclosed its total valuation or annual revenue [3].
With nine data centers now operational, DeepInfra has built out its infrastructure rapidly. The platform processes roughly five trillion tokens weekly, a volume that underscores the scale of enterprise inference demand the company is capturing [2].
Inference Market Context #
The Toronto deployment reflects a broader industry shift from training-dominated GPU demand toward inference workloads. McKinsey research cited in DeepInfra's announcement projects inference will account for more than 40% of total data center demand by 2030, growing at a roughly 35% compound annual rate [1].
For GPU suppliers, the trend is significant. NVIDIA's Blackwell architecture is positioned as the primary platform for next-generation inference infrastructure. NVIDIA shares traded at $203.53 on July 11, giving the company a market capitalization of approximately $4.9 trillion [4]. DeepInfra indicated that additional international data center deployments are under evaluation, though no specific locations or timelines were disclosed [2].
Companies mentioned #
Further sources #
[1] StorageReview, "DeepInfra Opens 1.7MW Toronto Data Center With 1,000+ NVIDIA B3… ↗ [2] GlobeNewswire, "DeepInfra Expands AI Inference Capacity with First Internationa… ↗
[[3] Data Center Dynamics, "DeepInfra deploys AI inference cloud in Toronto, Canada,… ↗](https://www.datacenterdynamics.com/en/news/deepinfra-deploys-ai-inference-cloud-in-toronto-canada-data-center/)
[[4] NVIDIA stock quote via FMP, July 11, 2026 ↗](https://financialmodelingprep.com)
The stories that matter, in one email. Free — unsubscribe anytime.