# IBM signs $240M deal with Together AI to build large-scale inference cluster

> Source: <https://cryptobriefing.com/ibm-together-ai-240m-inference-deal/>
> Published: 2026-08-11 12:15:54+00:00

Via taptwicedigital.com

# IBM signs $240M deal with Together AI to build large-scale inference cluster

The partnership will deploy GPU-accelerated AI inference infrastructure on IBM Cloud by 2027, marking a major bet on enterprise AI workloads.

IBM is putting $240 million behind a bet that enterprise AI inference, the process of actually running trained models at scale, is where the real money is heading. The company signed a deal with Together AI to deploy a large-scale inference cluster on IBM Cloud, with full deployment targeted by 2027.

The partnership pairs IBM’s enterprise cloud infrastructure with Together AI’s GPU-accelerated platform, which specializes in high-performance model training and inference. Together AI claims its infrastructure can deliver up to 2x faster inference times compared to standard setups, along with meaningful cost reductions.

## Why inference matters more than training now

IBM’s move here is essentially an infrastructure play. Rather than trying to build the models themselves, they’re positioning IBM Cloud as the place where enterprises run them.

Together AI, founded in 2020, has carved out a niche as an infrastructure layer for open-source AI models. The company provides the tooling and optimized compute that lets organizations deploy models without building their own GPU clusters from scratch. For IBM, bringing that capability in-house means enterprise clients get access to high-performance inference without leaving the IBM ecosystem.

## IBM’s broader AI infrastructure push in 2026

In May 2026, IBM Cloud launched Red Hat AI Inference services, which include governance features designed for enterprises running open-source models.

IBM has also been deepening its relationship with NVIDIA and investing in sovereign cloud solutions, essentially building cloud infrastructure that meets data residency requirements for governments and highly regulated sectors. The Together AI deal adds another piece to this puzzle, giving IBM a credible answer when enterprise buyers ask about inference performance and cost efficiency.

## What Together AI gets out of this

For Together AI, this is a significant validation moment. A long-term partnership with IBM gives Together AI a direct pipeline to enterprise customers who already live inside IBM’s ecosystem.

It also provides revenue visibility through 2027, which matters in a market where startups can see demand fluctuate dramatically based on the latest model architecture trends.

Together AI has built its platform around supporting various open-source models, and IBM’s Red Hat heritage means there’s a natural philosophical alignment. Both companies have economic incentives to make open models viable for enterprise use, since that’s where their respective business models generate revenue.

Analysts have noted the absence of immediate stock market reactions or expert commentary regarding the financial implications of this partnership as of August 2026. The real test comes when the inference cluster is live and processing production workloads.

**Disclosure:** This article was edited by Editorial Team. For more information on how we create and review content, see our

[Editorial Policy](https://cryptobriefing.com/editorial-policy/).
