# Ask HN: How are you operating OSS AI infrastructure?

> Source: <https://news.ycombinator.com/item?id=49164517>
> Published: 2026-08-04 05:05:29+00:00

There are many open-source projects across inference, orchestration, observability, vector search, data pipelines, evaluation, and model management. Most are relatively easy to test, but production operation is a different problem.

For those running open-source AI infrastructure in production:

* What open-source AI technologies are you using?

* Where are you running them?

* What challenges are you facing? - cost, GPU availability, security, manageability, or something else

Thanks

Comments URL: [https://news.ycombinator.com/item?id=49164517](https://news.ycombinator.com/item?id=49164517)

Points: 2

# Comments: 0