Ask HN: How are you operating OSS AI infrastructure?

wpnews.pro

cd /news/ai-infrastructure/ask-hn-how-are-you-operating-oss-ai-… · home › topics › ai-infrastructure › article

[ARTICLE · art-85604] src=news.ycombinator.com ↗ pub=2026-08-04T05:05Z topic=ai-infrastructure verified=true sentiment=· neutral

Ask HN: How are you operating OSS AI infrastructure?

An Ask HN post by a Hacker News user asks the community how they operate open-source AI infrastructure in production, seeking input on the technologies used, deployment locations, and challenges such as cost, GPU availability, security, and manageability. The post has received 2 points and no comments as of now.

read1 min views2 publishedAug 4, 2026

There are many open-source projects across inference, orchestration, observability, vector search, data pipelines, evaluation, and model management. Most are relatively easy to test, but production operation is a different problem.

For those running open-source AI infrastructure in production:

* What open-source AI technologies are you using?

* Where are you running them?

* What challenges are you facing? - cost, GPU availability, security, manageability, or something else

Thanks

Comments URL: [https://news.ycombinator.com/item?id=49164517](https://news.ycombinator.com/item?id=49164517)

Points: 2

source & further reading

news.ycombinator.com — original article Show CVBoosta:Resume Optimizer that tailors your resume to every job How are you operating AI infrastructure in production? Ask HN: Does AI research need "world models" more than bigger LLMs?

~/api · this article 200

$curl api.wpnews.pro/v1/news/ask-hn-how-are-you-opera…