{"slug": "ask-hn-how-are-you-operating-oss-ai-infrastructure", "title": "Ask HN: How are you operating OSS AI infrastructure?", "summary": "An Ask HN post by a Hacker News user asks the community how they operate open-source AI infrastructure in production, seeking input on the technologies used, deployment locations, and challenges such as cost, GPU availability, security, and manageability. The post has received 2 points and no comments as of now.", "body_md": "There are many open-source projects across inference, orchestration, observability, vector search, data pipelines, evaluation, and model management. Most are relatively easy to test, but production operation is a different problem.\n\nFor those running open-source AI infrastructure in production:\n\n* What open-source AI technologies are you using?\n\n* Where are you running them?\n\n* What challenges are you facing? - cost, GPU availability, security, manageability, or something else\n\nThanks\n\nComments URL: [https://news.ycombinator.com/item?id=49164517](https://news.ycombinator.com/item?id=49164517)\n\nPoints: 2\n\n# Comments: 0", "url": "https://wpnews.pro/news/ask-hn-how-are-you-operating-oss-ai-infrastructure", "canonical_source": "https://news.ycombinator.com/item?id=49164517", "published_at": "2026-08-04 05:05:29+00:00", "updated_at": "2026-08-04 05:22:32.282175+00:00", "lang": "en", "topics": ["ai-infrastructure", "ai-tools", "ai-products"], "entities": ["Hacker News"], "alternates": {"html": "https://wpnews.pro/news/ask-hn-how-are-you-operating-oss-ai-infrastructure", "markdown": "https://wpnews.pro/news/ask-hn-how-are-you-operating-oss-ai-infrastructure.md", "text": "https://wpnews.pro/news/ask-hn-how-are-you-operating-oss-ai-infrastructure.txt", "jsonld": "https://wpnews.pro/news/ask-hn-how-are-you-operating-oss-ai-infrastructure.jsonld"}}