{"slug": "how-are-you-operating-ai-infrastructure-in-production", "title": "How are you operating AI infrastructure in production?", "summary": "A Hacker News user asked the community how they operate open-source AI infrastructure in production, seeking recommendations on tools for inference, orchestration, observability, vector search, data pipelines, evaluation, and model management, as well as insights on self-hosting versus managed services and challenges beyond prototyping. The post received 1 point and no comments.", "body_md": "There are many open-source projects across inference, orchestration, observability, vector search, data pipelines, evaluation, and model management. Most are relatively easy to test, but production operation is a different problem.\n\nFor those running open-source AI infrastructure in production:\n\n- What are you running, for what workload, and would you recommend?\n\n- Do you operate yourself versus consume as a managed service?\n\n- Have you replaced or abandoned any tools because they were too difficult or expensive to operate?\n\n- What problems only appeared after moving beyond the prototype stage?\n\n- Anything that you would do differently if rebuilding the stack today?\n\nThanks\n\nComments URL: [https://news.ycombinator.com/item?id=49163280](https://news.ycombinator.com/item?id=49163280)\n\nPoints: 1\n\n# Comments: 0", "url": "https://wpnews.pro/news/how-are-you-operating-ai-infrastructure-in-production", "canonical_source": "https://news.ycombinator.com/item?id=49163280", "published_at": "2026-08-04 01:05:25+00:00", "updated_at": "2026-08-04 01:22:23.536840+00:00", "lang": "en", "topics": ["ai-infrastructure", "mlops", "ai-tools"], "entities": ["Hacker News"], "alternates": {"html": "https://wpnews.pro/news/how-are-you-operating-ai-infrastructure-in-production", "markdown": "https://wpnews.pro/news/how-are-you-operating-ai-infrastructure-in-production.md", "text": "https://wpnews.pro/news/how-are-you-operating-ai-infrastructure-in-production.txt", "jsonld": "https://wpnews.pro/news/how-are-you-operating-ai-infrastructure-in-production.jsonld"}}