Ask HN: How are you operating OSS AI infrastructure?

An Ask HN post by a Hacker News user asks the community how they operate open-source AI infrastructure in production, seeking input on the technologies used, deployment locations, and challenges such as cost, GPU availability, security, and manageability. The post has received 2 points and no comments as of now.

There are many open-source projects across inference, orchestration, observability, vector search, data pipelines, evaluation, and model management. Most are relatively easy to test, but production operation is a different problem. For those running open-source AI infrastructure in production: What open-source AI technologies are you using? Where are you running them? What challenges are you facing? - cost, GPU availability, security, manageability, or something else Thanks Comments URL: https://news.ycombinator.com/item?id=49164517 https://news.ycombinator.com/item?id=49164517 Points: 2 Comments: 0