There are many open-source projects across inference, orchestration, observability, vector search, data pipelines, evaluation, and model management. Most are relatively easy to test, but production operation is a different problem.
For those running open-source AI infrastructure in production:
* What open-source AI technologies are you using?
* Where are you running them?
* What challenges are you facing? - cost, GPU availability, security, manageability, or something else
Thanks
Comments URL: [https://news.ycombinator.com/item?id=49164517](https://news.ycombinator.com/item?id=49164517)
Points: 2
source & further reading
news.ycombinator.com — original article
Show HN: Prohibition of Nuclear Launch Automation
Ask HN: What happens when Claude Code goes away?
Show HN: Bastionskill – scan an AI agent skill for malicious code