Ask HN: What are you using for LLM inference in production?

| |||||||||||| 2 points by | I started with OpenAI back in the GPT-3 days, then bounced between the major labs (with a brief interlude with Workers AI). I eventually settled on Gemini 2.5 Flash Lite as my workhorse, using it against structured data/vectors as a chatbot. It was cheap, good enough, and most importantly, Groq seems promising but developer access hasn't been available for months. I'd love to use open source, but I never found anything comparable (cost/performance/speed). Would love to hear your suggestions. | ||||||||||| Applications are open till July 27. |