The good, the bad, and the AI…

Fireworks AI co-founder Benny Chen joins Ryan to discuss what makes an AI application good or bad, balancing qualitative signals with quantitative metrics in AI evaluation, and how open-source protocols and community efforts are setting standards for AI evaluation.

Ryan welcomes Benny Chen, co-founder of Fireworks AI, to the show to explore what actually makes an AI application good or not, how to balance qualitative signals with quantitative metrics when evaluating AI, and how open-source eval protocols and community efforts are setting the standard for AI evaluation.