Compilers 2.0: AI as stochastic optimizer
OpenAI hardware team member and XLA creator Sanjoy Das described how AI is being used as a 'stochastic optimizer' to write and optimize kernels, such as the Jalapeño MLA kernel presented at HotChips, arguing that AI-driv…