Luc Julia

Luc Julia claims large language models achieve only 64% reliability on complex reasoning tasks, a figure the author disputes based on hands-on testing. The author argues that models like Claude 3.5 So…

A reconstruction of the reasoning benchmark behind Luc Julia's repeated claim that large language models are 'relevant 64% of the time' shows the figure comes from a single sentence in Bang et al. (20…