GPT-1

In a blog post, an unnamed author argues that AI performance will not plateau, countering the common belief that progress is driven by brute-force scale with diminishing returns. The author contends t…

Researchers at arXiv improved the Huth et al. fMRI encoding baseline by expanding voxel selection to 15K and substituting GPT-2 medium for GPT-1, achieving mean METEOR = 0.149 and BLEU-1 = 0.200 for s…

GPT models are decoder-only transformers that generate text by predicting the next token one at a time, conditioning each new prediction on all previous tokens. Unlike BERT, which reads entire sequenc…