Your Language Model Cannot Say Certain Sentences.

A new article argues that certain next-word predictions in language models are mathematically impossible, comparing the limitation to a piano missing keys. The piece explores fundamental constraints in AI language generation.