01:07
2026-07-25
discuss.huggingface.co
large-language-models
Last layer hidden state: GPT2
A user investigating GPT-2's last hidden state in Hugging Face Transformers 3.1.0 found that the final hidden state (layer 12) is reported after the last decoder block but before the final LayerNorm (…