cd/entity/Cognitive Categorical Transformer· home› entities› Cognitive Categorical Transformer

grep -l @cognitive categorical transformer /news/*.json | wc -l → 1

Cognitive Categorical Transformer

mentions 1 type Person feed RSS

// recent coverage 1 mentions

04:00

2026-05-29

arxiv.org

large-language-models

The Cognitive Categorical Transformer: Category-Theoretic Inductive Biases for Language Modeling

A new 306M-parameter language model architecture, the Cognitive Categorical Transformer (CCT), achieved 21.27 validation perplexity on WikiText-103, a 12% relative improvement over a fine-tuned GPT-2 …

// co-occurs with top 3 entities

GPT-2 Small 1 WikiText-103 1 GPT-2 Large 1

// topics top 5 topics

large language models 1 natural language processing 1 artificial intelligence 1 machine learning 1 neural networks 1