# From text to tokens to intelligent answers—understanding tokens helps you understand how Generative AI really works

> Source: <https://discuss.huggingface.co/t/from-text-to-tokens-to-intelligent-answers-understanding-tokens-helps-you-understand-how-generative-ai-really-works/179045#post_1>
> Published: 2026-08-21 07:28:19+00:00

Hugging Face Forums
From text to tokens to intelligent answers—understanding tokens helps you understand how Generative AI really works
Spaces
sebastianchris
August 21, 2026, 7:28am
1
HQDZcwnbIAAWyFJ
547×507 151 KB
Related topics
Topic
Replies
Views
Activity
Break down AI into what really matters!
Spaces
0
10
August 21, 2026
Science and education and everything
Models
1
256
December 1, 2023
Answer template generation from question
🤗Transformers
0
306
November 11, 2023
[google/flan-t5-xl] Scores in each result
🤗Transformers
0
260
December 27, 2022
PigeonChat — AI-chat
🔒 Gradio
0
413
August 24, 2023