iLLaDA

mentions 2 type Organization feed RSS

// recent coverage 2 mentions

07:48

2026-06-27

the-decoder.com

large-language-models

ByteDance's "iLLaDA" is a diffusion language model that keeps up with Qwen2.5

ByteDance and Renmin University researchers released iLLaDA, an 8B diffusion language model that matches Qwen2.5 on base benchmarks but lags after fine-tuning. The model, trained from scratch on 12 tr…

04:00

2026-06-25

arxiv.org

large-language-models

Improved Large Language Diffusion Models

Researchers introduced iLLaDA, an 8B masked diffusion language model trained from scratch with fully bidirectional attention, scaling pre-training to 12T tokens and fine-tuning on a 25B-token instruct…

// co-occurs with top 8 entities

LLaDA 2 Qwen2.5 7B 1 arXiv 1 ML-GSAI 1 ByteDance 1 Renmin University 1 Qwen2.5 1 Google DeepMind 1

// topics top 4 topics

large language models 2 generative ai 2 ai research 2 natural language processing 1