{"slug": "qwenfant-train-big-character-level-babylms-on-concise-parallel-text", "title": "Qwenfant: Train Big Character-level BabyLMs on Concise Parallel Text", "summary": "A Qwen3-based model named Qwenfant ranks 1st in the Multilingual track of the 2026 BabyLM Challenge, according to an arXiv submission by Lukas Edman and Alexander Fraser. The team improved on its baseline using data summarized and translated by an LLM, then added two changes: a larger model and a character-level vocabulary, both of which required LoRA-style fine-tuning to reach full potential. The work, arXiv:2610.19294v1, argues higher-quality training data can come from synthetic sources.", "body_md": "# Qwenfant: Train Big Character-level BabyLMs on Concise Parallel Text\n\nBy Lukas Edman, Alexander FraserSource: \n\n[arXiv cs.CL](https://arxiv.org/list/cs.CL/recent)\narXiv:2610.19294v1 Announce Type: new \nAbstract: This work concerns our submission for the Multilingual track of the 2026 BabyLM Challenge. We improve on our baseline using data that has been summarized and translated by an \n\n[LLM](https://www.machinebrief.com/glossary/llm), showing that higher-quality data can come from synthetic sources. We further improve with 2 simple changes: using a larger model, and using a character-level vocabulary. Both of these changes require[LoRA](https://www.machinebrief.com/glossary/lora)-style[fine-tuning](https://www.machinebrief.com/glossary/fine-tuning)for realizing their full potential. We dub our final Qwen3-based model Qwenfant, which, at the time of submission, ranks 1st in the Multilingual track.\nGet AI news in your inbox\n\nDaily digest of what matters in AI.", "url": "https://wpnews.pro/news/qwenfant-train-big-character-level-babylms-on-concise-parallel-text", "canonical_source": "https://www.machinebrief.com/news/qwenfant-train-big-character-level-babylms-on-concise-parall-ha4y", "published_at": "2026-10-15 04:00:00+00:00", "updated_at": "2026-10-15 05:52:37.265017+00:00", "lang": "en", "topics": ["large-language-models", "natural-language-processing", "ai-research", "machine-learning"], "entities": ["Qwenfant", "Qwen3", "BabyLM Challenge", "Lukas Edman", "Alexander Fraser", "arXiv", "LoRA"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/qwenfant-train-big-character-level-babylms-on-concise-parallel-text", "markdown": "https://wpnews.pro/news/qwenfant-train-big-character-level-babylms-on-concise-parallel-text.md", "text": "https://wpnews.pro/news/qwenfant-train-big-character-level-babylms-on-concise-parallel-text.txt", "jsonld": "https://wpnews.pro/news/qwenfant-train-big-character-level-babylms-on-concise-parallel-text.jsonld"}}