{"slug": "freedream-1b-instruct-v1-1-from-scratch-published", "title": "Freedream-1B-Instruct V1.1 from scratch published!", "summary": "An eighth-grade developer using the handle Digilidaahz published Freedream-1B-Instruct V1.1, a 1B-parameter language model trained from scratch on a single RTX 5080 GPU with 65GB of DDR5 memory. On the lm-evaluation-harness at 0-shot, Freedream-1B-Instruct V1.1 scored 28.33% accuracy and 30.46% normalized accuracy on ARC-Challenge (standard error 1.34%), above the 25% random-guessing baseline, though the model still hallucinates on math, facts and code and has had no safety alignment, so it is released for educational and experimental use only. The release credits Hugging Face user @John6666 for finding a tokenizer bug in V1 that mapped '{' to <|unk|>, which is slated for a fix in the planned V2 version pretrained on 50B tokens.", "body_md": "Hello guys, I am a grade 8 student nicknamed Digilidaahz, this is an 1B model trained from scratch with a single rtx5080 and ddr5 65gb. V1.1 is an update from the previous V1 version, where generally the ability of writing and chat improved, but still hallucinations on maths, facts, and code. Special note that this model has not done any kinds of safety allignment, so it is only for educational and experiment purposes.\n\n**Models Performance:**\n\nModel Evaluation (V1.1 Only)\n\nEvaluated using the standard `lm-evaluation-harness` (0-shot setting).\n\n| Benchmark | Metric | Score | Notes | \n|---|---|---|---|\n| **ARC-Challenge** | acc | 28.33% |  | \n| **ARC-Challenge** | acc_norm | **30.46%** | (Standard Error: 1.34%) | \n\nShowing that it has the ability to reason, above the 25% random guessing baseline.\n\nSpecial thanks to [@John6666](https://discuss.huggingface.co/u/john6666)  who found the tokenizer bug (`{` mapping to `<|unk|>`) in the previous version. This bug will be fixed in the upcoming **V2 (50B tokens pretrain)** version of Freedream-1B.\n\nThanks for reading, have a good day", "url": "https://wpnews.pro/news/freedream-1b-instruct-v1-1-from-scratch-published", "canonical_source": "https://discuss.huggingface.co/t/freedream-1b-instruct-v1-1-from-scratch-published/191265#post_1", "published_at": "2026-10-31 11:15:26+00:00", "updated_at": "2026-10-31 11:19:57.762305+00:00", "lang": "en", "topics": ["large-language-models", "ai-research", "machine-learning", "artificial-intelligence"], "entities": ["Freedream-1B-Instruct V1.1", "Digilidaahz", "RTX 5080", "lm-evaluation-harness", "ARC-Challenge", "@John6666", "Hugging Face", "Freedream-1B"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/freedream-1b-instruct-v1-1-from-scratch-published", "markdown": "https://wpnews.pro/news/freedream-1b-instruct-v1-1-from-scratch-published.md", "text": "https://wpnews.pro/news/freedream-1b-instruct-v1-1-from-scratch-published.txt", "jsonld": "https://wpnews.pro/news/freedream-1b-instruct-v1-1-from-scratch-published.jsonld"}}