{"slug": "cstutorbench-benchmarking-small-language-models-as-tutors-for-block-based", "title": "CSTutorBench: Benchmarking Small Language Models as Tutors for Block-Based Programming", "summary": "Researchers introduced CSTutorBench, a benchmark to evaluate small language models as tutors for block-based programming in VEX VR robotics. Testing 11 models revealed that instruction-tuning approach predicts tutoring quality better than parameter count, and targeted prompt revisions improved scores for most models.", "body_md": "arXiv:2607.05571v1 Announce Type: new\nAbstract: Large language models are increasingly explored as AI tutors, yet deploying them in K-12 settings raises concerns around privacy, cost, and reliance on proprietary models. Small language models (SLMs) offer a promising alternative, but selecting the right model for a specific educational context remains difficult, particularly when the target domain, such as block-based programming, is largely absent from model training data. We introduce CSTutorBench, a benchmark for evaluating language models as CS tutors in VEX VR, a block-based robotics environment. The benchmark comprises 17 scenario-based questions scored against a pedagogical rubric grounded in established tutoring and feedback research, with a human-in-the-loop LLM-as-judge pipeline for evaluation. Preliminary findings across 11 models (4B-120B parameters) reveal that models perform well on surface-level criteria such as vocabulary and tone but struggle with deeper pedagogical behaviors, particularly avoiding answer leakage and engaging with student debugging histories. In our sample, model family and instruction-tuning approach appear to be better predictors of tutoring quality than parameter count alone, though the small number of models limits the strength of this conclusion. A targeted prompt revision grounded in recent educational prompt engineering research improved scores for 10 of 11 models. These results underscore the value of context-specific, pedagogically grounded benchmarks for SLM selection in educational deployment.", "url": "https://wpnews.pro/news/cstutorbench-benchmarking-small-language-models-as-tutors-for-block-based", "canonical_source": "https://arxiv.org/abs/2607.05571", "published_at": "2026-07-08 04:00:00+00:00", "updated_at": "2026-07-08 04:04:19.625716+00:00", "lang": "en", "topics": ["large-language-models", "ai-research", "ai-tools", "ai-agents"], "entities": ["CSTutorBench", "VEX VR", "arXiv"], "alternates": {"html": "https://wpnews.pro/news/cstutorbench-benchmarking-small-language-models-as-tutors-for-block-based", "markdown": "https://wpnews.pro/news/cstutorbench-benchmarking-small-language-models-as-tutors-for-block-based.md", "text": "https://wpnews.pro/news/cstutorbench-benchmarking-small-language-models-as-tutors-for-block-based.txt", "jsonld": "https://wpnews.pro/news/cstutorbench-benchmarking-small-language-models-as-tutors-for-block-based.jsonld"}}