{"slug": "intel-258v-what-s-the-point-ai", "title": "Intel 258v - What's the point?(AI)", "summary": "A user testing local AI model performance on the Samsung Galaxy Book 5 360 Pro with an Intel 258v processor reports disappointing results, achieving only about 30 tokens per second decode and 200 tokens per second prefill when running a Qwen 3.6 35B A3B model via llama.cpp with Vulkan, while noting that Intel's OpenVINO toolkit remains immature and underperforms compared to llama.cpp.", "body_md": "I recently lucked into a Samsung Galaxy Book 5 360 Pro(talk about a mouthful) with an Intel 258v 32GB model. I wanted to see how capable it was running local AI models and I’ve been kinda disappointed. Is there something I’m missing?\n\nUbuntu Server 26.04 - Kernel 7.2\n\nOpenVINO - So incredibly immature, I can run Qwen 3.6 35B A3B if I pull the latest nightlies and build everything myself but it just sucks in comparison to llama.cpp performance wise.\n\nllama.cpp - I tried Sycl and Vulkan, Vulkan was the clear winner with double the tokens per second output.\n\nI thought this generation was supposed to be more capable of running local models? Obviously there’s limitations with RAM amounts but parsing an A3B model and only getting roughly 30 t/s decode and 200 t/s prefill(honestly this is the more painful part) really sucks.", "url": "https://wpnews.pro/news/intel-258v-what-s-the-point-ai", "canonical_source": "https://forum.level1techs.com/t/intel-258v-whats-the-point-ai/254478#post_1", "published_at": "2026-08-26 22:26:21+00:00", "updated_at": "2026-08-26 22:49:35.017192+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-tools"], "entities": ["Samsung Galaxy Book 5 360 Pro", "Intel 258v", "OpenVINO", "llama.cpp", "Qwen 3.6 35B A3B", "Vulkan", "SYCL", "Ubuntu Server 26.04"], "alternates": {"html": "https://wpnews.pro/news/intel-258v-what-s-the-point-ai", "markdown": "https://wpnews.pro/news/intel-258v-what-s-the-point-ai.md", "text": "https://wpnews.pro/news/intel-258v-what-s-the-point-ai.txt", "jsonld": "https://wpnews.pro/news/intel-258v-what-s-the-point-ai.jsonld"}}