Microsoft's Foundry Local lets developers embed AI inference directly inside application binaries, using the same SDK and API shapes as the company's cloud Foundry offerings, with automatic hardware a…
A new arXiv preprint (2608.23809v1) investigates whether multilingual LLMs use shared or language-specific features for mathematical reasoning, introducing the Geometry-Invariant Sparse Autoencoder (G…
Atomic Chat, a new application, enables users to run open-weight LLMs from Hugging Face locally on Windows, macOS, and Linux, and exposes them through an OpenAI-compatible API for use with coding agen…
Phi, a browser-native and desktop game engine with a Blender-style editor, Python scripting, and built-in Claude AI, has been released as a single opaque engine.wasm or native executable. The engine i…
Small Language Models (SLMs) excel in specific, narrow AI workflows where latency and privacy are prioritized over general world knowledge, according to a developer experimenting with local deployment…
Fastllm, a C++ LLM inference library, now supports running DeepSeek-V4 and the full DeepSeek R1 671B model on a single GPU with just 10GB VRAM. The library is compatible with Nvidia, AMD, and domestic…