Fastllm, a C++ LLM inference library, now supports running DeepSeek-V4 and the full DeepSeek R1 671B model on a single GPU with just 10GB VRAM. The library is compatible with Nvidia, AMD, and domestic…
Guardian, an open-source user-space firewall for AI agents, has released v0.1.0, intercepting and evaluating agent actions with a deterministic policy engine. In testing, it reduced prompt-injection a…
A developer built a proof-of-concept IDE called TerminateCode that represents code as an interactive node graph on a canvas, allowing developers to manipulate architecture visually while AI writes the…
A developer outlines practical patterns for building multi-agent systems with Python, including the ReAct architecture, tool selection, memory hierarchy, and error recovery. The guide emphasizes start…
Hermes Agent is an open-source AI agent platform that includes built-in skills, persistent memory, task scheduling, and Stripe payment processing, distinguishing it from bare LLM wrappers. The platfor…
Google imposed compute-based usage limits on its Gemini AI platform starting May 17, 2026, after API requests more than doubled between March and August 2025. The caps affect all users, including Meta…
A developer's guide explains how to run open-source AI models locally on consumer hardware in 2026, highlighting that a mid-range laptop can now run models once considered frontier-class. The guide co…
An architect breaks down how to size a Mac mini M4 for local AI workloads, arguing that memory configuration is the critical decision, not the CPU. The analysis maps tasks to memory tiers: 16GB for ch…
Mixture-of-Experts (MoE) models like Qwen3-30B-A3B and DeepSeek-V3 separate total parameters (memory) from active parameters (compute), allowing a 30B-parameter model to run at the speed of a 3B model…
Cyera Research disclosed a critical vulnerability in Ollama, a popular tool for running large language models locally. Tracked as CVE-2026-7482 with a CVSS score of 9.1, the flaw allows attackers to l…
Chinese open-source AI models from DeepSeek and Alibaba have rapidly closed the performance gap with US rivals, capturing over 50% of global open-source downloads and 30% of AI model usage by early 20…
A tech leader's tour of China's leading AI labs reveals that Chinese researchers excel as fast-followers in large language model development due to a culture emphasizing collective optimization over i…
A new analysis of major AI models reveals systematic political biases, with most models leaning left on economic and social issues. The study, which tested models like Gemini, DeepSeek, Llama, Claude,…
Ora Computing launched an automated LLM compression engine that reduces model size by up to 70% with minimal accuracy loss, enabling deployment on edge devices, on-prem servers, or cloud infrastructur…
A researcher replicated Anthropic's concept-injection experiments on 14 open-weight language models and found that the models do not satisfy criteria for genuine introspection, instead exhibiting stat…
Researchers at arXiv found that jailbreak attacks on large language models can be detected by analyzing entropy dynamics in intermediate layers, rather than final outputs. The study shows that monoton…
Pangram Labs researchers explored the internal representations of their AI detection model Pangram 3.3.2 using document-level analysis of activations across layers, aiming to understand what the model…
Defence, intelligence, and critical-infrastructure organizations are deploying enterprise AI agents in air-gapped and restricted networks without cloud connectivity, using open-weight models, local in…
Developer Jason Van Pham released Niodoo, a runtime that uses hidden state steering to improve small language models' performance without fine-tuning, enabling self-correction and memory systems. The …
Meta CEO Mark Zuckerberg confirmed a multi-generation processor deal with Qualcomm, securing custom Snapdragon silicon for Meta's extended reality hardware and AI workloads. The agreement extends acro…