AI Infrastructure news and analysis on Web Pulse: 34908 curated articles tracking the latest AI Infrastructure developments, tools, and research, updated continuously from vetted sources.
A FreeBSD user documented running generative AI workloads on FreeBSD by combining the operating system's Linux Binary Compatibility layer (Linuxulator) with an external NVIDIA eGPU, after native Python compilation errors…
A refurbished Miniforum UM790 Pro with 64GB RAM and 1TB NVMe, powered by an AMD Ryzen 9 7940HS CPU with Radeon 780M GPU, was purchased for $537 and used to run local LLMs via Ollama and Open Web UI on OpenBSD and Linux. …
Enigmata, founded in 2024 by co-founder and CEO Scott Searle, emerged from stealth on September 10th with a $6.5 million seed round led by Blockchange Ventures to commercialize Enigmata Cipher, a cryptographic layer that…
The MCP server io.github.GarAlex/promoshot reached version 0.2.78, published to the official MCP registry on 2026-09-10 and distributed as the Docker image ghcr.io/garalex/promoshot-mcp:v0.2.78, according to the mcpindex…
DeepSeek released V4.1 Flash with a 1M context window, FP4 KV cache, and cross-layer attention reuse, while Alibaba open-weighted Qwen3.8-2.4T-A95B, a Qwen-Max-class mixture-of-experts model with 2.4 trillion parameters …
System76 announced Thelio Mira AI, a Linux workstation configurable with dual NVIDIA RTX Pro 6000 Blackwell GPUs delivering up to 192 GB of GPU memory, aimed at local AI training, fine-tuning, and inference. The machine …
A developer demonstrated that the MCP Python SDK rejects extension method collisions at server construction time rather than at request time, using the stable mcp==2.1.1 package and protocol version 2026-07-28. The sampl…
OpenRouter's tracking of the z-ai/glm-4.7-flash endpoint at venice/fp8 recorded a B3IT total-variation level shift of 0.38, with the endpoint now in active monitoring status. The endpoint does not return logprobs, making…
Redis launched LangCache, a fully managed semantic caching service now in public preview on Redis Cloud, which Redis reports can cut LLM API costs by up to 90% and return cache-hit responses up to 15x faster than re-quer…
A former B2B SaaS web developer who switched to inference engineering about a month ago published a skills map arguing the field requires only three service categories: routing and scheduling via Nvidia Dynamo or llm-d, …
A developer has released Metrice, a zero-dependency peer-to-peer mesh networking protocol built entirely on Node.js core libraries. The system combines NIST FIPS 203 ML-KEM-768 post-quantum key encapsulation with a Tor-l…
A developer released VernLLM, an open-source MIT-licensed LLM call framework for TypeScript, and stress-tested it with over 1,000 LLM calls. The framework offers adaptive AIMD rate-limiting, advanced circuit-breakers, mu…
Amazon SageMaker Inference launched prefix-aware routing, a routing strategy that directs requests sharing the same prompt prefix to the same instance so cached key-value pairs are reused. Benchmarks on Llama 3.1 70B Ins…
NVIDIA detailed BioNeMo Inference Runtime (BioIR), a Python library that accelerates biomolecular structure-prediction models on NVIDIA GPUs while remaining in plain PyTorch. In a matched benchmark on 1,000 human dimer t…
Anthropic reported degraded performance on the Claude API, citing elevated latency affecting some users. The company's status page is offering email and SMS notifications for updates as the incident is created and resolv…
Osprey, a target-agnostic speculative decoding method detailed in arXiv:2609.09338v1, raises mean acceptance length by 16.1% on Qwen3-8B, 21.2% on Llama-3.3-70B-Instruct, and 22.7% on MiniMax-M2.5 (229B), with a 17.5% ga…
Amazon launched model caching for Amazon SageMaker Inference on HyperPod, a feature that pre-loads model weights and container images onto cluster nodes so inference pods can read from local NVMe storage at approximately…
Bedrock Robotics posted an internship opening for a 2027 Onboard Infrastructure Engineer, ML Inference role based in San Francisco, CA, on a hybrid schedule, with pay not published. The intern will integrate open-source …
OpenAI released its Agents API in public beta, giving developers the same harness and infrastructure that run Codex through a managed service built on the open-source Codex harness. The API organizes work around four con…
Amazon Web Services announced the general availability of TwelveLabs Marengo Embed 3.0 as an embedding model in Amazon Bedrock Knowledge Bases, enabling natural language search across video, audio, and image content. Mar…