Glad Labs fixed a GPU pinning issue where LiteLLM 1.89.2's global api_base override prevented per-model routing, causing vision tasks to cold-load onto the wrong GPU. The team also hardened content gu…
A developer built a Grafana AI anomaly detection pipeline after a memory leak went undetected for three days because static CPU thresholds failed. The pipeline converts ML model scores into reliable a…
Memgraph 3.11 introduces cross-database querying, virtual graph views, per-database monitoring, and intra-cluster TLS to simplify multi-tenancy for graph workloads. The release helps teams manage isol…
Looop, a new open-source tool, launches as a tiny, portable autonomous control loop for LLM agents, operating as a single binary without external dependencies. It monitors sources like GitHub and Line…
A new open-source project called agent-git-service provides a self-hosted, GitHub-compatible API server designed for AI agents, offering durable agent accounts, scoped tokens, and direct permission gr…
TrueFoundry argues that organizations need an AI gateway to manage cost, security, reliability, and governance across multiple LLM providers. Without a gateway, AI sprawl leads to runaway spending, se…
Xenoeye, an open-source network traffic analyzer that avoids AI, uses netflow protocols, PostgreSQL or ClickHouse, and Grafana for visualization. It features monitoring objects for filtering flows, ag…
WasmAgent released the @wasmagent/aep package, which records every tool call as an ActionEvidence object with pre/post state digests and capability decisions baked into a single record, solving the pr…
A developer at Yogreet Global proposes dynamic model-routing thresholds to optimize costs and performance when escalating requests to frontier AI models. By analyzing request characteristics like toke…
Buildkite engineers implemented async LLM inference through the Bifrost AI gateway to prevent build workers from blocking on slow model calls. By switching to a submit-and-poll pattern, workers no lon…
AI observability startup Sazabi raised $8 million in a seed round led by J2 Ventures, Village Global, and Y Combinator. The San Francisco-based company, founded by former Brex engineer Sherwood Callaw…
A developer built a time-series forecasting engine using Temporal Convolutional Networks (TCN) and PyTorch Lightning to predict blood glucose spikes from Continuous Glucose Monitor (CGM) data. The sys…
A developer at a platform organization describes how AI can be used to draft DevOps runbooks from shell history and incident timelines, but emphasizes that human verification and editing are essential…
Buildkite ran a game day that fault-injected OpenAI with 429s and 500s to test whether Bifrost's fallback config would reroute requests for an LLM-backed build-failure summariser. After fixing a retry…
Amazon SageMaker AI now emits over 100 detailed inference metrics and provides a built-in Insights dashboard in Amazon CloudWatch, enabling teams to monitor and debug generative AI inference endpoints…
A developer argues that most AI coding tools are built for developers working in a repository, not for ops engineers debugging production issues at 2am. They propose an AI assistant that works within …
A developer released Python and Node.js SDKs for Ajah, an open-source self-hosted LLM observability gateway. The SDKs simplify integration by replacing manual header injection with a single import, en…
A developer's guide to AI Ops explains how to automate modern infrastructure using dynamic baselines, OpenTelemetry instrumentation, and LLM-driven root cause analysis. The approach reduces Mean Time …
Kaushik launched Rocketgraph, an open-source tool that uses machine learning to condense millions of log lines into a few hundred patterns with anomaly scores, enabling LLMs to debug production issues…
A developer built a middleware service that routes AI queries to cheaper models for simple questions and reserves expensive GPT-4 calls for complex ones, cutting API costs by 70% while improving respo…