Rightmodeler replays real agent traces through cheaper models, judges outputs against shipped versions, and shows cost-saving opportunities with evidence. The tool supports traces from Claude Code, Co…
A developer evaluates six LLM observability tools—Helicone, LangSmith, Langfuse, Future AGI, and Braintrust—for debugging hallucinated answers in production. The key requirement is the ability to quic…
Immersive Fusion released TraceGen, a single-binary distributed trace generator that produces realistic OpenTelemetry traces and correlated logs for up to 28 services, including AI agentic scenarios w…
Port's experiment found that routing AI agents through a structured context lake instead of direct-to-MCPs cut token costs by 58%, and adding a skill file brought savings to 80%. The context lake pre-…
Vercel released AI SDK 7 on June 25, introducing durable WorkflowAgent that preserves agent state across serverless timeouts and deploys, and HarnessAgent to unify multiple CLI runtimes. The update al…
A developer built Ballast, an open-source reliability layer for AI agents that sits on top of OpenTelemetry. While OpenTelemetry captures telemetry like token counts and latency, Ballast adds reliabil…
SigNoz, Langfuse, and Arize Phoenix lead the top LLM observability tools in 2026, offering capabilities such as full-stack monitoring, agent workflow debugging, and drift detection. The tools converge…
Llmaker, an open-source platform for self-hosting a complete LLM stack including models, vector databases, embeddings, caching, observability, and an agent layer, launched on Hacker News. The platform…
A developer built a complete RAG system from scratch using pgvector, Gemini embeddings, and MCP, covering setup, indexing, ingestion, search, and multi-step agents. The series concluded with deploymen…
VideoDB and Langfuse have released an open-source framework for evaluating multimodal vision-language models (VLMs) in video use cases, emphasizing task-specific benchmarks over generic model comparis…
A developer running reliability for a small team shipping LLM features compared six Langfuse alternatives—Helicone, Arize Phoenix, LangSmith, Braintrust, Laminar, and Future AGI traceAI—focusing on bo…
A Hacker News user asks how to detect when an AI agent's response quality degrades in production before customers complain, noting that cost and latency monitoring tools exist but quality monitoring r…
Langfuse launched code evaluators allowing users to run untrusted Python or TypeScript code in its multi-tenant SaaS environment. The company chose AWS Lambda for its runtime due to security, scalabil…
PostHog, Langfuse, and seven other AI observability tools are compared for developers building LLM-powered applications. These tools provide tracing, cost tracking, evaluations, and prompt management …
Poindexter shipped several improvements on June 24, 2026, including wrapping DeployCheckoutSync in a VBS helper to suppress flashing terminal windows on Windows. The team folded embedding hygiene jobs…
A team at an unnamed company built a customer support agent on LangChain that hallucinated a wrong return policy in a multi-step process, logging success while being confidently wrong. This incident h…
VideoDB Labs released an open-source pipeline for evaluating video vision-language models (VLMs) that emphasizes comparing full configurations—including segmentation, frame sampling, resolution, promp…
A developer built a production-ready LangGraph ReAct agent that exposes an OpenAI-compatible API, supports multi-model switching via a gateway, and includes one-line tracing with Langfuse. The deploym…
HALO, an open-source tool for debugging and optimizing AI agents using execution traces, has been released. It uses a Recursive Language Model to analyze traces and find systemic issues, and can optio…
CortexOps and Langfuse are both open-source AI observability platforms, but they differ in focus: Langfuse traces LLM calls for prompt engineering and cost monitoring, while CortexOps traces full agen…