A developer built a complete RAG system from scratch using pgvector, Gemini embeddings, and MCP, covering setup, indexing, ingestion, search, and multi-step agents. The series concluded with deploymen…
VideoDB and Langfuse have released an open-source framework for evaluating multimodal vision-language models (VLMs) in video use cases, emphasizing task-specific benchmarks over generic model comparis…
A developer running reliability for a small team shipping LLM features compared six Langfuse alternatives—Helicone, Arize Phoenix, LangSmith, Braintrust, Laminar, and Future AGI traceAI—focusing on bo…
A Hacker News user asks how to detect when an AI agent's response quality degrades in production before customers complain, noting that cost and latency monitoring tools exist but quality monitoring r…
Langfuse launched code evaluators allowing users to run untrusted Python or TypeScript code in its multi-tenant SaaS environment. The company chose AWS Lambda for its runtime due to security, scalabil…
PostHog, Langfuse, and seven other AI observability tools are compared for developers building LLM-powered applications. These tools provide tracing, cost tracking, evaluations, and prompt management …
Poindexter shipped several improvements on June 24, 2026, including wrapping DeployCheckoutSync in a VBS helper to suppress flashing terminal windows on Windows. The team folded embedding hygiene jobs…
A team at an unnamed company built a customer support agent on LangChain that hallucinated a wrong return policy in a multi-step process, logging success while being confidently wrong. This incident h…
VideoDB Labs released an open-source pipeline for evaluating video vision-language models (VLMs) that emphasizes comparing full configurations—including segmentation, frame sampling, resolution, promp…
A developer built a production-ready LangGraph ReAct agent that exposes an OpenAI-compatible API, supports multi-model switching via a gateway, and includes one-line tracing with Langfuse. The deploym…
HALO, an open-source tool for debugging and optimizing AI agents using execution traces, has been released. It uses a Recursive Language Model to analyze traces and find systemic issues, and can optio…
CortexOps and Langfuse are both open-source AI observability platforms, but they differ in focus: Langfuse traces LLM calls for prompt engineering and cost monitoring, while CortexOps traces full agen…
Dify, an open-source LLM app development platform with over 145,000 GitHub stars, released version 1.14.2 in May 2026, adding security hardening and workflow reliability improvements. The platform sup…
A developer evaluated six LLM observability tools—Langfuse, Helicone, Arize Phoenix, LangSmith, Braintrust, and Laminar—for their ability to monitor the audio layer in voice agents, not just LLM calls…
RootSign, a new SDK that produces cryptographic audit logs for CrewAI and LangGraph agents, was released on GitHub. The tool adds a SHA-256 hash chain to every tool call to detect log tampering, addre…
PostHog and Langfuse lead the cheapest AI observability tools for developers, offering free tiers with up to 100,000 LLM events per month. PostHog integrates AI observability with product analytics an…
The Red Team AI Benchmark v1.9.0 introduces a modular scoring architecture, unified provider interface, and YAML-native configuration to improve usability for legitimate researchers. The update also a…
A new open-source tool called agent-panorama converts raw LLM agent traces into plain-English reports for managers, answering whether agents are worth their cost. It works with LangChain and LangGraph…
A developer built ccglass, a local loopback reverse proxy for coding agents, after finding that SaaS AI observability tools like Langfuse and Helicone do not work with native CLIs such as Claude Code …
Meera, a GenAI engineer at AcmeAI, addresses prompt regression risks by implementing evaluation gates with LangSmith, building a routing benchmark dataset and correctness evaluator to catch silent fai…