Meera, a GenAI engineer at AcmeAI, addresses prompt regression risks by implementing evaluation gates with LangSmith, building a routing benchmark dataset and correctness evaluator to catch silent fai…
Meera, a GenAI engineer at AcmeAI, builds a customer-support agent using LangGraph that leadership loves, but risk head Sanjay halts the launch with demands for replayable interactions, tamper-evident…
Galdor, a Go-native framework for building and observing AI agents, launched v1.0.0 in June 2026 with built-in OpenTelemetry tracing, an embedded SQLite dashboard, and first-party support for both MCP…
ProofLayer released ProofLayer Rules, an open-source runtime security layer for MCP servers and LangGraph agents that blocks prompt injection, jailbreaks, and tool abuse in real-time with sub-100ms la…
LangChain launched LangSmith Sandboxes, a new infrastructure product that gives AI agents their own isolated computers with filesystems, shells, and package managers. The product addresses security ri…
Microsoft has open-sourced ASSERT, an AI evaluation framework that converts natural-language requirements into executable tests for enterprise agents, as organizations struggle to validate agent behav…
Runcap, a new open-source developer tool, estimates the cost of coding agent runs before they begin and enforces a hard spending ceiling that physically stops the run when the limit is reached. The to…
A developer spent 40 hours reading production logs from teams running LangGraph, CrewAI, and AutoGen agents, then launched a $149 diagnostic service that analyzes agent traces and delivers a written r…
Intencion launched a product analytics tool designed specifically for AI agents in production, capturing every user interaction end-to-end including intent, agent steps, and outcomes. The tool install…
A company shipped an AI chat feature to production but found the model was a black box, unable to answer basic operational questions about why answers were good or bad. The team added an observability…
The best evaluation harness for production AI and agents must support consistent testing across local development, CI, production monitoring, and continuous improvement as models, prompts, and agent d…
A developer building a team of AI agents to generate reports from transcript data spent a month rewriting jobs as durable executions after cascading errors from failed API calls and memory issues brok…
LangChain and AWS have released a framework for evaluating AI agents using LangSmith on Amazon Bedrock, addressing the challenge of validating non-deterministic, multi-step agent behavior before produ…
Warmtebouw deployed nine MCP servers in three months for non-technical business users across ERP, BIM, fleet, energy, and operational systems, bypassing the entire conventional AI stack of orchestrati…
Development of SafeRun, an inline reliability infrastructure for AI agents, and argues that post-incident debugging through state-capturing "Replay" functionality is more critical than pre-flight vali…
As engineering teams iterate on prompts for large language models, they face challenges similar to managing configuration files, requiring dedicated storage, versioning, sharing, and security. It revi…