Open Source Alternative to:
Last 30 days
Last commit
Repository age
Version
License
Repository
LangWatch is a testing, evaluation, and observability platform for AI agents. It's built for engineering teams that have moved past simple chatbots and are running agents that take dozens of steps, call external tools, and can fail in ways that are hard to reproduce. The core problem it solves: agents have too many possible paths to test by hand, and bugs that slip through tend to surface in production at the worst time.
The platform centers on simulation-based testing, where synthetic users run multi-turn text or voice conversations against your agent before any code ships. You write scenarios in plain language, and the same tests run locally and in CI without extra setup. Adversarial red-teaming is built in, probing for jailbreaks, policy violations, and unsafe tool calls.
Evaluation goes beyond single-turn output scoring:
Observability is OpenTelemetry-native with full GenAI spec support, so traces from Cline, OpenHands, or any other agent framework plug in without a rewrite. Every token, tool call, and cost is tracked per span, and you can view runs as a waterfall, flame graph, topology, or sequence diagram.
A feature called Langy closes the loop between product and engineering: a PM writes a goal in plain English, Langy generates a full test plan and scenarios, runs them in parallel, scores the results against a rubric, and opens a pull request with a prompt revision when something regresses. The platform also includes a Prompt Registry so changes are versioned and reviewable.
For teams with compliance requirements, LangWatch is ISO 27001 certified and GDPR compliant, with RBAC, SSO, SCIM, audit logs, and custom data retention. It deploys as managed SaaS across EU, US, UK, and APAC regions, as a self-hosted Docker or Kubernetes install, or in a hybrid configuration where the data plane runs on your infrastructure. The source is open under Apache 2. Last 30 days
Last commit
Repository age
Version
License
Repository
Every Sunday we deconstruct one proprietary app and pick the best open source alternatives worth switching to.
Stars
Last commit
License
Stars
Last commit
License
Stars
Last commit
License
Stars
Last commit
License
Compare with
Stars
Stars
Stars
Stars
Stars
Stars
Stars
Last commit
License
Compare with
Last commit
License
Compare with
Last commit
License
Compare with
Last commit
License
Compare with
Last commit
License
Compare with
Last commit
License
Compare with
Last commit
License
Compare with