{"slug": "replit-datacat-their-self-hosted-observability-is-ai-slop-and-it-doesn-t-work", "title": "Replit Datacat – their self-hosted observability is AI slop and it doesn't work", "summary": "Replit published DataCat, a self-hosted observability stack that stores telemetry in PostgreSQL or ClickHouse and accepts OpenTelemetry and Datadog-compatible agent traffic, but the release drew criticism that it is \"AI slop and it doesn't work.\" The setup requires Docker Engine with the Compose plugin, Git and OpenSSL, and the server runs on Node.js 22.15+, pnpm 10.11.0 and PostgreSQL 14+. DataCat's compatibility table lists Datadog Agent 7.56.2 and 7.85.4 as tested, while Datadog Agent 7.57–7.84 are \"not tested individually,\" with unreadable trace formats returning a 422 rather than a silent 202.", "body_md": "Self-hosted observability: metrics, logs, distributed traces, dashboards, infrastructure and alerts in one place. DataCat runs on your infrastructure, stores data in PostgreSQL (or telemetry in ClickHouse, if you choose; see docs/SELF_HOSTING.md), and accepts OpenTelemetry and Datadog-compatible agent traffic. No hosted account or external service is required.\n\n- Metrics explorer, formulas, dashboards and host maps\n- Searchable logs with facets, live tail and trace correlation\n- APM service catalog, trace explorer and waterfall\n- Metric, log and trace monitors with webhook/Slack notifications\n- Organizations, local accounts, single-use invites, API/application keys\n- OpenTelemetry Collector-based host agent and Node.js/Python instrumentation libraries\n- One production process serving the API, web UI, installer and downloads\n\nRequirements: Docker Engine with the Compose plugin, Git, and OpenSSL.\n\n```\ngit clone https://github.com/replit/datacat\ncd datacat\ncp .env.example .env\nsed -i \"s/^POSTGRES_PASSWORD=.*/POSTGRES_PASSWORD=$(openssl rand -hex 24)/\" .env\nsed -i \"s/^SESSION_SECRET=.*/SESSION_SECRET=$(openssl rand -hex 32)/\" .env\nchmod 600 .env\nmkdir -p downloads\ndocker compose up -d --build\n```\n\nOpen **[http://localhost:3000](http://localhost:3000)**, create your admin account and organization, then create\nan API key under **Organization Settings**. Setup asks for a setup token, printed in the\nserver log (`docker compose logs datacat | grep \"setup token\"`) unless you set `DATACAT_SETUP_TOKEN`.\nSet `PUBLIC_URL` to your externally reachable HTTPS origin before inviting colleagues or\ninstalling agents remotely.\n\nAgent binaries and SDK packages are separate release assets. Put them (including\n`SHA256SUMS`) in `downloads/` to serve them from your instance.\n\nDataCat accepts the Datadog public intake API and OTLP/HTTP:\n\n| Sender | Status | \n|---|---|\n| Datadog Agent 7.56.2 (metrics, logs, check runs, traces) | Tested in CI-style runs | \n| Datadog Agent 7.85.4 (metrics, logs, check runs, traces) | Tested with captured payloads; including the newer string-table trace format | \n| Datadog Agent 7.57–7.84 | Not tested individually. Agents that send traces in a format DataCat cannot read get a 422, never a silent 202 | \n| OpenTelemetry Collector / SDKs (OTLP/HTTP) | `/v1/traces` ,`/v1/metrics` ,`/v1/logs` (also under`/otlp/v1/*` ) | \n| DataCat Agent and libraries | Tested in CI | \n\n`GET /api/v1/intake/stats` shows, per intake path, how many items were stored and how many were dropped since the\nserver started.\n\nSign-in uses local email/password accounts; members join through single-use invite links.\n\nUse Node.js **22.15+**, pnpm **10.11.0** and PostgreSQL **14+**. Node 22 also meets\nthe Node SDK requirement; older Node 20 releases are not supported by the current SDK.\n\n```\ncorepack enable\ncorepack prepare pnpm@10.11.0 --activate\npnpm install --frozen-lockfile\nBASE_PATH=/ pnpm run build:selfhost\n# Set DATABASE_URL, SESSION_SECRET and PUBLIC_URL in your environment.\nNODE_ENV=production PORT=3000 pnpm start\n```\n\nThe server migrates its schema automatically before listening. There is no manual schema push and no separate frontend server.\n\nSee **[Self-hosting](https://github.com/replit/datacat/blob/develop/docs/SELF_HOSTING.md)** for clean Ubuntu installation, all environment\nsettings, backups, systemd, agent installation, Node/Python instrumentation and a\nwebhook monitor walkthrough.\n\n```\npnpm run typecheck:libs\npnpm --filter @workspace/api-server run dev\n# In another terminal:\nAPI_PROXY=http://localhost:3000 PORT=5173 pnpm --filter @workspace/web run dev\n```\n\nThe API needs `DATABASE_URL`; use a separate development database.\nThe agent is built with Go 1.26.11+:\n\n```\nbash agent/build.sh\nDESTDIR=\"$PWD/dist/downloads\" bash agent/release.sh\n```\n\nTests:\n\n```\npnpm --filter @workspace/api-server test     # server unit tests\nDATACAT_URL=http://localhost:3000 DATACAT_SETUP_TOKEN=<token> bash scripts/e2e.sh   # end-to-end known-answer checks against a fresh install\n```\n\nCI (`.github/workflows/ci.yml`) runs typechecks, unit tests, dependency and vulnerability audits, the end-to-end\nchecks on both storage options, the library and agent tests, a Docker build and a secrets scan on every pull request.\n\nRunnable examples are in [`examples/`](https://github.com/replit/datacat/blob/develop/examples). See [Contributing](https://github.com/replit/datacat/blob/develop/CONTRIBUTING.md), [Security](https://github.com/replit/datacat/blob/develop/SECURITY.md) and the [Changelog](https://github.com/replit/datacat/blob/develop/CHANGELOG.md).\n\n`bench/kit` sends metrics, logs and traces through DataCat and checks every answer against a known value; it reports\nthroughput, query latency and how long data takes to become searchable, for both storage options. The other folders\nin [`bench/`](https://github.com/replit/datacat/blob/develop/bench) hold the correctness, resilience, alerting, soak and isolation tests; raw results behind the\npublished numbers are in [`bench/evidence/`](https://github.com/replit/datacat/blob/develop/bench/evidence).\n\n[Apache License 2.0](https://github.com/replit/datacat/blob/develop/LICENSE). Third-party dependencies retain their own licenses.\nDataCat is an independent project, not affiliated with or endorsed by Datadog, Inc. Datadog is a trademark of\nDatadog, Inc.; it is named here only to describe protocol compatibility.", "url": "https://wpnews.pro/news/replit-datacat-their-self-hosted-observability-is-ai-slop-and-it-doesn-t-work", "canonical_source": "https://github.com/replit/datacat", "published_at": "2026-11-19 21:55:44+00:00", "updated_at": "2026-11-19 22:15:47.112574+00:00", "lang": "en", "topics": ["ai-tools", "developer-tools", "ai-infrastructure"], "entities": ["Replit", "DataCat", "Datadog", "OpenTelemetry", "PostgreSQL", "ClickHouse", "Node.js", "Docker"], "also_reported_by": [], "takeaway": "DataCat self-hosts metrics, logs and traces on PostgreSQL or ClickHouse and accepts OTLP/HTTP at /v1/traces, /v1/metrics and /v1/logs, but Datadog Agent versions 7.57–7.84 are untested and trace payloads it cannot parse return a 422 instead of a silent 202.", "recommendation": null, "alternates": {"html": "https://wpnews.pro/news/replit-datacat-their-self-hosted-observability-is-ai-slop-and-it-doesn-t-work", "markdown": "https://wpnews.pro/news/replit-datacat-their-self-hosted-observability-is-ai-slop-and-it-doesn-t-work.md", "text": "https://wpnews.pro/news/replit-datacat-their-self-hosted-observability-is-ai-slop-and-it-doesn-t-work.txt", "jsonld": "https://wpnews.pro/news/replit-datacat-their-self-hosted-observability-is-ai-slop-and-it-doesn-t-work.jsonld"}}