mcp-probe v1.0.0: A CI readiness gate for MCP servers

Release of mcp-probe v1.0.0, a CI-ready readiness gate for MCP servers that goes beyond basic startup checks to validate whether tools actually work in agent workflows. The tool can test real tool calls with configurable inputs and expected outputs, supports multiple transport protocols (stdio, Streamable HTTP, and legacy SSE), and integrates with GitHub Actions through step summaries and annotations.

mcp-probe started as a small CLI for checking whether an MCP server starts and exposes tools. That was useful, but after feedback from developers running real MCP servers in agent workflows, the gap became obvious: A server can start, pass tools/list , and still fail every real tool call because OAuth, browser auth, or downstream permissions are broken. So I shipped mcp-probe v1.0.0 as a CI-ready readiness gate for MCP servers. Install npx @k08200/mcp-probe@latest <server Example: npx @k08200/mcp-probe@latest @modelcontextprotocol/server-memory What it checks - MCP protocol handshake tools/list - optional resources and prompts discovery - tool schema shape - actual tool-call dry-runs - stderr classification - latency - batch/fleet CI status Tool-call dry-runs npx @k08200/mcp-probe@latest <server --probe-tools This closes the gap between “the server registered tools” and “those tools actually work in an agent loop.” Sidecar inputs Auto-generated inputs are fallback only. For real CI, v1 supports sidecar files: { "tools": { "logs query": { "input": { "query": "service:web status:error", "timeframe": "1h" }, "expect": { "not error code": 401, 403 } } } } Run: npx @k08200/mcp-probe@latest datadog-mcp --probe-tools --tools-file .mcp-probe.json This lets CI validate meaningful tool calls instead of just schema-minimum empty strings. Batch checks npx @k08200/mcp-probe@latest --config mcp-probe.config.json Useful when a team runs multiple MCP servers and wants one readiness gate. GitHub Actions output npx @k08200/mcp-probe@latest --config mcp-probe.config.json --github-summary v1 writes GitHub step summaries, emits annotations, and can generate a shields-compatible badge JSON file. HTTP and SSE mcp-probe now supports stdio, Streamable HTTP, and legacy SSE: npx @k08200/mcp-probe@latest https://example.com/mcp --header "Authorization: Bearer TOKEN" Stderr classification Some servers print harmless startup warnings; others print fatal init errors. v1 adds explicit rules: npx @k08200/mcp-probe@latest <server \ --stderr-allow "deprecated" \ --stderr-fatal "missing required api key" Recipes The repo includes starter recipes for Datadog, Supabase, Gmail, single-server GitHub Actions checks, fleet checks, and remote HTTP checks. GitHub: https://github.com/k08200/mcp-probe https://github.com/k08200/mcp-probe Release: https://github.com/k08200/mcp-probe/releases/tag/v1.0.0 https://github.com/k08200/mcp-probe/releases/tag/v1.0.0 npm: npm install -g @k08200/mcp-probe