{"slug": "mcp-probe-v1-0-0-a-ci-readiness-gate-for-mcp-servers", "title": "mcp-probe v1.0.0: A CI readiness gate for MCP servers", "summary": "Release of mcp-probe v1.0.0, a CI-ready readiness gate for MCP servers that goes beyond basic startup checks to validate whether tools actually work in agent workflows. The tool can test real tool calls with configurable inputs and expected outputs, supports multiple transport protocols (stdio, Streamable HTTP, and legacy SSE), and integrates with GitHub Actions through step summaries and annotations.", "body_md": "mcp-probe started as a small CLI for checking whether an MCP server starts and exposes tools.\n\nThat was useful, but after feedback from developers running real MCP servers in agent workflows, the gap became obvious:\n\nA server can start, pass\n\n`tools/list`\n\n, and still fail every real tool call because OAuth, browser auth, or downstream permissions are broken.\n\nSo I shipped **mcp-probe v1.0.0** as a CI-ready readiness gate for MCP servers.\n\n## Install\n\n```\nnpx @k08200/mcp-probe@latest <server>\n```\n\nExample:\n\n```\nnpx @k08200/mcp-probe@latest @modelcontextprotocol/server-memory\n```\n\n## What it checks\n\n- MCP protocol handshake\n`tools/list`\n\n- optional resources and prompts discovery\n- tool schema shape\n- actual tool-call dry-runs\n- stderr classification\n- latency\n- batch/fleet CI status\n\n## Tool-call dry-runs\n\n```\nnpx @k08200/mcp-probe@latest <server> --probe-tools\n```\n\nThis closes the gap between “the server registered tools” and “those tools actually work in an agent loop.”\n\n## Sidecar inputs\n\nAuto-generated inputs are fallback only. For real CI, v1 supports sidecar files:\n\n```\n{\n  \"tools\": {\n    \"logs_query\": {\n      \"input\": {\n        \"query\": \"service:web status:error\",\n        \"timeframe\": \"1h\"\n      },\n      \"expect\": {\n        \"not_error_code\": [401, 403]\n      }\n    }\n  }\n}\n```\n\nRun:\n\n```\nnpx @k08200/mcp-probe@latest datadog-mcp --probe-tools --tools-file .mcp-probe.json\n```\n\nThis lets CI validate meaningful tool calls instead of just schema-minimum empty strings.\n\n## Batch checks\n\n```\nnpx @k08200/mcp-probe@latest --config mcp-probe.config.json\n```\n\nUseful when a team runs multiple MCP servers and wants one readiness gate.\n\n## GitHub Actions output\n\n```\nnpx @k08200/mcp-probe@latest --config mcp-probe.config.json --github-summary\n```\n\nv1 writes GitHub step summaries, emits annotations, and can generate a shields-compatible badge JSON file.\n\n## HTTP and SSE\n\nmcp-probe now supports stdio, Streamable HTTP, and legacy SSE:\n\n```\nnpx @k08200/mcp-probe@latest https://example.com/mcp --header \"Authorization: Bearer TOKEN\"\n```\n\n## Stderr classification\n\nSome servers print harmless startup warnings; others print fatal init errors. v1 adds explicit rules:\n\n```\nnpx @k08200/mcp-probe@latest <server> \\\n  --stderr-allow \"deprecated\" \\\n  --stderr-fatal \"missing required api key\"\n```\n\n## Recipes\n\nThe repo includes starter recipes for Datadog, Supabase, Gmail, single-server GitHub Actions checks, fleet checks, and remote HTTP checks.\n\nGitHub: [https://github.com/k08200/mcp-probe](https://github.com/k08200/mcp-probe)\n\nRelease: [https://github.com/k08200/mcp-probe/releases/tag/v1.0.0](https://github.com/k08200/mcp-probe/releases/tag/v1.0.0)\n\nnpm:\n\n```\nnpm install -g @k08200/mcp-probe\n```\n\n", "url": "https://wpnews.pro/news/mcp-probe-v1-0-0-a-ci-readiness-gate-for-mcp-servers", "canonical_source": "https://dev.to/k08200/mcp-probe-v100-a-ci-readiness-gate-for-mcp-servers-4ch0", "published_at": "2026-05-20 16:01:55+00:00", "updated_at": "2026-05-20 16:36:19.881813+00:00", "lang": "en", "topics": ["developer-tools", "artificial-intelligence", "open-source"], "entities": ["mcp-probe", "@modelcontextprotocol/server-memory", "datadog-mcp", "GitHub"], "alternates": {"html": "https://wpnews.pro/news/mcp-probe-v1-0-0-a-ci-readiness-gate-for-mcp-servers", "markdown": "https://wpnews.pro/news/mcp-probe-v1-0-0-a-ci-readiness-gate-for-mcp-servers.md", "text": "https://wpnews.pro/news/mcp-probe-v1-0-0-a-ci-readiness-gate-for-mcp-servers.txt", "jsonld": "https://wpnews.pro/news/mcp-probe-v1-0-0-a-ci-readiness-gate-for-mcp-servers.jsonld"}}