{"slug": "show-hn-senseplane-open-source-eyes-and-ears-for-ai-agents-on-your-own-cameras", "title": "Show HN: Senseplane open-source eyes and ears for AI agents, on your own cameras", "summary": "Senseplane released v0.2, an open-source self-hosted system that gives AI agents eyes and ears on existing cameras, microphones and sensors, connecting agents such as Claude, ChatGPT and Cursor through an MCP server, a REST API, webhooks and a TypeScript SDK. The system runs from a single Docker Compose file with Caddy handling HTTPS, and its components include a TypeScript mediasoup media plane, a Python brain for motion, object, sound and episode detection, a Fastify API, an MCP server exposing 10 tools, a Go bridge for RTSP cameras and a Home Assistant integration. Senseplane's developers describe the release as early with \"rough edges\" and position the product as doing perception rather than decisions, reporting what it saw, its confidence and the evidence while the agent decides what to do, with a default 7-day retention period for replay.", "body_md": "**Eyes and ears for your agent.**\n\n[Website](https://senseplane.com) · [Docs](https://github.com/senseplane-ai/senseplane/blob/main/docs/README.md) · [Run it on a VM](https://github.com/senseplane-ai/senseplane/blob/main/docs/self-host-vm.md) · [Connect an agent](https://github.com/senseplane-ai/senseplane/blob/main/docs/mcp-setup.md) · [API](https://github.com/senseplane-ai/senseplane/blob/main/docs/api/README.md)\n\nConnect the cameras, microphones and sensors you already have, and any agent (Claude, ChatGPT, Cursor or your own code) can see, hear and remember what happens.\n\n- **Look:** a snapshot of what's there now, and questions about it.\n- **Watch:** \"tell me when a package is left at the door\", with events by signed webhook, MCP or Telegram.\n- **Ask:** \"when did the courier come?\", answered with the event, a snapshot and a clip.\n- **Measure:** \"how many meals today?\", \"how long did she sleep?\", \"is it quieter than usual?\", answered exactly from activities, with a daily summary if you want one.\n- **Replay:** any range within your retention period (7 days by default).\n\n<sub>Demo footage: vpdonline, Museum of Municipal Engineering (Kraków) and Diego Torres Silvestre, via Wikimedia Commons (CC BY); see [fixtures](https://github.com/senseplane-ai/senseplane/blob/main/fixtures/README.md).</sub>\n\nSenseplane does perception, not decisions: it reports what it saw, how sure it is and the evidence, and your agent decides what to do. Agents connect through an MCP server, a REST API, webhooks and a TypeScript SDK.\n\n**Status:** early (v0.2). Expect rough edges, and please\n[report what breaks](https://github.com/senseplane-ai/senseplane/issues).\n\nOn a server or your own computer with [Docker](https://docs.docker.com/engine/install/):\n\n```\nmkdir senseplane && cd senseplane\ncurl -fsSLO https://raw.githubusercontent.com/senseplane-ai/senseplane/main/docker-compose.yml\n# edit the settings block at the top: your domain, email, passwords and (optionally) a model key\nchmod 600 docker-compose.yml\ndocker compose up -d\n```\n\nOpen `https://<your domain>` and create your account (the first one owns the\nworkspace). Add a phone or laptop camera from the console, then connect your\nagent to `https://<your domain>/mcp`. The full guide, with DNS, firewall,\nbackups and upgrades: [Run Senseplane on a VM](https://github.com/senseplane-ai/senseplane/blob/main/docs/self-host-vm.md).\n\n| Part | Folder | Language | Role | \n|---|---|---|---|\n| Media plane | `media/` | TypeScript (mediasoup) | Ingest, continuous recording, playback, analysis feed | \n| Brain | `brain/` | Python | Motion, objects, sounds, episodes, watches, memory | \n| API | `api/` | TypeScript (Fastify) | Public `/v1` REST API, webhooks, auth | \n| MCP server | `mcp/` | TypeScript | 10 tools for agents | \n| SDK | `sdk/typescript/` | TypeScript | `npm i senseplane` | \n| Console | `console/` | TypeScript (React) | Web UI for sources, playback, watches, chat, access | \n| Bridge | `bridge/` | Go | RTSP cameras, outbound only | \n| Home Assistant | `integrations/home-assistant/` | Python | Forwards sensors as readings | \n| Spec | `spec/` | OpenAPI + JSON Schema | Single source of truth for API, SDK and MCP | \n\nEverything runs on one machine from [one compose file](https://github.com/senseplane-ai/senseplane/blob/main/docker-compose.yml),\nwith Caddy in front for HTTPS. More: [architecture](https://github.com/senseplane-ai/senseplane/blob/main/docs/architecture.md),\n[roadmap](https://github.com/senseplane-ai/senseplane/blob/main/docs/roadmap.md), [decisions](https://github.com/senseplane-ai/senseplane/blob/main/docs/decisions) and\n[lawful camera use](https://github.com/senseplane-ai/senseplane/blob/main/docs/lawful-use.md).\n\nThe development stack and a ten-minute tour of the API, webhooks and MCP are in\nthe [quick start for contributors](https://github.com/senseplane-ai/senseplane/blob/main/docs/quickstart.md); see also\n[CONTRIBUTING.md](https://github.com/senseplane-ai/senseplane/blob/main/CONTRIBUTING.md). To build and test everything:\n\n```\npnpm install\ndocker compose -f deploy/compose/docker-compose.yml up -d   # Postgres, Valkey, object storage\npnpm -r build && pnpm -r test\npnpm docs:build                                              # docs site in docs/site/\n```\n\nSecurity issues: see [SECURITY.md](https://github.com/senseplane-ai/senseplane/blob/main/SECURITY.md).\n\nApache 2.0. See [LICENSE](https://github.com/senseplane-ai/senseplane/blob/main/LICENSE) and [NOTICE](https://github.com/senseplane-ai/senseplane/blob/main/NOTICE). The Senseplane name is a\ntrademark; forks must rename (see [TRADEMARKS.md](https://github.com/senseplane-ai/senseplane/blob/main/TRADEMARKS.md)).", "url": "https://wpnews.pro/news/show-hn-senseplane-open-source-eyes-and-ears-for-ai-agents-on-your-own-cameras", "canonical_source": "https://github.com/senseplane-ai/senseplane", "published_at": "2026-10-19 17:25:01+00:00", "updated_at": "2026-10-19 17:46:36.712273+00:00", "lang": "en", "topics": ["ai-agents", "agent-protocols", "ai-tools", "computer-vision", "developer-tools"], "entities": ["Senseplane", "Claude", "ChatGPT", "Cursor", "Home Assistant", "Docker", "Caddy", "mediasoup"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/show-hn-senseplane-open-source-eyes-and-ears-for-ai-agents-on-your-own-cameras", "markdown": "https://wpnews.pro/news/show-hn-senseplane-open-source-eyes-and-ears-for-ai-agents-on-your-own-cameras.md", "text": "https://wpnews.pro/news/show-hn-senseplane-open-source-eyes-and-ears-for-ai-agents-on-your-own-cameras.txt", "jsonld": "https://wpnews.pro/news/show-hn-senseplane-open-source-eyes-and-ears-for-ai-agents-on-your-own-cameras.jsonld"}}