{"slug": "show-hn-interviewer-assistant-ai-open-source", "title": "Show HN: Interviewer assistant – AI open source", "summary": "An open-source interviewer assistant that joins Microsoft Teams calls via Recall.ai, transcribes them live, and privately scores each candidate answer on correctness, depth, clarity and relevance while suggesting follow-up questions has been published on GitHub under the blackarck/intaiassist repository. The backend schedules the bot, receives the transcript and runs analysis through Anthropic Claude and Azure OpenAI models, with coaching shown only to the interviewer in a web app; the author states the app was built largely with AI assistance, has tests and reviewed sign-in, access control and webhook verification, but has not had an independent security audit. The author warns users to obtain consent from every participant before recording and transcribing, not to treat scores or suggestions as the basis for a hiring decision, and offers optional Stripe contributions of $5, $7 or $10 that gate nothing.", "body_md": "An AI assistant for interviewers. A bot joins the interview video call (Microsoft Teams for now soon to come Zoom or Google Meet), listens,\nand privately coaches the interviewer in a web app: a **live transcript**, a **score for every answer** (correctness, depth,\nclarity, relevance, with the weak phrases quoted and a better answer suggested), and **follow-up questions to ask next**.\nThe assistant never speaks in the meeting, and only the interviewer sees the coaching in web app.\n\nMeeting access and live transcription come from [Recall.ai](https://docs.recall.ai). AI analysis uses Anthropic Claude and\nAzure OpenAI models. This repo contains the backend that schedules the bot, receives the transcript and runs the AI, plus the\nweb app interviewers use.\n\n**Consent matters.** A visible bot joins and the meeting is recorded and transcribed. Whoever runs this must tell every\nparticipant and get their permission first, and comply with the recording and privacy laws that apply to them. Data is\nprocessed by Recall.ai and your AI providers, and stored in your own database. You run it at your own risk; see the in-app\nTerms and Privacy pages (`web/src/pages/Legal.tsx`) and adapt them to your situation.\n\n- \n**Vibe-coded, open source, use at your own risk.** This application was built largely with AI assistance. I took care to\nclose gaps (there are tests, and sign-in, access control and webhook verification were reviewed), but it has not had an\nindependent security audit and there are surely bugs. Do not treat its scores or suggestions as the basis for a hiring\ndecision, and do not rely on it to keep or recover data (see the Terms in the app).\n- \n**Get consent.** Tell candidates and everyone on the call that a bot will join and that the meeting is recorded,\ntranscribed and analysed by AI, and get their permission first.\n- \n**It is self-hosted and I pay for it.** The hosted instance runs on my own infrastructure: I pay for the meeting bot\n(Recall.ai) and the AI models. If it helps your interviews, please consider contributing:\n  - \n**Pay what you like through Stripe** ($5, $7 or $10) from the app. Nothing is gated on it. The app shows a small,\noptional \"found it useful?\" line under the interview setup form and a card on the Interviews page; the $ amounts\nappear only when`STRIPE_SECRET_KEY` is set.\n  - \n**Try it** on your own interviews and**report bugs** or rough edges as GitHub issues.\n  - \n**Contribute code, tests, docs or fixes** by pull request, or help maintain it.\n  - \n**Run your own copy** (below) with your own Recall.ai, Infra & AI keys.\n- \n\nDocs: [plan](https://github.com/blackarck/intaiassist/blob/main/doc/plan.md) · [hosting & DNS](https://github.com/blackarck/intaiassist/blob/main/doc/hosting.md) · [inbound e-mail](https://github.com/blackarck/intaiassist/blob/main/doc/inbound-email.md) · [Recall integration](https://github.com/blackarck/intaiassist/blob/main/doc/recall-integration.md) · [data & backups](https://github.com/blackarck/intaiassist/blob/main/doc/data.md) · [end-to-end flow](https://github.com/blackarck/intaiassist/blob/main/doc/flow.md) ·\n[why not our own Teams bot](https://github.com/blackarck/intaiassist/blob/main/doc/bot-join-research.md).\n\n| Need | Why | Required? | \n|---|---|---|\n| Node.js 24 and npm (what the Docker image uses) | Run the backend and web app | Yes | \n| [Recall.ai](https://www.recall.ai) account and API key | Bot that joins meetings and streams the transcript | For real meetings (not for local dev) | \n| Anthropic API key and/or Azure OpenAI resource | The AI that scores answers and suggests questions | For coaching | \n| Microsoft Entra app registration | \"Sign in with Microsoft\" | For real sign-in (not for local dev) | \n| A public HTTPS URL for the backend | Recall and SendGrid deliver webhooks to it (a tunnel such as ngrok works for testing) | For real meetings | \n| SendGrid account + a subdomain | Optional: lets people invite the bot by e-mail ( `iv-<alias>@your-subdomain` ) | Optional | \n| Stripe account | Optional \"support us\" payment | Optional | \n| A Linux VM with Docker | Production hosting (Caddy gives automatic HTTPS) | For production | \n\n```\ninterviewer adds iv-K7M2QX9WPB@invite.askproso.ai to the meeting invite\n        │  (no mailbox: the subdomain's MX record points at SendGrid)\nSendGrid Inbound Parse ──POST──►  backend /inbound/sendgrid/<secret>\n                      │  parse link (Teams/Zoom/Meet) + calendar data, match alias → paid interview\n                      ▼\n                 Recall: create bot (scheduled for the start time, or immediate)\n                      │\n meeting ◄──joins──  Recall bot ──live transcript + status──►  backend /webhooks/recall  (HMAC-verified)\n                                                                   │\n                                                                   ▼\n                                                    status tracking, transcript segments → coaching (next)\n```\n\n| Path | What | State | \n|---|---|---|\n| `backend/` | TypeScript (Fastify). Inbound invite e-mail, Recall client, bot scheduling, webhook receiver, live AI coaching and scoring, SQLite persistence | Tested; verified live end to end | \n| `web/` | React + Vite single-page app: Microsoft sign-in, interview setup, live transcript, scores and suggested questions | Built | \n| `deploy/` | Docker Compose: backend + Caddy (automatic HTTPS), nightly DB backup | Used in production | \n| `infra/sendgrid/` | Script to create the SendGrid Inbound Parse host | Written | \n| `infra/azure/` | `provision.sh` : resource group + Key Vault | Used | \n| `teams-app/` | Optional Teams chat app for private coaching messages (chat only) | Manifest packs, **not sideloaded** | \n| `doc/` | Plan, flow, Recall integration guide, research history |  | \n\nTag `teams-media-bot-spike` holds the earlier own-Teams-media-bot attempt (it could join meetings but Microsoft does\nnot allow link-joined bots to record or transcribe).\n\nLocal dev mode skips Microsoft sign-in and never creates a real bot, so you can run the whole app on your machine.\n\n```\ngit clone https://github.com/blackarck/intaiassist.git && cd intaiassist\n\n# 1. backend (http://localhost:3000)\ncd backend\nnpm install\ncp .env.example .env            # git-ignored; set INTAKE_TOKEN to any long random string\nDEV_AUTH=1 RECALL_API_KEY= ALLOWED_ORIGINS=http://localhost:5173 npm run dev\n\n# 2. web app (http://localhost:5173), in a second terminal\ncd web\nnpm install\ncp .env.example .env.local\n# in .env.local set: VITE_API_URL=http://localhost:3000   VITE_DEV_USER=you@example.test\nnpm run dev\n```\n\nOpen [http://localhost:5173](http://localhost:5173). To play a fake meeting without Recall, see \"Local development\" in [web/README.md](https://github.com/blackarck/intaiassist/blob/main/web/README.md).\nAdd `ANTHROPIC_API_KEY` (and/or the `AZURE_OPENAI_*` pair) to `backend/.env` to get real AI scoring. `DEV_AUTH=1` is refused when\n`NODE_ENV=production`, and `VITE_DEV_USER` must never be set in a deployed build.\n\nBackend settings live in `backend/.env` (see [backend/.env.example](https://github.com/blackarck/intaiassist/blob/main/backend/.env.example) for the full, commented list). The main ones:\n\n| Variable | Purpose | \n|---|---|\n| `INTAKE_TOKEN` | Operator bearer token for admin/dev API calls. Long random string. | \n| `MS_CLIENT_ID` | Entra app (client) id for sign-in. Same value as the web build's `VITE_MS_CLIENT_ID` . | \n| `ALLOWED_ORIGINS` | Web app origin(s) allowed to call the API (CORS), e.g. `https://app.example.com` . | \n| `RECALL_API_KEY` ,`RECALL_REGION` ,`RECALL_WEBHOOK_SECRET` | Recall.ai credentials, region and webhook verification secret. | \n| `PUBLIC_BASE_URL` | Public https URL of the backend; Recall posts transcripts to `<PUBLIC_BASE_URL>/webhooks/recall` . | \n| `ANTHROPIC_API_KEY` ,`AZURE_OPENAI_ENDPOINT` ,`AZURE_OPENAI_API_KEY` | AI providers. Model choice per task is in `backend/src/ai/` . | \n| `ALIAS_DOMAIN` ,`INBOUND_TOKEN` | Optional: SendGrid Inbound Parse for e-mail invites. | \n| `ADMIN_SUBJECTS` | Comma-separated user ids who may change AI settings (get yours from `GET /api/me` after signing in). | \n| `DATABASE_PATH` | SQLite file. Unset means in-memory (lost on restart). | \n| `STRIPE_SECRET_KEY` ,`WEB_BASE_URL` | Optional support payment. Leave blank to turn it off. | \n\nWeb settings are build-time variables in `web/.env.local` (see [web/.env.example](https://github.com/blackarck/intaiassist/blob/main/web/.env.example)): `VITE_API_URL`,\n`VITE_MS_CLIENT_ID`, `VITE_MS_AUTHORITY`.\n\n1. In Entra ID create an app registration with account type **any organizational directory and personal Microsoft accounts** (multi-tenant), so interviewers from any company can sign in.\n2. Add platform **Single-page application** with redirect URIs`http://localhost:5173/redirect.html` and`https://<your-web-domain>/redirect.html` .\n3. Set the client id as `MS_CLIENT_ID` (backend) and`VITE_MS_CLIENT_ID` (web), with`VITE_MS_AUTHORITY=https://login.microsoftonline.com/common` .\n\nMore detail in [web/README.md](https://github.com/blackarck/intaiassist/blob/main/web/README.md).\n\nRunning your own copy means using your own accounts. Everything is set in `backend/.env` (or `/opt/intassist/.env` in production),\nthen restart the backend (`npm start`, or `docker compose restart backend`).\n\n1. \nCreate an account at [recall.ai](https://www.recall.ai) and note your**region** (`us-west-2` ,`us-east-1` ,`eu-central-1` or`ap-northeast-1` ). Keys only work in the region they were created in.\n2. \nIn the Recall dashboard create an **API key** , and under Developers add a**webhook endpoint**`https://<your-backend-domain>/webhooks/recall` ; copy its verification secret (`whsec_...` ).\n3. \nSet in the env file: \n\n```\nRECALL_API_KEY=<your api key>\nRECALL_REGION=us-west-2\nRECALL_WEBHOOK_SECRET=whsec_...\nPUBLIC_BASE_URL=https://<your-backend-domain>     # no trailing slash, must be public HTTPS\n# optional: BOT_NAME=Interview Assist   TRANSCRIPT_LANGUAGE=en\n```\n\n Set all of these or none: with `RECALL_API_KEY` set but the others missing, the backend reports what is missing. With none set,\nno real bot is created. For local testing use a tunnel (ngrok, Cloudflare Tunnel) as`PUBLIC_BASE_URL` .\n4. \nDetails and troubleshooting: [doc/recall-integration.md](https://github.com/blackarck/intaiassist/blob/main/doc/recall-integration.md) .\n\nThe backend calls models through two providers. Set the keys for the ones you use:\n\n```\nANTHROPIC_API_KEY=sk-ant-...                       # Claude (console.anthropic.com)\nAZURE_OPENAI_ENDPOINT=https://<resource>.openai.azure.com   # optional: Azure OpenAI / Foundry\nAZURE_OPENAI_API_KEY=...\n```\n\n- **Anthropic only is enough.** Several tasks default to an Azure model first and fall back to Claude, so with no Azure\nsettings they still work but each call first tries and fails on Azure. Avoid that by reassigning those tasks (next point).\n- **Choose which model does what** without redeploying: sign in as an admin and open**AI settings** . Admins are the users listed in`ADMIN_SUBJECTS` (sign in once, call`GET /api/me` , copy`subject` , put it in`ADMIN_SUBJECTS` , restart). For each task\n(live coach, answer scoring, opening questions, scorecard, assist) pick a primary and fallback model.\n- **Model list:** the available models are in`backend/src/ai/models.ts` (`CATALOG` ). Azure entries are*deployment names* on your\nAzure resource, so edit them to match your deployments. Defaults per task are in`backend/src/ai/tasks/*.ts` .\n- Restart the backend after changing keys. Check the backend logs if a task fails; a missing key shows as\n`ANTHROPIC_API_KEY is not set` or`AZURE_OPENAI_ENDPOINT / AZURE_OPENAI_API_KEY are not set` .\n\nProduction is one Linux VM running Docker Compose: **Caddy** (HTTPS, serves the built web app) and the **backend**\n(SQLite on a Docker volume). Outline:\n\n1. Create a VM with Docker and point DNS for your API domain and web domain at it.\n2. Put the backend settings above into `/opt/intassist/.env` , plus`DOMAIN` (API host) and`WEB_DOMAIN` (web host).\n3. Build the web app (`cd web && VITE_API_URL=https://<api-domain> VITE_MS_CLIENT_ID=<id> VITE_MS_AUTHORITY=https://login.microsoftonline.com/common npm run build` )\nand copy`web/dist` to`/opt/intassist/web` .\n4. From `deploy/` :`docker compose --env-file /opt/intassist/.env up -d --build` .\n5. In Recall, point the webhook at `https://<api-domain>/webhooks/recall` . Optionally run`infra/sendgrid/` for e-mail invites.\n\nThe scripts in `infra/azure/` automate this on Azure (VM, Key Vault for secrets, deploy); they contain our own resource names,\nso treat them as a worked example and change the names. Full walk-through in [doc/hosting.md](https://github.com/blackarck/intaiassist/blob/main/doc/hosting.md). Do not deploy\nor restart during live interviews: a restart drops in-flight webhooks for a few seconds.\n\nWithout `RECALL_API_KEY` the backend uses a log-only bot controller. With `DEV_AUTH=1` you can exercise intake with curl:\n\n```\ncurl -X POST localhost:3000/api/dev/interviews -H \"authorization: Bearer $INTAKE_TOKEN\" -H 'content-type: application/json' \\\n  -d '{\"alias\":\"7KQ2\",\"ownerEmail\":\"you@example.com\"}'\ncurl -X POST localhost:3000/api/intake/link -H \"authorization: Bearer $INTAKE_TOKEN\" -H 'content-type: application/json' \\\n  -d '{\"alias\":\"7KQ2\",\"link\":\"https://meet.google.com/abc-defg-hij\"}'\n```\n\nRecall can only deliver webhooks to a public HTTPS URL, so a real end-to-end test needs the backend hosted or tunnelled\n(see [doc/recall-integration.md](https://github.com/blackarck/intaiassist/blob/main/doc/recall-integration.md)).\n\nPeople can optionally pay $5, $7 or $10; nothing is gated on it. To turn it on, put your keys in `backend/.env` (git-ignored):\n\n```\nSTRIPE_SECRET_KEY=sk_test_...        # https://dashboard.stripe.com/apikeys\nWEB_BASE_URL=http://localhost:5173   # where Stripe sends people back\n```\n\nLeave `STRIPE_SECRET_KEY` empty and the web app shows no payment amounts (the small \"found it useful?\" line stays, without them).\n\n**If you run your own copy,** the contribution prompts say this instance costs infrastructure, meeting-bot and AI money to run.\nReword them for your own situation in `web/src/components/Support.tsx` (`SupportCard` and `SupportNote`). The Stripe keys are\nyours, so payments go to your Stripe account. To remove the prompts, delete `<SupportCard />` from `web/src/pages/Interviews.tsx`\nand `<SupportNote />` from `web/src/components/SetupForm.tsx`. The backend creates a Stripe Checkout session\n(`POST /api/me/support/checkout`); amounts are fixed in `backend/src/support.ts`. For the Azure deploy, store the key as the\nKey Vault secret `stripe-secret-key`. Payments are not tracked in the database: the Stripe dashboard is the record.\n\n```\ncd backend && npm test && npm run typecheck\ncd web && npm test && npm run typecheck\n```\n\nSource: [https://github.com/blackarck/intaiassist](https://github.com/blackarck/intaiassist). Released under the [Apache License 2.0](https://github.com/blackarck/intaiassist/blob/main/LICENSE): free to use, modify and distribute,\nincluding commercially. Contributions are welcome, see [CONTRIBUTING.md](https://github.com/blackarck/intaiassist/blob/main/CONTRIBUTING.md). Interview Assist is sponsored by [Proso.ai](https://proso.ai).", "url": "https://wpnews.pro/news/show-hn-interviewer-assistant-ai-open-source", "canonical_source": "https://github.com/blackarck/intaiassist", "published_at": "2026-11-20 10:51:21+00:00", "updated_at": "2026-11-20 11:15:56.133563+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-products", "ai-tools", "generative-ai", "ai-agents"], "entities": ["Recall.ai", "Anthropic", "Claude", "Azure OpenAI", "Microsoft Teams", "Stripe", "SendGrid", "blackarck/intaiassist"], "also_reported_by": [], "takeaway": "The self-hosted backend joins Teams calls through Recall.ai, streams the transcript to Anthropic Claude or Azure OpenAI for per-answer scoring, and requires a public HTTPS URL for webhooks plus Node.js 24 to run.", "recommendation": null, "alternates": {"html": "https://wpnews.pro/news/show-hn-interviewer-assistant-ai-open-source", "markdown": "https://wpnews.pro/news/show-hn-interviewer-assistant-ai-open-source.md", "text": "https://wpnews.pro/news/show-hn-interviewer-assistant-ai-open-source.txt", "jsonld": "https://wpnews.pro/news/show-hn-interviewer-assistant-ai-open-source.jsonld"}}