{"slug": "show-hn-brisvox-a-rust-engine-for-real-time-voice-agents-phone-and-browser", "title": "Show HN: Brisvox – a Rust engine for real-time voice agents, phone and browser", "summary": "A developer released Brisvox, an open-source Rust engine for real-time voice agents on phone and browser, claiming it carried 250 concurrent calls within a latency SLO on a single 4 vCPU / 4 GB container versus 1 for Pipecat 1.12.0. In the same benchmark, Brisvox reached 430 calls without a failed call or lost turn against 10 for Pipecat, and at 8 vCPU / 8 GB it scaled to 470 and 780 calls while Pipecat stayed at 10. On real providers (Deepgram STT, an OpenAI-compatible LLM, Deepgram Aura voice) across 5 concurrent calls and 100 turns, Brisvox reported median voice-to-voice latency of 1.85 s versus 1.97 s for Pipecat and p95 of 2.88 s versus 4.35 s.", "body_md": "**A Rust engine for real-time voice agents: phone calls and browser sessions where a caller talks,\nthe agent listens, thinks (an LLM, with tools) and answers, and the caller can interrupt at any\nmoment. Open source, one process, hundreds of isolated calls per container.**\n\n[Website: brisvox.com](https://brisvox.com) · [Install](#install) · [Try it without keys](#try-it-without-keys) · [Quickstart](#quickstart) · [Comparison](#brisvox-vs-livekit-agents-vs-pipecat) ·\n[Features](#features) · [For AI coding agents](#for-ai-coding-agents) ·\n[Docs: the book](https://github.com/bilal07karadeniz/brisvox/blob/main/book/src/introduction.md) · [Discussions](https://github.com/bilal07karadeniz/brisvox/discussions) · [License](#license)\n\nBuilt to beat Pipecat on three axes with the same speech and language providers: latency, density and correctness.\n\n- **Density.** Every call through each system's own provider client code (Deepgram live STT, an\nOpenAI-compatible LLM and Deepgram Aura over TLS, against protocol-faithful fake servers) with the\nreal Silero VAD and Smart Turn models on every call: one 4 vCPU / 4 GB cloud container carried**250 concurrent calls** within the latency SLO and**430** without a failed call or a lost turn,\nagainst**1** and**10** for Pipecat 1.12.0. At 8 vCPU / 8 GB brisvox nearly doubled to**470** and**780** ; Pipecat stayed at**10** . At its maximum brisvox used about 1.8 MB of memory and\n0.007 cores per call, Pipecat about 240 MB and 0.14 cores. Each call is an isolated session; a\npanic or a provider failure in one cannot touch another.\n- **Latency.** The engine's own added time is tens of microseconds per stage (0.089 ms at p95 from\nend of turn to the LLM request, budget 3 ms). On real providers (Deepgram, OpenRouter pinned to\none upstream, Deepgram Aura voice), 5 concurrent calls, 100 turns per system, the median\nvoice-to-voice was**1.85 s against 1.97 s** for Pipecat and the p95**2.88 s against 4.35 s** .\nThe STT final arrived earlier through brisvox (its`Finalize` runs at the VAD stop instead of\nwaiting for the provider's own endpointing; the two systems' timers are not measured from the\nsame point, so this is not a share of the gap); the LLM's first token took about the same time on\nboth. Pipecat sent more than one LLM request in 56 of 100 turns (mostly the first turn of a call),\nwhich is where its tail comes from; the cause was not investigated (it is consistent with a turn\nended at a pause inside the utterance). An earlier run with Cartesia,\none call at a time and 30 turns, gave 1.69 s against 2.03 s. Connections\nare prewarmed, the LLM can start speculatively, and the first clause of the answer goes to the\nvoice after one word.\n- **Correctness.** Every user turn is a numbered epoch and stale frames are dropped everywhere;\nafter a barge-in the LLM context holds only the text that was actually played; side-effect tools\nnever run speculatively and never run twice for one call id (and an identical repeat in the\nsame turn is refused). The exact scope, and the idempotency key to add for \"once per order,\never\", is in[`docs/TOOLS.md`](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/TOOLS.md#what-never-twice-covers) . All of it is proven by\ndeterministic, paused-clock simulation.\n\nThe same SLO for both (p95 voice-to-voice at most 1110 ms: the fake providers' own 860 ms plus 250 ms), three runs each on a fresh container, one system at a time, on one CPU model (AMD EPYC 9655P; deployments the cloud placed on other CPUs were redeployed) with the container limits checked in its own samples. On these cores a single Pipecat call already sits near the limit (p95 about 1.05 to 1.1 s at one call, about 200 ms above the providers' floor, against 10 to 30 ms for brisvox), so its SLO number is decided by per-turn latency more than by load. The next chart drops the latency limit and shows how many calls each system holds without failing:\n\nPipecat (one worker process per vCPU, Silero and Smart Turn loaded in each) runs out of memory at 20 calls in 4 GB: workers are killed and their calls drop. With 8 GB it lost turns at 20 calls in two of three runs (no response); the third held 20 and reached the 8 GB limit at 30, where calls dropped. So the extra cores and memory did not raise its median. brisvox is bound by CPU: twice the container gave about 1.9 times the calls.\n\nLatency stays at the providers' floor until a system runs out of CPU or memory, then crosses the SLO within a step or two: the number that matters is where that happens.\n\nBoth systems ran the same agent file against the same real providers and models (Deepgram nova-3,\nOpenRouter `openai/gpt-6-luna` with reasoning effort `none`, pinned to OpenRouter's `openai`\nupstream without fallbacks and checked on every response that streamed (Pipecat's cancelled\nrequests never reported one), Deepgram Aura `aura-2-thalia-en`), with 5\nconcurrent calls, 10 blocks of 10 turns per system, strictly alternating (b1 p1 b2 p2 ...), so both\nsaw the same provider conditions. The LLM provider's own variance is still as large as the median\ndifference (126 ms): the LLM first token is 931 ms for brisvox and 889 ms for Pipecat at p50. The\ntail differs more than the median because Pipecat sent a second or third LLM request in about half\nof the turns here (one call at a time it was 5 of 30). One setting is not equal: the same nominal\n100 ms silence before the VAD stop is 3 Silero windows (96 ms) in Pipecat and 4 (128 ms) in\nbrisvox, so Pipecat decides about 32 ms earlier at every turn end (faster when the turn really\nended, and a candidate for its extra mid-utterance turn ends); the breakdown by stage, the routing\ncheck, this mismatch and the\nearlier Cartesia runs are in the \"Live comparison with real providers\" section of\n[`docs/LATENCY.md`](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/LATENCY.md).\n\n- **Capacity and memory** are cloud runs of 2026-10-16/17: Linux containers on AMD EPYC 9655P\n(Zen 5) limited to 4 vCPU / 4 GB and 8 vCPU / 8 GB, release builds, one system at a time. Every\ncall goes through each system's own provider clients (brisvox's Rust adapters; Pipecat's`DeepgramSTTService` ,`OpenAILLMService` and`DeepgramTTSService` ) to fake providers that speak\nthe real Deepgram and OpenAI-compatible protocols over TLS with fixed latencies (STT final 150 ms\nafter 300 ms of endpointing, LLM first token 350 ms, TTS first audio 150 ms;[`bench/fake_providers`](https://github.com/bilal07karadeniz/brisvox/blob/main/bench/fake_providers/README.md) ), in a container of their own, like the\nload generator. So the numbers include the provider client code, TLS and both models, not the\nproviders' own variance. The Pipecat side is`bench/pipecat_baseline` : a Pipecat 1.12.0 bot\nspeaking the same websocket protocol with the same agent file, measured by the same client with\nthe same definition of voice-to-voice. brisvox's admission control was off for the ramp; in\nproduction it refuses calls past its capacity instead of degrading the running ones. LiveKit\nAgents was not part of this run.\n- **Memory is PSS** (proportional set size: a page shared by several processes is split between\nthem) summed over the server container's processes, from its cgroup samples every 2 s.\n- The same comparison runs locally with `PROVIDERS=fakes MODELS=1 bench/capacity_linux.sh` (Docker\ncontainers with the same limits). The Smart Turn model is memory-bandwidth heavy (about 200 MB of\nmemory traffic per analysis), so on a desktop with little memory bandwidth it can stop brisvox\nfrom scaling with cores before the CPU does; the cloud host above does not.\n- **Live voice-to-voice** is**Windows** on a shared development machine over the public internet,\none evening (100 turns per system, 5 concurrent calls, alternating blocks; Cartesia's plan allows\nonly 2 concurrent generations, hence the Aura voice); absolute numbers carry noise.**Engine overhead** is the Windows run over mocks.\n- Every number is in a committed file under [`bench/results/`](https://github.com/bilal07karadeniz/brisvox/blob/main/bench/results/README.md) (the file\nstarts with the command that produced it); the charts are generated from those files by`python3 scripts/gen_charts.py` and checked for staleness by the quality gate. Definitions and\nmore results (load simulation, speculation, Windows capacity): the book's[Benchmark results](https://github.com/bilal07karadeniz/brisvox/blob/main/book/src/benchmarks.md) and[`docs/LATENCY.md`](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/LATENCY.md) .\n\nTwo kinds of rows. **Measured** rows come from this repository's own benchmark harness (files named\nin the last column; the table is generated from them); \"not measured\" means this repository has\nno such run for that system yet. **Documented** rows are what each project's own documentation and\nrepository say, fetched 2026-10-14, not benchmarks; the bracketed tags are source ids listed in\n[`docs/research/frameworks-2026-10-14.md`](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/research/frameworks-2026-10-14.md), where every\nfact carries its URL and what is inferred or not stated is marked as such.\n\n| Measured here | brisvox | LiveKit Agents | Pipecat 1.12 | Source | \n|---|---|---|---|---|\n| Concurrent calls within the latency SLO (p95 voice-to-voice at most 1110 ms), **4 vCPU / 4 GB** (median, runs in brackets) | **250** (260, 250, 220) | not measured | **1** (1, 1, 0) | `bench/results/capacity-*-cloud-4c-linux-*` | \n| Most concurrent calls with no failed call and no lost turn (any latency), **4 vCPU / 4 GB** | **430** (430, 480, 400) | not measured | **10** (10, 10, 10) | `bench/results/capacity-*-cloud-4c-max-linux-*` | \n| Server memory at that maximum, 4 vCPU / 4 GB (PSS summed over the container's processes) | 753 MB at 430 calls | not measured | 2.4 GB at 10 calls | same files | \n| Concurrent calls within the latency SLO (p95 voice-to-voice at most 1110 ms), **8 vCPU / 8 GB** (median, runs in brackets) | **470** (480, 460, 470) | not measured | **10** (10, 5, 10) | `bench/results/capacity-*-cloud-8c-linux-*` | \n| Most concurrent calls with no failed call and no lost turn (any latency), **8 vCPU / 8 GB** | **780** (740, 780, 800) | not measured | **10** (10, 20, 10) | `bench/results/capacity-*-cloud-8c-max-linux-*` | \n| Server memory at that maximum, 8 vCPU / 8 GB (PSS summed over the container's processes) | 1.3 GB at 780 calls | not measured | 3.3 GB at 10 calls | same files | \n| Per call at that maximum, 4 vCPU / 4 GB: memory and CPU (idle baseline included) | 1.8 MB, 0.007 cores | not measured | 239.9 MB, 0.137 cores | same files | \n| Voice-to-voice on real providers, English, p50 / p95 (5 concurrent calls, 100 turns, Deepgram Aura voice; Windows, public internet) | 1.85 s / 2.88 s (100 turns) | not measured | 1.97 s / 4.35 s (100 turns) | `bench/results/v2v-live-*-windows-*` | \n\n| Documented (2026-10-14) | brisvox | LiveKit Agents | Pipecat | \n|---|---|---|---|\n| Language | Rust engine; your agent in Python or TypeScript (SDKs on PyPI and npm) or in Rust | Python ( `livekit-agents` 1.8.7); Node.js in a separate repo [L2][L5] | Python ( `pipecat-ai` 1.12.0) [P2][P4] | \n| License | Apache-2.0 or MIT | Apache-2.0; the turn-detector text model and `v1-mini` use the LiveKit Model License [L6][L8] | BSD-2-Clause [P3] | \n| Runtime model | one process, one isolated async session per call, models on a dedicated thread pool | one OS process per job, \"each in its own process for isolation\" [L7] | documented as one session per process or container [P5] | \n| Needs a media server | no: WebSocket, Twilio and Telnyx built in; WebRTC and SIP are cargo features | yes: a LiveKit server (Cloud or self-hosted), the agent joins a room [L6] | no for WebSocket and SmallWebRTC; the Daily and LiveKit transports use those vendors' infrastructure [P7] | \n| Telephony | Twilio and Telnyx media streams, SIP trunk listener, DTMF, transfer | LiveKit SIP service: Twilio, Telnyx, Plivo and others, DTMF, cold and warm transfer [L12] | Twilio, Telnyx, Plivo, Exotel serializers [P7]; no SIP stack of its own found in the pages read (inferred) | \n| Turn detection | Smart Turn v3.2 (ONNX, on device) with an adaptive policy | own turn-detector models: a text model (396 MB on disk, about 50-160 ms per turn on CPU) and the audio model `v1-mini` (its size and cost are not stated) [L8] | Smart Turn v3 (8 MB int8) [P8][P10] | \n| Turkish | first class ( [`docs/TURKISH.md`](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/TURKISH.md) ) | listed by both turn detectors [L8] | listed by Smart Turn [P10] | \n| Interruptions | turn epochs; context keeps only the text actually played | adaptive mode separates interruptions from backchannel, resumes after a false one [L13] | cancels LLM and TTS, flushes audio, commits only the played text; a minimum-words turn-start strategy and a Krisp backchannel filter [P12] | \n| Tools | `read_only` /`side_effect` kinds, idempotency keys, never speculative; written in Rust, Python or TypeScript | function tools, async tools, handoff, MCP (Python), provider-side tools; parallel calls not stated on the page read [L15] | parallel calls by default, async tools, per-tool timeouts, cancel on interruption; MCP not checked [P13] | \n| Speech-to-speech | OpenAI Realtime, Gemini Live | many realtime models [L16] | several [P4] | \n| Overload handling | admission control and graceful drain built in | default load function (5 s average CPU, threshold 0.7) [L11][L17] | none found in the docs; autoscaling guidance [P5] | \n| Hosted cloud | none, self-host only | optional LiveKit Cloud [L6] | optional Pipecat Cloud [P5][P14] | \n| Vendor sizing guidance | none, see the measured rows | 4 cores / 8 GB for 10-25 jobs; a vendor test of 30 agents peaked at about 3.8 cores and 2.8 GB [L11] | Pipecat Cloud profile of 0.5 vCPU / 1 GB per session [P6] | \n\nNone of this is an independent benchmark: no third-party density comparison of the three was found\n([research notes](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/research/frameworks-2026-10-14.md#3-independent-benchmarks-2025-2026)).\n\n**Prebuilt binary.** Every release has `brisvox-server` archives for Linux (x86_64, aarch64), macOS\n(aarch64) and Windows (x86_64) with a `SHA256SUMS` file, on the\n[Releases page](https://github.com/bilal07karadeniz/brisvox/releases). Linux binaries need glibc\n2.39 or newer.\n\n```\nv=v0.1.4; t=x86_64-unknown-linux-gnu        # pick the release and your platform\ncurl -fLO https://github.com/bilal07karadeniz/brisvox/releases/download/$v/brisvox-server-$v-$t.tar.gz\ncurl -fLO https://github.com/bilal07karadeniz/brisvox/releases/download/$v/SHA256SUMS\nsha256sum --ignore-missing -c SHA256SUMS && tar xzf brisvox-server-$v-$t.tar.gz\ncd brisvox-server-$v-$t\npython3 scripts/models/fetch_models.py     # the Smart Turn model (pinned SHA-256)\n./brisvox-server --version\n```\n\n**Docker.** A multi-architecture image (`linux/amd64`, `linux/arm64`) with the Smart Turn model\ninside:\n\n```\ndocker run --rm ghcr.io/bilal07karadeniz/brisvox-server:latest --version\n```\n\nTags are `vX.Y.Z` and `latest`. Running it with an agent file and your keys:\n[Docker and compose](https://github.com/bilal07karadeniz/brisvox/blob/main/book/src/quickstart/docker.md).\n\n**From crates.io.** Needs Rust 1.99 or newer, a C compiler and cmake (libopus, ONNX Runtime):\n\n```\ncargo install brisvox-server --locked --features all-providers,call-control,smart-turn-ort,mcp,webrtc\n```\n\n**What to build with.** The prebuilt binaries and the image are built with\n`all-providers,call-control,smart-turn-ort,mcp,webrtc`: every STT/LLM/TTS adapter, the carriers' call\ncontrol (`transfer_call`, `send_dtmf`, `end_call`), Smart Turn on ONNX Runtime, MCP tools and the\nWebRTC listener. The crate's own default features are deliberately small (no provider adapter): an\napplication that only needs some of them names just those, for example\n`--features provider-deepgram,provider-openai,provider-cartesia`. Not in the prebuilt set: `sip`\n(the SIP trunk listener), `otlp` (OpenTelemetry export) and `recording-encryption`; build from\nsource with them added when you need them.\n\n**SDKs.**\n\n```\npip install brisvox                   # Python 3.11+; installs brisvox-agent, the SDK itself\nnpm i brisvox                         # TypeScript / Node 20+; brisvox/web is the browser client\n```\n\nThe short names are umbrella packages: `brisvox` on PyPI depends on `brisvox-agent` and re-exports\nit, `brisvox` on npm depends on `@brisvox/agent` and `@brisvox/web` and re-exports them (the agent\nSDK as `brisvox`, the browser module as `brisvox/web`). Install the specific packages instead if\nyou want only one:\n\n```\npip install brisvox-agent             # Python 3.11+\nnpm install @brisvox/agent            # TypeScript / Node 20+\nnpm install @brisvox/web              # the browser module for a \"Talk to us\" button\n```\n\n**As a Rust library.** `cargo add brisvox --features all-providers` is one dependency for a server\nwith your own Rust tools: it re-exports `brisvox-server`, the tools API (` brisvox-agent`), the\nprovider adapters and the core types, and forwards the server's features. The other crates\n(`brisvox-server`, `brisvox-core`, `brisvox-agent`, `brisvox-providers`, `brisvox-transport`,\n`brisvox-engine`, `brisvox-agent-link`, `brisvox-inference`, `brisvox-audio`, `brisvox-sim`) are on\ncrates.io too, for those who need one alone. Release notes are in the\n[changelog](https://github.com/bilal07karadeniz/brisvox/blob/main/CHANGELOG.md); security reports go to the [security policy](https://github.com/bilal07karadeniz/brisvox/blob/main/SECURITY.md).\n\nA voice agent that runs entirely on your computer (speech recognition, language model and voice, CPU only), talked to in the browser. Needs Docker, 4+ cores, 8 GB of memory; the first start downloads about 6.5 GB.\n\n```\ndocker compose -f deploy/local/compose.yaml up      # then open http://localhost:8088/demo?force=ws\n```\n\nDetails, a larger model for faster machines and the licences: [`deploy/local/`](https://github.com/bilal07karadeniz/brisvox/blob/main/deploy/local/README.md).\n\nNeeds Rust (the toolchain is pinned in `rust-toolchain.toml`) and API keys for the example agent's\nproviders: Deepgram (STT), OpenAI (LLM) and Cartesia (TTS).\n\n```\ncargo build --release -p brisvox-server --features all-providers,smart-turn-ort,demo-tools\npython3 scripts/models/fetch_models.py          # the Smart Turn model (pinned SHA-256)\nexport DEEPGRAM_API_KEY=...  OPENAI_API_KEY=...  CARTESIA_API_KEY=...\nBRISVOX_AGENT_FILE=examples/agents/support-en.toml target/release/brisvox-server   # ws on :8080\n# in another shell: play a recorded utterance at it and measure the answer time\ncargo run --release -p brisvox-bench -- v2v --url ws://127.0.0.1:8080/ --fixtures en_two_utterances --runs 1\n```\n\nYour own tools and logic, in Python or TypeScript:\n\n``` python\nfrom brisvox_agent import Agent\n\nagent = Agent(\"luigi\", system_prompt=\"You are Luigi's host.\", greeting=\"Hi, Luigi's here!\")\n\n@agent.tool\nasync def opening_hours(day: str) -> str:\n    \"\"\"Opening hours of the restaurant on a weekday.\"\"\"\n    return \"12:00 to 22:00\"\n\nagent.run(port=8765)    # server side: BRISVOX_AGENT_URL=ws://127.0.0.1:8765\n```\n\nOr with Docker: `cp deploy/ws.env.example deploy/ws.env`, fill in the keys, then\n`docker compose -f deploy/compose.yaml up --build agent-ws`. More in the book:\n[Quickstart](https://github.com/bilal07karadeniz/brisvox/blob/main/book/src/quickstart.md); fully local with no API key: [A fully local\nassistant](https://github.com/bilal07karadeniz/brisvox/blob/main/book/src/quickstart/local.md).\n\nThe default build has no providers and no listeners beyond the websocket; you choose cargo\nfeatures for what you want to run. The same names go into the Docker image through the\n`BRISVOX_FEATURES` build argument (default `all-providers,call-control,smart-turn-ort`, which has\n**no `webrtc`**). `all-providers` can be replaced by the individual `provider-*` features to keep\nthe binary smaller.\n\n| Goal | Cargo features ( `--features` ) | Docker `--build-arg BRISVOX_FEATURES=` | Read | \n|---|---|---|---|\n| A voice button on a website (browser, WebRTC with a WebSocket fallback) | `all-providers,smart-turn-ort,webrtc` | `all-providers,smart-turn-ort,webrtc` | [web assistant](https://github.com/bilal07karadeniz/brisvox/blob/main/examples/web-assistant) ,[hosting, incl. one-port platforms](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/DEPLOY.md) (add`call-control` if the same server also takes phone calls) | \n| A phone number through Twilio or Telnyx (transfer, DTMF, hang-up) | `all-providers,call-control,smart-turn-ort` | the default | [phone receptionist](https://github.com/bilal07karadeniz/brisvox/blob/main/examples/phone-receptionist) ,[Telephony](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/TELEPHONY.md) | \n| A SIP trunk | `all-providers,call-control,smart-turn-ort,sip` | `all-providers,call-control,smart-turn-ort,sip` | [Telephony](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/TELEPHONY.md) ,[Deploying](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/DEPLOY.md) | \n| Fully local speech (sherpa-onnx, Ollama, Kokoro), no API key | `provider-sherpa-onnx,provider-openai-compatible,provider-openai-speech,smart-turn-ort,webrtc` | the same list | [A fully local assistant](https://github.com/bilal07karadeniz/brisvox/blob/main/book/src/quickstart/local.md) | \n| Your own tools in Python or TypeScript | the features of the goal above; tools come from an SDK process | the same | [SDKs](https://github.com/bilal07karadeniz/brisvox/blob/main/sdk/python/README.md) ,[booking agent](https://github.com/bilal07karadeniz/brisvox/blob/main/examples/booking-agent) | \n| Your own tools in Rust, in one binary | your crate depends on `brisvox-server` with the provider features your agent file names (and`smart-turn-ort` ,`webrtc` ,`call-control` as above) | build your own image from your crate | [Rust tools](https://github.com/bilal07karadeniz/brisvox/blob/main/examples/rust-tools) ,[Tools](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/TOOLS.md) | \n\n`smart-turn-ort` is the end-of-turn model: without it, and the model file from\n`python3 scripts/models/fetch_models.py`, adaptive turns end at a 3 second fallback deadline.\nBefore you run anything, `target/release/brisvox-server check <agent-file> --require-secrets`\nvalidates an agent file against the binary you built (providers compiled in, keys set, tools\nknown), offline, with line and column for every problem. Which provider and which model to pick\nfor your language and budget is a live test, not a table: the agent files in\n[`examples/agents`](https://github.com/bilal07karadeniz/brisvox/blob/main/examples/agents) are the starting points.\n\n- **Transports.** Generic websocket ([protocol](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/WEBSOCKET_PROTOCOL.md) ), Twilio Media\nStreams, Telnyx media streaming, RTVI (Pipecat's client SDKs), WebRTC (feature`webrtc` ) and a\nSIP trunk listener (feature`sip` ). G.711 mu-law and A-law, any call rate with any provider\nrate.\n- **Providers.** STT: Deepgram, AssemblyAI, Gladia; on your own machine sherpa-onnx (CPU) or a\nserver that speaks the OpenAI Realtime transcription protocol. LLM: OpenAI, Anthropic, Gemini,\nand any OpenAI-compatible endpoint (Groq, Together, Fireworks, vLLM, Ollama, OpenRouter:[recipe](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/PROVIDERS.md) ). TTS: Cartesia, ElevenLabs, Deepgram Aura; on your own machine any\nserver of the OpenAI`/v1/audio/speech` shape (Kokoro-FastAPI, Chatterbox). Speech-to-speech:\nOpenAI Realtime and Gemini Live. On-device: Silero VAD and Smart Turn v3.2 end-of-turn detection. Per-stage\nfailover, circuit breakers and retry budgets.\n- **Conversation.** Adaptive turn taking, interruption policy with backchannel lists, speculative\nLLM start, played-text truncation, tool calls with`read_only` /`side_effect` kinds and\nidempotency keys, filler phrases for slow tools, DTMF in and out, call transfer, answering\nmachine handling. English and Turkish supported.\n- **SDKs and clients.**[Python](https://github.com/bilal07karadeniz/brisvox/blob/main/sdk/python/README.md) and[TypeScript](https://github.com/bilal07karadeniz/brisvox/blob/main/sdk/typescript/README.md) SDKs for an out-of-process agent: your tools and application logic in your own process, the\nserver runs the call ([agent protocol](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/AGENT_PROTOCOL.md) ).[`@brisvox/web`](https://github.com/bilal07karadeniz/brisvox/blob/main/sdk/web/README.md) is one dependency-free ES module for a \"Talk to us\" button on a website: WebRTC first, an\nautomatic WebSocket fallback on the same port, microphone, playback, barge-in and clean hang-up.\n- **Config.** One TOML or YAML file per agent ([reference](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/CONFIG.md) );`brisvox-server check <file>` validates a file offline, with line and column for every problem,\nbefore you deploy it.`brisvox_server::app::run_with_tools(Arc::new(MyTools))` is a whole`main` for a server with your own Rust tools ([guide](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/TOOLS.md) ,[example](https://github.com/bilal07karadeniz/brisvox/blob/main/examples/rust-tools) ).\n- **Operations.** Health and readiness endpoints, Prometheus metrics, OpenTelemetry traces\n(feature`otlp` ), admission control that learns the machine's capacity (refuses new calls\ninstead of degrading running ones), graceful drain, a container image and compose file.\n- **Usage and cost.** Every call reports what providers bill by: LLM tokens (input, cached,\noutput), STT audio seconds and TTS characters, with duration, turns and latencies, as a`session.usage` event, in the transcript, in the log and as Prometheus totals per provider and\nmodel ([docs](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/OPERATIONS.md#usage-and-cost) ).\n- **Examples.**[Phone receptionist](https://github.com/bilal07karadeniz/brisvox/blob/main/examples/phone-receptionist) ,[web\nassistant](https://github.com/bilal07karadeniz/brisvox/blob/main/examples/web-assistant) ,[booking agent](https://github.com/bilal07karadeniz/brisvox/blob/main/examples/booking-agent) (Python SDK tools),[Rust tools](https://github.com/bilal07karadeniz/brisvox/blob/main/examples/rust-tools) , plus single-file agent definitions in[`examples/agents`](https://github.com/bilal07karadeniz/brisvox/blob/main/examples/agents) .\n\nbrisvox is written to be picked up by an AI coding agent (Claude Code, Codex, Cursor and the like) with no prior knowledge:\n\n- [`llms.txt`](https://github.com/bilal07karadeniz/brisvox/blob/main/llms.txt) is the map ([llmstxt.org](https://llmstxt.org) format): the facts to know\nbefore writing anything and one line per document saying when to read it.[`llms-full.txt`](https://github.com/bilal07karadeniz/brisvox/blob/main/llms-full.txt) is the user guide in one file. Both are generated from the docs\n(`scripts/gen_llms.py` ) and checked for staleness by the quality gate.\n- [`skills/brisvox`](https://github.com/bilal07karadeniz/brisvox/blob/main/skills/brisvox/SKILL.md) is an Agent Skill with the workflow and the common\ntraps. For Claude Code, copy the folder into your project's`.claude/skills/` (or`~/.claude/skills/` ); other agents can be pointed at the file.\n- `brisvox-server check <agent-file>` validates an agent file offline with the real loader, so an\nagent finds its own mistakes (key path and line for each) before anything runs.\n- [`docs/agent.schema.json`](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/agent.schema.json) is the JSON Schema of the agent file for\neditors and tools (`brisvox-server --print-schema` ; setup in`docs/CONFIG.md` ).\n\nThe book in [`book/`](https://github.com/bilal07karadeniz/brisvox/blob/main/book) organises the design and reference documents in [`docs/`](https://github.com/bilal07karadeniz/brisvox/blob/main/docs)\n(included, not copied: one source of truth) into chapters: introduction, quickstart, concepts\n(pipeline, turns and interruptions, played-text truncation, tools), configuration, telephony,\noperations, benchmarks and reference (protocols, providers).\n\n```\ncargo install mdbook        # once\nmdbook serve book --open    # or: mdbook build book  (output in target/book)\npython3 scripts/check_book.py   # structure check without mdbook: links, includes, every doc included\n```\n\nEntry points: [`docs/ARCHITECTURE.md`](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/ARCHITECTURE.md) (design),\n[`docs/PIPELINE.md`](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/PIPELINE.md) (the production pipeline),\n[`docs/LATENCY.md`](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/LATENCY.md) (latency budget and measurements),\n[`docs/OPERATIONS.md`](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/OPERATIONS.md) (running the server),\n[`docs/TESTING.md`](https://github.com/bilal07karadeniz/brisvox/blob/main/docs/TESTING.md) (how it is proven),\n[`bench/results/README.md`](https://github.com/bilal07karadeniz/brisvox/blob/main/bench/results/README.md) (the benchmark harness and every result file).\n\n| Crate | Purpose | \n|---|---|\n| `brisvox-core` | frames, processors, pipeline, clock, turn epochs | \n| `brisvox-audio` | codecs, resampling, buffers, output pacing | \n| `brisvox-inference` | dedicated CPU pool, on-device models (VAD, turn detection) | \n| `brisvox-agent` | turn taking, interruptions, context, tools, TTS segmentation | \n| `brisvox-engine` | the production voice pipeline (one session per call) | \n| `brisvox-providers` | STT / LLM / TTS traits and adapters | \n| `brisvox-transport` | websocket, telephony, WebRTC transports | \n| `brisvox-agent-link` | the out-of-process agent protocol | \n| `brisvox-server` | multi-tenant session server (binary + library) | \n| `brisvox-sim` | mock providers and deterministic simulator | \n| `brisvox-bench` | benchmark harness (binary) | \n\n```\ncargo build --workspace\nscripts/verify.sh        # fmt + clippy (-D warnings) + docs + tests + SDKs + examples + book check\n```\n\nLibrary code may not `unwrap`, `expect`, `panic!`, `todo!` or index in a way that can panic;\nthese lints are denied workspace-wide and relaxed only inside tests (`clippy.toml`).\n\nQuestions, ideas and what you are building: [GitHub Discussions](https://github.com/bilal07karadeniz/brisvox/discussions).\nBugs: [Issues](https://github.com/bilal07karadeniz/brisvox/issues).\n\nLicensed under either of\n\n- Apache License, Version 2.0 ([LICENSE-APACHE](https://github.com/bilal07karadeniz/brisvox/blob/main/LICENSE-APACHE) )\n- MIT license ([LICENSE-MIT](https://github.com/bilal07karadeniz/brisvox/blob/main/LICENSE-MIT) )\n\nat your option.\n\nException: the speech test fixtures in `fixtures/` (audio and transcripts from Google FLEURS /\nFLORES) are not covered by the code license; they are shared under CC BY-SA 4.0, see\n[`fixtures/NOTICE`](https://github.com/bilal07karadeniz/brisvox/blob/main/fixtures/NOTICE).\n\nUnless you explicitly state otherwise, any contribution intentionally submitted for inclusion in the work by you, as defined in the Apache-2.0 license, shall be dual licensed as above, without any additional terms or conditions.", "url": "https://wpnews.pro/news/show-hn-brisvox-a-rust-engine-for-real-time-voice-agents-phone-and-browser", "canonical_source": "https://github.com/bilal07karadeniz/brisvox", "published_at": "2026-11-18 14:05:58+00:00", "updated_at": "2026-11-18 14:16:13.869568+00:00", "lang": "en", "topics": ["ai-agents", "ai-tools", "developer-tools", "ai-infrastructure", "large-language-models"], "entities": ["Brisvox", "Pipecat", "Deepgram", "OpenRouter", "Silero", "Smart Turn", "Rust", "AMD EPYC 9655P"], "also_reported_by": [], "takeaway": "Brisvox's Rust engine adds 0.089 ms at p95 from end of turn to the LLM request and holds 250 concurrent calls within a 1110 ms p95 voice-to-voice SLO on 4 vCPU / 4 GB, versus 1 call for Pipecat 1.12.0.", "recommendation": null, "alternates": {"html": "https://wpnews.pro/news/show-hn-brisvox-a-rust-engine-for-real-time-voice-agents-phone-and-browser", "markdown": "https://wpnews.pro/news/show-hn-brisvox-a-rust-engine-for-real-time-voice-agents-phone-and-browser.md", "text": "https://wpnews.pro/news/show-hn-brisvox-a-rust-engine-for-real-time-voice-agents-phone-and-browser.txt", "jsonld": "https://wpnews.pro/news/show-hn-brisvox-a-rust-engine-for-real-time-voice-agents-phone-and-browser.jsonld"}}