{"slug": "show-hn-ai-system-design-primer", "title": "Show HN: AI System Design Primer", "summary": "A developer released the AI System Design Primer in November 2026, a first-release educational resource modeled on Donne Martin's System Design Primer that teaches engineers to design production systems built on large language models. The primer covers method, trade-offs, components, solved designs and dated reference numbers, with each topic a roughly ten-minute page plus a deep dive, and it ships runnable numpy-or-standard-library labs and Anki flashcard decks generated by a standard-library Python script. The author states every section was researched against primary sources and reviewed, with CI checking links, structure, diagrams and that every lab runs, and unconfirmed claims listed in PLAN.md under verification debt.", "body_md": "**Status: first release, November 2026.** Every section was researched against primary sources and\nreviewed by the author, and CI checks every change: links, structure, diagrams, and that every lab\nruns. The few claims that couldn't be confirmed against a primary source are listed, with the sections\nthat use them, in [PLAN.md](https://github.com/daneb/ai-system-design-primer/blob/master/PLAN.md#verification-debt). Reviews and corrections are welcome; please\ninclude a source.\n\nLearn how to design systems built on large language models: the trade-offs, the components, and the patterns that have converged across the industry, along with the ones that are still moving.\n\nLearn how to design AI systems that hold up in production. Prepare for the AI system design conversation.\n\nBuilding on models is now a core engineering skill, and the field moves fast. Most of what's written about it is a product announcement, a framework tutorial or a single team's experience. This primer is an organised collection of what has converged across providers and researchers, with every trade-off named and every number dated and sourced.\n\nIt is modelled on Donne Martin's [System Design Primer](https://github.com/donnemartin/system-design-primer):\nthe same arc of method, trade-offs, components, solved designs and reference numbers, rebuilt for\nsystems whose core component is probabilistic, priced per token, and open to prompt injection.\n\n**Learn how to design AI systems.** Each topic is a short page you can read in ten minutes, with a\ndiagram, when to use it, when not to, and its disadvantages. A deep dive per topic holds the provider\nsurvey, numbers, risk controls and cloud mappings.\n\n**Prepare for the AI system design conversation,** in an interview or a design review. Work through the\n[method](https://github.com/daneb/ai-system-design-primer/blob/master/docs/1-method/1-method.md), the [solved designs](#ai-system-design-questions-with-solutions)\nand the [practice questions](https://github.com/daneb/ai-system-design-primer/blob/master/docs/4-solved-designs/4.8-unsolved-questions.md).\n\nEvery page ends in question-and-answer flashcards. Build the deck with either command (standard library only):\n\n```\npython3 scripts/primer.py anki         # writes build/ai-system-design-primer.apkg: double-click to import\npython3 scripts/primer.py flashcards   # writes build/flashcards.tsv: plain text for Anki's File > Import\n```\n\nThe package has one sub-deck per part. Re-importing a newer build updates answers in place and keeps\nyour review history; a reworded question arrives as a new card. Cards are tagged by section and\nmaturity, so you can study one part, or suspend `maturity::frontier` cards when they go stale.\n\nMost topics come with a small, runnable lab: a simulation or calculation, numpy or the standard library only, with the prediction written down before the run and an honest note when it was wrong.\n\n| Lab | Question | \n|---|---|\n| [0.1](https://github.com/daneb/ai-system-design-primer/blob/master/labs/0.1-tokens-and-sampling/README.md) | What a token is, and what temperature does | \n| [0.2](https://github.com/daneb/ai-system-design-primer/blob/master/labs/0.2-inside-a-model-call/README.md) | Prefill, decode, the KV cache and reasoning tokens | \n| [0.3](https://github.com/daneb/ai-system-design-primer/blob/master/labs/0.3-tool-calling/README.md) | The tool-calling loop, its token bill, and what checks catch | \n| [2.1](https://github.com/daneb/ai-system-design-primer/blob/master/labs/2.1-cost-quality-latency/README.md) | When does routing between models pay off? | \n| [2.2](https://github.com/daneb/ai-system-design-primer/blob/master/labs/2.2-determinism-vs-autonomy/README.md) | What autonomy costs in reliability and predictability | \n| [2.3](https://github.com/daneb/ai-system-design-primer/blob/master/labs/2.3-context-vs-retrieval/README.md) | When is the whole corpus in the prompt cheaper than retrieval? | \n| [2.4](https://github.com/daneb/ai-system-design-primer/blob/master/labs/2.4-capability-vs-security/README.md) | Count to three, then size what a detector leaves behind | \n| [2.5](https://github.com/daneb/ai-system-design-primer/blob/master/labs/2.5-single-vs-multi-agent/README.md) | One agent or several? | \n| [2.7](https://github.com/daneb/ai-system-design-primer/blob/master/labs/2.7-throughput-vs-latency/README.md) | Batching, per-user speed, and why you can't run at 100% | \n| [3.2](https://github.com/daneb/ai-system-design-primer/blob/master/labs/3.2-input-guardrails/README.md) | What a guardrail's error rates mean at volume | \n| [3.3](https://github.com/daneb/ai-system-design-primer/blob/master/labs/3.3-context-engineering/README.md) | What each context strategy costs, and what it forgets | \n| [3.4](https://github.com/daneb/ai-system-design-primer/blob/master/labs/3.4-retrieval-pipeline/README.md) | Keyword vs dense vs hybrid retrieval | \n| [3.5](https://github.com/daneb/ai-system-design-primer/blob/master/labs/3.5-agentic-retrieval/README.md) | Single-shot retrieval, query fan-out, or an agent loop? | \n| [3.6](https://github.com/daneb/ai-system-design-primer/blob/master/labs/3.6-vector-stores/README.md) | Approximate search and filtering | \n| [3.7](https://github.com/daneb/ai-system-design-primer/blob/master/labs/3.7-model-layer/README.md) | Picking the cheapest model that \"meets the bar\", with a noisy eval | \n| [3.8](https://github.com/daneb/ai-system-design-primer/blob/master/labs/3.8-serving-internals/README.md) | Cache arithmetic and when speculation pays | \n| [3.9](https://github.com/daneb/ai-system-design-primer/blob/master/labs/3.9-workflows-and-agents/README.md) | An evaluator loop is only as good as its evaluator | \n| [3.10](https://github.com/daneb/ai-system-design-primer/blob/master/labs/3.10-multi-agent-and-protocols/README.md) | What does connecting more tools cost, and does tool search pay? | \n| [3.11](https://github.com/daneb/ai-system-design-primer/blob/master/labs/3.11-memory/README.md) | What should an agent remember, and how? | \n| [3.12](https://github.com/daneb/ai-system-design-primer/blob/master/labs/3.12-output-guardrails/README.md) | How far does a quote check get you? | \n| [3.13](https://github.com/daneb/ai-system-design-primer/blob/master/labs/3.13-caching/README.md) | When a prompt cache pays, and what a semantic cache gets wrong | \n| [3.14](https://github.com/daneb/ai-system-design-primer/blob/master/labs/3.14-asynchronism/README.md) | Retries during an overload, and checkpoints for long runs | \n| [3.15](https://github.com/daneb/ai-system-design-primer/blob/master/labs/3.15-evals/README.md) | How many eval cases do you need? | \n| [3.16](https://github.com/daneb/ai-system-design-primer/blob/master/labs/3.16-observability/README.md) | Which agent traces should you keep? | \n| [3.17](https://github.com/daneb/ai-system-design-primer/blob/master/labs/3.17-security/README.md) | Pin your tools, and see what pinning can't see | \n| [3.18](https://github.com/daneb/ai-system-design-primer/blob/master/labs/3.18-model-adaptation/README.md) | What LoRA trains, and when a fine-tune pays for itself | \n| [4.1](https://github.com/daneb/ai-system-design-primer/blob/master/labs/4.1-inference-api/README.md) | How many accelerators does a self-hosted inference API need? | \n| [4.2](https://github.com/daneb/ai-system-design-primer/blob/master/labs/4.2-enterprise-rag/README.md) | Where the money goes in an enterprise RAG assistant | \n| [4.4](https://github.com/daneb/ai-system-design-primer/blob/master/labs/4.4-document-review/README.md) | What 98% recall costs in lawyer time | \n| [4.5](https://github.com/daneb/ai-system-design-primer/blob/master/labs/4.5-support-agent/README.md) | Consistency with policy in the prompt or in a policy engine | \n| [4.6](https://github.com/daneb/ai-system-design-primer/blob/master/labs/4.6-coding-agent/README.md) | Review capacity caps merged work | \n\nLearn from the community.\n\nPull requests are welcome to fix errors, improve sections and add new ones. Read [STYLE.md](https://github.com/daneb/ai-system-design-primer/blob/master/STYLE.md)\nfor how sections are researched and written (learner-first, several providers per topic, every claim\nsourced) and [CONTRIBUTING.md](https://github.com/daneb/ai-system-design-primer/blob/master/CONTRIBUTING.md) for the mechanics. Decisions about the primer itself\nare recorded in [adr/](https://github.com/daneb/ai-system-design-primer/blob/master/adr). Work still to do is in [ROADMAP.md](https://github.com/daneb/ai-system-design-primer/blob/master/ROADMAP.md).\n\nSummaries of AI system design topics, including pros and cons. **Everything is a trade-off.**\n\nEach section links to its deep dive. Maturity is marked `S` (stable core), `S/F` (stable concept,\nvolatile specifics) or `F` (frontier, expect rewrites).\n\n**Part 0: Orientation**\n\n- [0 Orientation](https://github.com/daneb/ai-system-design-primer/blob/master/docs/0-orientation/0-orientation.md)`S`\n- [0.1 Tokens, context and sampling](https://github.com/daneb/ai-system-design-primer/blob/master/docs/0-orientation/0.1-tokens-context-and-sampling.md)`S`\n- [0.2 Inside a model call: prefill, decode and reasoning](https://github.com/daneb/ai-system-design-primer/blob/master/docs/0-orientation/0.2-inside-a-model-call.md)`S`\n- [0.3 Tool calling and structured output](https://github.com/daneb/ai-system-design-primer/blob/master/docs/0-orientation/0.3-tool-calling.md)`S`\n\n**Part 1: Method**\n\n**Part 2: Trade-offs**\n\n- [2.1 Cost vs quality vs latency](https://github.com/daneb/ai-system-design-primer/blob/master/docs/2-trade-offs/2.1-cost-quality-latency.md)`S` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/2.1-cost-quality-latency.md)\n- [2.2 Determinism vs autonomy](https://github.com/daneb/ai-system-design-primer/blob/master/docs/2-trade-offs/2.2-determinism-vs-autonomy.md)`S/F` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/2.2-determinism-vs-autonomy.md)\n- [2.3 Context stuffing vs retrieval](https://github.com/daneb/ai-system-design-primer/blob/master/docs/2-trade-offs/2.3-context-vs-retrieval.md)`S/F` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/2.3-context-vs-retrieval.md)\n- [2.4 Capability vs security](https://github.com/daneb/ai-system-design-primer/blob/master/docs/2-trade-offs/2.4-capability-vs-security.md)`S/F` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/2.4-capability-vs-security.md)\n- [2.5 Single-agent vs multi-agent](https://github.com/daneb/ai-system-design-primer/blob/master/docs/2-trade-offs/2.5-single-vs-multi-agent.md)`S/F` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/2.5-single-vs-multi-agent.md)\n- [2.6 Prompting vs RAG vs fine-tuning](https://github.com/daneb/ai-system-design-primer/blob/master/docs/2-trade-offs/2.6-prompt-rag-finetune.md)`S` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/2.6-prompt-rag-finetune.md)\n- [2.7 Throughput vs per-request latency in serving](https://github.com/daneb/ai-system-design-primer/blob/master/docs/2-trade-offs/2.7-throughput-vs-latency.md)`S` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/2.7-throughput-vs-latency.md)\n\n**Part 3: Components, in request order**\n\n- [3.1 AI gateway and router](https://github.com/daneb/ai-system-design-primer/blob/master/docs/3-components/3.1-ai-gateway-and-router.md)`S` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/3.1-ai-gateway-and-router.md)\n- [3.2 Input guardrails](https://github.com/daneb/ai-system-design-primer/blob/master/docs/3-components/3.2-input-guardrails.md)`S` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/3.2-input-guardrails.md)\n- [3.3 Context engineering](https://github.com/daneb/ai-system-design-primer/blob/master/docs/3-components/3.3-context-engineering.md)`S/F` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/3.3-context-engineering.md)\n- [3.4 Retrieval pipeline](https://github.com/daneb/ai-system-design-primer/blob/master/docs/3-components/3.4-retrieval-pipeline.md)`S` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/3.4-retrieval-pipeline.md)\n- [3.5 Agentic retrieval and the long-context boundary](https://github.com/daneb/ai-system-design-primer/blob/master/docs/3-components/3.5-agentic-retrieval.md)`F` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/3.5-agentic-retrieval.md)\n- [3.6 Vector stores](https://github.com/daneb/ai-system-design-primer/blob/master/docs/3-components/3.6-vector-stores.md)`S/F` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/3.6-vector-stores.md)\n- [3.7 Model layer: selection, structured outputs, streaming](https://github.com/daneb/ai-system-design-primer/blob/master/docs/3-components/3.7-model-layer.md)`S/F` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/3.7-model-layer.md)\n- [3.8 Serving internals](https://github.com/daneb/ai-system-design-primer/blob/master/docs/3-components/3.8-serving-internals.md)`S/F` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/3.8-serving-internals.md)\n- [3.9 Workflows and agents](https://github.com/daneb/ai-system-design-primer/blob/master/docs/3-components/3.9-workflows-and-agents.md)`S` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/3.9-workflows-and-agents.md)\n- [3.10 Multi-agent topologies and protocols (MCP, A2A)](https://github.com/daneb/ai-system-design-primer/blob/master/docs/3-components/3.10-multi-agent-and-protocols.md)`F` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/3.10-multi-agent-and-protocols.md)\n- [3.11 Agent memory](https://github.com/daneb/ai-system-design-primer/blob/master/docs/3-components/3.11-memory.md)`F` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/3.11-memory.md)\n- [3.12 Output guardrails and validation](https://github.com/daneb/ai-system-design-primer/blob/master/docs/3-components/3.12-output-guardrails.md)`S` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/3.12-output-guardrails.md)\n- [3.13 Caching](https://github.com/daneb/ai-system-design-primer/blob/master/docs/3-components/3.13-caching.md)`S/F` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/3.13-caching.md)\n- [3.14 Asynchronism: batch, durable execution, back-pressure](https://github.com/daneb/ai-system-design-primer/blob/master/docs/3-components/3.14-asynchronism.md)`S` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/3.14-asynchronism.md)\n- [3.15 Evals](https://github.com/daneb/ai-system-design-primer/blob/master/docs/3-components/3.15-evals.md)`S` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/3.15-evals.md)\n- [3.16 Observability](https://github.com/daneb/ai-system-design-primer/blob/master/docs/3-components/3.16-observability.md)`S/F` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/3.16-observability.md)\n- [3.17 Security](https://github.com/daneb/ai-system-design-primer/blob/master/docs/3-components/3.17-security.md)`S/F` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/3.17-security.md)\n- [3.18 Model adaptation](https://github.com/daneb/ai-system-design-primer/blob/master/docs/3-components/3.18-model-adaptation.md)`S` ·[deep dive](https://github.com/daneb/ai-system-design-primer/blob/master/docs/deep-dives/3.18-model-adaptation.md)\n\n**Part 4: Solved designs**\n\n**Part 5: Appendix**\n\nSuggested topics to review based on your timeline.\n\n|  | Short (days) | Medium (weeks) | Long (months) | \n|---|---|---|---|\n| Read [Orientation](https://github.com/daneb/ai-system-design-primer/blob/master/docs/0-orientation/0-orientation.md) , the foundations ([0.1](https://github.com/daneb/ai-system-design-primer/blob/master/docs/0-orientation/0.1-tokens-context-and-sampling.md) –[0.3](https://github.com/daneb/ai-system-design-primer/blob/master/docs/0-orientation/0.3-tool-calling.md) ) and the[method](https://github.com/daneb/ai-system-design-primer/blob/master/docs/1-method/1-method.md) | ✓ | ✓ | ✓ | \n| Read the trade-offs (Part 2) | Some | All | All | \n| Read the components (Part 3) | 3.1, 3.4, 3.9, 3.15, 3.17 | Most | All, plus deep dives | \n| Read [Numbers](https://github.com/daneb/ai-system-design-primer/blob/master/docs/5-appendix/5.1-numbers.md) and the[Glossary](https://github.com/daneb/ai-system-design-primer/blob/master/docs/5-appendix/5.6-glossary.md) | ✓ | ✓ | ✓ | \n| Work the solved designs (Part 4) | Some | Many | All | \n| Run the labs and their exercises | Some | Many | All | \n| Practise the [additional questions](https://github.com/daneb/ai-system-design-primer/blob/master/docs/4-solved-designs/4.8-unsolved-questions.md) | Some | Many | Most | \n| Read [real-world architectures](https://github.com/daneb/ai-system-design-primer/blob/master/docs/5-appendix/5.5-real-world-architectures.md) | Some | Many | All | \n| Map your platform with [cloud](https://github.com/daneb/ai-system-design-primer/blob/master/docs/5-appendix/5.2-cloud-mapping.md) and[governance](https://github.com/daneb/ai-system-design-primer/blob/master/docs/5-appendix/5.4-governance-crosswalk.md) crosswalks | — | Some | All | \n\nHow to tackle an AI system design question, in an interview or a design review.\n\nThe classic four steps, with two changes: the **quality bar comes first**, because a model-backed\nfeature is right only some of the time; and **hardening is its own step**, because prompt injection,\ndata leakage and runaway agents are design constraints, not add-ons.\n\n1. **Use cases, constraints and the quality bar.** Who, what, how many, how fast, what data, and how\nyou'll know it works.\n2. **Back-of-the-envelope.** Tokens per request, requests per second, cost per day, latency.\n3. **High-level design on the complexity ladder.** Single call → workflow → single agent →\nmulti-agent. Start at the lowest rung that meets the bar.\n4. **Core components.** Retrieval, context, tools, model choice, output checks.\n5. **Harden.** Which legs of the lethal trifecta are present, and which does the design break?\n6. **Scale and optimise.** Bottlenecks in order; caching, routing, batching.\n\nFull walkthrough with a worked example: [How to approach an AI system design question](https://github.com/daneb/ai-system-design-primer/blob/master/docs/1-method/1-method.md).\n\nCommon AI system design questions with sample discussions, numbers and diagrams.\n\n| Question |  | \n|---|---|\n| Design an LLM inference API | [Solution](https://github.com/daneb/ai-system-design-primer/blob/master/docs/4-solved-designs/4.1-llm-inference-api.md) | \n| Design an enterprise RAG assistant | [Solution](https://github.com/daneb/ai-system-design-primer/blob/master/docs/4-solved-designs/4.2-enterprise-rag-assistant.md) | \n| Design an enterprise AI gateway | [Solution](https://github.com/daneb/ai-system-design-primer/blob/master/docs/4-solved-designs/4.3-enterprise-ai-gateway.md) | \n| Design a regulated document-review assistant | [Solution](https://github.com/daneb/ai-system-design-primer/blob/master/docs/4-solved-designs/4.4-regulated-document-review.md) | \n| Design a customer-support agent | [Solution](https://github.com/daneb/ai-system-design-primer/blob/master/docs/4-solved-designs/4.5-customer-support-agent.md) | \n| Design a coding agent platform | [Solution](https://github.com/daneb/ai-system-design-primer/blob/master/docs/4-solved-designs/4.6-coding-agent.md) | \n| Design an eval and release pipeline | [Solution](https://github.com/daneb/ai-system-design-primer/blob/master/docs/4-solved-designs/4.7-eval-and-release-pipeline.md) | \n| Add an AI system design question | [Contribute](https://github.com/daneb/ai-system-design-primer/blob/master/CONTRIBUTING.md) | \n\nMore practice: [additional design questions](https://github.com/daneb/ai-system-design-primer/blob/master/docs/4-solved-designs/4.8-unsolved-questions.md).\n\n- [Numbers every AI engineer should know](https://github.com/daneb/ai-system-design-primer/blob/master/docs/5-appendix/5.1-numbers.md) : tokens, speed, cost\nratios, memory, retrieval and eval figures, each dated and sourced.\n- [Cloud mapping](https://github.com/daneb/ai-system-design-primer/blob/master/docs/5-appendix/5.2-cloud-mapping.md) : each capability on Azure, AWS, Google Cloud,\nOpenAI, Anthropic and open source.\n- [Pattern crosswalk](https://github.com/daneb/ai-system-design-primer/blob/master/docs/5-appendix/5.3-pattern-crosswalk.md) : the same patterns under each\nprovider's and author's names.\n- [Governance crosswalk](https://github.com/daneb/ai-system-design-primer/blob/master/docs/5-appendix/5.4-governance-crosswalk.md) : OWASP LLM and Agentic Top 10,\nFINOS, EU AI Act, mapped to primer sections.\n- [Real-world architectures](https://github.com/daneb/ai-system-design-primer/blob/master/docs/5-appendix/5.5-real-world-architectures.md) : engineering write-ups\nand independent studies.\n- [Glossary](https://github.com/daneb/ai-system-design-primer/blob/master/docs/5-appendix/5.6-glossary.md) and changelog.\n\n- **Trade-offs first.** Every pattern says which trade-off it moves and in which direction.\n- **Quality bar first.** Evals are part of the method, not an afterthought.\n- **Maturity is labelled and dated.** Each page carries`last_verified` and`review_by` ; the checker\nfails when a review is overdue. Frontier pages are reviewed every three months.\n- **Several providers on every topic.** Anthropic, OpenAI, Google, AWS and Microsoft, with the names\neach uses.\n- **Vendor-neutral prose.** Product names live in the deep dives and the cloud mapping.\n- **Risk and controls on every topic,** with the evidence an auditor would ask for.\n- **Runnable labs** with predictions recorded before the run.\n\n| Phase | Sections | Planned | Draft | Review | Published | \n|---|---|---|---|---|---|\n| 0 | 6 | 0 | 0 | 0 | 6 | \n| 1 | 12 | 0 | 0 | 2 | 10 | \n| 2 | 10 | 0 | 0 | 2 | 8 | \n| 3 | 11 | 0 | 0 | 1 | 10 | \n| 4 | 5 | 0 | 0 | 2 | 3 | \n\nSee [ROADMAP.md](https://github.com/daneb/ai-system-design-primer/blob/master/ROADMAP.md) for what's next and [PLAN.md](https://github.com/daneb/ai-system-design-primer/blob/master/PLAN.md) for the build plan and the\nverification debt (claims still waiting for a first-party source).\n\n- Donne Martin's [System Design Primer](https://github.com/donnemartin/system-design-primer) , whose\nstructure this follows.\n- The provider guides, papers and engineering write-ups cited in each section; see\n[real-world architectures](https://github.com/daneb/ai-system-design-primer/blob/master/docs/5-appendix/5.5-real-world-architectures.md) .\n\nOpen an issue to discuss errors, missing topics or new solved designs. Report security problems, or\nguidance that would make a system less safe, privately as described in [SECURITY.md](https://github.com/daneb/ai-system-design-primer/blob/master/SECURITY.md).\nParticipation is covered by the [Code of Conduct](https://github.com/daneb/ai-system-design-primer/blob/master/CODE_OF_CONDUCT.md).\n\n- **Content** (pages, diagrams, flashcards, lab READMEs) is licensed under[Creative Commons Attribution 4.0 International](https://github.com/daneb/ai-system-design-primer/blob/master/LICENSE) (CC BY 4.0), the same licence as the\noriginal System Design Primer.\n- All diagrams and charts are original to this repository and covered by the content licence.\n- **Code** (`scripts/` , the lab scripts and the CI workflow) is licensed under the[MIT License](https://github.com/daneb/ai-system-design-primer/blob/master/LICENSE-CODE) .\n- Contributions are accepted under the same terms. The reasoning is in [ADR 0008](https://github.com/daneb/ai-system-design-primer/blob/master/adr/0008-licences.md) .\n\nThe author researched and wrote this primer with an AI assistant, and reviewed every section. The\nmethod is in [STYLE.md](https://github.com/daneb/ai-system-design-primer/blob/master/STYLE.md): primary sources from several providers for every claim, a dated\n`last_verified` on every page, runnable labs instead of asserted numbers, and a public list of what\nisn't yet verified. Mistakes are still possible; please report them with a source.", "url": "https://wpnews.pro/news/show-hn-ai-system-design-primer", "canonical_source": "https://github.com/daneb/ai-system-design-primer/", "published_at": "2026-11-02 05:42:08+00:00", "updated_at": "2026-11-02 06:51:27.162226+00:00", "lang": "en", "topics": ["large-language-models", "ai-tools", "developer-tools", "ai-research"], "entities": ["AI System Design Primer", "Donne Martin", "System Design Primer", "Anki"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/show-hn-ai-system-design-primer", "markdown": "https://wpnews.pro/news/show-hn-ai-system-design-primer.md", "text": "https://wpnews.pro/news/show-hn-ai-system-design-primer.txt", "jsonld": "https://wpnews.pro/news/show-hn-ai-system-design-primer.jsonld"}}