{"slug": "databricks-certified-context-engineer-associate-exam-cheatsheet", "title": "Databricks Certified Context Engineer Associate exam cheatsheet", "summary": "Databricks has published a cheatsheet for its Certified Context Engineer Associate exam, detailing the seven exam sections, context failure modes, and product stack recommendations. The guide covers topics such as system prompt design, knowledge retrieval with Genie, memory architecture using Lakebase and MLflow, and multi-agent task design, verified against official documentation.", "body_md": "*Verified 2026-07-25 against the exam guide + the official docs pages.*\n\n| # | Section | Weight |\n|---|---|---|\n| 1 | Foundations of Context Engineering | 16% |\n| 2 | System Prompt and Instruction Design | 9% |\n| 3 | Knowledge Retrieval and Genie Configuration | 20% |\n| 4 | Memory Architecture with Lakebase and MLflow | 18% |\n| 5 | Tool Design, MCP, and Agent Context | 13% |\n| 6 | Context Compression and Compaction | 11% |\n| 7 | Multi-Agent and Long-Horizon Task Design | 13% |\n\nAssumed knowledge the exam guide names explicitly: LLM context windows · prompt engineering & few-shot construction · agent frameworks + MCP · Agent Bricks · Semantic Search + embedding models · Lakebase for memory · MLflow 3 for evaluation · Unity Catalog governance for agent tools and retrieval sources.\n\n**The 4 context failure modes** (diagnose from a trace):\n\n**Poisoning**— an error/hallucination enters context and keeps getting referenced.** Distraction**— context so long the model over-focuses on history, ignores instructions.** Confusion**— superfluous content (e.g., too many tools) → wrong tool/action selection.** Clash**— contradictory info in context.\n\n**Proactive context control** (before compaction is needed):\nMinimal tool sets · just-in-time retrieval · tool-result scoping (return only needed fields).\n\n**Attention budget** — identify which context elements consume disproportionate attention and cut them:\n\n- Verbose boilerplate system prompts\n- Full tool schemas for rarely-used tools\n- Unscoped raw tool outputs\n- Stale conversation turns\n- Duplicated retrieved chunks Fix = remove/shrink the largest low-signal block first.\n\n**Context-length degradation point** — degradation shows up as falling *retrieval accuracy* (right chunk in context, wrong chunk cited) or falling *reasoning quality* (instruction drift, forgotten constraints) as the window fills. Locate the turn where the metric breaks, then intervene: compact, re-retrieve just-in-time, or clear consumed tool outputs — don't just enlarge the window.\n\n**Reasoning mode:** **reduced** = simple/high-volume/tight token budget · **extended thinking** = genuinely hard multi-step reasoning · **standard** = default. Justify by token budget + context window impact.\n\n**Product-stack picker**:\n\n| Need | Pick |\n|---|---|\n| Govern what the agent may read; metadata, tags, lineage, PII/quality policy | Unity Catalog |\n| Durable state/memory across sessions, transactional reads/writes | Lakebase |\n| Expose governed tools/data to the agent over a standard protocol | MCP |\n| Trace, evaluate, score, monitor agent quality | MLflow 3 |\n\n**Production-ready Genie Agent** = instructions + sample questions + **trusted SQL assets** (see Sec 3).\n\n**Few-shot example selection** — evaluate candidates against **canonical coverage criteria**, then take the **minimal set**:\n\n- One example per\n*distinct*behaviour/edge case; drop any example whose behaviour is already demonstrated. - Prefer short, representative examples over long real transcripts.\n- Adding an example must buy measurable accuracy — otherwise it is pure token cost.\n- Redundant examples also cause distraction, not just cost.\n\n**Miscalibrated system prompt** → pick the *targeted* revision with least token + maintenance cost:\n\n| Observed failure | Targeted fix |\n|---|---|\n| Agent ignores a rule | Move the rule up / state it once, imperatively — don't restate it 3× |\n| Over-refuses or over-escalates | Narrow the guard clause's trigger condition |\n| Wrong output format | Add one output exemplar, not a prose spec |\n| Rarely-needed capability instructions bloat every call | Package as Agent Skills, load on demand (Sec 5) |\n\n**Two index types:**\n\n**Delta Sync Index**— auto-syncs with a source Delta table, incrementally updating as the underlying data changes. Standard endpoints require**Change Data Feed enabled** on the source table. Embeddings either:**Managed**— Databricks computes the vectors with a model you specify, optionally saved to a UC table.** Self-managed**— you supply pre-computed embeddings in the Delta table. Converting a self-managed embedding index to a Databricks-managed index is not possible. You must create a new index and recompute.\n\n**Direct Vector Access Index**— direct read/write of vectors + metadata; you update it manually via the REST API when embeddings change. Use when an external system owns embedding updates.\n\n**Endpoints & sync:**\n\n**Standard**— supports** Continuous**(seconds of latency, higher cost) and** Triggered**; both are incremental (only changed data processed). Requires CDF.** Storage-optimized**— >1B vectors at dim 768,** 10–20× faster indexing**, but** only Triggered sync**(continuous not supported) and*every sync partially rebuilds the index*.\n\n**Strategy:** **pre-inference** (embedding-based, up-front/synced index) for stable corpora + low latency · **just-in-time agentic** (tool call / dynamic Delta query) for fresh, occasional or fast-changing data.\n\n**Chunking:** structure/semantic-aware, sized to the **embedding model's context length**, modest overlap, matched to the query types the agent will face.\n\n**RAG pipeline over a UC-governed corpus:** UC-governed source table → chunk → embed → Delta Sync Index on the *authoritative* table only → retrieve top-k with metadata filters → scope fields before injecting → cite. Governance is applied at the index/source layer, not by post-filtering results.\n\n**Metadata accuracy gap** → fix **UC table and column comments/descriptions** + Genie instructions. Diagnose the failure mode from **MLflow eval logs** (what was retrieved vs. what was needed) cross-referenced with **UC metadata**, then apply the UC governance action — comments, certification, tags, or revoking access to derived copies.\n\n📚 [https://docs.databricks.com/aws/en/vector-search/vector-search](https://docs.databricks.com/aws/en/vector-search/vector-search) · [https://docs.databricks.com/aws/en/vector-search/create-vector-search](https://docs.databricks.com/aws/en/vector-search/create-vector-search)\n\nProduction-ready = **instructions** + **example SQL** + **trusted assets** + **knowledge store** + **benchmarks**.\n\n**Instructions limit = 100 per agent**: each example SQL query, each SQL function, and the entire** General instructions**text block** each count as one**.** Knowledge Store snippets = 200 per agent**: table descriptions, join relationships, and SQL expressions (measures, filters, dimensions) share this limit.*Not counted:*text instructions, example SQL queries, SQL functions, column descriptions, prompt matching settings.**Data objects: up to 30 tables or views per agent.** Scale limits: 10,000 conversations per agent, 10,000 messages per conversation.**Trusted assets**=** parameterized example SQL queries**+** SQL functions registered in Unity Catalog**. When Genie uses a trusted asset to answer, it provides a** verified answer**.** Benchmarks**= a set of test questions run to assess overall response accuracy.- Genie is\n**nondeterministic**→ keep guidance free from conflicting or ambiguous information. - Joins:\n**primary and foreign keys defined in your schema are automatically saved as join relationships.**\n\n📚 [https://docs.databricks.com/aws/en/genie/tune-quality](https://docs.databricks.com/aws/en/genie/tune-quality) · [https://docs.databricks.com/aws/en/genie/trusted-assets](https://docs.databricks.com/aws/en/genie/trusted-assets) · [https://docs.databricks.com/aws/en/genie/set-up](https://docs.databricks.com/aws/en/genie/set-up)\n\n**Lakebase = a fully managed Postgres database integrated into the Databricks platform.** Autoscaling compute; isolated **branches** for development and testing.\n\n**Short-term memory**= context within a** single conversation session**, via** thread IDs + checkpointing**.** Long-term memory**= extracts and stores key insights** across multiple conversations**; enables personalised responses from past interactions.\n\n**Match memory type to scope:**\nTransient working memory → **in-context scratchpad**; durable cross-session facts → **Lakebase**.\n\n**Delta-backed state object** required over an in-context scratchpad when state must persist beyond the context window, survive failures, or be queryable.\n\n**Static vs. dynamic retrieval from Lakebase:**\n\n*static*= load a fixed memory slice at session start — predictable tokens, low latency, goes stale mid-task*dynamic*= query Lakebase per turn as the agent needs it — always fresh and token-lean, at the cost of per-turn latency and more failure surface.\n\n**MLflow 3 for GenAI:**\n\n**Tracing** logs inputs, outputs, intermediate steps and metadata — prompts, retrievals, tool calls, responses, latency, cost.**Scorer**= a unified interface for defining evaluation criteria, returning** pass/fail, true/false, a numerical value, or a categorical value**.** Four**scorer categories:- Built-in judges\n- Custom LLM judges\n- Code-based scorers\n- Third-party scorers\n\n**The same scorer works for evaluation in development and monitoring in production**, keeping evaluation consistent across the lifecycle.** Comparing runs:**the most reliable context configuration is the one with the best scorer results*and*the least variance across runs on the specified task.\n\n📚 [https://docs.databricks.com/aws/en/oltp/projects/state-management](https://docs.databricks.com/aws/en/oltp/projects/state-management) · [https://docs.databricks.com/aws/en/oltp/](https://docs.databricks.com/aws/en/oltp/) · [https://docs.databricks.com/aws/en/mlflow3/genai/eval-monitor/concepts/scorers](https://docs.databricks.com/aws/en/mlflow3/genai/eval-monitor/concepts/scorers) · [https://docs.databricks.com/aws/en/mlflow3/genai](https://docs.databricks.com/aws/en/mlflow3/genai)\n\n**Five Databricks managed MCP servers.** Unity Catalog enforces permissions, so agents and users access only the tools and data you grant them. On-behalf-of-user OAuth scopes: `genie`\n\n· `ai-search`\n\n· `sql`\n\n· `unity-catalog`\n\n.\n\n**Layered MCP (discovery → planning → execution) + progressive disclosure**: metadata always in context; full tool/skill detail loads just-in-time → fewer tokens than loading all tool schemas upfront.- Confused tools =\n**overlapping descriptions**→ disambiguate purpose, inputs and outputs so no two tools claim the same job. - Bloated system prompt with rarely-invoked capabilities → package as\n**Agent Skills**, load on demand; minimize baseline context cost without harming task success rate. - Tool selection = semantic similarity (task description ↔ tool description). Good documentation helps your agents know when and how to use each tool.\n**UC function tools**= structured retrieval when the query is known ahead of time and the agent provides the parameters.- Require Python type hints and Google-style docstrings\n`*args`\n\n/`**kwargs`\n\nunsupported- Serverless execution is the default/recommended mode for production\n- Databricks recommends\n**adding UC functions via MCP servers** over direct integration (automatic tool discovery + built-in auth).\n\n- Near capacity → clear\n**old, already-consumed raw tool outputs** first.\n\n📚 [https://docs.databricks.com/aws/en/generative-ai/mcp/managed-mcp](https://docs.databricks.com/aws/en/generative-ai/mcp/managed-mcp) · [https://docs.databricks.com/aws/en/generative-ai/agent-framework/create-custom-tool](https://docs.databricks.com/aws/en/generative-ai/agent-framework/create-custom-tool)\n\n**Maximize recall first**(capture everything relevant),** then iterate to improve precision**(remove superfluous outputs).- Preserve\n**durable user constraints, decisions and requirements**— the category most often wrongly discarded, whose loss shows up as downstream coherence failures. - Safe to remove: consumed raw tool outputs, superseded intermediate results, resolved sub-tasks, duplicate retrievals.\n- Hard-coded trimming (drop oldest N) is sufficient\n**only when relevance correlates with recency**; otherwise use semantic compaction. - Aggressive = lower token cost, risk of losing subtle context; conservative = higher fidelity, higher cost. Pick per stakes.\n\n- Insufficient\n**shared context**→ inconsistent outputs, conflicting decisions, degraded reliability. - Sub-agents receiving only individual\n**task messages** rather than**full agent traces** at dispatch time → give common ground**without** expanding each sub-agent's context window. - Conflicting outputs → change\n**context propagation**: shared state store, consistent instructions, dispatch the relevant trace. - Orchestrator context saturation → redesign sub-agent\n**outputs** to be concise, scoped and structured, without compromising task coherence. - Boundaries\n**too fine**= excessive handoff/compression overhead;** too coarse**= unmanageable context window growth within individual agents. - Strategy mismatch: linear single-thread where subtasks are\n**independent and parallelisable**→ decompose into sub-agents; justify by the task's** dependency structure**.\n\nConstrain retrieval to **authoritative** sources **before deployment**: grant the service principal read on certified tables only · build the index on the authoritative source only · use UC certification/tags + permissions to exclude derived copies. Never grant broad catalog `SELECT`\n\n\"so the agent can choose.\"", "url": "https://wpnews.pro/news/databricks-certified-context-engineer-associate-exam-cheatsheet", "canonical_source": "https://gist.github.com/ch-geo/4dbe6d7f78611fce78809fae0ef6e0f6", "published_at": "2026-07-25 20:50:37+00:00", "updated_at": "2026-08-10 18:09:10.908094+00:00", "lang": "en", "topics": ["artificial-intelligence", "large-language-models", "ai-agents", "developer-tools"], "entities": ["Databricks", "Lakebase", "MLflow", "Unity Catalog", "MCP", "Genie"], "alternates": {"html": "https://wpnews.pro/news/databricks-certified-context-engineer-associate-exam-cheatsheet", "markdown": "https://wpnews.pro/news/databricks-certified-context-engineer-associate-exam-cheatsheet.md", "text": "https://wpnews.pro/news/databricks-certified-context-engineer-associate-exam-cheatsheet.txt", "jsonld": "https://wpnews.pro/news/databricks-certified-context-engineer-associate-exam-cheatsheet.jsonld"}}