Post-mortem GPU crash debugging with LLMs

AMD has released an open-source Radeon GPU Detective (RGD) MCP Server that connects large language models to AMD's crash analysis pipeline, enabling automatic post-mortem GPU crash debugging. The tool allows developers to analyze GPU crash dumps with a single natural-language prompt, as the LLM autonomously investigates the crash by calling structured tools and proposes fixes in the application's source code.

/radeon-gpu-detective/ AMD Radeon™ GPU Detective AMD Radeon™ GPU Detective RGD is a tool for post-mortem analysis of GPU crashes. RGD can capture AMD GPU crash dumps from DirectX® 12 apps. Software development is in the middle of a fundamental shift. More and more developers rely on LLM-powered coding agents — GitHub Copilot, Claude, Codex, and others — as first-class members of their workflow, not just as autocomplete engines. These tools can read, reason about, and generate source code at a level that makes them genuine force multipliers for complex engineering tasks. GPU crash debugging has always been one of those tasks where that force multiplication is most needed. A GPU crash typically manifests as a device reset, a black screen, or a TDR Timeout Detection and Recovery , leaving the developer with a crash dump and little else. Correlating low-level GPU state with high-level application code is painstaking work, requiring expertise in both graphics API semantics and AMD hardware internals. LLMs, on their own, do an OK job here. They understand the vocabulary — page faults, virtual address timelines, shader disassembly, resource lifecycles — but without structured access to the crash data, they can only speculate. With the right tooling, however, the picture changes dramatically. Give an LLM direct, structured access to the AMD GPU crash dump through a purpose-built interface, and point it at the application’s source code, and it can identify the root cause in minutes and propose a fix in high-level source code, all without debug information. This article introduces the AMD Radeon™ GPU Detective RGD MCP Server : an open-source tool that connects LLMs to AMD’s crash analysis pipeline, enabling automatic post-mortem GPU crash debugging. The workflow is intentionally simple from the developer’s perspective. You open your application’s source code workspace in VS Code or Claude Code CLI, attach the AMD RGD MCP Server, and send one message: “Analyze the crash dump at crash dumps/RenderBench DX12-20260324-131311177.rgd” That’s it. From that single prompt, the LLM takes over, autonomously orchestrating a structured investigation. The developer provides the path to the .rgd crash dump file. No flags, no command-line options, no manual tool invocations. The LLM receives the request and begins its investigation by calling into the RGD MCP Server. The developer sends a single natural-language prompt. The LLM immediately begins calling RGD MCP tools to gather crash evidence. Behind the scenes, the LLM follows a guided investigation strategy embedded in the MCP Server’s tool descriptions. It calls a structured sequence of tools — getting a crash summary, querying page fault information, walking the resource timeline, retrieving execution markers, and analyzing shader disassembly — building up a complete picture of what the GPU was doing at the moment of the crash. The developer can watch this reasoning unfold in real time in the VS Code Copilot Chat or Claude Code CLI session. The LLM synthesizes the evidence into a plain-language explanation of the crash root cause: which resource was accessed illegally, why the virtual address was invalid, which draw call or dispatch was executing, and what the application logic error most likely was. The LLM identifies the root cause — a use-after-free of a GPU resource — and pinpoints the suspect code path. It then proposes a concrete fix in the application’s source. Because the LLM has access to the application source files in its context window see Best Practices best-practices below , it can do more than describe the problem — it can propose a specific, targeted fix in the actual source code. The developer reviews the suggestion, and either accepts it directly or uses it as the starting point for their own fix. Before installing the AMD RGD MCP Server, ensure the following are in place: rgd.exe together with its runtime libraries e.g., amdgpu dis.dll , amd comgr 3.dll on Windows . Download the latest RGD release from rgd.exe is located is in your PATH environment variable, or the RGD EXE PATH environment variable set RGD EXE PATH , then falls back to the system PATH . To verify PATH availability: where rgd . python --version .The RGD MCP Server package can be downloaded from GPUOpen.com /download/rgd mcp server-1.0.0.2.zip . Install the server from the downloaded release package, replacing <version with the actual version number: If upgrading from a previous version, uninstall first: Create a .vscode/mcp.json file in your workspace root or add to an existing one : Note:If rgd.exe is already on your system PATH , the env block can be omitted entirely. Open Copilot Chat Ctrl+Alt+I , click the Tools button, and confirm that rgd appears in the list of available MCP tools. VS Code will prompt you to start the server the first time. If upgrading from a previous version, uninstall first: If rgd.exe is already on your system PATH : If rgd.exe is at a specific path: Tip:The --scope user part of the command is used to register the server globally across all workspaces rather than only for the current workspace. If you wish to only register the server for the current workspace remove --scope user from your command: To unregister the server at any time: Before starting an analysis session, two practices will significantly improve the quality of the LLM’s output: 1. Use your application’s source code as the working directory. When the LLM has the application source files in its context, it can correlate the crash evidence — execution markers, faulting resource names, shader file paths extracted from the crash dump — directly against the actual code. It can, in many cases, identify the exact function, the exact line, and propose a concrete fix. Without source access, the LLM can describe the crash at the GPU level, but cannot close the loop to a code-level recommendation. In VS Code, simply open the folder containing your application’s source as your workspace before running the analysis. In Claude Code CLI, navigate to that directory before starting your session. 2. Instrument your application with user execution markers. AMD GPU crash dumps capture GPU execution state at the time of the crash, including user-defined execution markers if your application inserts them via the AGS library https://github.com/GPUOpen-LibrariesAndSDKs/AGS SDK or the PIX marker replacement headers https://gpuopen.com/manuals/rgp manual/rgp manual-user debug markers . These markers act as named breadcrumbs — strings like "DownSamplePass::Render" or "ShadowMap::Update" — that appear in the crash dump and give the LLM an explicit, searchable link between the GPU crash site and the high-level code structure. With markers present, the LLM can jump directly to the suspect area of your codebase. Without them, it must infer the call site from resource names and shader file paths alone, which is still useful but less precise. Open your application workspace in VS Code see best practices above . Open Copilot Chat with Ctrl+Alt+I or from the Activity Bar . Use the /mcp.rgd.analyze crash prompt command — type /analyze crash in the chat input. VS Code will prompt you to provide the full path to your .rgd crash dump file.Alternatively, type a natural-language request directly: “Analyze the crash dump at C:/crash dumps/my app crash.rgd” Wait for the analysis to complete. The LLM will call a sequence of RGD MCP tools automatically, and you will see its reasoning steps appear in the chat. A full analysis typically takes one to two minutes. Review the root cause explanation and, if source code is available, the proposed fix. You can ask follow-up questions — for example: “Show me the exact line in the source code that causes this.”“What other places in the code could trigger the same issue?”“Apply the fix.” Navigate to your application’s source directory before launching Claude Code CLI: Ask Claude to analyze the crash directly in a prompt. Unlike VS Code, Claude Code CLI does not have an interactive file picker, so include the full path to the .rgd file in your message: “Analyze the crash dump at C:/crash dumps/my app crash.rgd and identify the root cause.” Alternatively , use one of the RGD MCP predefined prompts, which may show as /rgd:analyze crash or /mcp rgd analyze crash type “/analyze crash” and you should see them listed . Even if you choose to use the predefined prompt instead of free text, remember to provide the full path to the .rgd file to be analyzed as part of the prompt text. Claude will call the RGD MCP tools in sequence and present the analysis and fix suggestion in the conversation. To request a source-level fix after the analysis: “Fix it.” The AMD RGD MCP Server bridges two previously separate worlds: AMD’s post-mortem GPU crash analysis pipeline and LLM-powered coding agents. The result is a workflow that automatically produces root cause analysis for a given AMD GPU crash dump .rgd file and can even propose source-code fixes without debug information. The tool is open source and available on GitHub. Download the MCP server package from GPUOpen.com to get started: