DroidPath – Stream Android UI Trees at 60Hz over TCP (Bypassing ADB) A GitHub project called DroidPath, published by developer V0val0x, streams Android UI trees as a live Shadow DOM over TCP port 27189 via a 631 KB single-DEX Kotlin JAR launched with app_process, bypassing a companion APK install. DroidPath's A* symbolic router completed a four-hop "Navigate to Night Light" task in 1,683 ms with zero intermediate LLM roundtrips, versus roughly 12,000–25,000 ms and 4–5 vision inference calls for a traditional VLM screenshot loop, and it persists screens to ~/.droidpath/shadow_graph.json while compacting near-duplicates at Jaccard similarity of 0.90 or higher. The project also ships a standalone MCP bridge (droidpath-mcp) that exposes the router to Claude, Cursor and other MCP clients over JSON-RPC 2.0 via stdio or HTTP+SSE. Persistent A Symbolic UI Router, Headless Kotlin Shadow DOM Daemon & Standalone MCP Bridge for Android English | Русская версия Russian https://github.com/V0val0x/DroidPath/blob/main/README RU.md DroidPath eliminates slow, token-heavy VLM screenshot-think-tap loops for Android automation. Instead of asking an LLM to inspect screenshots at every step, DroidPath streams a live Shadow DOM directly from Android Accessibility & Window APIs, compiles UI transitions into a persistent Spatial Graph , and navigates multi-screen workflows deterministically with A pathfinding in sub-second hops — with zero intermediate LLM roundtrips . php flowchart LR Agent "AI Agent Claude / Cursor / MCP Client " <-- |"JSON-RPC 2.0 stdio / HTTP+SSE "| CLI "droidpath-mcp / DroidPathBridge" subgraph Host "macOS Host Swift 5.9+ · AndroidShadowGraphKit " CLI <-- |"Path Queries & Passive Learning"| Bridge "ShadowGraphBridge" Bridge -- DOM "ShadowDOMState + ShadowTreeIndex" Bridge -- Graph "SpatialGraphEngine\nScreenLayoutHasher · Jaccard ≥ 0.90\n~/.droidpath/shadow graph.json" Bridge -- AStar "AStarPathfinder + MacroExecutionEngine" Bridge -- |"Self-Healing Recovery Hook"| Recovery "SHA-256 Deploy + app process Restart" end subgraph Android "Android Device Zero-APK " Daemon "android-daemon.jar Kotlin single-DEX \napp process :27189 · NDJSON Delta Stream" Sys "UiAutomation / Accessibility / WindowManager" end Daemon <-- |"adb forward tcp:27189"| DOM AStar -- |"adb shell input tap/swipe"| Sys Daemon --- Sys 1. Layer 1 — Headless Kotlin Shadow DOM Daemon android-daemon/ : - Compiles into a standalone 631 KB single-DEX JAR android-daemon.jar launched via app process — zero companion APK install required. - Streams full snapshots and compact NDJSON incremental diffs over TCP :27189 with event debouncing, configurable tree depth, and heartbeat/watchdog protection. - Deployed idempotently via SHA-256 verification DroidPathManager / deploy.sh and protected by automatic self-healing recovery if Android kills the process. 2. Compiles into a standalone 3. Layer 2 — Live Shadow DOM & Persistent Spatial Graph AndroidShadowGraphKit : - ScreenLayoutHasher strips volatile timestamps, clocks 12:34 , and dates so returning to Home or Settings hashes deterministically. - SpatialGraphEngine constructs a directed multigraph of screens vertices and UI gestures edges , automatically compacts near-duplicate screens via Jaccard similarity = 0.90 , and persists to ~/.droidpath/shadow graph.json . 4. Layer 3 — Persistent A Symbolic Router & Standalone MCP Bridge DroidPathBridge + droidpath-mcp : - AStarPathfinder + BinaryHeapPriorityQueue computes minimum-cost multi-hop routes to any target text, resource-id , package, or canonical layout hash. - MacroExecutionEngine dispatches each tap/swipe over ADB, waits for exact or canonical Shadow DOM confirmation per hop including post-swipe RecyclerView fling quiescence before resolving downstream bounds , and raises structured PathDeviationError diagnostics on unexpected popups or screen timeouts. Prompt: "Navigate to Night Light" from Launcher Home Screen: | Metric | Traditional VLM Screenshot Loop | DroidPath A Router | |---|---|---| | Intermediate LLM Roundtrips | 4–5 vision inference calls | 0 calls | | Total End-to-End Latency | ~12,000–25,000 ms | 1,683 ms 4 hops | | State Feedback | Full PNG screenshots screencap | Sub-ms Shadow DOM NDJSON frames | | Standalone Agentic HUD Execution | |---| Prerequisites: macOS 14+, Swift 5.9+, adb brew install android-platform-tools , JDK 17 only needed if rebuilding android-daemon.jar from Kotlin source . git clone https://github.com/V0val0x/DroidPath.git cd DroidPath Build standalone single-DEX Kotlin daemon requires JDK 17 + Android d8 / build-tools or Gradle ./android-daemon/scripts/build-dex.sh Run Swift + Kotlin tests swift test ./android-daemon/gradlew -p android-daemon test Build release CLI swift build -c release Or download prebuilt droidpath-mcp and android-daemon.jar directly from GitHub Releases https://github.com/V0val0x/DroidPath/releases . { "mcpServers": { "droidpath": { "command": "/path/to/droidpath-mcp", "args": "--stdio", "--daemon-jar", "/path/to/android-daemon.jar" } } } Or launch the loopback HTTP/SSE MCP server 127.0.0.1:8766 : droidpath-mcp --http --port 8766 --daemon-jar ./android-daemon/build/dist/android-daemon.jar dependencies: .package url: "https://github.com/V0val0x/DroidPath.git", from: "1.0.0" Add "AndroidShadowGraphKit" core Shadow DOM, Spatial Graph, and A engine or "DroidPathBridge" ADB deployer, persistence, and MCP core to your target dependencies. | Tool | Description | |---|---| | android navigate to node | Runs Layer 3 A routing to reach a target text, resource-id , package, or canonical layout hash 0x... across screens | | android get ui tree | Reads live interactive UI elements from the Kotlin Shadow DOM stream with uiautomator XML fallback | | android graph stats | Inspects persisted graph vertex/edge counts, active canonical hash, daemon state, and storage path | | android list devices | Lists connected USB and Wireless ADB Android devices | | android tap element | Taps by x, y or semantic text / resource id / content desc and records the graph edge | | android swipe | Swipes x1, y1 - x2, y2 and attributes the gesture into the Spatial Graph | | android type text | Types text into the active Android field | | android keyevent | Sends Android keyevents HOME , BACK , ENTER , APP SWITCH , POWER | Part of the native macOS ↔ Android automation suite alongside AndOnMac https://github.com/V0val0x/AndOnMac : - AndOnMac https://github.com/V0val0x/AndOnMac — Native 120Hz ProMotion Metal Android mirroring & control app with built-in DroidPath Agentic HUD - AndroidMCPKit https://github.com/V0val0x/AndroidMCPKit — Visual-to-MCP {{parameter}} macro studio & 3-tier Apple Vision OCR self-healing - MetalScrcpyKit https://github.com/V0val0x/MetalScrcpyKit — Zero-copy VideoToolbox H.264/HEVC decoder & CAMetalLayer renderer - ADBConnectKit https://github.com/V0val0x/ADBConnectKit — Zero-dependency Swift ADB SDK USB, QR Wi-Fi pairing, Direct Hotspot bypass - VisionScreenRecallKit https://github.com/V0val0x/VisionScreenRecallKit — Apple Silicon Vision OCR & SQLite FTS5 screen memory MIT License © 2026 Kirill Zaitsev. See LICENSE https://github.com/V0val0x/DroidPath/blob/main/LICENSE .