for AI Agents
Device automation CLI for AI agents. Real apps on iOS, Android, TV, and desktop. Token-efficient snapshots, semantic refs, evidence captured only when needed
Inspired by the browser automation patterns that made web agents practical. Built for native mobile and TV apps.
Give your agent "eyes" on the UI
Agents need a structured way to understand the current screen. snapshot exposes the accessibility tree and assigns stable refs (like @e2), keeping context smaller than raw screenshots or verbose dumps.
Act with semantic precision
Once the agent understands the screen, it acts. It can use stable refs or rely on semantic selectors to find elements by text, label, or role—making flows readable and resilient.
Cross-platform by default
One mental model across iOS, Android, and TV. The same agent workflow moves seamlessly between development simulators, physical QA devices, and TV-class targets.
$ agent-device open com.example.app --platform android --serial emulator-5554$ agent-device open com.myapp --platform ios$ agent-device open YouTube --platform android --target tv
From Exploration to E2E Replay
This is where exploration becomes infrastructure. Agents can explore a UI, save the flow to a script, and re-run it later. Experimental auto-updating (-u) can even heal stale selectors on the fly.
Built for agents. Anywhere. #
We believe all agents should have access to agent-device running real simulators and devices regardless whether they operate within your desktop or from a cloud sandbox.
Make your agent productive from the first prompt. #
Don't make your agent learn the tool from scratch. Install the official agent-device skills to give it the canonical workflows, targeting rules, debugging patterns, and replay guidance it needs to automate mobile apps effectively.
Not just a CLI. A fully typed integration layer. #
Use the typed TypeScript client to integrate directly into your codebase or your custom cloud agents. Manage sessions, provision devices, and capture snapshots programmatically and deterministically.
1import { createAgentDeviceClient } from 'agent-device';2 3const client = createAgentDeviceClient({4 session: 'qa-ios',5 lockPolicy: 'reject',6});7 8// Boot the right target9const ensured = await client.simulators.ensure({10 device: 'iPhone 17 Pro',11 boot: true,12});13 14// Navigate and capture15await client.apps.open({ app: 'com.apple.Preferences', platform: 'ios' });16const snapshot = await client.capture.snapshot({ interactiveOnly: true });17 18await client.sessions.close();
Built for debugging, not just the happy path. #
When things break, agents and humans both need evidence. Capture parsed logs, network dumps, and screen recordings without leaving the terminal.
Log & Network Parsing
$ agent-device logs mark "before submit"$ agent-device network dump 25
Visual Proof
$ agent-device screenshot error.png$ agent-device record start fail-state.mp4
Environment & Push Triggers
$ agent-device settings airplane on$ agent-device push com.example.app '{"aps":{"alert":"Welcome"}}'
What agents build with it #
Exploratory QA
Navigate apps, identify problems, collect visual evidence.
Bug Reproduction
Deep link to a state, capture logs, and preserve exact steps.
Regression Loops
Turn successful exploration into replayable .ad scripts.
Clean-State Testing
Reinstall builds, manage permissions, test onboarding.