{"slug": "poki-open-source-iphone-agent-that-taps-and-types-in-real-apps", "title": "Poki: Open-Source iPhone Agent That Taps and Types in Real Apps", "summary": "The open-source iPhone agent Poki, published by Joseph Zhou at github.com/JosssphZhou/poki under AGPL-3.0-only, runs on the device and taps, types and swipes inside real installed apps using the user's own ChatGPT, Claude, Gemini, DeepSeek or OpenRouter credentials, and had about 1,700 GitHub stars when explainx.ai checked on November 21, 2026. Installation requires an iPhone on iOS 18+, a Mac on macOS 14+ with Node.js 24+ (or Windows x64 with Apple Devices or iTunes), a USB cable, a free Apple Account, Developer Mode and a VPN-style tunnel routing traffic to 10.7.0.1, with Poki Setup renewing 7-day signatures. The README's canonical first task is creating a Notes entry titled \"Poki Demo\" with three grocery lines, and payments are always gated behind a hard stop.", "body_md": "**Poki is an open-source iPhone agent that operates real apps on the phone itself**, not a cloud browser session. The [JosssphZhou/poki](https://github.com/JosssphZhou/poki?ref=explainx) repository showed **about 1,700 GitHub stars** when explainx.ai checked on November 21, 2026, after trending the prior week. The project site is [poki.bot](https://poki.bot/?ref=explainx) — unrelated to the **poki.com** casual games portal searchers often mean.\n\nIf you are hunting **phone-use agents** after [OpenAI computer-use APIs](https://explainx.ai/blog/openai-computer-use-healthcare-gpt-6-astra-cvs-november-2026) and [Anthropic tool-use patterns](https://explainx.ai/blog/what-are-agent-skills-complete-guide), Poki is the **on-device, consumer-shaped** entry in that stack: **AGPL-3.0**, **your model keys**, and **hard stops** before money moves.\n\n## What Poki does on an iPhone\n\nThe README headline is blunt: **Poki uses your iPhone like you do.** The app **runs on the device**, **reads the screen**, and **taps, types, and swipes** inside **real installed apps**, using **your** ChatGPT, Claude, Gemini, DeepSeek, OpenRouter, or compatible server credentials.\n\nThree positioning points matter for builders:\n\n| Feature | README claim | Why it matters | \n|---|---|---|\n| On-device execution | No PC required after install | Unlike remote Mac relays in some MCP demos | \n| Permission tiers | User-chosen ask mode; payments always gated | Reduces runaway purchase stories | \n| Skills and voice | Saved skills, Action Button, Siri, Talk to Poki | Product UX beyond one-shot chat | \n\n**iPhone Duo Split View** lets one agent work across **two apps side by side** — closer to how humans context-switch than single-app demos.\n\nOn-device agent stack on a handheld device, illustrating local phone GUI automation\n\nJoseph Zhou (周瑟夫) and contributors copyright the project **AGPL-3.0-only**; brand assets follow separate [BRAND.md](https://github.com/JosssphZhou/poki/blob/main/BRAND.md?ref=explainx) rules on the repo.\n\n## Install path developers actually use\n\nPoki's README optimizes for **coding agents as installers**:\n\n```\nInstall Poki on my iPhone from https://github.com/JosssphZhou/poki\n```\n\nPrerequisites from [INSTALL-IPHONE.md](https://github.com/JosssphZhou/poki/blob/main/INSTALL-IPHONE.md?ref=explainx) summarized on the README:\n\n- **iPhone** on**iOS 18+** (README also mentions testing on**iOS 27** builds).\n- **Mac macOS 14+** with**Node.js 24+** for agent-driven install, or**Windows x64** with Apple Devices or iTunes.\n- **USB data cable** and a**free Apple Account** ;**Poki Setup** can renew**7-day signatures** while open, or you sign in inside Poki for longer installs.\n- **Developer Mode** and**Automation Mode** when iOS prompts.\n- **VPN-style tunnel** so traffic to**10.7.0.1** routes back to the phone (LocalDevVPN, Karing, or Shadowrocket named in README).\n\nThe canonical first task in README: create a **Notes** entry titled **Poki Demo** with three grocery lines, then **open Notes** to verify — a minimal **closed-loop** test builders can script in eval harnesses.\n\nCompare install friction to [agentes.chat self-hosted chat](https://explainx.ai/blog/agentes-chat-open-source-self-hosted-slack-alternative-ai-agents-mcp-agpl-github-trending-2026): Poki targets **one user, one phone**; agentes targets **team channels**. Both are AGPL-shaped and ask you to bring **model spend**.\n\n## Models, skills, and triggers\n\nSupported providers per README include **Anthropic, OpenAI, Gemini, DeepSeek, OpenRouter, OpenCode Go**, and **OpenAI-compatible servers**, plus **ChatGPT Plus/Pro** sign-in.\n\n**Skills** live in repo folders the agent can launch by tap or voice — same cultural move as [AWS Quick skills](https://explainx.ai/blog/aws-quick-skills-agents-catalog-build-guide-2026) and [Jane Street socratic-tutor](https://explainx.ai/blog/janestreet-agent-skills-socratic-tutor-github-2026), but on a **phone shell** with **Action Button** and **Siri** hooks.\n\n**Talk to Poki** runs a **spoken chat** with **Dynamic Island** step tracking, which is the UX pattern Apple platform reviewers watch closely when agents act outside Safari.\n\n## Safety and compliance considerations\n\nPhone agents sit at the intersection of **accessibility APIs**, **enterprise MDM policies**, and **fraud**. Before dogfooding:\n\n1. **Read SECURITY.md** on the repo and file issues through GitHub if you find privilege leaks.\n2. **Use a non-production Apple ID** until you trust automation on Wallet and Mail.\n3. **Keep payment and delete confirmations on** — README says those classes always halt; do not patch that away in forks you ship to customers.\n4. **Mind AGPL-3.0** if you embed Poki in a commercial mobility product; network use triggers copyleft obligations unless you negotiate a separate license with maintainers.\n\nFor agent-security architecture patterns — **policy before tool call** — see how explainx.ai approaches [coding-agent guardrails](https://explainx.ai/blog/cognition-acquires-corridor-devin-security-ex-cisa-founders-stamos-agent-written-code-guardrails-2026). Poki is consumer-facing, but the **approval gate** design is the same lesson.\n\n## How Poki differs from remote computer-use stacks\n\n| Approach | Control plane | Typical latency | Best for | \n|---|---|---|---|\n| Poki on iPhone | On-device screen + input | Local UI loop | Personal errands in native apps | \n| Cloud CUA / Operator | Hosted VM or browser | Network round trips | Web-first workflows | \n| Mac MCP relay | Desktop tether | USB or LAN | Dev machines with full filesystem | \n\nPoki's bet is **offline-from-PC daily use** after a one-time install — interesting for markets where **Android desktop agents** already ship but **iOS automation** stayed sandboxed.\n\n## What developers on Hacker News are watching\n\nThe GitHub trending entry drew builders comparing Poki to **Apple's own agentic hiring** stories explainx.ai covered in [Apple agentic assistant job listings](https://explainx.ai/blog/apple-agentic-ai-assistant-job-listing-siri-ui-frameworks-foundation-models-bloomberg-verge-2026). Expect threads to focus on **VPN tunnel requirements**, **7-day signing**, and whether **Split View** generalizes to **banking apps** with attestation.\n\nNone of that replaces **your** device test: star counts move faster than security review.\n\n## iPhone requirements and release channels\n\nThe README's hardware table is worth copying into your internal runbook before a team pilot:\n\n| Requirement | README detail | \n|---|---|\n| Devices | iPhone XS, XR, SE 2nd gen or newer; iPadOS 18+ on iPad | \n| OS | iOS 18 minimum; project mentions physical testing on newer iOS builds | \n| Desktop | macOS 14+ with Node 24+ for agent install, or Windows with Apple device tooling | \n| Signing | Free Apple Account works; Poki Setup can refresh **7-day** signatures while open | \n| Networking | Tunnel routing **10.7.0.1** to the handset for API reachability | \n\nPoki documents **release channels** and verification steps in [INSTALL-IPHONE.md](https://github.com/JosssphZhou/poki/blob/main/INSTALL-IPHONE.md?ref=explainx) and the main [Poki iPhone App Guide](https://github.com/JosssphZhou/poki/blob/main/docs/guide.md?ref=explainx) linked from the README. Treat **changelog entries** as the source of truth when a demo video on social media shows a feature your build lacks — mobile agent projects ship weekly during hype cycles.\n\n## Everyday tasks the README highlights\n\nBeyond the Notes demo, Poki markets **practical errands**:\n\n- **Built-in browser lookups** and**weather checks** from chat, Action Button, or Siri.\n- **Saved skills** launched by tap or voice so repeat workflows do not need re-prompting.\n- **Talk to Poki** hands-free sessions with**Dynamic Island** progress for multi-step chores.\n\nThose flows matter for product managers comparing Poki to **Shortcuts automations**. Shortcuts are deterministic; Poki is **model-steered** with **visual grounding**. The failure mode is different: Shortcuts break when UI IDs shift; Poki may **mis-tap** when layouts change but can sometimes **recover** if the model reasons about the new screen.\n\n## Split View and Duo scenarios\n\nOn **iPhone Duo**, Poki can operate **two apps in Split View** simultaneously. That is the architecture teams want when a workflow copies numbers from Mail into Numbers, or checks Maps while editing a Reminders list. Cloud browser agents typically **serialize** context across tabs; on-device Split View keeps **both pixel buffers** in scope for the same agent session — at the cost of **smaller tap targets** and **higher mis-click risk**.\n\nDocument **eval scenarios** per Duo pair you care about; do not assume one successful Notes test generalizes to banking plus authenticator apps.\n\n## Licensing, contributions, and forks\n\nPoki ships **AGPL-3.0-only** with a **Contributor Agreement** and brand guidelines. Forking for internal labs is fine; **shipping a rebranded store build** without complying with AGPL network copyleft triggers legal review.\n\nThe README points contributors to **GitHub Discussions** for ideas and **Issues** for bugs. If you integrate Poki lessons into an Android stack, compare openly with [Google Gemini robotics and assistant investments](https://explainx.ai/blog/google-duplex-tasks-gemini-business-phone-calls-november-2026) — different OS policy envelopes.\n\n## Enterprise MDM and privacy posture\n\nCorporate security teams should ask:\n\n1. Does **Developer Mode** on employee phones violate policy?\n2. Can the **VPN tunnel** exfiltrate traffic outside corporate DNS inspection?\n3. Do **screen-reading agents** violate**app confidentiality** rules for healthcare or finance installs?\n\nApple's platform controls and Poki's **user confirmation** gates reduce but do not eliminate **insider misuse**. Pair technical controls with **logging exports** if the project adds them; at publish time the README emphasizes **local execution**, not centralized audit SaaS.\n\nFor screenshot and agent surveillance context on other messengers, see [Signal's screenshot block for AI agents](https://explainx.ai/blog/signal-blocks-screenshots-by-default-ai-agents-siri-gemini-recall-android-ios-macos-2026).\n\n## When to choose Poki versus a cloud agent\n\nChoose **Poki** when:\n\n- The workflow is **native-app heavy** (Wallet, Health, proprietary enterprise apps).\n- You need **offline-from-desktop** daily use after one USB install.\n- You already pay for **ChatGPT Plus** or**Claude API** and want to reuse those accounts.\n\nChoose **cloud computer-use** or **desktop MCP** when:\n\n- The workflow is **browser-only** and you can sandbox a VM.\n- You must **centralize** secrets and forbid on-device Developer Mode.\n- You need **team observability** out of the box — Poki is single-user shaped today.\n\n## Maintenance, updates, and support expectations\n\nOpen-source phone agents move quickly. Before you rely on Poki for daily automation, read **CHANGELOG.md** on the repo for breaking changes to **Automation Mode** prompts, **VPN requirements**, or **model provider auth**. The README explicitly marks **Poki MCP** and **Poki Agent** as **no longer updated** — do not copy their install docs.\n\nCommunity support runs through **GitHub Discussions** and **Issues**; there is no enterprise SLA. Plan an internal owner who can rebuild signatures when Apple rotates provisioning profiles, especially if you use the free **7-day** developer certificate path.", "url": "https://wpnews.pro/news/poki-open-source-iphone-agent-that-taps-and-types-in-real-apps", "canonical_source": "https://explainx.ai/blog/poki-open-source-iphone-gui-agent-claude-code-install-2026?utm_source=rss&utm_medium=feed&utm_campaign=blog", "published_at": "2026-11-21 00:00:00+00:00", "updated_at": "2026-11-21 03:12:33.323548+00:00", "lang": "en", "topics": ["ai-agents", "ai-tools", "artificial-intelligence", "ai-products"], "entities": ["Poki", "Joseph Zhou", "GitHub", "OpenAI", "Anthropic", "Google Gemini", "DeepSeek", "OpenRouter"], "also_reported_by": [], "takeaway": "Poki runs an on-device iPhone agent under AGPL-3.0 that reads the screen and taps, types and swipes in real apps using your own model keys, with payments always gated and a Notes-based \"Poki Demo\" task as the closed-loop install test.", "recommendation": null, "alternates": {"html": "https://wpnews.pro/news/poki-open-source-iphone-agent-that-taps-and-types-in-real-apps", "markdown": "https://wpnews.pro/news/poki-open-source-iphone-agent-that-taps-and-types-in-real-apps.md", "text": "https://wpnews.pro/news/poki-open-source-iphone-agent-that-taps-and-types-in-real-apps.txt", "jsonld": "https://wpnews.pro/news/poki-open-source-iphone-agent-that-taps-and-types-in-real-apps.jsonld"}}