I built an MCP server that lets AI agents use my Windows apps while I keep typing A developer built Sidehand, an MCP server for Windows 10 and 11 that lets AI agents read and operate background application windows while the user keeps typing in the foreground. The tool exposes a window's controls as a compact text tree and supports typing, clicking and list selection without moving the mouse or stealing focus, with the author reporting 4-5x fewer tokens than agent-desktop on typical apps and about 20x fewer on an Edge page. Sidehand is source-available under PolyForm Shield 1.0.0 and installs via npx or npm. Most "computer use" tools take over the machine. The pointer moves, windows jump to the front, and you wait until the agent is done. I wanted an agent to work in one Windows app while I kept typing in another, so I built Sidehand. Sidehand is an MCP server plus a CLI and a pi extension for Windows 10 and 11. Claude, Codex, Cursor or any MCP client can read and operate Windows apps that sit behind the window you are using. It types, clicks, picks from lists and reads the screen as text. Your mouse does not move and your keyboard stays with you. bash $ sidehand tree "Contoso Orders" window: Contoso Orders 18 elements e4 Edit "Customer" e12 Button "Submit order" $ sidehand act e4 type "Blue-B Studio" $ sidehand act e12 click One short line per control. Reading a window takes about 4 to 5 times fewer tokens than agent-desktop on typical apps, and about 20 times fewer on an Edge page. The method is in docs/benchmark.md. In the benchmark task: Some apps bring their own window to the front while they handle a click. Windows gives a background process no way to forbid that, so Sidehand watches the foreground while an action runs and puts your window back as it happens. In my tests on the real desktop that took 11 to 13 ms. A key you press in that moment can still be lost, and the result tells the agent when it happened. claude mcp add sidehand -- npx -y sidehand mcp Cursor, Codex and Claude Desktop config are in the README. For the CLI: npm install -g sidehand . --allow-foreground , which is your permission to take the foreground for the keys. Enter on a button or link works without it.