{"slug": "github-copilot-can-now-interact-with-desktop-apps-with-computer-use", "title": "GitHub Copilot can now interact with desktop apps with computer use", "summary": "GitHub launched computer use in public preview for GitHub Copilot CLI and the GitHub Copilot app on macOS and Windows, letting Copilot read accessible app content and visual context, click controls, enter and edit text, press keys, scroll, drag, and navigate workflows across desktop applications. The feature requires user approval before Copilot controls an app, guides macOS users through Accessibility and Screen Recording permissions, and can be disabled by organization-managed settings; users enable it with /computer on in Copilot CLI or via Settings > Computer Use in the GitHub Copilot app. GitHub said computer use works best for automating legacy and GUI-only software that lacks an API, command-line interface, or MCP integration.", "body_md": "# GitHub Copilot can now interact with desktop apps with computer use\n\nComputer use is now available in public preview in GitHub Copilot CLI and the GitHub Copilot app on macOS and Windows.\n\nCopilot can interact with desktop applications on your behalf (e.g., reading accessible app content and visual context, clicking controls, entering and editing text, pressing keys, scrolling, dragging, and navigating workflows across applications). This expands the tasks Copilot can help automate, including workflows in legacy and GUI-only software that do not provide an API, command-line interface, or MCP integration.\n\nCopilot uses computer-use tools to navigate an expense-report workflow in Safari.\n\nYou remain in control. Copilot asks for approval before controlling an app, and you can review or reset apps that you have chosen to always allow. On macOS, computer use also guides you through the required Accessibility and Screen Recording permissions. Organization-managed settings can disable the feature.\n\nTo get started:\n\n- In Copilot CLI, run `/computer on` . Use`/computer show` to check its status and`/computer off` to disable it.\n- In the GitHub Copilot app, open **Settings** , select**Computer Use** , and turn on**Enable Computer Use** . You can also use`/computer on` .\n\nComputer use works best when you describe the outcome you want, the applications involved, and any important constraints. For example, you can ask Copilot to summarize notifications in a browser, update content in a presentation, or move information through a workflow in a desktop application.\n\nLearn more about [computer use in GitHub Copilot CLI and the GitHub Copilot app](https://docs.github.com/copilot/concepts/agents/computer-use)", "url": "https://wpnews.pro/news/github-copilot-can-now-interact-with-desktop-apps-with-computer-use", "canonical_source": "https://github.blog/changelog/2026-10-01-github-copilot-can-now-interact-with-desktop-apps", "published_at": "2026-10-01 19:11:26+00:00", "updated_at": "2026-10-01 21:33:48.349532+00:00", "lang": "en", "topics": ["ai-agents", "ai-products", "developer-tools", "artificial-intelligence"], "entities": ["GitHub", "GitHub Copilot", "GitHub Copilot CLI", "macOS", "Windows", "Safari"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/github-copilot-can-now-interact-with-desktop-apps-with-computer-use", "markdown": "https://wpnews.pro/news/github-copilot-can-now-interact-with-desktop-apps-with-computer-use.md", "text": "https://wpnews.pro/news/github-copilot-can-now-interact-with-desktop-apps-with-computer-use.txt", "jsonld": "https://wpnews.pro/news/github-copilot-can-now-interact-with-desktop-apps-with-computer-use.jsonld"}}