On Thursday, WorkBuddy, Tencent’s AI agent platform, launched a remote control feature supported by Tencent’s Edge One team. The feature allows users to connect to a computer logged into the same account via the mobile app, view the desktop in real time, and take control of operations when necessary.
Unlike traditional remote desktop tools, which primarily focus on remote access between devices, WorkBuddy’s new feature is designed specifically for AI agent workflows. Users can monitor an agent’s actions in real time and intervene when tasks go off track or require manual authorization.
To use the feature, users need to update the mobile app to version 2.7.0 or later and the macOS desktop client to version 5.9.3 or later. Once connected, the computer screen appears in a floating window on the app’s home page or at the top of a conversation. Users can monitor the agent without leaving the current chat.
If an agent encounters a problem while executing a task, users can intervene directly from their phones. For example, if an account is not logged in or a connector’s authorization has expired, users can try to resolve the issue on their mobile devices rather than returning to their computers.
For manual control, users can tap the full-screen button, which switches the phone interface to landscape mode and enables them to operate the desktop via touch.
The interface provides three options: Controls, Keyboard, and Mouse, which support actions such as switching windows, returning to the desktop, and entering text. A virtual mouse is also available for more precise clicking and scrolling in smaller areas of the screen.
On security, Tencent says the feature limits each computer to one authenticated mobile device at a time. Screen data and control commands are transmitted through an encrypted channel.
The platform does not record user input or store screen footage from remote control sessions. Network traffic generated by remote control is charged against the device’s data usage and does not consume WorkBuddy’s AI agent token quota.
To get started, users must enable the remote connection option for devices logged into the same account in WorkBuddy’s settings, install the required remote control component, and grant screen recording and accessibility permissions. Once configured, users can connect remotely as long as the computer remains powered on and WorkBuddy is online.
In practical terms, the feature helps solve a common challenge in AI agent workflows: the need for human intervention during task execution. AI agents can already handle multi-step tasks such as organizing documents and compiling data, but they may still encounter login requirements, permission requests, or operational errors.
Remote control allows users to monitor progress and make adjustments from their phones without having to stay at their desks.
However, the feature may offer more than just a way for users to operate computers from their phones. It could introduce a more flexible model of human-AI collaboration, with AI handling repetitive work while users step in to make decisions and correct mistakes at critical points.
Rather than pursuing fully autonomous execution at all costs, retaining human oversight may be a more practical approach for AI productivity tools at their current stage of development.
That said, a smartphone cannot fully replicate the experience of working on a computer. Remote access may be convenient for simple tasks such as approving permissions or switching windows, but its efficiency in more complex workflows involving data processing and multiple windows remains to be tested.
The feature is now available for trial to all users. Tencent says future versions will introduce more enterprise-focused capabilities, including tiered permission management and audit logs.