Microsoft is one of the few companies evaluating the dangers of AI while simultaneously implementing the latest features across its product portfolio with cutting-edge designs, advanced models, and top-tier frameworks. However, this doesn't mean the company is halting the rollout of new AI features, despite being aware of the risks of these products on consumer PCs. For example, on PCs running the Windows 11 operating system, the Copilot AI companion includes features that can control some actions on your PC, with your consent. Yet, the company is now arguing in a separate news post that frontier models and the agents running on them are not to be trusted. Unfortunately, frontier models, regardless of their origin, cannot be trusted. This is not because models are inherently malicious. Models have been trained to attain results, which often leads to reward hacking, and models are not optimized around organizational norms or judgment. Agents are unpredictable. They will adapt as the context changes, may not behave as intended and will collaborate and collude with other agents to reach their objectives, without needing to be compromised.
Global default for Copilot features generally available