Guilherme Rambo:
Apple ships the
fm
command-line tool in macOS 27, which can be used to run inference with the local system model or Private Cloud Compute from Terminal or scripts. You know what else can run command-line tools? Mac apps! 😃I decided to spend some of my Codex tokens and take GPT 5.6 Sol for a spin. I asked it to create this Swift package. All it does is provide a
LanguageModel
implementation that uses thefm
command-line tool under the hood, meaning that any Mac app can use the Private Cloud Compute model without requiring a special entitlement from Apple.The main limitation is that this will not work for sandboxed Mac apps, so any Mac app distributed via the Mac App Store won’t be able to use it.
But for developers of Mac apps distributed outside the Mac App Store, this provides a simple and entitlement-free way to use Private Cloud Compute in their apps.
Use sparingly and at your own risk. This is a workaround for Apple’s current limitation that only grants access to Private Cloud Compute to “developers in the App Store Small Business Program with fewer than two million first time App Store downloads”. Hence Rambo’s clever name for the framework.