macOS 27 fm tool output

Apple has released a command-line tool called 'fm' for macOS that provides access to Apple Foundation Models. The tool supports commands for generating responses, interactive chat, token counting, JSON schema generation, serving a Chat Completions API, and checking model availability and quota usage. It offers both on-device and Private Cloud Compute model options.

| ❯ fm 02:34:03 | | | Apple Foundation Models CLI | | | USAGE | | | % fm <command options | | | COMMANDS | | | respond Generate a response to a prompt ⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⣠⠞⠛⠳⣄⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀ | | | chat Start an interactive chat session ⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢀⣀⣿⡀⠀⢀⣽⣀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀ | | | token-count Count tokens in a prompt or instructions ⠀⠀⠀⠀⠀⠀⠀⠀⠀⣀⣤⠴⠚⠋⢁⡼⠛⠛⠛⢧⡈⠙⠓⠦⣤⣀⠀⠀⠀⠀⠀⠀⠀⠀⠀ | | | schema Generate a JSON generation schema ⢠⡶⠒⠲⣦⣠⡴⠞⠋⠉⠀⠀⠀⣴⠟⠀⠀⠀⠀⠀⠹⣆⠀⠀⠀⠈⠙⠲⠦⣄⣠⠖⠒⢦⡀ | | | serve Start a Chat Completions API server ⢿⡀⠀⠀⣸⣇⠀⠀⠀⠀⠀⣠⡾⠁⠀⠀⠀⠀⠀⠀⠀⠈⢳⡄⠀⠀⠀⠀⠀⣨⣇⠀⠀⢀⡿ | | | available Check model availability ⠈⠛⠲⠚⢿⡍⠙⠳⢦⣤⣴⠋⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠙⣦⣠⠴⠖⠋⢁⡽⠓⠒⠋⠁ | | | quota-usage Check model quota usage ⠀⠀⠀⠀⠀⠹⣦⡀⣠⠟⠉⠛⠲⢦⣄⣠⡴⠶⢦⣄⣠⡤⠖⠛⠉⠳⣄⠀⣴⠋⠀⠀⠀⠀⠀ | | | ⠀⠀⠀⠀⠀⠀⢈⣿⣏⠀⠀⠀⠀⠀⢈⣿⠀⠀⠀⣿⡁⠀⠀⠀⠀⠀⣸⣿⡁⠀⠀⠀⠀⠀⠀ | | | MODELS ⠀⠀⠀⠀⠀⣴⠟⠀⠙⣧⣀⣤⠶⠚⠋⠙⠳⠶⠞⠋⠙⠓⠦⣤⣀⡴⠋⠀⠹⣄⠀⠀⠀⠀⠀ | | | system On-device Apple Foundation Model default ⢀⣤⠶⢦⣾⣃⣤⡴⠞⠋⠻⣄⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⣠⠟⠙⠒⠦⣄⡈⣳⡤⠤⢤⡀ | | | pcc Apple Foundation Model on Private Cloud Compute ⣿⠁⠀⠀⢹⡏⠀⠀⠀⠀⠀⠙⢷⡀⠀⠀⠀⠀⠀⠀⠀⢀⡾⠃⠀⠀⠀⠀⠀⢉⡏⠀⠀⠀⡷ | | | ⠘⠷⠦⠶⠟⠙⠳⢦⣤⣀⠀⠀⠀⠻⣦⠀⠀⠀⠀⠀⣴⠏⠀⠀⠀⣀⣠⠴⠒⠋⠙⠦⠤⠞⠁ | | | EXAMPLES ⠀⠀⠀⠀⠀⠀⠀⠀⠀⠉⠛⠲⢦⣄⡈⢳⣤⠤⣤⡞⢁⣠⡤⠖⠋⠉⠀⠀⠀⠀⠀⠀⠀⠀⠀ | | | % fm respond 'What is Swift?' ⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠈⠉⣿⠁⠀⠈⣻⠉⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀ | | | % fm respond --model pcc --stream 'Summarize this article' ⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠙⢦⣤⠴⠋⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀ | | | % fm chat --instructions 'You are a coding assistant' | | | % fm token-count 'Hello world' | | | % fm schema object --name Person --string name --int age | | | Run 'fm <command --help' for more information on a command. |