Release: ttok 0.4
ttok is my CLI tool for counting tokens, using OpenAI's open source tiktoken library.
It hasn't been in updated in a couple of years, but I finally fixed a Click warning, updated CI, and added a --list-models command to list available models.
It works with uvx, so you can count tokens in anything like this:
cat file.txt | uvx ttok
Tags: projects, ai, openai, generative-ai, llms, tokenization
source & further reading
simonwillison.net — original article
Quoting Victoria Kim
llm-openai-decisions 0.1a0
llm-mistral 0.16