EveryCli: Natural-language CLI assistant that runs 100% locally (Rust and ONNX) EveryCli, a natural-language command-line assistant built in Rust and running on ONNX Runtime, performs all search locally with no API key and no network call, according to its project documentation. The tool retrieves matching shell commands from a local YAML corpus in English or French, never executes commands on the user's behalf, and requires confirmation for its --run flag. The daemon listens only on 127.0.0.1:51821, and prebuilt archives for Linux and Windows remove the need for Rust, Cargo or Python. Stop hunting for commands. Describe what you want to do. EveryCli is a natural-language command-line assistant. You describe your intent β€” in English or French β€” and it retrieves the matching shell command from a local corpus. Search runs entirely on your machine: a native Rust daemon combines lexical matching with semantic reranking through ONNX Runtime, with no API key and no network call. The move from the historical Python/PyInstaller flow to this native Rust stack means end users no longer need Rust, Cargo or Python β€” a prebuilt archive is enough. πŸ›Ÿ Safety first. EveryCli never runs a command on your behalf. Results are shown for you to read; --run always asks for confirmation, and shell wrappers only place the command in an editable buffer. EveryCli grew out of a small daily friction. Whenever a CLI command slipped my mind, I'd ask an online LLM β€” and each lookup added two or three seconds of waiting. That delay sounds small, but it can be enough to break context: you switch to another tab, start another task, and later have to reconstruct what you were doing. Digital attention is not split without cost; rapid task switching increases the effort of resuming context and the risk of losing the thread 1 https://www.nngroup.com/articles/serial-task-switching/ . The idea was to keep that loop inside the terminal β€” describe the intent, get a command quickly from a local corpus, and gradually grow your own set of commands with add / list / remove . The goal is not to claim that a compact local model is universally better than a large remote one. It is to accept a smaller, controlled scope when that reduces latency, preserves context and avoids a detour to another tab. When local coverage is not enough, everycli ask remains available as an optional LLM assistant. The objective is simple: less waiting, fewer context switches, and continued control over what actually runs 1 https://www.nngroup.com/articles/serial-task-switching/ . In this setting, a model that is fast and available locally can be more useful than a heavier model that imposes a round-trip and breaks attention. | Audience | What EveryCli offers | |---|---| | Developers & power users | Describe an intent instead of memorizing flags; bilingual EN/FR search | | Privacy-conscious / offline users | search works fully offline β€” no cloud, no API key, no telemetry | | Linux & Windows users | Prebuilt archives with one-command installers; no toolchain required | | Release testers | A reproducible install/search/uninstall runbook | | Contributors & integrators | A documented Rust workspace, daemon protocol and shell contract | EveryCli separates the user interface from the more expensive semantic computation. The Rust client receives your intent and communicates with a local daemon that keeps the model in memory and answers searches quickly. This avoids reloading the model for every command and helps you stay in the terminal on both Ubuntu/Linux and Windows. User β”‚ β–Ό everycli-rs ── JSON/TCP localhost ──▢ everycli-daemon β”‚ β”œβ”€β”€ YAML corpus β”‚ β”œβ”€β”€ model.onnx β”‚ β”œβ”€β”€ tokenizer.json β”‚ └── native ONNX Runtime └── local lexical fallback if the daemon is unavailable The daemon listens only on 127.0.0.1:51821 ; it is not a public network API. It combines the YAML corpus, ONNX model and platform-native runtime. The client also keeps a local lexical fallback so search remains useful when the daemon is unavailable. πŸ“– Architecture deep dive: components, daemon role, protocol, model, runtime, corpus and lifecycle β†’ docs/explanation architecture.md https://github.com/HE11032006/EveryCli/blob/main/docs/explanation architecture.md . - πŸ”Ž Natural-language search β€” describe what you want to do instead of memorizing syntax, using a corpus organized by namespace Git, Docker, Compose, npm, SSH, Python, Linux… . - 🧬 Hybrid local ranking β€” lexical matching and ONNX semantic reranking are fused on your machine to surface relevant commands without sending your query to the cloud. - 🌍 Bilingual search β€” write your request in English, French or a mixed query, without mentally translating a command or its description. - πŸ›°οΈ Fast local daemon β€” the model stays loaded on 127.0.0.1:51821 , allowing repeated searches to answer in a few hundred milliseconds after the first load on tested hardware, on Ubuntu/Linux and Windows, so you can stay in the work rhythm instead of waiting for a remote request. - ✍️ Add your own commands β€” with add , list and remove , you gradually build a personal corpus; its files remain separate from the built-in corpus and survive updates. - 🀝 Optional AI assistance β€” when no local command matches sufficiently, everycli ask can request a proposal from an OpenAI-compatible API and add it to your corpus, so you do not need to repeat a remote lookup for the same need later. - πŸ›‘οΈ Review before execution β€” Sentinel everycli plan can review a retrieved command and flag risks before you decide whether to run it. - 🐚 Shell integration β€” the interactive picker, --json , --copy and deterministic --shell protocol support human and scriptable workflows without automatic execution. - πŸ“¦ No development dependencies for end users β€” a prebuilt release includes the binaries, model, tokenizer, runtime and corpus; end users do not need Rust, Cargo or Python. The simplest path is to run the installer directly from the main branch. It downloads the latest release, verifies its integrity and configures the client, daemon, model, runtime, corpus and background startup automatically. Rust, Cargo and Python are not required. v1.2.1 or later . The public v1.2.0 release shipped an ONNX Runtime library that is too old for the ort crate version used by the daemon; it should not be presented as a working semantic installation. ⚠️ Use the next corrected release, curl -fsSL https://raw.githubusercontent.com/HE11032006/EveryCli/main/install.sh | bash The installer asks for the language, places EveryCli in ~/.local/share/everycli , creates links in ~/.local/bin and configures the systemd --user service. At the end, reload your profile: source ~/.profile everycli search "how to undo my last commit" If everycli is not recognized yet, open a new terminal. The first start may take longer while the daemon loads the model and computes corpus embeddings; later searches benefit from the warm daemon and disk cache. In PowerShell , run: irm https://raw.githubusercontent.com/HE11032006/EveryCli/main/install.ps1 | iex The installer asks for the language, downloads the release, verifies its integrity and configures EveryCli in your user profile. The first path can be somewhat slow, especially during the download and first model load. Open a new terminal if needed for the everycli command to become available. To inspect files before installation, download the matching archive from GitHub Releases https://github.com/HE11032006/EveryCli/releases , extract it and run the installer without arguments from the extracted folder. On Ubuntu/Linux: mkdir everycli-linux-x86 64 tar -xzf everycli-linux-x86 64.tar.gz -C everycli-linux-x86 64 cd everycli-linux-x86 64 ./install.sh source ~/.profile On Windows PowerShell: Expand-Archive .\everycli-windows-x86 64.zip .\everycli-windows-x86 64 cd .\everycli-windows-x86 64 .\install.ps1 The complete archive contains the client, daemon, model.onnx , tokenizer.json , the native ONNX Runtime library and the built-in corpus. To uninstall, use ./uninstall.sh on Linux or ./uninstall.ps1 on Windows; personal data is preserved by default. macOS is compiled and tested by CI , but no installable macOS archive is published yet β€” the native runtime and installer still need end-to-end validation. πŸ“– Full guide: prerequisites, one-command installation, archive installation, checksum verification, uninstall and troubleshooting β†’ docs/tutorial installation.md https://github.com/HE11032006/EveryCli/blob/main/docs/tutorial installation.md . The most useful everyday workflow is the interactive path: everycli search "how to undo my last commit" --top 2 -i ⭐ Recommended workflow. --top 2 limits the display to the two most relevant candidates and -i opens the interactive picker. After choosing, EveryCli shows the selected command instead of making you scan a longer result list. On Windows , the selected command is copied automatically to the clipboard, so you can paste it immediately with Ctrl+V . On Linux , automatic copying from the interactive workflow is not implemented yet; it is planned for a future update. The simple form remains available: everycli search "describe your intent" Common options: everycli search "query" --top 3 maximum number of candidates everycli search "query" -i choose with the keyboard everycli search "query" --copy copy the selected result everycli search "query" --run run after confirmation everycli search "query" --json machine-readable output everycli search "query" --no-daemon force the local lexical fallback Interactive mode lets you review candidates before choosing. EveryCli never runs a command without explicit confirmation. Add and maintain your own commands: everycli add everycli list everycli remove This turns a command found once into a reusable local shortcut. Personal commands live in ~/.everycli/commands Linux or %USERPROFILE%\.everycli\commands Windows , separate from the built-in corpus and preserved through a normal update or uninstall. search is the main local path β€” corpus + Rust daemon, no API key. Two optional companions exist: - everycli ask calls an OpenAI-compatible API to propose a command, explanation, warning and tags, then offers to save it to your personal corpus. It is not the local ranking of search . - Sentinel everycli plan is a separate Python planner that reviews an already-retrieved command. It never executes a shell command for you. Configure a key stored privately, 0600 on Unix : everycli config set api key "your-api-key" everycli config show never prints the full key everycli ask "compress the current directory" The key may also come from EVERYCLI API KEY . Known prefixes are auto-detected, or set a provider explicitly everycli config set provider openai , plus api url / api model for OpenAI-compatible endpoints . Without a key, ask reports a config error while search keeps working offline. EveryCli is driven by a handful of environment variables and a ~/.everycli/config.toml file. The essentials: | Variable | Role | Dev default | |---|---|---| | EVERYCLI PORT | Daemon TCP port | 51821 | | EVERYCLI MODEL DIR | Folder holding model.onnx + tokenizer.json | model dir | | EVERYCLI ONNXRUNTIME DYLIB | Native ONNX Runtime library | .dll / .so per OS | | EVERYCLI DATA DIR | Built-in YAML corpus | shipped corpus | | EVERYCLI USER DATA DIR | Personal YAML corpus | ~/.everycli/commands | | EVERYCLI API KEY | Key for everycli ask | unset | Installers replace the dev defaults with absolute paths. A corpus entry is a YAML record with id , description , tags , per-platform commands , explanation and an optional warning . πŸ“– Full reference: every variable, data paths, corpus schema and the JSON daemon protocol β†’ docs/reference config.md https://github.com/HE11032006/EveryCli/blob/main/docs/reference config.md . EveryCli separates the human interface from the wrapper protocol so a command is never executed by surprise. The --shell -s mode prints only the resolved command to stdout no trailing newline , sends diagnostics to stderr , and does not confirm or run anything β€” ideal for Bash/Zsh/PowerShell wrappers that place the command in an editable buffer. everycli search "undo my last commit" --shell To stay deterministic, --shell does not combine with -i , --run , --copy , --error or --top 1. πŸ“– Full guide: interactive mode, Bash/Zsh/PowerShell wrappers, execution-safety rules β†’ docs/shell integration.md https://github.com/HE11032006/EveryCli/blob/main/docs/shell integration.md . For a prebuilt release you don't need this β€” it targets developers building a local bundle. Rust binaries cd rust cargo build --release -p everycli-rs -p everycli-daemon Targeted tests cargo test -p everycli-rs cargo test -p everycli-core cargo test -p everycli-daemon The production ONNX artifact lives in Michelhe/everycli-minilm-ft-boosted-onnx https://huggingface.co/Michelhe/everycli-minilm-ft-boosted-onnx ; CI pins a revision and verifies SHA-256 checksums. The ort 2.0.0-rc.13 crate requires a native ONNX Runtime 1.27.x+ library the workflow pins 1.27.0 . πŸ“– Full guide: ONNX assets, native runtime, local staging, CI/release flow β†’ docs/how to build.md https://github.com/HE11032006/EveryCli/blob/main/docs/how to build.md . Measurements are development observations, not universal guarantees. On the bilingual eval/confusion set.yaml set the recorded ranking result was 58/66 queries 87.9% . An indicative Windows latency baseline: ~383 ms for a full daemon search vs ~33 ms for the local lexical fallback a cold first load is much slower . python tools/evaluate confusion.py hybrid path python tools/evaluate confusion.py --matcher lexical lexical only πŸ“– Full guide: measurement rules, bundle validation, CI checks, regression reports β†’ docs/benchmarking.md https://github.com/HE11032006/EveryCli/blob/main/docs/benchmarking.md . | Area | Verified status | |---|---| | Rust client, Rust daemon and hybrid search | βœ”οΈ Available | | Distributable model.onnx and tokenizer | βœ”οΈ In validated CI bundles | | Windows install from a complete bundle | βœ”οΈ Verified end to end | | Linux install from a complete bundle | βœ”οΈ Verified under WSL service, search, uninstall | | Ubuntu & Windows CI | βœ”οΈ Complete bundles with model checksums | | macOS | πŸ”§ CI build/tests only; no installer or public archive yet | | Model quantization | πŸ”­ To explore current model is large float32 | | ANN index for very large corpora | πŸ”­ To explore | See CHANGELOG.md https://github.com/HE11032006/EveryCli/blob/main/CHANGELOG.md for factual change history and measurements. | Document | Audience | Scope | |---|---|---| | Installation tutorial https://github.com/HE11032006/EveryCli/blob/main/docs/tutorial installation.md | Users & testers | Install, usage, uninstall, troubleshooting | | Architecture https://github.com/HE11032006/EveryCli/blob/main/docs/explanation architecture.md | Curious developers | Client, daemon, model, ranking, lifecycle | | Build & tests https://github.com/HE11032006/EveryCli/blob/main/docs/how to build.md | Developers | Rust builds, ONNX assets, staging, validation | | Configuration reference https://github.com/HE11032006/EveryCli/blob/main/docs/reference config.md | Integrators | Env vars, paths, YAML schema, daemon protocol | | Shell integration https://github.com/HE11032006/EveryCli/blob/main/docs/shell integration.md | Advanced users | --shell protocol, wrappers, execution safety | | Benchmarks & validation https://github.com/HE11032006/EveryCli/blob/main/docs/benchmarking.md | Developers | Tests, ranking benchmark, latency, CI | | Linux validation guide https://github.com/HE11032006/EveryCli/blob/main/LINUX TEST GUIDE.md | Release testers | Linux install/search/uninstall runbook | | CONTRIBUTING.md https://github.com/HE11032006/EveryCli/blob/main/CONTRIBUTING.md | Contributors | Setup, tests, contribution rules | | CHANGELOG.md https://github.com/HE11032006/EveryCli/blob/main/CHANGELOG.md | Technical readers | Factual change history | EveryCli/ β”œβ”€β”€ everycli/ Sentinel Python component and historical data β”‚ └── data/commands/ Built-in YAML corpus β”œβ”€β”€ rust/ β”‚ β”œβ”€β”€ everycli-core/ Corpus loading and lexical search β”‚ β”œβ”€β”€ everycli-inference/ Semantic encoder and ONNX Runtime β”‚ β”œβ”€β”€ everycli-daemon/ Local TCP server β”‚ └── everycli-rs/ Rust CLI client β”œβ”€β”€ docs/ Standalone technical guides β”œβ”€β”€ scripts/ Platform staging scripts β”œβ”€β”€ install.sh / install.ps1 Linux / Windows installers β”œβ”€β”€ uninstall.sh / uninstall.ps1 └── .github/workflows/build.yml Tests, builds and CI bundles | Resource | Link | |---|---| | Website | | | Support | | Code is released under the MIT License ; documentation under a Creative Commons license. See LICENSE.md https://github.com/HE11032006/EveryCli/blob/main/LICENSE.md .