Leviathan LLM Inference Leviathan LLM Inference is a Windows application that loads GGUF language models directly into an NVIDIA GPU's memory and runs them locally, with no server, cloud account, subscription, API key, or telemetry, requiring only a GTX 16-series/RTX 20-series card or newer and a driver providing CUDA 13.0 or later. The app adds persistent memory across sessions, teachable traits without retraining, and an interface other programs can call, and its demo screenshots were produced by Qwen 2.5 Coder 7B (Q8_0) on a single RTX 4080. A 7–8 billion parameter model at moderate quality fits in 8 GB of VRAM, and users without an NVIDIA card can run Leviathan as a front-end to a model server hosted elsewhere, losing the GPU-native features but keeping chat, memory and knowledge systems. Local AI models, running directly on your graphics card. No server, no cloud, no account, no subscription, no telemetry. Leviathan loads a language model straight into your GPU's memory and talks to it there. Nothing is sent anywhere. There is no background service, no Docker container, no Python to install, and no API key. You open the app, pick a model, and type. You can also connect hosted models such as Grok alongside your local ones. Those, by their nature, send your messages to their provider. Everything that runs on your own GPU stays on your machine. What makes it different from the other ways of running a model locally is what happens around the model: Leviathan gives it a memory that survives closing the app, a way to be taught things without retraining, and a way for your other programs — a game engine, a script, a tool you wrote — to use the model Leviathan runs. Leviathan is the host. The model is the guest. Every picture on this page is the real app, driven by a real model on one RTX 4080 — nothing is mocked up.