Live Transformer Graphs: Running and Editing LLM Architectures on a Custom CUDA Engine

A developer has built live transformer graphs into Leviathan, a custom CUDA engine that allows LLM architectures to be run and edited while the model is executing, with every part of the KV cache persisted as state that carries forward indefinitely. The project was presented as a Show/tell submission focused on manipulating a model during live operation.