I wanted to run LLM models locally on my machine. I discovered that llama.cpp is how people run models locally, and that the popular LLM servers like Ollama and lmstudio and unsloth use llama.cpp under the hood.
llama.cpp is, of course, written in C++. I don't care for C++ and
I prefer Common Lisp. With the appropriate declarations, Common
Lisp code should be in the same performance ballpark as C++ code.
So I decided to write a Common Lisp implementation of llama.cpp,
which I call llambda.lisp
.
It is available
on [GitHub.com/jrm-code-project/llambda](https://github.com/jrm-code-project/llambda)
If you care to contribute, it could use routing for architectures
other than gemma, GPU support, NPU support, and other features.
source & further reading
funcall.blogspot.com ā original article