Hi HN,
I built kernelspace - a free and interactive course that takes a backend engineer (like me) with java/python experience to the systems level required to work on LLM serving at scale. (Mostly an attempt for me to understand what everyone's talking about lately and also an attempt at staying up to date to current tech - career wise).
It has: 1. 68 Lessons across 9 tracks, with a rust-from-zero ramp. 2. 8 rust labs - BPE tokenizer, KV block manager, radix cache, batching scheduler, a toy executor 3. 9 simulators running in browser (wasm) - roofline model, KV cache pressure, continuous batching dynamics 4. Fleet week - a simulated prod serving fleet
All progresss is local - there is no server (it's served from github pages, repo here https://github.com/praveer13/kernelspace) Feedback appreciated, and contributions welcome. I want to make this a really good course for me (and everyone else like me).
* (OK, I had sol and kimi on it for most part)
Comments URL: [https://news.ycombinator.com/item?id=49266750](https://news.ycombinator.com/item?id=49266750)
Points: 1