Article URL:
https://blog.tacoda.dev/this-ones-not-ai-992c95537790 Comments URL: https://news.ycombinator.com/item?id=48668240
Points: 1
source & further reading
blog.tacoda.dev — original article
Kog Laneformer 2B: The Latency-First Model Behind Kog Inference Engine
Real-time LLM Inference on Standard GPUs: 3k tokens/s per request
Building a single-kernel, latency-optimized LLM inference engine on AMD MI300X GPUs