{"type": "article", "title": "In 2018 I hand-wrote a C++ deep learning framework so I'd never pad a batch. In 2023 LLM serving landed on the same structure.", "publisher": "Web Pulse", "url": "https://wpnews.pro/news/in-2018-i-hand-wrote-a-c-deep-learning-framework-so-i-d-never-pad-a-batch-in-llm", "original_source": "https://dev.to/chncwang/in-2018-i-hand-wrote-a-c-deep-learning-framework-so-id-never-pad-a-batch-in-2023-llm-serving-6ob", "published": "2026-09-24T05:25:13+00:00", "accessed": "2026-09-24", "id": "in-2018-i-hand-wrote-a-c-deep-learning-framework-so-i-d-never-pad-a-batch-in-llm"}