LightSeek Org

mentions 2 type Person feed RSS

// recent coverage 2 mentions

22:36

2026-07-26

github.com

large-language-models

Shepherd Model Gateway – Model-routing gateway for LLM deployments

LightSeek Org released Shepherd Model Gateway (SMG), an engine-agnostic, high-performance model-routing gateway for large-scale LLM deployments that centralizes worker lifecycle management and balance…

14:48

2026-06-25

pytorch.org

large-language-models

TokenSpeed-Kernel: Portable APIs and High-Performance Kernels for Multi-Silicon LLM Inference

LightSeek Org open-sourced TokenSpeed-Kernel, a portable API and high-performance kernel subsystem for multi-silicon LLM inference, decoupling runtime from hardware-specific code to simplify backend c…

// co-occurs with top 8 entities

TokenSpeed-Kernel 1 AMD 1 NVIDIA 1 GPT-OSS 1 Gluon 1 GitHub 1 Shepherd Model Gateway 1 vLLM 1

// topics top 4 topics

large language models 2 ai infrastructure 2 ai tools 2 developer tools 2