TokenRouter

Researchers at Tsinghua University released TokenRouter, an open-source serving engine for token-level LLM routing, on GitHub under the thu-nics organization. TokenRouter schedules and executes reques…

Inco AI launched day-0 support for Z.ai's GLM 5.3 model, releasing DFlash 2 and NVFP4 checkpoints alongside an Inco Engine endpoint that delivers up to 4.4× throughput versus the native FP8 checkpoint…