David Wang

mentions 2 type Person feed RSS

// recent coverage 2 mentions

13:12

2026-07-17

techstrong.ai

ai-infrastructure

Tetrate Adds Ability to Route Inference Requests via AI Gateway

Tetrate added a token broker service to its AI gateway to route inference requests to the most suitable large language model based on capability and cost, and introduced a distributed inference contro…

23:22

2026-06-11

modal.com

large-language-models

Making FlashAttention-4 faster for inference

Modal AI engineers Charles Frye and David Wang optimized FlashAttention-4 for large language model inference, focusing on decode-heavy workloads dominated by memory bandwidth-limited token generation.…

// co-occurs with top 8 entities

FlashAttention-4 1 Charles Frye 1 Together AI 1 Tetrate 1 Envoy AI Gateway 1 Bloomberg 1 Nutanix 1 OpenAI 1

// topics top 6 topics

ai infrastructure 2 large language models 1 ai research 1 machine learning 1 ai chips 1 ai products 1