Shepherd Model Gateway (SMG) has disaggregated all CPU-bound workloads from GPU inference in large language model serving, moving tokenization, detokenization, and parsing into a dedicated Rust gatewa…
Zed, the code editor built from scratch in Rust with a GPU-based UI framework, has officially reached version 1.0 after five years of development. The milestone marks the editor's readiness for widesp…
The article explains that Rust Workers on Cloudflare's platform, which compile Rust to WebAssembly, previously faced reliability issues where panics or aborts could poison the runtime and cause cascad…
The article describes a small Rust-based back-end system called "upvoters," created to handle anonymous upvotes on static blogs, with compatibility for Hugo. The author also mentions recent website de…
The article introduces an individual who is a father of two, a husband, and a scientific backend software developer with a PhD in Computational Materials Science from Georgia Tech. It lists their tech…
In a three-month project, the author used AI coding agents to build a 100K-line Rust-based multi-Paxos consensus engine that modernizes Azure's Replicated State Library (RSL) for contemporary hardware…
"function colors" represent genuine differences in execution contexts (e.g., async vs. sync, CPU vs. GPU) that cannot be eliminated through type systems or syntactic workarounds. It criticizes efforts…
The author, a software developer, finds generative AI tools like Claude highly useful for certain tasks, such as Java Spring Boot development, but notes that local models are only adequate and that th…
After two months of full-time Rust development, the author plans to use Rust instead of C++ for future performance-critical projects. A key reason is that Rust's syntax is cleaner than modern C++, par…
This article demonstrates how to create a library in Rust and call it from Python (both CPython and PyPy) using the C Foreign Function Interface (CFFI), which offers lower call overhead than ctypes an…
This article provides a curated, alphabetically ordered list of HTTP(S) benchmarking and testing tools, noting that the full repository has been moved to GitHub. It catalogs over 30 tools, including `…