Perplexity released Photon, an in-house Rust-based retrieval and ranking engine that cut p99 retrieval and ranking latency from about 800 ms to about 65 ms and now handles all production traffic for i…
Io_uring maintainer Jens Axboe has posted an RFC patch set that adds a PF_IO_HANDOFF flag to the task_struct flags field, letting a thread that is about to block hand off its identity so the submittin…
OpenLake, an open-source storage engine for offloading LLM KV caches from GPU memory to RAM and NVMe, cuts GPU time by 48.2% for long-context inference, reducing a 1,169-second workload to 606 seconds…
Monocoque, a Rust-native ZeroMQ-compatible messaging library implementing ZMTP 3.1, achieves up to 3.7x higher throughput than libzmq in PUSH/PULL benchmarks with write coalescing, according to develo…
An AI agent tasked with optimizing a system's performance achieved full NIC and disk bandwidth saturation, but its explanation of the optimization was completely wrong. The system, which uses a single…
Zeroserve, a new zero-configuration HTTPS server, serves entire websites from a single tarball over HTTP/2 and TLS 1.3 while allowing users to script request handling with eBPF programs that run as sa…
Amalgafy Labs has achieved 21+ tokens per second inference on the Mixtral 8x7B model using only CPU and SSD storage, bypassing the need for GPU VRAM. The team's Micro-Expert-Router (MER) system levera…
This article describes a Linux privilege escalation exploit (CVE-2024-0582) that targets a use-after-free vulnerability in the Generic Receive Offload (GRO) subsystem. The bug occurs when `skb_gro_rec…