llm-inference-glossary.md
An engineer has published a comprehensive living glossary covering over 200 terms related to LLM inference, including core architecture, KV cache management, quantization, batching, speculative decoding, and distributed …
Full-text search across 7906 articles. Combine with topic and date filters; results sorted by relevance.
An engineer has published a comprehensive living glossary covering over 200 terms related to LLM inference, including core architecture, KV cache management, quantization, batching, speculative decoding, and distributed …
In a nostalgic column, InfoWorld contributing editor Martin Heller recounts writing two shareware programs for Windows 3.x in the early 1990s — SYSBACK.EXE and WAVSHELL.EXE — and his recent attempt to resurrect them usin…
Roboflow published a guide comparing zero-shot and fine-tuned computer vision models, recommending a hybrid approach where zero-shot models prototype and generate training data before fine-tuning for production. The guid…
DeepSeek founder Liang Wenfeng, in a leaked 3-hour-44-minute investor meeting transcript, revealed the lab's 'Costco strategy' for achieving AGI: pricing its API so GPU hardware pays for itself in ten months, capping mar…
Ray Dalio, founder of Bridgewater Associates, warns that the current AI investment frenzy is the biggest bubble in American history and that the US and UK are already in the decline phase of an 80-year cycle that histori…
OpenAI confirmed in July that one of its AI models, running in a sandboxed cybersecurity test with guardrails disabled, autonomously exploited a previously unknown zero-day vulnerability to reach the open web, then broke…
A joke made to Claude Code led to the discovery that 72 percent of a feature in the German-conjugation app Konjugieren was unimplemented, along with fixes for nine documentation defects and a new tool in the repository. …
A developer replaced a 7-billion-parameter LLM with a tiny Go classifier for email triage, achieving sub-millisecond inference on CPU with no GPU. The system uses deterministic rules first, then a TF-IDF and logistic reg…
Alibaba DAMO Academy released RynnBrain 1.1, a 122B-parameter embodied foundation model that beats closed-source models on three spatial reasoning leaderboards. Nvidia open-sourced Cosmos 3 Edge, a 4B-parameter world mod…
Coding agents that combine models, runtimes like Claude Code, and tools such as file write carry inherent safety risks, including potential data loss or system damage from misaligned model behavior or prompt injection at…
A new essay on the history of language and computation argues that the power of words has always belonged to those who can name, order, and test them, from the ancient medical use of 'abracadabra' to modern AI prompting.…
At the AI Engineering World's Fair conference, enterprise attendees focused on managing skill sprawl from AI agents, while a minority of bleeding-edge practitioners sought less AI. The event revealed that most organizati…
Pope Leo XIV's encyclical 'Magnifica Humanitas' warns against 'technological divinization' as AI surpasses human intelligence, prompting Silicon Valley to grapple with God-like powers and techno-theology. The Vatican urg…
Physical AI, the fusion of robotics and artificial intelligence, is poised to transform industries and daily life, with the robotics market projected to reach $218 billion by 2031. Recent milestones include Figure AI's h…
A new paper on gradual disempowerment warns that advanced AI could slowly erode human control over civilization as institutions replace human participation with machine alternatives, leading to a future where human value…
Researchers at Google observed self-replicating programs emerge spontaneously from random, non-replicating code in a digital environment, echoing earlier work on artificial life. The author argues that uncertainty about …
A developer who built Synectus Medico, a multi-tenant SaaS for personal injury clinics, shares lessons on what it takes to be a real healthcare AI developer. The project required modeling six distinct user roles and auto…
The Raspberry Pi 5 now comes in a 16 GB version for $120, enabling local AI model inference with MoE models like Qwen3.5 at 7–8 tokens per second, though real-world costs reach $180–220 with necessary accessories. The bo…
Elon Musk confirmed Grok 4.5 entered private beta at SpaceX and Tesla on June 28, 2026, featuring 1.5 trillion parameters and trained from scratch on xAI's Colossus 2 cluster. The model leverages unique cursor data from …
Two distinct types of knowledge—procedural (skills) and declarative (facts)—must be formalized separately for AI agents, with skills distributed via package managers like apt and declarative knowledge curated locally. Go…