The Inference Engine
A language model inference engine must allocate model weights, activation space, KV cache, and accelerator resources across concurrent requests, with prefill and decode phases imposing different compu…
A language model inference engine must allocate model weights, activation space, KV cache, and accelerator resources across concurrent requests, with prefill and decode phases imposing different compu…
An AI training workshop succeeds when attendees leave with a working result they can inspect, rerun, and extend, according to a system documented by an unnamed facilitator. At the 2026 AI Engineer Wor…
OpenAI's ChatGPT Work Google Drive connector displays as connected but fails to access files, and Anthropic's Claude GitHub integration cannot handle multiple organizations, with both bugs persisting …
A 2017 paper by eight Google researchers, 'Attention Is All You Need', introduced the transformer architecture, which replaced recurrence with attention mechanisms and now underpins nearly all major A…
Embeddings provide a coordinate system for AI systems to measure semantic relatedness, replacing lexical string matching with learned vector representations that place similar objects near one another…
Retrieval-augmented generation (RAG) gives a language model a temporary, query-specific memory by searching an external corpus, selecting evidence, and placing it in the prompt before the model answer…
Granola, a note-taking tool, captures client-call audio on a user's device without joining as a visible participant, preserving conversational candor. The tool provides transcripts, summaries, and act…
Granola offers iOS and Android apps that capture in-person conversations through a phone's microphone, producing a transcript, summary, and action items. The tool addresses the limitation of bot-based…
Granola offers a device-capture transcription tool for Google Meet that does not join the call as a participant, avoiding the awkwardness of bots or the visible note-taking indicator of Gemini. The ap…
Granola captures Microsoft Teams meeting audio on a user's device without joining as a bot or requiring Teams admin approval, providing a transcript, summary, and action items after the call. The tool…
Granola captures Zoom meeting audio on a user's device without joining as a participant, eliminating the need for a bot or host-dependent AI features. The tool provides a transcript, summary, and acti…
Zack Proser, a WorkOS engineer who is partly hard of hearing, uses Granola in every work meeting to capture live transcripts and AI-generated notes, reducing the cognitive load of capturing meetings t…
At WorkOS, Granola is the first connector Zachary wires into any new agentic system he builds, enabling meeting notes and transcripts to flow directly into an agent without manual prompting. The conne…
A developer replaced the portrait on their personal homepage with an interactive visualization of 160 essays, arranged as constellations by topic. The new hero features the Mind on Fire logo rendered …
Vercel's open-source eve agentic framework allows developers to turn a folder of agent files into a deployed app, handling durable runs, sandboxed compute, approvals, and tracing. The author, who runs…
AI Engineer conference founder swyx praised WorkOS's workshops as the gold standard for AI Engineer content at the AI Engineer World's Fair in San Francisco. The workshops treat sessions as products w…
Nick Nisi and swyx taught a workshop titled "Lifestyles of the AI-Native" at the AI Engineer World's Fair in San Francisco, where attendees learned voice coding, agent loops, verification gates, and s…
Applied AI engineer Zack Proser built a fleet of single-purpose AI agents to run his solo consulting business, with each bot owning one domain and coordinated by an orchestrator via Slack. The system,…
WorkOS engineer Zack Proser defends AI-assisted writing after a reader complained about uncertainty over AI-generated content. Drawing an analogy to Zildjian's cymbal factory where automation handles …
A developer argues that AI agents should output reviewable artifacts like pull requests instead of chat replies, because PRs provide a diff, CI gates, and a reject button that chat messages lack. The …