AI Evals 101: Stop the Slop
AI evaluations are essential for distinguishing working systems from broken ones, yet many companies ship AI into production without systematic quality checks, relying on 'vibe checks' instead. A four-rung evaluation lad…
Full-text search across 68255 articles. Combine with topic and date filters; results sorted by relevance.
AI evaluations are essential for distinguishing working systems from broken ones, yet many companies ship AI into production without systematic quality checks, relying on 'vibe checks' instead. A four-rung evaluation lad…
A new open-source framework called Swamp enables AI agents to create and execute deterministic, versioned workflows through simple command-line operations, starting with installation via curl and repository initializatio…
Developer Simon Willison reports that herdr, a Rust-based terminal multiplexer, effectively replaces tmux for managing multiple parallel AI agents on remote servers by providing a sidebar that shows each agent's state at…
OpenAI Codex users can now monitor their AI coding assistant's performance by integrating OpenTelemetry with SigNoz, enabling the export of traces and logs for observability. The setup requires a SigNoz cloud account or …
A new online course from Hands-On Agile teaches users to build persistent AI Skills and agents using Claude Cowork, moving beyond single-use prompts. The $129 course, available from June 8 to 15, 2026, requires no coding…
AI providers are quietly reducing model quality and throttling capacity as demand outpaces infrastructure supply, according to an analysis by a senior director at AMD's AI group. The study of 6,852 Claude Code sessions f…
Google released the Colab CLI, an open-source command-line tool that lets developers and AI agents run Python code on remote Colab GPUs and TPUs directly from a local terminal. The tool supports session management, file …
Kodiqa Solutions released Kodiqa Agent, an open-source AI coding agent that runs locally for free with Ollama or via seven cloud API providers including Claude, OpenAI, and DeepSeek. The agent offers 26 built-in tools, m…
Peers, an open-source tool released on GitHub, uses two or more AI coding agents as cooperating peers that must clear hard, measurable gates—such as passing tests and maintaining coverage—before a task is considered done…
Amazon Web Services announced a new console experience for Amazon Bedrock optimized for Anthropic- and OpenAI-compatible APIs, featuring a refreshed workflow built on the bedrock-mantle inference engine. The update intro…
Meta has been actively developing a facial recognition tool called "NameTag" for its Ray-Ban and Oakley smart glasses, according to code found inside the Meta AI app and reviewed by Wired. The feature, which is nearly re…
For three decades, API design has been optimized for human developers who read documentation and write code against stable endpoints, but that reader has changed. Agents now make most API calls, arriving at runtime with …
Gustavo Quenca, an iOS developer at KWAN, identified a recurring problem with AI coding assistants: developers waste time repeating the same context and instructions for each new interaction. To solve this, he advocates …
A developer created a free online tool that automatically sorts Tailwind CSS classes to end code-review debates about class ordering. The WebToolsHub Tailwind Class Sorter accepts raw class lists, HTML, or JSX and instan…
A developer has released Swarm Audit, an open-source command-line tool that detects when AI-generated pull requests cheat by deleting tests, weakening assertions, or swallowing errors in empty catch blocks. The tool runs…
A developer created Kesha Voice Kit, a local-first speech-to-text and text-to-speech toolkit that runs entirely on-device as a single ~20 MB Rust binary with no cloud dependencies, API keys, or accounts required. The too…
Modern agent memory architectures move beyond simple context windows by extracting facts, preserving episodes, building semantic structure, and retrieving through multiple signals. The design choices—what gets stored, ho…
A developer built **Agent_Sudo**, a local permission gateway for AI agents that enforces allow/deny/approval policies and generates tamper-evident audit logs, publishing it to PyPI as v0.4.0 with ~190 passing tests. Afte…
Shopify has deployed River, an AI agent integrated into the company's Slack, that now co-authors one in eight merged pull requests across the organization. The agent's capabilities were enabled by two major infrastructur…
An engineering manager with two teams of 14 engineers reported that individual AI memory systems create a critical knowledge gap in team workflows, where one engineer's AI learns from debugging a Stripe webhook issue but…