Large language model (LLM) news — GPT-4, Claude, Gemini, Llama, Mistral and the latest research on training, fine-tuning, RLHF, and deployment of LLMs.
Autotune, a new open-source tool, optimizes local large language models by automatically right-sizing KV cache buffers, tuning precision, caching system prompts, and managing model keep-alive, freeing over 300 MB of RAM …
A developer known as rynaqrtz created an open-source Node.js library called chatday that provides programmatic access to the Chatday.ai API. The library handles anonymous authentication, model listing, and streaming chat…
A developer created mcpgen, a tool that converts any OpenAPI specification into a ready-to-run MCP server in seconds. The generated server runs over stdio and can be plugged into Claude Desktop or any MCP client. The too…
A developer identified a structural cause for coding agents ignoring system-prompt rules mid-session: attention dilution as context grows. The rule becomes an old, low-weight token among thousands of newer tokens, leadin…
Trix Cyrus introduces context engineering as a discipline that goes beyond prompt engineering to curate everything a language model sees during inference, including system prompts, retrieved documents, conversation histo…
Anthropic released Claude Sonnet 5, a new AI model offering top-tier coding and tool use performance at Sonnet pricing with a 1M context window. It is now the default in Claude Code for Pro users and available across the…
A developer argues that feature engineering remains critical for machine learning performance, even in the era of large language models. Raw data, such as dates and order counts, often fails to capture meaningful pattern…
Anthropic is rolling out new real-time cyber safeguards on Claude Opus and Sonnet models to automatically detect and block prohibited or high-risk cybersecurity usage, while launching a Cyber Verification Program for leg…
Giles Thomas built a JAX training loop for an LLM from scratch, using NNX and Optax, as part of a project to replicate GPT-2 small quality without referencing Sebastian Raschka's book. He trained a base model on 3.2B tok…
Answer Engine Optimization (AEO) is reshaping digital marketing as zero-click searches approach 65% and Google AI Overviews trigger an 83% zero-click rate. ChatGPT processes 2.5 billion prompts daily, with LLM-referred t…
A developer shares three MCP servers they use daily with Claude Desktop: server-filesystem for reading project files, server-github for code reviews, and server-postgres for database queries. Each server takes two minute…
Anthropic released Claude Sonnet 5, a cheaper and more agentic midsize model that can plan, use tools, and run autonomously. Priced at $2 per million input tokens through August, it offers performance close to Opus 4.8 a…
Google launched Conversational Analytics in BigQuery to general availability, enabling natural language queries, multi-step analyses, and visual reports directly on governed data. The feature uses Gemini models and BigQu…
Anthropic released Claude Sonnet 5, its most agentic Sonnet model yet, capable of planning, tool use, and autonomous operation at a lower price point than Opus-class models. The model is available across all plans with i…
Anthropic released Claude Sonnet 5, its most agentic medium-sized AI model, replacing Sonnet 4.6 as the default for free and pro users. The model offers improved reasoning, tool use, and coding at lower prices, with intr…
Anthropic is preparing to release Claude Sonnet 5, codenamed "Fennec," on OpenRouter, according to reports. The model, which was rumored for a February 2026 launch that did not materialize, is now nearing availability on…
Singapore-based startup Acti launched an agentic keyboard for iOS and Android that embeds AI agents directly into the keyboard, enabling actions like sharing live stock prices or local recommendations without switching a…
RadixArk released Miles, an open-source PyTorch-native framework for large-scale LLM reinforcement learning post-training. The framework integrates SGLang for rollout, NVIDIA Megatron-LM for training, and Ray orchestrati…
A developer built a free customer support AI agent for NextJS websites using Hexabot, OpenRouter, and Railway. The agent uses RAG to ingest website content and answer questions, deployed with a free Postgres database. Th…
OpenAI engineers cut inference costs for guest ChatGPT users by more than half, reducing the number of Nvidia GPUs needed to just a few hundred, according to a person familiar with the discussions. The optimization appli…