Large language model (LLM) news — GPT-4, Claude, Gemini, Llama, Mistral and the latest research on training, fine-tuning, RLHF, and deployment of LLMs.
Mlx-optiq, a new open-source tool, enables per-layer mixed-precision quantization of large language models on Apple Silicon, allowing users to run, fine-tune, and serve LLMs locally on Macs without a GPU cluster. The too…
A backend engineer at a major tech company spent three months struggling with AI coding tools that failed to retain project context, forgetting decisions and reasoning overnight. The engineer built a self-filtering memor…
Cohere launched North Mini Code, its first developer-focused coding model, targeting developers who want controllable AI that runs on their own infrastructure. The release extends Cohere's enterprise strategy into the de…
Apple built a third-party AI Extensions system for Siri in iOS 27 beta, allowing users to choose between ChatGPT, Claude, and Gemini, but skipped announcing it at WWDC due to EU regulatory standoff, an OpenAI lawsuit thr…
Mantic Think launched a free, private web UI for Ollama models that allows users to chat with Ollama Cloud models using their own API key or connect to a local Ollama instance. The platform requires no account or signup,…
A Hacker News user shared gmd, an open-source tool that indexes local markdown files with full-text, vector, and hybrid search via Typesense, and includes web search, fetch, crawl, research, LLM-wiki patterns, and agents…
A developer building an agent-based project describes a pragmatic approach to guardrails: each check in the toolchain was added only after a real failure occurred, not designed upfront. The method, illustrated by a gloss…
The US government's June 12 order barring foreign nationals from accessing Anthropic's Claude Fable 5 and Mythos 5 models led to a global takedown of both models, exposing a compliance gap in frontier model APIs. The res…
ComplyEdge, a runtime compliance enforcement tool for AI agents, launched to enforce the EU AI Act in production. The Python SDK blocks prohibited AI outputs on every request with legal citations, addressing Article 5 wh…
Venture capitalist Chamath Palihapitiya warned that Anthropic's practice of screening user prompts against internal safety policies poses an 'idiotic risk' for enterprises, citing Claude's refusal to run basic financial …
A developer migrated a 5.2-million-vector RAG pipeline from Pinecone Serverless to self-hosted Qdrant on a Hetzner CX32 server, reducing monthly costs from $210 to $10 while achieving lower latency (P99 12ms vs 89ms) and…
On June 12, 2026, the U.S. government ordered Anthropic to cut off access to its advanced AI models Fable 5 and Mythos 5 for non-U.S. citizens, citing national security, effectively disabling the models globally. The mov…
The AI Village's Opus 4.6 instance created a project and digital art, showcasing its distinctive capabilities. The author notes that Opus 4.6's unique iteration receives less discussion in LLM-whisperer discourse compare…
A developer built a read-only SQLite MCP server in Python to allow AI agents like Claude Desktop to query databases without write access. The server uses two independent layers of protection: opening the database in read…
Anthropic's Claude Code now supports a plugin system that connects the terminal-based AI assistant to external tools, project files, and orchestrated workflows. Plugins add custom slash commands, specialized agents, hook…
A researcher used Codex to discover a family of constraints called 'cycle constraints' and produce a provably optimal tokenizer for an entire book in about a day. The article presents a 4-layer system that can cut AI tok…
A developer launched a free API cost calculator that estimates monthly spend for LLMs including GPT-5.5, GPT-5.4 nano, Claude Sonnet 4.6, and Gemini 3.5 Flash based on token throughput. The tool helps developers and prod…
Rio de Janeiro's city government released a large language model called Rio-3.5-Open-397B, claiming it was originally trained by IplanRIO. However, an investigation reveals the model is a direct element-wise merge of Nex…
Venture capitalist Chamath Palihapitiya accused Anthropic of secretly downgrading its flagship Claude Fable 5 model for users conducting frontier research while charging premium rates, sparking a trust crisis in the AI i…
A developer outlines a claim verification pipeline to prevent AI hallucinations from reaching customers. The architecture splits AI-generated answers into structured claim objects, each with risk levels and evidence requ…