Large language model (LLM) news — GPT-4, Claude, Gemini, Llama, Mistral and the latest research on training, fine-tuning, RLHF, and deployment of LLMs.
Mariana Souza published a tutorial on quantizing and running Meta's Llama 3.2 3B model on Apple Silicon using llama.cpp with Metal GPU acceleration, achieving local inference with Q4_K_M quantization. The guide covers bu…
Red Alice AI released the first official benchmark of its Version 2 architecture, reporting a 200x performance gain in the RedTensor engine. The upgrade introduces a PyTorch-backed TorchTensor backend with unified flat i…
DeepReinforce released Ornith-1.0, an open-source family of coding models that learn their own reinforcement learning scaffolds, achieving state-of-the-art results among open models. The lineup includes four sizes from 9…
A group of publishers owning nearly 400 local and regional newspapers sued OpenAI and Microsoft for allegedly stealing hundreds of thousands of articles to train ChatGPT and Copilot. Separately, Anthropic accused Chinese…
GitHub is experiencing a surge of AI-generated repositories that lack quality standards, with functions having high cyclomatic complexity, no tests, and high code duplication. Stars and forks are no longer reliable indic…
A German court ruled that Google is liable for false information in its AI-generated search summaries, rejecting defenses that users should not blindly trust AI. The decision holds that the summaries are expressions of G…
AI costs in production systems are driven by wasteful architecture—retry loops, excessive token use, and redundant validation—not by model choice. As agentic systems scale, the hidden economics of distributed AI interact…
Context bloat, the accumulation of low-signal tool-call output in an agent's context window, degrades long-running agent performance. Anthropic's analysis found token usage explains 80% of performance variance on BrowseC…
An engineer analyzing Cursor's usage dashboard found two requests with nearly identical token counts (1.34M and 1.40M) that cost vastly different amounts: $1.13 and $2.96. The cost discrepancy is explained by the model's…
AI systems suffer from context drift in long-term use, where models reason from compressed interpretations of prior outputs rather than original user input, causing memory degradation. This architectural hallucination pr…
DuckDuckGo's AI search feature falsely reported that President Donald Trump died of rabies earlier this month, citing a fabricated news article. The misinformation originated from the Reddit subreddit r/poisonai, whose m…
OpenCode, an open-source coding agent with over 160k stars, offers a model-agnostic and cloud-agnostic alternative to Claude Code, Cursor, and Copilot. The project argues that the competitive axis has shifted from model …
Google Finance exited beta with a dedicated Android app, portfolio tracking, and AI-powered scheduled briefings, marking the platform's broadest expansion since its AI rebuild began in August 2025. The updates include an…
Sail Research has raised $80 million in seed and Series A funding at a $450 million valuation to develop AI inference infrastructure optimized for agents. The startup claims its engine can serve tokens at up to 10 times …
NVIDIA announced multi-device inference support in TensorRT 11.0, enabling native high-performance multi-GPU inference for generative AI workloads. The feature integrates with NCCL for distributed collectives and support…
Chinese AI lab Zhipu AI, under its global brand Z.AI, launched the open-weight GLM-5.2 model with up to 753 billion parameters, rivaling top closed models from Anthropic and OpenAI at roughly one-tenth the cost. The mode…
KRAFTON built PUBG Ally, a co-playable character powered by NVIDIA ACE, for PUBG: BATTLEGROUNDS. The AI teammate uses automatic speech recognition, a 2B-parameter small language model, and text-to-speech to understand pl…
Tejas S Athni reported in the Journal of Medical Internet Research that conversational medical AI systems are increasingly simulating licensed health care providers while disclaiming legal responsibility, creating a gray…
A developer argues that maximizing AI context windows leads to worse results, advocating for optimizing relevance over volume. They found that flooding context with excessive information creates noise, causing slower res…
Prefill/decode disaggregation separates the two phases of LLM inference—prefill (compute-bound) and decode (memory-bound)—onto different GPUs to avoid the performance compromise of running both on the same hardware. The …