Large language model (LLM) news — GPT-4, Claude, Gemini, Llama, Mistral and the latest research on training, fine-tuning, RLHF, and deployment of LLMs.
An engineer patched NVIDIA's proprietary driver to run modern LLM inference on a GeForce GTX 770 (Kepler) GPU with a Linux 7.x kernel. The fix involves a five-byte binary patch to libcuda.so that bypasses a buffer-size n…
DeepSeek released DSpark, a speculative decoding framework now live in its DeepSeek-V4 Flash and Pro production API, delivering 51 to 400 percent throughput gains and up to 80 percent latency reduction over standard auto…
A Hacker News user asked the community about their setups for running local large language models, seeking details on models and hardware configurations.
The r/programming subreddit with 6.9 million members temporarily banned all LLM-related posts due to overwhelming volume, quality collapse, and moderator exhaustion. Developers largely thanked the moderators, reflecting …
A Hacker News user asks the community to predict how the world will change in 5-10 years due to rapid progress in LLMs and AI, sparking discussion on future societal and technological shifts.
OpenAI and Broadcom unveiled Jalapeno, OpenAI's first custom ASIC designed specifically for large language model inference, marking a shift from general-purpose GPUs to specialized silicon to address the memory-bandwidth…
A developer's team saw their LLM bill jump from $620 to $2,480 in 23 days without any new features or traffic spikes. By instrumenting every LLM call with feature, user, and service tags, they discovered that 74% of spen…
Researchers at UC Berkeley, Carnegie Mellon University, and Tel Aviv University developed ConlangCrafter, an AI model that generates novel constructed languages with consistent rules. The model can create diverse languag…
The Trump administration is close to allowing Anthropic to restore access to its Fable 5 model, Axios reported on Saturday, citing a source close to the situation. Reuters could not immediately confirm the report.
The Trump administration is nearing an agreement to restore access to Anthropic's Fable 5 AI model after 15 days of suspension due to export controls imposed over national security concerns. The model was taken offline f…
A developer argues that large language models cannot generate truly novel ideas because they interpolate within the convex hull of existing human thought rather than extrapolating beyond it. The author contends that LLMs…
A developer released ctxfold, a dependency-free tool that losslessly compresses structured data like logs, JSON, and CSV in LLM prompts by re-encoding repetitive structure into a compact table format. It achieves ~35-40%…
Hugging Face's top-voted papers on June 27, 2026, reveal key AI trends: smarter agents, more realistic image/video generation, and adaptive learning systems. Notable papers include a memory evaluation framework for LLM a…
Alibaba queried Anthropic's Claude 29 million times in a black-box distillation attempt, revealing that while such methods can replicate some capabilities, they fail to fully copy the original model's performance, highli…
Google's June 2026 spam update now targets attempts to manipulate generative AI responses in Search, but enforcement is challenging because planted text on user-generated pages is difficult to distinguish from legitimate…
Agentic AI, built on large language models, can autonomously pursue goals by taking actions such as calling APIs, running code, and editing files, distinguishing it from chatbots that only generate text. This agency intr…
Researchers introduced Tapered Language Models (TLMs), an architectural principle that allocates more parameter capacity to earlier layers and less to later layers under a fixed budget. Across four architectures and thre…
AI companies paying workers to generate fresh training data are discovering that many contractors are using other AI chatbots to create that data, a practice known as AI cannibalism that can destabilize large language mo…
William, a tiny poetry language model trained by a developer, runs entirely in the browser using ONNX Runtime Web. The 6-layer transformer was trained on the Gutenberg Poetry Corpus and fine-tuned on Poetry Foundation po…
A developer built TokenBoard, a local CLI tool that tracks AI coding token usage from Codex without uploading prompts or code. The tool provides aggregate metrics and a leaderboard for developers to compare usage and und…