Large language model (LLM) news — GPT-4, Claude, Gemini, Llama, Mistral and the latest research on training, fine-tuning, RLHF, and deployment of LLMs.
A developer replaced Google's Gemini 3 Flash with a self-hosted Qwen model via Ollama for two production applications, citing cost, control, and infrastructure economics. The setup uses a Mac mini as primary through a Cl…
A developer detailed how they configured Claude Code with 26 production subagents, a CLAUDE.md contract, MCP servers, and hooks to transform the AI from a forgetful junior into a reliable senior team. The setup uses focu…
OTOBO has released the AISummaryPackage, an add-on that uses AI to generate internal summaries of tickets and articles for its ITSM platform. The package supports multiple AI providers including OpenAI, Claude, and Gemin…
GPT4All now supports Blablador, enabling users to chat with their PDFs locally and privately. The integration allows documents to remain on the user's computer while leveraging Blablador's models through an OpenAI-compat…
Open source large language models will never match closed-source models due to inherent safety limitations, argues a commentator. Without multi-layered guardrails—baked-in safety, real-time flagging, and offline batch an…
Anthropic received partial US government approval to redeploy its Mythos 5 AI model to critical infrastructure organizations, two weeks after an export-control order blocked access to Mythos 5 and Fable 5 over national s…
A first-year arts student at the University of Melbourne reports widespread misuse of AI by fellow students to complete assignments and exams, raising concerns about the devaluation of university degrees. The student des…
A developer created Alchemy, a ruleset that removes common AI writing patterns from generated text. The tool bans overused words like 'delve' and 'robust', limits phrases such as 'in the ever-evolving landscape', and fla…
A new approach to cybersecurity evaluations proposes using language models as constant red-team oracles to empirically compare the attack surfaces of different software implementations, such as OpenSSL forks or formally …
An engineer patched NVIDIA's proprietary driver to run modern LLM inference on a GeForce GTX 770 (Kepler) GPU with a Linux 7.x kernel. The fix involves a five-byte binary patch to libcuda.so that bypasses a buffer-size n…
DeepSeek released DSpark, a speculative decoding framework now live in its DeepSeek-V4 Flash and Pro production API, delivering 51 to 400 percent throughput gains and up to 80 percent latency reduction over standard auto…
A Hacker News user asked the community about their setups for running local large language models, seeking details on models and hardware configurations.
The r/programming subreddit with 6.9 million members temporarily banned all LLM-related posts due to overwhelming volume, quality collapse, and moderator exhaustion. Developers largely thanked the moderators, reflecting …
A Hacker News user asks the community to predict how the world will change in 5-10 years due to rapid progress in LLMs and AI, sparking discussion on future societal and technological shifts.
OpenAI and Broadcom unveiled Jalapeno, OpenAI's first custom ASIC designed specifically for large language model inference, marking a shift from general-purpose GPUs to specialized silicon to address the memory-bandwidth…
A developer's team saw their LLM bill jump from $620 to $2,480 in 23 days without any new features or traffic spikes. By instrumenting every LLM call with feature, user, and service tags, they discovered that 74% of spen…
Researchers at UC Berkeley, Carnegie Mellon University, and Tel Aviv University developed ConlangCrafter, an AI model that generates novel constructed languages with consistent rules. The model can create diverse languag…
The Trump administration is close to allowing Anthropic to restore access to its Fable 5 model, Axios reported on Saturday, citing a source close to the situation. Reuters could not immediately confirm the report.
The Trump administration is nearing an agreement to restore access to Anthropic's Fable 5 AI model after 15 days of suspension due to export controls imposed over national security concerns. The model was taken offline f…
A developer argues that large language models cannot generate truly novel ideas because they interpolate within the convex hull of existing human thought rather than extrapolating beyond it. The author contends that LLMs…