Researchers introduced a PyTorch-based framework for pruning binarized neural networks, achieving a 70% pruning rate on VGG11 with constant accuracy, compared to 41% for state-of-the-art methods. The …
Databricks' AI Runtime introduces APIs for fast, fault-tolerant PyTorch training, emphasizing that GPU failures are expected at scale and that data pipeline and checkpointing choices determine goodput…
A new 12-chapter, 7,500+ line interactive textbook teaches readers how to build, train, and run a modern language model from scratch, covering the architecture behind ChatGPT, Claude, LLaMA, and Mistr…
Thinking Machines Lab, a San Francisco-based AI company, is hiring a Coding Agents researcher with a salary range of $350k–475k per year to work on agentic coding capabilities for its frontier models.…
The moeinGTS team, led by Ali and Arshiya Sohrevardi, has released an open-source family of AI models designed for local deployment, including lightweight LLMs (1.5b and 3b), a flagship model (GTS-1),…
JetBrains Research has open-sourced DPTrainer, a library that integrates Opacus with Hugging Face's Trainer to enable differential privacy (DP-SGD) training without rewriting training loops or modifyi…
A developer built Tensorless, a PyTorch-based package that automates configuration of language model training, allowing users to train text-generation models with minimal parameter setup. The tool aut…
A new GitHub example demonstrates how to store AOTInductor model weights outside the shared library and update them at inference runtime in a thread-safe manner, addressing the lack of documentation f…
A new benchmark, DataKernelBench, evaluates whether large language models can optimize database queries on GPUs, achieving up to 2.11x speedup over torch.compile on TPC-H SF10 with an H100 GPU. The be…
A developer's work-in-progress release of Celestium Neon aims to fix out-of-memory (OOM) errors on 4GB GPUs for SDXL, with a GTX 1650 benchmark. The release notes highlight Windows-specific issues, in…
South Korean chip startup Rebellions is adopting an open source-first software strategy, including vLLM, OpenShift, and PyTorch, to help telecom carriers quickly build AI stacks with its AI inferencin…
GGML, a small math library created by Georgi Gerganov, underpins llama.cpp and is designed for CPU inference on constrained hardware, using a computation-graph-first approach that pre-allocates memory…
Sasha Rush's notebook introduces differentiable rasterization, a method to make the conversion of vector graphics to pixels differentiable for gradient-based optimization in deep learning frameworks l…
The second part of a guide to LLM inference optimization focuses on attention mechanisms and KV cache management, explaining the compute-bound prefill phase and memory-bound decode phase. It introduce…
Ramya Ravi, a Developer Advocate for AI and Open Source at NetApp Instaclustr, is running for the Python Software Foundation board in 2026. She aims to bridge the gap between AI/ML practitioners who u…
A developer detailed how an out-of-memory crash in a production computer-vision pipeline led to a redesign that treats memory as a first-class resource. The fix, which included bounded queues, uint8 q…
Kohya-ss/sd-scripts enables training a ~45 MB SDXL LoRA from 15–30 product photos on a single 12 GB GPU, with a step-by-step guide covering installation, dataset preparation, and training. The workflo…
A developer compares Node.js Express and Python FastAPI for backend development in 2026, highlighting FastAPI's native data validation and automatic API docs, and its advantage for AI/ML projects due …
A developer's deep dive on tamiz.pro examines the shift from high-performance LLM serving engines like SGLang to local-first logic frameworks such as OpenLogi, which prioritize data privacy, determini…
ComfyUI v0.33.1, released August 2026, can be installed locally to run Stable Diffusion 1.5 workflows, according to a tutorial by Mariana Souza on Sourcefeed. The guide walks through setting up ComfyU…