Handy Computer released transcribe.cpp, an open-source ggml-based transcription library supporting over 60 ASR models with GPU acceleration via Vulkan, Metal, CUDA, and TinyBLAS. The library, created …
A solo developer added AI background removal to Convertify, a free image converter, in one week using only Rust and no Python. The backend runs ONNX models natively via the ort crate, avoiding the nee…
A developer built a production-grade cross-platform face recognition pipeline with anti-spoofing, using a lightweight RFB-320 face detector, FaceNet-style embeddings, and HNSW indexing for sub-millise…
A developer built rustnn, a Rust implementation of the W3C WebNN specification for Firefox, using Claude Code to accelerate development. The project implements 95 operators and validates against WPT c…
A developer completed Module 2 of the LLM Zoomcamp 2026 and built a hybrid search engine from scratch, combining keyword and vector search. The project implemented vector search using ONNX runtime emb…
A developer built a custom Inference Optimization Engine on an NVIDIA RTX 4050 GPU to analyze how PyTorch, ONNX, and TensorRT interact with hardware, revealing that model deployment and optimization c…
Manticore Search rebuilt its ONNX path, achieving 14× faster embeddings than the previous SentenceTransformers/Candle backend. The new ONNX Runtime backend, released in Manticore Search 27.1.5, boosts…
A developer building a native desktop editor for fiction writers embedded a full MCP server inside the application binary to enable AI agents to drive the app programmatically, solving the problem of …
A developer built NanoMaestro Realtime, a 50MB AI music model with 13M parameters that generates piano music in real time on CPU in the browser, using ONNX and Transformers.js. The model runs on older…
Darktable 5.6 introduces its first AI features, including an AI object mask and a neural restore module for denoising and upscaling, all running locally on the user's CPU or GPU. The open-source photo…
Mozilla AI has expanded its encoderfile project to support image classification, allowing vision models to run as standalone executables without Python or serving infrastructure. The update includes p…
Promptblock, a new GitHub App, detects prompt-injection attempts in GitHub issues and comments by scanning hidden HTML comments that AI agents read via the API but humans do not see. The app uses a bu…
A developer released PII GUI, a free, open-source desktop app that detects and redacts personal information in PDFs, Markdown, and text files entirely on-device using regex or local ONNX models, with …
Researchers introduced RAMS, a runtime controller that dynamically switches between YOLOv8 model tiers on embedded devices to balance latency and detection quality under resource pressure. On Jetson O…
Photo Organizer AI Premium 4.7.5 was released on June 15, 2026, with a file size of 425.3 MB. The update introduces automated event album clustering, duplicate detection, and quality-based culling usi…
ImageToolbox, a free and open-source image editing tool developed by T8RIN, offers over 310 filters, AI-powered background removal, and batch processing for photographers and developers. The app is av…
NVIDIA released a workflow for converting FP8-quantized CLIP model checkpoints into TensorRT engines, enabling faster inference and higher GPU throughput for production deployment. The process involve…
OpenCV 5.0 was released today as a major update to the open-source computer vision library, featuring a rewritten deep neural network engine and built-in support for large language and vision language…
Google added native support for Gemma 4 Multi-Token Prediction (MTP) to LiteRT-LM, its on-device LLM runtime built on LiteRT (formerly TensorFlow Lite). Google reports the integration yields MTP decod…
AWS Lambda's reported `@maxMemoryUsed` metric tracks a high-water mark across an entire execution environment, not per-invocation memory usage, according to AWS support. A customer's ONNX model infere…