Aina, a new open-source tool, lets developers upload an ONNX model, autotune it for specific edge hardware, and deploy it across a fleet with a single API and CLI, eliminating the manual per-device SS…
STMicroelectronics (ST) announced the STM32N6, its most powerful microcontroller and the first to include a custom Neural-ART Accelerator NPU capable of 600 GOPS, enabling machine learning application…
Rod Johnson, creator of the Spring Framework, shipped Embabel 1.0.0 GA, an AI agent framework for Java that uses deterministic Goal-Oriented Action Planning (GOAP) instead of letting LLMs decide actio…
Inflect-v2, two open-weight English TTS models at 3.9M and 9.3M parameters, generate speech multiple times faster than real-time on CPU while delivering quality competitive with larger systems like Ki…
Vendor lock-in in AI infrastructure creates technical debt and forces companies into a one-size-fits-all approach, warns a technical guide. To avoid this, the guide recommends implementing a Gateway P…
DKSplit v1.0.2, a fast character-level word segmentation library for Python, achieves 86.5% strict exact match accuracy on a 1,000-sample benchmark of domain prefixes, outperforming WordSegment (65.2%…
Typesense 30.2 can now fuse BM25 keyword ranks with local embedding search in a single API call, eliminating the need for a separate embedding service. A tutorial by Rachel Goldstein demonstrates buil…
AI Firewall, an open-source security gateway for LLM traffic, launched as an MVP with a TypeScript gateway and Go edge proxy that inspect prompts and outputs for secrets, prompt injections, and EU AI …
A developer's practical guide details the engineering challenges and solutions for deploying production-ready Retrieval-Augmented Generation (RAG) applications, covering data indexing, vector stores, …
Insight IT Systems released PrismShine, an open-source tool that verifies LLM answers against evidence, addressing a gap in hallucination detection for agentic workflows. In benchmarks on HaluEval, Pr…
Christopher 'CJ' Pais, creator of the desktop dictation tool Handy, released transcribe.cpp on June 30 as an MIT-licensed C/C++ library that unifies local speech-to-text inference across macOS, Window…
SlopSift is a local, graph-backed linter for AI writing that uses a custom-trained dependency parser to detect canned arguments, unsupported claims, and filler. The tool runs quantized ONNX weights lo…
Manning Publications will release 'Domain-Specific Small Language Models' in May 2026, a book by Guglielmo Iozzia that teaches developers how to build generative AI models optimized for specific field…
ONNX v1.22.0, published June 30, introduces Opset 27 with LinearAttention and CausalConvWithState operators that enable modern hybrid LLMs to export cleanly to ONNX for the first time, alongside WebAs…
EndoSeg, an ovarian-lesion ultrasound segmenter built for the Nebius Serverless AI Builders Challenge, achieves a test Dice of 0.755 but cannot diagnose endometriosis or classify lesion types. The mod…
A developer's tutorial demonstrates how to automate AI workflows using Qualcomm AI Runtime (QAIRT), covering model optimization and deployment. The system leverages QAIRT features to streamline deploy…
A developer built a semantic search engine that runs entirely in the browser using a static embedding model (model2vec) instead of a full transformer, reducing the model size to a 4 MB lookup table. T…
Smolbren, a new CLI tool, turns Markdown vaults into local, queryable knowledge graphs with full-text search, using frontmatter to discover ontology and supporting Cypher queries and BM25 search. Desi…
A developer has released an open-source starter kit that integrates DeepSeek V4 into Claude Code, featuring nine custom agents, seven behavior rules, security hooks, local OCR, and auto-backup. The ki…
OpenAI Whisper has 12 unique checkpoint files, but the Python package exposes 14 local model names due to aliases for 'large' and 'turbo'. Additional confusion arises from runtimes and converted forma…