Helsing, a defense technology company developing AI-enabled drone software, is hiring a Machine Learning Engineer for Detection and Tracking in Washington, DC, to own the detection and tracking models…
AIsbom v1.3.0, a tool for scanning ML model artifacts, now flags Keras Lambda layers and embedded code objects as CRITICAL, without unmarshalling payloads. The tool also detects ONNX external-data pat…
A new mobile sign language recognition system combines MediaPipe's 21 hand and 468 face landmarks with a GRU/LSTM sequence classifier, achieving real-time 30fps performance on devices via ONNX or Tens…
Tynx, a new ONNX runtime with a PyTorch-shaped API for inference and training, has been released as a Python package under 20 MB. Written in Rust, it uses Burn/CubeCL and wgpu for GPU execution across…
Developer cloudkj released lance-bundle, an open-source library that packages precomputed embedding vectors with their embedding model into a single file for fast, local semantic queries, using LanceD…
ONNX Runtime, an open-source inference engine, enables interoperability of machine learning models across frameworks and hardware platforms by leveraging the ONNX standard. It simplifies deployment by…
Mistral AI released Shieldstral, a 3B-parameter open-weights multimodal moderation model that outputs toxicity and safety scores across multiple axes, trained on ~600K human-judged examples covering h…
Ninad Phalak released LLM-Shield-Proxy, an open-source zero-egress reverse proxy that redacts PII from OpenAI-compatible LLM API requests within a corporate VPC, re-hydrating SSE streams with sub-mill…
Opt.Gear, a new foundation model family from an unnamed research team, achieves up to 4.9x faster prefill and decoding speeds on NPUs compared to similar-scale models, with dense models of 1M, 270M, a…
A developer detailed a privacy-preserving inference pipeline for health data using Intel SGX and Gramine, demonstrating how to build a secure C++ inference engine that encrypts data even from the host…
Wipe.photos, a free in-browser AI photo inpainting tool, removes unwanted objects, people, text, and logos from images using LaMa and ONNX, running entirely on the user's device via WebGPU acceleratio…
Aina, a new open-source tool, lets developers upload an ONNX model, autotune it for specific edge hardware, and deploy it across a fleet with a single API and CLI, eliminating the manual per-device SS…
STMicroelectronics (ST) announced the STM32N6, its most powerful microcontroller and the first to include a custom Neural-ART Accelerator NPU capable of 600 GOPS, enabling machine learning application…
Rod Johnson, creator of the Spring Framework, shipped Embabel 1.0.0 GA, an AI agent framework for Java that uses deterministic Goal-Oriented Action Planning (GOAP) instead of letting LLMs decide actio…
Inflect-v2, two open-weight English TTS models at 3.9M and 9.3M parameters, generate speech multiple times faster than real-time on CPU while delivering quality competitive with larger systems like Ki…
Vendor lock-in in AI infrastructure creates technical debt and forces companies into a one-size-fits-all approach, warns a technical guide. To avoid this, the guide recommends implementing a Gateway P…
DKSplit v1.0.2, a fast character-level word segmentation library for Python, achieves 86.5% strict exact match accuracy on a 1,000-sample benchmark of domain prefixes, outperforming WordSegment (65.2%…
Typesense 30.2 can now fuse BM25 keyword ranks with local embedding search in a single API call, eliminating the need for a separate embedding service. A tutorial by Rachel Goldstein demonstrates buil…
AI Firewall, an open-source security gateway for LLM traffic, launched as an MVP with a TypeScript gateway and Go edge proxy that inspect prompts and outputs for secrets, prompt injections, and EU AI …
A developer's practical guide details the engineering challenges and solutions for deploying production-ready Retrieval-Augmented Generation (RAG) applications, covering data indexing, vector stores, …