Qwen/Qwen2.5-1.5B-Instruct
Qwen released Qwen2.5-1.5B-Instruct, an Apache-2.0 licensed 1.5B parameter instruct model for local chat and agent tasks, requiring 8-16 GB RAM/VRAM. The model is available on Hugging Bay with externa…
Qwen released Qwen2.5-1.5B-Instruct, an Apache-2.0 licensed 1.5B parameter instruct model for local chat and agent tasks, requiring 8-16 GB RAM/VRAM. The model is available on Hugging Bay with externa…
Hugging Bay has hosted the mradermacher/sarashina2-70b-GGUF model, a 445.1 GB quantized version of the sbintuitions/sarashina2-70b base model under the MIT license, with 2 of 15 files verified and sca…
Anthropic released a Linux desktop app for Claude Code, offering the same features as macOS and Windows versions. The app requires manual repository setup and only supports Debian/Ubuntu-based distrib…
A new analysis of edge AI hardware reveals that TOPS (trillions of operations per second) is a poor predictor of large language model (LLM) performance, with memory capacity and bandwidth being the cr…
Small language models (SLMs) are increasingly powering next-generation AI agents, challenging the assumption that larger models are always better. NVIDIA research shows SLMs excel at repetitive, speci…
Security researchers at MBG Security built a global network of honeypots with exposed AI inference and agent endpoints, observing attackers actively scanning for and exploiting vulnerabilities like CV…
Zackriya Solutions released Meetily v0.4.0, a free and open-source AI meeting assistant that records, transcribes, and summarizes meetings entirely on-device for Windows, macOS, and Linux. Unlike clou…
Solo developer released Kivarro, an open-source local inference workbench for running AI models on personal hardware, built on Rust and Tauri and targeting GGUF models. The creator posted it to r/Loca…
A developer is using AI coding agents to fork the open-core meeting assistant Meetily, replacing its paywalled Pro features with open-source alternatives. The fork, tentatively named LibreMeet, aims t…
Glad Labs fixed a GPU pinning issue where LiteLLM 1.89.2's global api_base override prevented per-model routing, causing vision tasks to cold-load onto the wrong GPU. The team also hardened content gu…
A developer building Bastra Recall, an MIT-licensed MCP memory server for Claude, discovered that their initial 98.3% benchmark was misleading because it queried each memory with its own trigger phras…
A developer built a Go library for semantic LLM caching that combines deterministic hashing with vector similarity search to reduce costs from repeated but differently worded queries. The library supp…
Felix Kjellberg (PewDiePie) released Odysseus, an open-source, self-hosted AI workspace bundling chat, agents, research, and local model workflows under an AGPL-3.0 license. The project, launched in M…
A developer built session-indexer, a Go tool that indexes Claude Code session transcripts into a per-project SQLite database for semantic memory retrieval. The tool avoids centralized memory stores by…
Qwen open-sourced the 35-billion parameter Mixture of Experts model Qwen 3.6-35B-A3B, which activates only 3 billion parameters per token and runs on a $599 Mac Mini M4 with 16GB RAM at 17 tok/s with …
Loomcycle released versions 1.9.0 to 1.11.1 with four major arcs: a security hardening pass closing 17 findings, a new CredentialDef system for encrypted per-tenant secrets using AES-256-GCM, cost att…
OrinIDE v1.0.8, an AI-powered code editor that runs entirely in the browser without cloud accounts or subscriptions, now supports offline AI models via Ollama and introduces a 4-agent workflow for pla…
SmolSignal, an AI signal copilot for Flipper Zero, launches to help users analyze capture files with plain-English explanations and safety classifications. The tool reads multiple file formats, detect…
Solon 4.0's ReActAgent enables developers to build AI agents that reason, use external tools, and adapt based on real-world feedback. The agent implements a cognitive loop of thought, action, and obse…
Solon 4.0 introduces ChatModel, a unified LLM client that abstracts away boilerplate code for integrating large language models into Java applications. The API supports multiple model providers includ…