Machine Learning Bangladesh, a community of 5,000+ AI/ML enthusiasts founded by an unnamed organizer in September 2023, is $780 short of funding for a free hybrid student hackathon on July 26 in Dhaka…
A developer known as Avifenesh released Bw24, a from-scratch LLM inference engine in Rust and CUDA tuned for NVIDIA's RTX 5090 Laptop GPU (Blackwell sm_120a, 24 GB), achieving up to 2.3x speedup over …
Running large language models like Qwen or GPT locally requires a dedicated machine with sufficient RAM/VRAM, and costs vary based on hardware; smaller variants of Gemma or Qwen Coder are recommended …
Engineer Carlo Valenti built his own transformer engine from scratch in C over 18 months to understand AI claims of sentience, then ran the same litmus tests on his two toddlers, finding that his daug…
Alibaba's Qwen2.5, a 7-billion parameter open model, runs on Android phones with 6GB RAM via Termux, enabling local multilingual AI for Indian traders and companies. It understands Hindi, English, and…
Imbue's Bouncer app now offers on-device AI text and image detection using a LoRA adapter on Gemma 4 E2B, achieving 99.8% accuracy on human vs. AI-generated text classification. The feature, called "R…
A new study from researchers evaluating large language models as unified multimodal learners for clinical prediction finds that converting all patient data into a single natural language sequence and …
A developer provides a practical guide for integrating open-weight LLMs like Llama, Mistral, and Gemma via API, covering authentication, request handling, and streaming responses. The guide emphasizes…
PrismML released Bonsai 27B, a 27-billion-parameter AI model compressed to 3.9 GB that runs on an iPhone 17 Pro Max at 11 tokens per second, the first model at that capability tier to fit on a smartph…
A study applying Signal Detection Theory to four AI models—Llama-3-8B-Instruct, Mistral-7B-Instruct-v0.3, Llama-3-8B-Base, and Gemma-2-9B-Instruct—across 224,000 factual QA trials found that models va…
A study analyzing ChatGPT usage patterns found that 71% of user queries could be handled by a capable local model, yet most organizations still route every request to a cloud API, incurring unnecessar…
A new measurement study by an independent developer using the open-source HomeLab Monitor tool found that running local large language models on a single NVIDIA RTX 3090 can cost as little as €0.046 p…
A behavioral experiment on Google's Gemma model found that providing a stop_run tool did not meaningfully change its task completion rate, with the tool called in only ~2% of runs and exclusively when…
ZETIC has released a curated catalog of open-source on-device AI apps that run entirely on the phone's NPU with no cloud dependency, eliminating compliance costs and per-token fees. The collection inc…
Japanese intellectual property lawyers often fail to address open source licensing adequately because they focus solely on copyright analysis (Layer 1) while ignoring contractual issues (Layer 2) and …
Mesh LLM, a new open-source tool, launched yesterday and hit the Hacker News front page, enabling users to pool GPUs across machines and run AI models up to 235B parameters via an OpenAI-compatible AP…
A human blogger built an AI slop machine despite writing every word of their blog manually. American and Chinese AI labs release increasingly strong open-weights large language models that can be self…
A developer built Model Kombat, a 2D fighting game that visualizes Large Language Model architectures, parameter scales, and hardware constraints as playable mechanics. The game features fighters repr…
An educational lab demonstrating various AI agent architectures built on LangChain and a local Ollama server has been released. The project includes multiple runnable CLI variants for studying chat wi…
Cactus released version 2 of its on-device AI inference platform, featuring model confidence-based routing to cloud fallback, lossless 4-bit quantization, and GPU acceleration on Apple Metal. The plat…