70B AI Model Runs on 8GB Laptop
A developer released AirLLM, an open-source tool that enables running 70-billion-parameter AI models on laptops with as little as 8GB RAM, without requiring a GPU. By using memory mapping and layer sw…
Hugging Face is an AI community platform and company providing a hub for open-source machine learning models, datasets, and demo spaces. It hosts over 500,000 models and is widely used by the AI research community.
A developer released AirLLM, an open-source tool that enables running 70-billion-parameter AI models on laptops with as little as 8GB RAM, without requiring a GPU. By using memory mapping and layer sw…
A new roadmap outlines the skills needed to become an LLM engineer by 2026, focusing on adapting and serving pretrained large language models rather than training from scratch. The five-step path cove…
An engineer released a cleaned, validated dataset of India's Census 2011 district-level data on Hugging Face, containing 640 districts with 29 columns and zero missing values. The dataset sums exactly…
A team has built Aiden AI, a physical hardware AI agent device that connects as a standard USB HID device to control any computer without requiring software installation, API access, or permissions. T…
FineSet released four quality-scored ML research datasets on Hugging Face, covering synthetic data, efficient LLMs, LLM agents, and mechanistic interpretability papers from ArXiv and Semantic Scholar.…
Moonshot AI released Kimi K2.7-Code, a coding-focused agent model with 1 trillion total parameters and a 256K context window, aimed at multi-step software engineering tasks. The Beijing lab positions …
A developer released Ghostty Playground, an experimental project that runs the full Ghostty terminal with a real Linux-like backend directly in the browser via BrowserPod, supporting configs, AI model…
Developer Anil Madhavapeddy released ocaml-deepseek, an OCaml library that integrates DeepSeek's open-weight LLM directly into applications via a native inference engine, enabling local, dependency-fr…
A user training a T5 model asked for alternative metrics to Exact Match for evaluating text generation. Community members suggested ROUGE-1, ROUGE-2, and BLEU, and recommended Braintrust for running e…
Researchers introduced AgentViSS, a benchmark for evaluating visual social intelligence in multimodal agents, featuring 240 scenarios and four role-level tasks. Tests on seven multimodal large languag…
Researchers from Aalto University and the University of Waterloo introduced Locket, a feature-locking technique for large language models that enables pay-to-unlock schemes by restricting specific mod…
A developer compares four dominant alignment methods—RLHF, DPO, IPO, and KTO—for fine-tuning large language models, detailing their mathematical formulations, data requirements, and practical tradeoff…
SigNoz announced a new integration with the Vercel AI SDK and OpenTelemetry to provide observability for LLM-powered applications, enabling developers to monitor latency, errors, and model behavior in…
Developer released llmslim, an open-source Python package that compresses prompts, chat histories, and RAG contexts using semantic chunking and extractive ranking, achieving up to 60% token reduction.…
A developer built contextcram, a zero-dependency Python library that prioritizes and packs context pieces (system prompts, chat history, documents) into a fixed token budget for LLM applications. It a…
A developer released 'Fish anything', a chill game built using small language models, hosted on Hugging Face Spaces. The project was shared on Hacker News as a Show HN submission.…
A developer built Perri Comic Generator, a lightweight single-panel comic creator that combines an LLM (Meta-Llama-3-8B-Instruct) with a diffusion model (SDXL-Turbo) to generate comics from story seed…
Rio de Janeiro's municipal IT company IplanRIO released Rio-3.5-Open-397B on Hugging Face under an MIT license, claiming it as a government-developed 397-billion-parameter Mixture-of-Experts model. Ne…
Rio de Janeiro's municipal IT company, IplanRIO, released an AI model called Rio 3.5 Open 397B that outperformed DeepSeek V4 Pro on a key benchmark, built by fine-tuning Alibaba's open-source Qwen mod…
Arduino has introduced support for running local Vision Language Models (VLMs) on the Arduino UNO Q board via the new App Lab software, enabling developers to deploy generative AI on low-power devices…