{"slug": "liquid-ai-open-sources-pipette-a-reproducible-benchmarking-suite-that-measures", "title": "Liquid AI Open-Sources Pipette: A Reproducible Benchmarking Suite That Measures On-Device Models, Quantization, Runtime and Hardware Together", "summary": "Liquid AI released Pipette, an open-source benchmarking platform for foundation models on edge devices, developed with Artificial Analysis as an independent methodology validator. Pipette measures on-device models, quantization, runtime, and hardware together to provide reproducible performance data beyond server-class, full-precision model card numbers.", "body_md": "Model cards report quality under server-class, full-precision conditions. Those numbers rarely predict how the same model behaves on a phone. This week, Liquid AI released Pipette. It is an open-source platform for benchmarking foundation models on edge devices, built in partnership with Artificial Analysis as an independent methodology validator. Pipette treats on-device behavior as a […]\n\nThe post [Liquid AI Open-Sources Pipette: A Reproducible Benchmarking Suite That Measures On-Device Models, Quantization, Runtime and Hardware Together](https://www.marktechpost.com/2026/08/25/liquid-ai-open-sources-pipette-a-reproducible-benchmarking-suite-that-measures-on-device-models-quantization-runtime-and-hardware-together/) appeared first on [MarkTechPost](https://www.marktechpost.com).", "url": "https://wpnews.pro/news/liquid-ai-open-sources-pipette-a-reproducible-benchmarking-suite-that-measures", "canonical_source": "https://www.marktechpost.com/2026/08/25/liquid-ai-open-sources-pipette-a-reproducible-benchmarking-suite-that-measures-on-device-models-quantization-runtime-and-hardware-together/", "published_at": "2026-08-25 23:48:08+00:00", "updated_at": "2026-08-26 00:14:03.868187+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-tools", "ai-research"], "entities": ["Liquid AI", "Artificial Analysis", "Pipette"], "alternates": {"html": "https://wpnews.pro/news/liquid-ai-open-sources-pipette-a-reproducible-benchmarking-suite-that-measures", "markdown": "https://wpnews.pro/news/liquid-ai-open-sources-pipette-a-reproducible-benchmarking-suite-that-measures.md", "text": "https://wpnews.pro/news/liquid-ai-open-sources-pipette-a-reproducible-benchmarking-suite-that-measures.txt", "jsonld": "https://wpnews.pro/news/liquid-ai-open-sources-pipette-a-reproducible-benchmarking-suite-that-measures.jsonld"}}