FridgeFlow AI: Never Stand Staring at an Open Refrigerator Door Again

A developer released FridgeFlow AI, an MIT-licensed, local-first grocery inventory app that uses Ollama with vision models like Gemma 3 4B and LLaVA to identify fridge contents from photos without sending images to cloud APIs. The stack pairs a Next.js 16/React 19 frontend with a FastAPI, SQLAlchemy and SQLite backend, using a strict Pydantic JSON contract that flags obscured items for review instead of guessing quantities, plus a reconciliation engine that merges rescans by normalized item stems. The project ships with 22 automated tests and exports shopping lists grouped by supermarket aisle to CSV or text.

We've all done it: standing in the kitchen after a long day, holding the refrigerator door wide open for three minutes, letting all the cold air escape while blankly wondering: “Do we have enough milk for tomorrow? Are those tomatoes still good? Do I need eggs, or did I buy some on Tuesday?” Then you get to the grocery store, can't remember, buy another carton of oat milk anyway, and come home to find two already sitting in the door shelf. FridgeFlow AI is a 100% private, local-first grocery intelligence application that lets you be genuinely lazy about managing food. Instead of typing spreadsheets or doing manual inventory: Smart Reconciliation: Rescanning your fridge updates quantities and merges existing items rather than creating duplicates. Store Shopping Mode: High-contrast, large touch-target checklist mode built for walking supermarket aisles on your phone. Recipe Ingredient Matcher: Compare any dinner recipe against your fridge; missing items queue to your shopping list in 1 click. Code The complete source code is released under the permissive MIT License: "Your fridge. Decoded." Snap a photo. Know what you have. Shop only what you need. Key Features https://github.com/omshree59/Hacto-FridgeAI -key-features • Architecture https://github.com/omshree59/Hacto-FridgeAI -system-architecture • Quickstart https://github.com/omshree59/Hacto-FridgeAI -quickstart-guide • Supported AI Models https://github.com/omshree59/Hacto-FridgeAI -supported-ai-models • API Reference https://github.com/omshree59/Hacto-FridgeAI -rest-api-reference • Testing https://github.com/omshree59/Hacto-FridgeAI -testing • Privacy & Security https://github.com/omshree59/Hacto-FridgeAI -privacy--security FridgeFlow AI is a complete, production-grade, privacy-first web application designed to eliminate open-door kitchen guesswork and unnecessary grocery spending. Instead of relying on costly, privacy-invasive cloud APIs like OpenAI or Google Cloud Vision , FridgeFlow AI executes 100% locally on your own computer using Ollama and vision-capable open models like Gemma 3 or LLaVA . Frontend: Next.js 16 App Router , React 19, TypeScript, Tailwind CSS, Lucide Icons. Backend: Python 3.11+, FastAPI, SQLAlchemy, SQLite, Pillow, HTTPX. Local AI Runtime: Ollama with Gemma 3 4B Vision gemma3:4b . Test Suite: 22 automated tests 17 pytest backend + 5 Vitest frontend . How I Built It Instead of sending private images to paid cloud APIs, FridgeFlow AI binds directly to Ollama at http://localhost:11434 http://localhost:11434 . Image Pipeline: Safe image decoding with Pillow, automated EXIF orientation transposition ImageOps.exif transpose , and Lanczos downsampling max 1280px to optimize model memory without sacrificing label clarity. Structured Pydantic Contract: The model produces strict JSON matching AIScanResult. If an item is obscured behind a jar, it marks quantity estimate: null and sets needs review: true—strictly avoiding hallucinations. AI models should detect, not dictate. Stock evaluation is deterministic: quantity <= 0 → out of stock quantity <= threshold → low stock unknown quantity → unknown never assumed as zero When a rescan occurs, the reconciliation engine matches normalized stems tomatoes → tomato, while preserving distinctions like oat milk ≠ milk . It proposes updates and only modifies SQLite when confirmed. Confirmed low-stock items are automatically grouped into standard supermarket aisles: Produce, Dairy & Eggs, Meat & Seafood, Pantry & Grains, Frozen, and Beverages. Lists export to .csv or formatted .txt anytime. Why Does Open Innovation Matter? Open innovation is what made this project possible: Privacy In the Home: Photographs of your personal living space and food habits should not become training data for closed advertising platforms. Running open-weight models like Gemma 3 locally guarantees zero telemetry. Zero API Cost & Rate Limits: Cloud vision APIs charge per image and throttle requests. With open-source runtimes like Ollama, scanning your fridge 10 times a day is completely free forever. Auditability: When tracking food stock and planning meals, you need inspectable algorithms. Because the prompt engineering, JSON validation, and database reconciliation code are open source, there are no proprietary black boxes. My Agent Session This entire application—from initial backend schema design to Next.js UI implementation, Pillow security validation, and automated test suites—was built and documented through an interactive pair-programming trajectory with Antigravity and preserved via DevRelay: Direct Session Link: FridgeFlow AI Session on DEV The Lazy Payoff Before FridgeFlow AI: Staring blankly into the fridge for 5 minutes before leaving home. Texting roommates or partners: "Do we have butter? Can you check?" Buying duplicate produce that ends up rotting in the back of the shelf. Wandering back and forth across supermarket aisles trying to remember what was missing. With FridgeFlow AI: One 3-second camera snap. Tap Confirm Inventory → Tap Generate from Low Stock. Walk through the store in Shopping Mode with an aisle-ordered checklist. Estimated weekly time saved: ~45 minutes of kitchen rummaging and aisle backtracking. Prize Categories 🌟 Primary Category: Lazy Innovation Track Building an open-source tool that automates tedious everyday tasks and lets humans be productively lazy . 🛡️ Secondary Category: Open Innovation Track Leveraging open-weight models via Ollama to protect household data sovereignty and eliminate cloud vendor lock-in .