This is a submission for the Hacktoberfest Open-Source AI Challenge Week 1: Touch Grass
#
🌿 What I Built
BugDex is an AI-powered real-world insect collection game and digital field journal designed to turn screen time into an outdoor adventure. Inspired by classic monster-catching compendiums like the Pokédex, BugDex empowers people to step outside, explore backyards, parks, campus gardens, and hiking trails, and discover the fascinating mini-beasts living all around us.
Whenever you spot an insect, spider, or arthropod in the wild:
Snap a photo using your smartphone or upload a picture. 2. AI Multimodal Vision identifies the specimen in real-time, extracting its biological taxonomy (Order, Family, Scientific Name, and Common Name), morphological traits (wing venation, elytra, antennae), habitat, diet, and human safety guidance. 3. Claim a Holographic Collectible Card : Each verified observation transforms into a collectible card ranked across rarity tiers (Common ,Uncommon ,Rare ,Very Rare , andLegendary ) with animated foil sheens, confidence scores, and ecological notes. 4. Level Up & Embark on Daily Outdoor Quests : Earn XP, unlock ranks (from Novice Bug Catcher to Master Entomologist ), maintain daily exploration streaks, and complete daily expeditions verified directly by Vision AI (e.g.,"Find an insect on a flower" ,"Spot a winged flyer" ,"Find a micro-marvel smaller than a fingernail" ).
🎯 Who is it for?
Outdoor Explorers & Nature Lovers seeking an interactive field guide to understand local biodiversity. #
Kids, Families & Students who want to learn biological taxonomy through hands-on gamification rather than dry textbooks. #
Developers & Tech Enthusiasts who need an engaging, rewarding excuse to close their IDEs, take a walk, and truly**"touch grass"** .
#
🎥 Demo
✨ Key Features at a Glance
-
📸 Instant Multimodal AI Field Identification : Sub-second visual classification with real-world biological accuracy.
-
🎴 Holographic Foil Specimen Cards : Dynamic 3D tilt effects, animated rarity gleams, and comprehensive ecological field notes.
-
📜 Interactive BugDex & Journal : Filter by taxonomic order (Coleoptera, Lepidoptera, Hymenoptera, Mantodea, Odonata, etc. ) and rarity with smart deduplication and sighting counters.
-
🎯 AI-Verified Daily Expeditions : Daily outdoor quest verification where AI assesses whether your real-world snapshot fulfills the day's biodiversity mission.
-
🏆 Achievements & Leveling System : Earn badges (🐛First Bug , 🦋Collector , 🌙Night Hunter , 🔥Streak Adventurer ) and progress across 6 naturalist ranks.
-
⚠️ Wildlife Safety First : Automatic warnings for stinging or venomous species paired with advice to observe respectfully and never harm specimens.
-
🔒 Privacy-First & Offline-Ready : Client-side storage with broad habitat tagging (Park, Garden, Trail )—no intrusive GPS tracking.
#
💻 Code
The entire project is open source and hosted on GitHub:
🔗 Repository: https://github.com/TarunTXE/BugDex
#
🛠️ How I Built It
BugDex is built around a modern, reactive, mobile-first web architecture combined with multimodal vision models:
🧠 Open-Source & Multimodal AI Architecture
BugDex utilizes the Google Gemini Multimodal Vision REST API (@google/genai), implementing an ultra-low-latency model hierarchy with resilient fallback handling:
`gemini-flash-lite-latest`*(Primary for instant outdoor scanning)*
2. `gemini-3.5-flash-lite`
3. `gemini-3.1-flash-lite`
4. `gemini-2.5-flash-lite`
gemini-3.6-flash(Deep analysis fallback)
🔍 Strict Taxonomy & Vision Pipeline
To prevent hallucinations and guarantee scientific fidelity:
Base64 Inline Buffer Ingestion : Live camera captures or user-selected images are downscaled and encoded client-side to minimize mobile data usage. #
Constrained JSON Schema Output : AI prompts enforce structured biological schemas (response_mime_type: "application/json" ) with low temperature (0.1 ), extracting exact scientific binomial nomenclature, family, order, confidence rating, appearance breakdown, diet, and human safety instructions. #
Negative Sample & Uncertainty Rejection : If an uploaded photo contains human faces, pets, or non-living objects, the model gracefully returns"is_insect": false , guiding the user with framing tips. #
AI Quest Evaluation Engine : A dedicated prompt engine evaluates photos against active daily challenges, analyzing the scene context (e.g. insect perched on a petal vs flying in midair) and returning custom verification feedback.
🎨 Frontend & Ergonomics
React 19 & Vite : Ultra-fast hot-re and lightning-fast bundle performance. #
Tailwind CSS : Custom dark nature glassmorphism, glowing taxonomic badges, and CSS keyframe holographic foil sheen animations. #
Web Audio API Sound Synthesizer : Custom synthesized retro field sound effects for scanning, level-ups, and card unlocks without external audio asset bloat. #
Canvas-Confetti : Visual celebration bursts upon completing quests or uncovering rare specimens.
#
🌍 Why Does Open Innovation Matter?
Open innovation in AI and scientific education is a transformative force:
Democratizing Biodiversity Education : Traditional field guides and taxonomic keys are often dense, academic, and inaccessible to casual nature enthusiasts. Open AI models turn complex biological taxonomy into an accessible, interactive digital companion in the palm of anyone's hand. 2. Citizen Science at Scale : When biodiversity tools are open, extensible, and free from proprietary lock-in, anyone can contribute to local ecological awareness, documenting urban pollinators and tracking seasonal insect populations in their local communities. 3. Transparency & Safety : Because nature exploration involves real creatures—some of which can sting or bite—open, reproducible prompt architectures ensure that safety guidelines, non-invasive observation practices, and data privacy remain transparent and community-audited. 4. Connecting Technology with the Living Earth : Open innovation reminds us that technology should not isolate us in virtual walled gardens; instead, it can serve as a lens that deepens our awe, curiosity, and respect for the natural ecosystems right outside our front door.
#
🏆 Prize Categories
Hacktoberfest Week 1: Touch Grass (Main Track)
- Open-Source AI & Vision Innovation
Go outside, explore your local greenery, and happy bug hunting! 🐛🌿🔍