TrailWhisper: Keep Eyes on the Canopy. Phone in the Pocket.

A developer built TrailWhisper, an offline-first, zero-screen nature companion that runs open-weights acoustic models (BirdNET-Mini ONNX and MobileNet-V3 BioAcoustic) directly in the phone's browser via WebAssembly and WebGL, so hikers can identify bird calls without a network connection. The app analyzes ambient biophonics through the Web Audio API, then whispers a one-sentence directional cue such as "Asian Koel calling at your ten o'clock, high in the mango canopy" through bone-conduction headphones, logging detections to localStorage with SHA-256 fingerprints and JSON export.

Project Name: TrailWhisper Tagline: Keep Eyes on the Canopy. Phone in the Pocket. Live Demo: https://ayush-trailwhisper.surge.sh https://ayush-trailwhisper.surge.sh Video Walkthrough: https://youtu.be/p9flaxXcBRI https://youtu.be/p9flaxXcBRI Repository: https://github.com/Ayushgupta1715/trailwhisper https://github.com/Ayushgupta1715/trailwhisper When modern hikers and birders enter forest trails or mountain ranges, they carry smartphones equipped with nature recognition apps. Ironically, this traps them in the "Screen Trap" : We built TrailWhisper to reverse this. It is an offline-first, zero-screen nature trail audio companion powered by on-device open-weights AI. You put your phone in your pocket, put on bone-conduction headphones, and walk. When native birds call or endemic flora flutter, TrailWhisper analyzes the ambient biophonics locally, chimes a gentle 528 Hz Solfeggio announcement tone, and whispers a concise 1-sentence directional cue: "Asian Koel calling at your ten o'clock, high in the mango canopy." The challenge asks: “Tell us why open innovation matters for what you built.” Here is why proprietary cloud models fail on trails, and why open weights win: NetworkError: Failed to fetch . Open-weights acoustic models BirdNET-Mini ONNX and MobileNet-V3 BioAcoustic execute directly on the phone's browser engine using WebAssembly and WebGL—operating seamlessly at 0 bars. AudioContext , createAnalyser , getByteTimeDomainData , getByteFrequencyData . window.speechSynthesis with trail-pace cadence. localStorage , complete with SHA-256 cryptographic fingerprints, timestamps, bearings, and 1-click JSON export. | Feature | Purpose | |---|---| | Live Audio Monitor | Real-time oscilloscope waveform + 256-bin FFT spectrum with visual detection markers | | Bird Call Replay | Procedural frequency synthesis allowing hikers to hear and verify bird call notes offline | | Why this bird? | Transparent acoustic reasoning frequency bands, interval rhythms, seasonal notes | | Trail Bingo Quests | 3x2 responsive 1-tap sensory checklist without camera or typing | | My Trail Journal | Offline search, filtering, and cryptographic audit records | git clone https://github.com/Ayushgupta1715/trailwhisper.git cd trailwhisper npm install npm run dev Visit http://localhost:3000 on your laptop or phone on the same Wi-Fi. Technology should connect us with the physical world, not isolate us behind glass. TrailWhisper shows how open-source edge AI can disappear into your pocket so you can truly Touch Grass .