FitLens: The AI-Powered Fitness App Usable without wearables A developer built FitLens, a consent-first Android fitness companion that uses the Presage SmartSpectra SDK on the phone's live camera stream to measure pulse rate, HRV (RMSSD), breathing rate, arterial-pressure waveforms and facial expressions without any wearable. The on-device signals drive personalized Karvonen heart-rate zones, adaptive rest intervals, recovery-breathing guidance and readiness labels, with metric computation kept on-device and camera access gated behind explicit consent. This is a submission for the Presage SmartSpectra SDK Challenge https://dev.to/challenges/presage-2026-11-04 FitLens is a consent-first Android fitness companion that turns a phone camera into a contactless wellness coach—no smartwatch, chest strap, or wearable required. Instead of using a fixed workout timer that ignores how your body is responding, FitLens runs Presage SmartSpectra on the live camera stream to measure pulse rate , HRV RMSSD , breathing rate , relative arterial-pressure waveform , chest/abdomen traces , facial expressions , and SDK validation/insight signals. Those live signals drive a workout HUD with personalized Karvonen heart-rate zones, adaptive rest intervals, recovery-breathing guidance, readiness labels, and optional AI coaching. FitLens supports quick exercises and multi-exercise routines, timed isometric holds such as Plank, manual rep logging, Android TTS cues, front/rear camera switching, and local workout history. SmartSpectra metric computation stays on-device; SmartSpectra Insights, optional Firebase AI features, and local data handling are disclosed below. 🎬 Demo video: Paste your public demo video link or embed here Suggested 2–3 minute walkthrough: Consent-first launch — show that the camera remains off until the user reviews the sensing/privacy consent and grants Android camera permission. Live SmartSpectra vitals — face the camera and show pulse BPM, breathing rate, HRV RMSSD, expression, PPG/respiratory waveforms, confidence, and validation hints updating in real time. Adaptive workout — start a workout, show live vitals feeding the coaching banner, extended rest when heart rate remains elevated, the recovery breathing pacer, and readiness/HRV cues. Privacy close-out — show local recent sessions and the Profile & Privacy controls for consent, SDK telemetry, offline edge mode, and deleting local health data. README.md secrets.properties file: PRESAGE API KEY=your presage smartspectra api key ./scripts/verify fitlens.sh runs the local architecture/unit checks, ./gradlew testDebugUnitTest runs the JVM test suite, and ./gradlew installDebug builds the Android app. android-ci checks that secrets are not committed, verifies the architecture invariants, compiles Kotlin, runs lint/unit tests, builds signed release APKs, and verifies critical classes survive R8 minification. FitLens uses one CameraX pipeline for both preview and analysis: PresageManager SmartSpectraSdk.shared with the API key, imageOutputEnabled = false , the user’s telemetry preference, and SmartSpectraConfig.cardioMetrics + SmartSpectraConfig.breathingMetrics + listOf MetricType.EXPRESSIONS . PresageFrameAnalyzer SmartSpectraSdk.shared.useCustomInput handle and submits CameraX ImageProxy frames through input.sendFrame ... . DualStreamAnalyzer WorkoutViewModel sdk.metricsFlow , sdk.validationStatus , sdk.insight , and sdk.error , then maps the latest samples into the app’s VitalsReading state. cardio cardio.pulseRateList sample drives BPM, confidence, and personalized Karvonen zones. arterialPressureTraceList feeds the live pulse waveform. When a set ends, calculateAdaptiveRest compares current pulse with the user’s resting HR and can extend rest by breathing breathing.rateList drives live BRPM, while upperTraceList and lowerTraceList feed respiratory waveforms. Rest and cooldown show a guided cardio.hrvList samples are converted into readiness labels such as High Readiness , Balanced Load , and High Exertion Load , shown in the vitals/workout UI and included in local session context. MetricType.EXPRESSIONS face.expressionList result is mapped to SDK labels such as Happy, Neutral, Sad, Angry, Surprise, Fear, Disgust, and Contempt. evaluateHolisticBiofeedback turns detected strain-related expressions into cues like relaxing the jaw/brow and exhaling, while positive expressions are treated as composure/effort signals. The deterministic workout/coach path runs locally through FitnessTools https://github.com/Tech-Vexy/FitLens/blob/main/app/src/main/kotlin/com/fitlens/app/ai/FitnessTools.kt , so adaptive rest, readiness, breathing cues, and session summaries do not depend on a cloud model. Optional Gemini/Firebase features are described under Consent and Data Handling. WorkoutManager and FitnessTools convert live pulse/HRV/breathing/expression signals into adaptive rest, readiness, recovery-breathing, and summary decisions without cloud latency. +1 Rep taps and Plank is a timed hold. The SmartSpectra contribution is physiological adaptation, not pose tracking. google-services.json enables cloud plan/live-voice paths; without it, LocalEdgeEngine still handles plans/routines locally, but Live Voice is unavailable. FitLens is entering both prize categories and remains eligible for Best Overall Human-Sensing Experience because it integrates SmartSpectra into a functional app with live camera signals. Solo exercisers often train with a propped-up phone but have no objective feedback about recovery between sets. FitLens addresses that gap by turning the same camera into a privacy-conscious wellness coach: it can wait for cardiovascular recovery before the next set, guide breathing during rest, and keep health records on-device rather than requiring a wearable ecosystem or cloud health account. The experience is designed for real home/gym use: explicit consent before camera sensing, front/rear camera switching, live framing hints, personalized Karvonen zones, Android TTS cues, timed holds, local session history, and one-tap deletion of local health records. FitLens treats the phone camera like an empathetic training partner rather than a dashboard. It combines pulse recovery, breathing cadence, HRV readiness, and facial-expression cues into one live biofeedback loop—so the coach can respond when a user looks tense, is holding their breath, or needs a longer recovery window. The animated recovery-breathing ring and expression-aware coaching prompts make the SmartSpectra signals feel tangible and human. YUV 420 888 frames are processed in volatile memory by SmartSpectra on-device and are not written to disk as raw video by FitLens. requestInsight while pulse is available, and can request an insight from the mood check-in flow; raw video and facial imagery are not sent for this feature. enableTelemetry . FitLens describes it as anonymous stability telemetry without video, vitals, or user/device identifiers and lets users disable it. fitlens health sqlite.db . Health records remain on-device until the user deletes them or uninstalls the app.