This is a submission for the Presage SmartSpectra SDK Challenge
FitLens is a consent-first Android fitness companion that turns a phone camera into a contactless wellness coach—no smartwatch, chest strap, or wearable required.
Instead of using a fixed workout timer that ignores how your body is responding, FitLens runs Presage SmartSpectra on the live camera stream to measure pulse rate, HRV (RMSSD), breathing rate, relative arterial-pressure waveform, chest/abdomen traces, facial expressions, and SDK validation/insight signals. Those live signals drive a workout HUD with personalized Karvonen heart-rate zones, adaptive rest intervals, recovery-breathing guidance, readiness labels, and optional AI coaching.
FitLens supports quick exercises and multi-exercise routines, timed isometric holds such as Plank, manual rep logging, Android TTS cues, front/rear camera switching, and local workout history. SmartSpectra metric computation stays on-device; SmartSpectra Insights, optional Firebase AI features, and local data handling are disclosed below.
🎬 Demo video: [Paste your public demo video link or embed here]
Suggested 2–3 minute walkthrough:
Consent-first launch — show that the camera remains off until the user reviews the sensing/privacy consent and grants Android camera permission. Live SmartSpectra vitals — face the camera and show pulse BPM, breathing rate, HRV RMSSD, expression, PPG/respiratory waveforms, confidence, and validation hints updating in real time. Adaptive workout — start a workout, show live vitals feeding the coaching banner, extended rest when heart rate remains elevated, the recovery breathing pacer, and readiness/HRV cues. Privacy close-out — show local recent sessions and the Profile & Privacy controls for consent, SDK telemetry, offline edge mode, and deleting local health data.
README.md`` secrets.properties file:
PRESAGE_API_KEY=your_presage_smartspectra_api_key
./scripts/verify_fitlens.sh runs the local architecture/unit checks, ./gradlew testDebugUnitTest runs the JVM test suite, and ./gradlew installDebug builds the Android app.android-ci) checks that secrets are not committed, verifies the architecture invariants, compiles Kotlin, runs lint/unit tests, builds signed release APKs, and verifies critical classes survive R8 minification.
FitLens uses one CameraX pipeline for both preview and analysis:
PresageManager`` SmartSpectraSdk.shared with the API key, imageOutputEnabled = false, the user’s telemetry preference, and SmartSpectraConfig.cardioMetrics + SmartSpectraConfig.breathingMetrics + listOf(MetricType.EXPRESSIONS). PresageFrameAnalyzer``SmartSpectraSdk.shared.useCustomInput() handle and submits CameraX ImageProxy frames through input.sendFrame(...). DualStreamAnalyzer``WorkoutViewModel`` sdk.metricsFlow, sdk.validationStatus, sdk.insight, and sdk.error, then maps the latest samples into the app’s VitalsReading state.cardio) cardio.pulseRateList sample drives BPM, confidence, and personalized Karvonen zones. arterialPressureTraceList feeds the live pulse waveform. When a set ends, calculateAdaptiveRest compares current pulse with the user’s resting HR and can extend rest by breathing) breathing.rateList drives live BRPM, while upperTraceList and lowerTraceList feed respiratory waveforms. Rest and cooldown show a guided cardio.hrvList samples are converted into readiness labels such as High Readiness, Balanced Load, and High Exertion Load, shown in the vitals/workout UI and included in local session context.MetricType.EXPRESSIONS) face.expressionList result is mapped to SDK labels such as Happy, Neutral, Sad, Angry, Surprise, Fear, Disgust, and Contempt. evaluateHolisticBiofeedback turns detected strain-related expressions into cues like relaxing the jaw/brow and exhaling, while positive expressions are treated as composure/effort signals.
The deterministic workout/coach path runs locally through FitnessTools, so adaptive rest, readiness, breathing cues, and session summaries do not depend on a cloud model. Optional Gemini/Firebase features are described under Consent and Data Handling.
WorkoutManager and FitnessTools convert live pulse/HRV/breathing/expression signals into adaptive rest, readiness, recovery-breathing, and summary decisions without cloud latency.+1 Rep taps and Plank is a timed hold. The SmartSpectra contribution is physiological adaptation, not pose tracking.google-services.json enables cloud plan/live-voice paths; without it, LocalEdgeEngine still handles plans/routines locally, but Live Voice is unavailable.
FitLens is entering both prize categories and remains eligible for Best Overall Human-Sensing Experience because it integrates SmartSpectra into a functional app with live camera signals.
Solo exercisers often train with a propped-up phone but have no objective feedback about recovery between sets. FitLens addresses that gap by turning the same camera into a privacy-conscious wellness coach: it can wait for cardiovascular recovery before the next set, guide breathing during rest, and keep health records on-device rather than requiring a wearable ecosystem or cloud health account.
The experience is designed for real home/gym use: explicit consent before camera sensing, front/rear camera switching, live framing hints, personalized Karvonen zones, Android TTS cues, timed holds, local session history, and one-tap deletion of local health records.
FitLens treats the phone camera like an empathetic training partner rather than a dashboard. It combines pulse recovery, breathing cadence, HRV readiness, and facial-expression cues into one live biofeedback loop—so the coach can respond when a user looks tense, is holding their breath, or needs a longer recovery window. The animated recovery-breathing ring and expression-aware coaching prompts make the SmartSpectra signals feel tangible and human.
YUV_420_888 frames are processed in volatile memory by SmartSpectra on-device and are not written to disk as raw video by FitLens.requestInsight while pulse is available, and can request an insight from the mood check-in flow; raw video and facial imagery are not sent for this feature.enableTelemetry. FitLens describes it as anonymous stability telemetry without video, vitals, or user/device identifiers and lets users disable it.fitlens_health_sqlite.db). Health records remain on-device until the user deletes them or uninstalls the app.