{"slug": "fitlens-the-ai-powered-fitness-app-usable-without-wearables", "title": "FitLens: The AI-Powered Fitness App Usable without wearables", "summary": "A developer built FitLens, a consent-first Android fitness companion that uses the Presage SmartSpectra SDK on the phone's live camera stream to measure pulse rate, HRV (RMSSD), breathing rate, arterial-pressure waveforms and facial expressions without any wearable. The on-device signals drive personalized Karvonen heart-rate zones, adaptive rest intervals, recovery-breathing guidance and readiness labels, with metric computation kept on-device and camera access gated behind explicit consent.", "body_md": "*This is a submission for the [Presage SmartSpectra SDK Challenge](https://dev.to/challenges/presage-2026-11-04)*\n\n**FitLens** is a consent-first Android fitness companion that turns a phone camera into a contactless wellness coach—no smartwatch, chest strap, or wearable required.\n\nInstead of using a fixed workout timer that ignores how your body is responding, FitLens runs **Presage SmartSpectra** on the live camera stream to measure **pulse rate**, **HRV (RMSSD)**, **breathing rate**, **relative arterial-pressure waveform**, **chest/abdomen traces**, **facial expressions**, and SDK **validation/insight** signals. Those live signals drive a workout HUD with personalized Karvonen heart-rate zones, adaptive rest intervals, recovery-breathing guidance, readiness labels, and optional AI coaching.\n\nFitLens supports quick exercises and multi-exercise routines, timed isometric holds such as Plank, manual rep logging, Android TTS cues, front/rear camera switching, and local workout history. SmartSpectra metric computation stays on-device; SmartSpectra Insights, optional Firebase AI features, and local data handling are disclosed below.\n\n🎬 **Demo video:** [Paste your public demo video link or embed here]\n\nSuggested 2–3 minute walkthrough:\n\n**Consent-first launch** — show that the camera remains off until the user reviews the sensing/privacy consent and grants Android camera permission.\n**Live SmartSpectra vitals** — face the camera and show pulse BPM, breathing rate, HRV RMSSD, expression, PPG/respiratory waveforms, confidence, and validation hints updating in real time.\n**Adaptive workout** — start a workout, show live vitals feeding the coaching banner, extended rest when heart rate remains elevated, the recovery breathing pacer, and readiness/HRV cues.\n**Privacy close-out** — show local recent sessions and the Profile & Privacy controls for consent, SDK telemetry, offline edge mode, and deleting local health data.\n\n`README.md`` secrets.properties` file:\n\n```\n  PRESAGE_API_KEY=your_presage_smartspectra_api_key\n```\n\n`./scripts/verify_fitlens.sh` runs the local architecture/unit checks, `./gradlew testDebugUnitTest` runs the JVM test suite, and `./gradlew installDebug` builds the Android app.`android-ci`) checks that secrets are not committed, verifies the architecture invariants, compiles Kotlin, runs lint/unit tests, builds signed release APKs, and verifies critical classes survive R8 minification.\nFitLens uses one CameraX pipeline for both preview and analysis:\n\n`PresageManager`` SmartSpectraSdk.shared` with the API key, `imageOutputEnabled = false`, the user’s telemetry preference, and `SmartSpectraConfig.cardioMetrics + SmartSpectraConfig.breathingMetrics + listOf(MetricType.EXPRESSIONS)`.` PresageFrameAnalyzer``SmartSpectraSdk.shared.useCustomInput()` handle and submits CameraX `ImageProxy` frames through `input.sendFrame(...)`.` DualStreamAnalyzer``WorkoutViewModel`` sdk.metricsFlow`, `sdk.validationStatus`, `sdk.insight`, and `sdk.error`, then maps the latest samples into the app’s `VitalsReading` state.`cardio`)` cardio.pulseRateList` sample drives BPM, confidence, and personalized Karvonen zones. `arterialPressureTraceList` feeds the live pulse waveform. When a set ends, `calculateAdaptiveRest` compares current pulse with the user’s resting HR and can extend rest by `breathing`)` breathing.rateList` drives live BRPM, while `upperTraceList` and `lowerTraceList` feed respiratory waveforms. Rest and cooldown show a guided `cardio.hrvList` samples are converted into readiness labels such as `High Readiness`, `Balanced Load`, and `High Exertion Load`, shown in the vitals/workout UI and included in local session context.`MetricType.EXPRESSIONS`)` face.expressionList` result is mapped to SDK labels such as Happy, Neutral, Sad, Angry, Surprise, Fear, Disgust, and Contempt. `evaluateHolisticBiofeedback` turns detected strain-related expressions into cues like relaxing the jaw/brow and exhaling, while positive expressions are treated as composure/effort signals.\nThe deterministic workout/coach path runs locally through [`FitnessTools`](https://github.com/Tech-Vexy/FitLens/blob/main/app/src/main/kotlin/com/fitlens/app/ai/FitnessTools.kt), so adaptive rest, readiness, breathing cues, and session summaries do not depend on a cloud model. Optional Gemini/Firebase features are described under Consent and Data Handling.\n\n`WorkoutManager` and `FitnessTools` convert live pulse/HRV/breathing/expression signals into adaptive rest, readiness, recovery-breathing, and summary decisions without cloud latency.`+1 Rep` taps and Plank is a timed hold. The SmartSpectra contribution is physiological adaptation, not pose tracking.`google-services.json` enables cloud plan/live-voice paths; without it, `LocalEdgeEngine` still handles plans/routines locally, but Live Voice is unavailable.\nFitLens is entering **both** prize categories and remains eligible for **Best Overall Human-Sensing Experience** because it integrates SmartSpectra into a functional app with live camera signals.\n\nSolo exercisers often train with a propped-up phone but have no objective feedback about recovery between sets. FitLens addresses that gap by turning the same camera into a privacy-conscious wellness coach: it can wait for cardiovascular recovery before the next set, guide breathing during rest, and keep health records on-device rather than requiring a wearable ecosystem or cloud health account.\n\nThe experience is designed for real home/gym use: explicit consent before camera sensing, front/rear camera switching, live framing hints, personalized Karvonen zones, Android TTS cues, timed holds, local session history, and one-tap deletion of local health records.\n\nFitLens treats the phone camera like an empathetic training partner rather than a dashboard. It combines pulse recovery, breathing cadence, HRV readiness, and facial-expression cues into one live biofeedback loop—so the coach can respond when a user looks tense, is holding their breath, or needs a longer recovery window. The animated recovery-breathing ring and expression-aware coaching prompts make the SmartSpectra signals feel tangible and human.\n\n`YUV_420_888` frames are processed in volatile memory by SmartSpectra on-device and are not written to disk as raw video by FitLens.`requestInsight` while pulse is available, and can request an insight from the mood check-in flow; raw video and facial imagery are not sent for this feature.`enableTelemetry`. FitLens describes it as anonymous stability telemetry without video, vitals, or user/device identifiers and lets users disable it.`fitlens_health_sqlite.db`). Health records remain on-device until the user deletes them or uninstalls the app.", "url": "https://wpnews.pro/news/fitlens-the-ai-powered-fitness-app-usable-without-wearables", "canonical_source": "https://dev.to/tech-vexy/fitlens-the-ai-powered-fitness-app-usable-without-wearables-45ok", "published_at": "2026-11-19 15:38:31+00:00", "updated_at": "2026-11-19 15:43:57.716569+00:00", "lang": "en", "topics": ["ai-products", "computer-vision", "ai-tools", "developer-tools"], "entities": ["Presage", "SmartSpectra SDK", "FitLens", "CameraX", "Firebase", "Android"], "also_reported_by": [], "takeaway": "Running SmartSpectra on a single CameraX pipeline with imageOutputEnabled disabled and submitting ImageProxy frames via useCustomInput lets an Android app derive pulse, HRV and breathing metrics on-device to drive adaptive rest and readiness cues.", "recommendation": {"advice": "Keep camera sensing behind explicit consent and on-device metric computation, and map SDK validation and confidence signals into UI cues before acting on vitals.", "playbook": "agent-architecture", "playbook_url": "https://wpnews.pro/playbooks/agent-architecture"}, "alternates": {"html": "https://wpnews.pro/news/fitlens-the-ai-powered-fitness-app-usable-without-wearables", "markdown": "https://wpnews.pro/news/fitlens-the-ai-powered-fitness-app-usable-without-wearables.md", "text": "https://wpnews.pro/news/fitlens-the-ai-powered-fitness-app-usable-without-wearables.txt", "jsonld": "https://wpnews.pro/news/fitlens-the-ai-powered-fitness-app-usable-without-wearables.jsonld"}}