Building an edge-first, fail-closed voice & vision pipeline with ~8-40 MB RAM footprints and sub-millisecond local triggers.
When building financial software, "make it fast" isn't a strategy—and letting unvalidated AI models hold execution authority is a disaster waiting to happen.
Over the past few weeks, we overhauled the core engine of FinTally. We moved away from web-heavy runtimes (React JS) and expensive continuous model inference, pivoting to a bare-metal, native-first architecture.
Running deep learning speech models like Whisper 24/7 just to listen for voice triggers burns continuous CPU cycles, requires 500MB–2GB+ of VRAM, and adds 200ms+ of latency per audio chunk.
Instead, we built fintally_voice: a bounded-memory C23 + Rust subsystem that acts as a microsecond gatekeeper.
- Deterministic Native Kernels (C23 & C++17)
- C23 Core (~8-40 MB working set): Handles MFCC extraction, Zero-Crossing Rate (ZCR), energy levels, and F0 pitch tracking.
- C++17 Vision Engine: Binarizes invoices and extracts spatial layout deterministically before any text hits an LLM.
- Safe Rust Runtime & Zero-Copy FFI
- Lock-free Single-Producer Single-Consumer (SPSC) ring buffers handle frame passing with only 10–40 µs FFI overhead.
- Strict financial safety rule: LLMs only draft review prompts. Money-moving actions require explicit human approval and fail-closed validation.
- Slint UI: Cross-Platform Without JS Taxes We purged the React frontend. Using Slint UI, a single codebase now cross-compiles natively to Desktop, Mobile, and WebAssembly (WASM) with sub-second boot times and near-zero memory footprint.
🔗 **Cross-Platform Links:**
- Follow the discussion thread on X: [https://x.com/AnshuGondi/status/2113835272186347712](https://x.com/AnshuGondi/status/2113835272186347712)
- Check out the full dev branch on GitHub: [https://github.com/Anshu-Gondi/FINTALLY-Finance-Monitoring-app/tree/dev](https://github.com/Anshu-Gondi/FINTALLY-Finance-Monitoring-app/tree/dev)
About the author #
- Systems Engineer focused on low-latency architectures, bare-metal C/C++ FFI, and production Rust backends. I specialize in eliminating runtime bottlenecks at the C-ABI boundary—building high-throughput polyglot extensions (PyO3, FFI) and zero-copy memory pipelines for AI/ML inference and SaaS infrastructure. Core Stack: Rust (Axum, Candle, SQLx), C++17/23, C23, PyO3, PostgreSQL, MinIO. Proof of Work: Creator of FinTally—a pure Rust finance platform evolved from legacy Node.js/Django to FastAPI + PyO3, and ultimately rewritten into a full-stack Rust architecture powered by bare-metal C/C++ native engines via extern "C" FFI.
Comments #
[Join the discussion](https://hashnode.com/posts/why-we-are-replacing-react-and-model-proxies-with-bare-metal-c23-rust-and-slint-ui-in-fintally/6adc216b2811ca40f2ba8e27)
No comments yet. [Be the first to comment.](https://hashnode.com/posts/why-we-are-replacing-react-and-model-proxies-with-bare-metal-c23-rust-and-slint-ui-in-fintally/6adc216b2811ca40f2ba8e27)