SignBridge: Real-Time Open-Source AI Sign Language Translator for My Deaf Friend

This is a submission for the Hacktoberfest Weekend Challenge: Build for a Friend

I built SignBridge for my close friend Minh, who was born deaf and communicates primarily through Vietnamese Sign Language (VSL). In university seminars and daily coffee chats, communication was slow because typing takes away personal eye contact.

SignBridge is a bidirectional, real-time sign language interpreter. It runs client-side hand-landmark tracking and local neural network inference to translate continuous hand gestures into natural Vietnamese speech and text with near-zero latency.

Hệ thống dịch ngôn ngữ ký hiệu tiếng Việt (VSL) hai chiều, thời gian thực — đồ án tốt nghiệp 2026.

apps/web   — Next.js 16: webcam + MediaPipe (landmark NGAY TRONG browser) → WebSocket
apps/core  — Spring Boot 4.1 MODULAR MONOLITH (Spring Modulith 2.1):
             identity | dictionary | translation | dataset | analytics
apps/ml    — FastAPI: 1 service mỏng suy luận gloss từ chuỗi landmark (ONNX)
training/  — tiền xử lý + notebook huấn luyện (Colab/Kaggle, log lên W&B)

Luồng phiên dịch đầy đủ:

webcam → MediaPipe (browser) → WebSocket → cửa sổ trượt 32 frame
      → ML service (gloss + độ tin cậy) → buffer gloss theo phiên
      → nghỉ tay 2s (nhãn NO_SIGN) → LLM ghép câu tiếng

…