{"slug": "signbridge-real-time-open-source-ai-sign-language-translator-for-my-deaf-friend", "title": "SignBridge: Real-Time Open-Source AI Sign Language Translator for My Deaf Friend", "summary": "A developer built SignBridge, an open-source bidirectional real-time sign language interpreter, for a deaf friend who communicates primarily through Vietnamese Sign Language. The system runs MediaPipe hand-landmark tracking in the browser via Next.js, streams landmarks over WebSocket to a Spring Boot modular monolith and a FastAPI ONNX inference service that produces glosses, then uses an LLM to assemble natural Vietnamese sentences after a two-second no-sign pause. It targets near-zero-latency translation of continuous gestures into Vietnamese speech and text.", "body_md": "*This is a submission for the [Hacktoberfest Weekend Challenge: Build for a Friend](https://dev.to/challenges/hacktoberfest-weekend-2026-10-01)*\n\nI built **SignBridge** for my close friend Minh, who was born deaf and communicates primarily through Vietnamese Sign Language (VSL). In university seminars and daily coffee chats, communication was slow because typing takes away personal eye contact.\n\n**SignBridge** is a bidirectional, real-time sign language interpreter. It runs client-side hand-landmark tracking and local neural network inference to translate continuous hand gestures into natural Vietnamese speech and text with near-zero latency.\n\nHệ thống dịch **ngôn ngữ ký hiệu tiếng Việt (VSL) hai chiều, thời gian thực** — đồ án tốt nghiệp 2026.\n\n```\napps/web   — Next.js 16: webcam + MediaPipe (landmark NGAY TRONG browser) → WebSocket\napps/core  — Spring Boot 4.1 MODULAR MONOLITH (Spring Modulith 2.1):\n             identity | dictionary | translation | dataset | analytics\napps/ml    — FastAPI: 1 service mỏng suy luận gloss từ chuỗi landmark (ONNX)\ntraining/  — tiền xử lý + notebook huấn luyện (Colab/Kaggle, log lên W&B)\n```\n\nLuồng phiên dịch đầy đủ:\n\n```\nwebcam → MediaPipe (browser) → WebSocket → cửa sổ trượt 32 frame\n      → ML service (gloss + độ tin cậy) → buffer gloss theo phiên\n      → nghỉ tay 2s (nhãn NO_SIGN) → LLM ghép câu tiếng\n```\n\n…", "url": "https://wpnews.pro/news/signbridge-real-time-open-source-ai-sign-language-translator-for-my-deaf-friend", "canonical_source": "https://dev.to/minkasent/signbridge-real-time-open-source-ai-sign-language-translator-for-my-deaf-friend-4abl", "published_at": "2026-10-02 05:37:03+00:00", "updated_at": "2026-10-02 05:44:26.343434+00:00", "lang": "en", "topics": ["computer-vision", "natural-language-processing", "ai-tools", "developer-tools", "machine-learning"], "entities": ["SignBridge", "MediaPipe", "Next.js", "Spring Boot", "Spring Modulith", "FastAPI", "ONNX", "Weights & Biases"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/signbridge-real-time-open-source-ai-sign-language-translator-for-my-deaf-friend", "markdown": "https://wpnews.pro/news/signbridge-real-time-open-source-ai-sign-language-translator-for-my-deaf-friend.md", "text": "https://wpnews.pro/news/signbridge-real-time-open-source-ai-sign-language-translator-for-my-deaf-friend.txt", "jsonld": "https://wpnews.pro/news/signbridge-real-time-open-source-ai-sign-language-translator-for-my-deaf-friend.jsonld"}}