{"slug": "show-hn-niceshot-ai-the-analytics-layer-competitive-games-forgot-to-add", "title": "Show HN: NiceShot AI – The analytics layer competitive games forgot to add", "summary": "NiceShot AI, a computer vision project developed over 26 months, automatically converts long gameplay recordings into structured event data, highlight clips, and session statistics using a pipeline of YOLO detection, OCR filtering, and optional Video LLM analysis. The system runs locally on NVIDIA GPUs, including older models like a GTX1650 4GB VRAM laptop, and aims to be game-agnostic by requiring only new detectors and configurations for different games. The developer chose offline processing to avoid impacting player performance and is seeking feedback on making detection real-time.", "body_md": "I've been working on NiceShot AI for the last 26 months as a way to experiment with computer vision for gameplay analysis.\n\nThe basic idea is to take a recorded long gameplay session and automatically turn it into structured gameplay information and highlights. Bridging the performance analysis gap between match stats (too short) & lifetime stats (too long).\n\nThe current pipeline is:\n\nGameplay video → YOLO detection → event tracking → OCR/context filtering → event timestamps → clips → highlight compilation → session statistics\n\nFor example, I can fine-tune a YOLO model to recognize game-specific HUD elements and then configure the pipeline to interpret those detections as events such as kills, deaths, or medals.\n\nOne thing I wanted to avoid was making the entire system game-specific. Supporting another game should mostly require a new detector/model and configuration rather than rewriting the whole pipeline. And currently, I am working on that.\n\nI also use OCR for states that shouldn't be counted as gameplay events. For example, in Call of Duty games a kill indicator can appear during a \"KillCam\" or \"Spectating\" state, so the OCR layer can be used to filter those cases.\n\nThe system can then produce clips around detected events and compile them into highlight reels, including vertical versions for Shorts/TikTok-style content.\n\nRecently, I have also been experimenting with using a lightweight Video LLM after event detection. Instead of sending the entire multi-hour gameplay session to the Video LLM model, I take the extracted short clips around an interesting event and ask the model to explain what happened. The goal is to eventually turn this into a lightweight conversational gameplay coach.\n\nThe project currently runs locally on NVIDIA GPUs. Have experimented with an old GTX1650 4GB VRAM laptop and it works fine but slow ofcourse.\n\nFinally, I know that real-time event detection should be the way to go and this was my original goal, but I chose offline processing because I didn't want computer vision inference to interfere with the player's actual game performance.\n\nI'd also be interested in hearing how others would approach making the detector/inference layer fast enough for real-time gameplay without causing noticeable GPU/CPU overhead. Keeping in mind, I input 1080p frames into the model.\n\nThe project is still evolving, so technical criticism and suggestions are very welcome.\n\nThanks.\n\nComments URL: [https://news.ycombinator.com/item?id=49253675](https://news.ycombinator.com/item?id=49253675)\n\nPoints: 1\n\n# Comments: 0", "url": "https://wpnews.pro/news/show-hn-niceshot-ai-the-analytics-layer-competitive-games-forgot-to-add", "canonical_source": "https://github.com/karimm-ai/NiceShot_AI", "published_at": "2026-08-11 05:18:28+00:00", "updated_at": "2026-08-11 05:41:12.456899+00:00", "lang": "en", "topics": ["computer-vision", "artificial-intelligence", "generative-ai"], "entities": ["NiceShot AI", "YOLO", "Call of Duty", "NVIDIA", "GTX1650"], "alternates": {"html": "https://wpnews.pro/news/show-hn-niceshot-ai-the-analytics-layer-competitive-games-forgot-to-add", "markdown": "https://wpnews.pro/news/show-hn-niceshot-ai-the-analytics-layer-competitive-games-forgot-to-add.md", "text": "https://wpnews.pro/news/show-hn-niceshot-ai-the-analytics-layer-competitive-games-forgot-to-add.txt", "jsonld": "https://wpnews.pro/news/show-hn-niceshot-ai-the-analytics-layer-competitive-games-forgot-to-add.jsonld"}}