🐧 OpsBuddy: A Privacy-First Local AI SysAdmin Mentor (Built with Gemma, Ollama & Sentry)

A developer built OpsBuddy, a privacy-first local AI sysadmin mentor that runs entirely on the user's machine using Gemma 2B via Ollama, so trainees can analyze sensitive SSH, database, and application logs without sending data to third-party cloud APIs. The CLI tool, created for a friend learning server administration, uses the rich library for its interface and Sentry transaction and child spans to trace the latency of local inference streaming.

This is a submission for the Hacktoberfest Weekend Challenge: Build for a Friend https://dev.to/challenges/hacktoberfest-weekend-2026-10-03 I built OpsBuddy , a local, privacy-first AI mentor designed specifically for SysAdmin and Linux training in a CLI environment. I built this for my friend and trainee, Andre , who is currently learning the ropes of server administration. The biggest hurdle for beginners like him is understanding complex error logs without accidentally leaking sensitive server information like IPs, usernames, or paths to public cloud AI tools. OpsBuddy solves this by running entirely locally on his machine. It acts as a safe, intelligent sandbox where he can ask technical questions and securely analyze local .log files. Here is OpsBuddy in action safely analyzing a local log file, along with the deep-dive performance tracing data captured by Sentry OpsBuddy is built around a fully open-source and local stack: rich library for a beautiful, colorful CLI experience. start transaction and start child spans to track the exact latency of the local inference streaming process whenever Andre interacts with the agent, ensuring the application remains responsive. Open innovation is the absolute backbone of this project. By utilizing open-weight models like Gemma 2B and open local harnesses like Ollama, OpsBuddy guarantees absolute data privacy. Andre can command the AI to analyze sensitive SSH, database, or application logs without the fear of that data being sent to a closed, third-party API. Open innovation made it possible to build a capable, free-to-use mentor that respects user data sovereignty.