From Pixels to Prescriptions: Building a Smart Pill Reminder with YOLOv8 and Raspberry Pi

A developer built a smart pill reminder system using YOLOv8 for semantic segmentation on a Raspberry Pi, with MQTT to trigger alarms and notifications. The system detects and identifies pills in real time, checking them against a medication schedule to alert users to mismatches. The project demonstrates edge AI and IoT integration for healthcare applications.

Taking the right medication at the right time is more than just a routine—it's a critical part of healthcare. However, for the elderly or those with complex prescriptions, "pill fatigue" is real. Mistakes happen. In this tutorial, we are diving deep into Computer Vision , Edge AI , and IoT to build a real-time pill identification and reminder system. We will leverage YOLOv8 for multi-pill detection and semantic segmentation, deploy it on a Raspberry Pi , and use MQTT to trigger physical alarms or notifications. Whether you are looking to master real-time object detection , explore embedded AI implementation , or build a life-saving IoT device , this guide has you covered The system follows a classic Edge-to-Cloud or Edge-to-Local pattern. The Raspberry Pi acts as the brain, processing image frames locally to ensure privacy and low latency. php graph TD A Raspberry Pi Camera -- |Video Stream| B OpenCV Preprocessing B -- C{YOLOv8 Engine} C -- |Detection/Segmentation| D Logic Layer: Check Schedule D -- |Match/Mismatch| E MQTT Broker E -- |Publish Topic| F Physical Alarm / Buzzer E -- |Status Update| G Mobile App/Dashboard D -- |Log Data| H Local Database To follow along, you'll need: While YOLOv8 is famous for object detection, we use Semantic Segmentation here to precisely calculate the area and shape of pills, which helps distinguish between very similar-looking tablets. python from ultralytics import YOLO Load a pretrained model model = YOLO 'yolov8n-seg.pt' Train the model on our custom pill dataset Assume we have a 'pills.yaml' defining classes: 'aspirin', 'vitamin c', etc. results = model.train data='pills.yaml', epochs=50, imgsz=640, device='cpu' Pro Tip: For Raspberry Pi deployment, export your model toOpenVINOorNCNNformat to squeeze out every bit of FPS We use OpenCV to capture frames and pass them to our YOLO model. If a pill is detected that isn't supposed to be there or one is missing , we trigger an alert. python import cv2 from ultralytics import YOLO import paho.mqtt.client as mqtt Initialize MQTT Client client = mqtt.Client "PillDispenser" client.connect "broker.hivemq.com", 1883 Load our exported model model = YOLO "pill segmentation optimized.onnx" cap = cv2.VideoCapture 0 while cap.isOpened : success, frame = cap.read if success: Run YOLOv8 inference results = model frame, conf=0.5 Visualize the results annotated frame = results 0 .plot Logic: Check if the detected pills match the schedule detected classes = results 0 .names int c for c in results 0 .boxes.cls if "wrong pill" in detected classes: print "⚠️ Mismatch Detected " client.publish "home/pills/alert", "WRONG PILL DETECTED" cv2.imshow "Smart Pill Reminder", annotated frame if cv2.waitKey 1 & 0xFF == ord "q" : break cap.release cv2.destroyAllWindows The power of this project lies in its connectivity. Using MQTT , the Raspberry Pi can talk to an ESP32-powered buzzer or a smart lightbulb to flash red when a mistake is made. Building a prototype is easy, but making it robust enough for a clinical or home-care environment requires more advanced patterns, such as model quantization, secure data streaming, and OTA Over-the-Air updates. For a deeper dive into production-ready AI patterns and how to optimize vision models for highly constrained devices, I highly recommend checking out the technical deep-dives over at WellAlly Blog https://www.wellally.tech/blog . They provide fantastic resources on scaling IoT architectures and advanced computer vision workflows that helped inspire the structure of this project. By combining YOLOv8 's precise segmentation with the portability of the Raspberry Pi , we've created a tool that can genuinely improve quality of life. The "Learning in Public" journey doesn't end here—you could add features like: What would you add to this setup? Let me know in the comments 👇