{"slug": "scaling-ai-from-scripts-to-production-my-journey-in-gen-ai-academy-cohort-3", "title": "Scaling AI from Scripts to Production: My Journey in Gen AI Academy Cohort 3", "summary": "A computer science student at Vardhaman College of Engineering completed the Google Cloud Gen AI Academy APAC Edition Cohort 3, building a system of AI agents for a coffee shop business deployed on Cloud Run. The project included a customer-facing AI assistant using the Google Agent Development Kit and RAG, a strategic analysis agent using Gemini and BigQuery, and an internal productivity agent with human-in-the-loop governance. The student highlighted principles such as least privilege, secure sandboxes, and automated containerization with Cloud Buildpacks.", "body_md": "Introduction\n\nAs a Computer Science student at Vardhaman College of Engineering, I spend a lot of time working on backend systems. Having previously built a Retrieval-Augmented Generation (RAG) pipeline from scratch using Docker, Kubernetes, Jenkins, and Kafka during my software engineering internship at DevAI, I know how complex orchestrating AI can be.\n\nThat’s exactly why I joined the Google Cloud Gen AI Academy APAC Edition (Cohort 3). I wanted to see how enterprise-grade tools streamline the leap from local AI scripts to production-ready deployments. Over the past few weeks, I built a connected system of AI agents for a growing coffee shop business, deploying everything on Cloud Run. Here is a breakdown of what I built and the core architectural principles I learned along the way.\n\nTrack 1: Building a Customer-Facing AI Agent\n\nThe first challenge was building a personalized AI assistant for a coffee shop app that recommends orders to customers using the Google Agent Development Kit (ADK) and RAG.\n\nThe Build: Instead of manually writing and maintaining Dockerfiles like I have in the past, I learned how to use Google Cloud Buildpacks. Buildpacks automatically convert application source code into production-ready containers, drastically reducing manual maintenance.\n\nThe Concept: To make the chat experience truly interactive and handle continuous message exchanges, the application exposed a WebSocket endpoint rather than relying solely on standard HTTP requests.\n\nTrack 2: Turning Business Data into Strategic Decisions\n\nAs the coffee shop expanded nationally, we needed an agent to determine optimal new store locations—specifically ones friendly to cyclists.\n\nThe Build: I utilized Gemini alongside a BigQuery MCP Server to analyze public datasets for bike routes. We combined historical operational data retrieved via a tool with new user inputs to perform strategic analysis.\n\nThe Concept: A major takeaway here was the importance of the Principle of Least Privilege. We authenticated the application using a dedicated service account granted only the specific permissions needed to invoke the Gemini API and access the data, keeping the system highly secure.\n\nTrack 3: Automating Daily Operations\n\nThe final lab focused on the internal side of the business: deploying a personal productivity agent to help the shop owner check sales, inventory, and daily tasks by interacting with Google Sheets.\n\nThe Build: The architecture clearly separated the LLM's reasoning capabilities from its controlled interactions with external systems.\n\nThe Concept: Because this application executed commands and updated business records, security and governance were critical. I learned about running generated shell commands inside an isolated Cloud Run sandbox environment to minimize security risks. Furthermore, to implement \"Human-in-the-loop\" governance, the system required explicit user approval before the agent could apply modifications to shared operational records.\n\nFinal Thoughts\n\nCompleting these three tracks completely shifted my perspective on AI architecture. It is no longer just about prompt engineering; it is about secure sandboxes, isolated environments, service accounts, and seamless Cloud Run deployments.\n\nNow that I've graduated with my Gen AI Master Certificate, I'm gearing up for the Cohort 3 Ideathon, where I'll be building a secure, authenticated Personal Gemini Journal.", "url": "https://wpnews.pro/news/scaling-ai-from-scripts-to-production-my-journey-in-gen-ai-academy-cohort-3", "canonical_source": "https://dev.to/sai_swaranmaram_015a991d/scaling-ai-from-scripts-to-production-my-journey-in-gen-ai-academy-cohort-3-27mh", "published_at": "2026-08-29 03:27:46+00:00", "updated_at": "2026-08-29 04:18:25.287357+00:00", "lang": "en", "topics": ["artificial-intelligence", "ai-agents", "ai-infrastructure", "developer-tools", "generative-ai"], "entities": ["Google Cloud", "Gemini", "BigQuery", "Cloud Run", "Google Agent Development Kit", "Vardhaman College of Engineering", "DevAI"], "alternates": {"html": "https://wpnews.pro/news/scaling-ai-from-scripts-to-production-my-journey-in-gen-ai-academy-cohort-3", "markdown": "https://wpnews.pro/news/scaling-ai-from-scripts-to-production-my-journey-in-gen-ai-academy-cohort-3.md", "text": "https://wpnews.pro/news/scaling-ai-from-scripts-to-production-my-journey-in-gen-ai-academy-cohort-3.txt", "jsonld": "https://wpnews.pro/news/scaling-ai-from-scripts-to-production-my-journey-in-gen-ai-academy-cohort-3.jsonld"}}