{"slug": "are-we-sending-too-much-data-to-llms-agentic-production-support-aps", "title": "Are We Sending Too Much Data to LLMs? Agentic Production Support (APS)", "summary": "A developer working on agentic AI for production support is advocating for treating LLMs as a data egress boundary, proposing a sanitization layer before data reaches RAG or embedding models. The approach emphasizes redacting sensitive information such as hostnames, emails, and authorization tokens, and suggests that if sensitive data is still detected after sanitization, the model should not be called. The developer argues that AI governance should be enforced through technical controls rather than policy documents alone.", "body_md": "While working on Agentic AI for production support, one question came to my mind:\n\nDo we really know what data we are sending to the LLM?\n\nLet's take a simple production incident.\n\nHost: ip-10–0–21–145\n\nMemory: 1024 MB\n\nContact: [user@example.com](mailto:user@example.com)\n\nAuthorization: Bearer abc.def.ghi\n\nERROR: Service failed due to disk space issue\n\nFor RCA, the LLM mainly needs to understand:\n\n**\"Service failed because of a disk space issue.\"**\n\nIt doesn't really need the actual hostname, email, AWS resource details, file paths, capacity values or authorization token.\n\nThis is where I started looking at the LLM as a Data Egress Boundary.\n\nInstead of:\n\n**Production Data → RAG → LLM**\n\nI am looking at:\n\n**Production Data → Clean/Sanitization Layer → RAG → LLM**\n\nBefore anything goes to an LLM or embedding model, sensitive information should be cleaned or redacted.\n\nBut there is another important point.\n\nRAG itself is not the security layer.\n\nWe normally think that our data is safe because we are using RAG. But before storing a document in a vector database, we generate embeddings.\n\nSo the actual flow can be:\n\n**Raw Data → Embedding Model → Vector DB → Retrieval → LLM**\n\nThis means sanitization should happen before embedding as well, not only before the final LLM call. The same principle should apply to retrieval queries and AI observability logs.\n\nFor high-risk information like API keys, passwords, JWTs or bearer tokens, I prefer a simple rule:\n\nIf sensitive data is still detected after sanitization → don't call the model.\n\nIn my view, AI governance should not be only a policy document saying:\n\n**\"Don't send sensitive data to AI.\"\n**\n\nRaw Context → Sanitize → Validate → RAG / LLM\n\nThe objective is not to remove useful context.\n\n**The objective is:\nGive AI enough context to solve the problem, but don't give it information it doesn't need.**\n\n#AgenticAI #AIGovernance #LLM #RAG #GenAI #AIArchitecture #ProductionSupport", "url": "https://wpnews.pro/news/are-we-sending-too-much-data-to-llms-agentic-production-support-aps", "canonical_source": "https://dev.to/dev_hajare_d11ce990734a91/are-we-sending-too-much-data-to-llms-agentic-production-support-aps-b5p", "published_at": "2026-08-21 04:00:42+00:00", "updated_at": "2026-08-21 04:17:58.571720+00:00", "lang": "en", "topics": ["ai-safety", "ai-agents", "large-language-models", "ai-infrastructure"], "entities": [], "alternates": {"html": "https://wpnews.pro/news/are-we-sending-too-much-data-to-llms-agentic-production-support-aps", "markdown": "https://wpnews.pro/news/are-we-sending-too-much-data-to-llms-agentic-production-support-aps.md", "text": "https://wpnews.pro/news/are-we-sending-too-much-data-to-llms-agentic-production-support-aps.txt", "jsonld": "https://wpnews.pro/news/are-we-sending-too-much-data-to-llms-agentic-production-support-aps.jsonld"}}