{"slug": "i-built-tickettriage-ai-an-nlp-based-support-ticket-classification-system", "title": "I Built TicketTriage AI: An NLP-Based Support Ticket Classification System", "summary": "A developer built TicketTriage AI, an open-source NLP system that classifies and routes customer support tickets, with the repository documenting synthetic-data generation, model training, macro-F1 evaluation, automated testing, Docker configuration, and GitHub Actions CI. The developer notes the training data is synthetic and that the tool is meant to assist support agents rather than replace human decisions, and points to model confidence and human-in-the-loop workflows as areas for improvement.", "body_md": "Customer support teams spend significant time reading and routing incoming requests.\n\nI developed **TicketTriage AI** to explore how natural language processing can assist this workflow.\n\nThe repository documents synthetic-data generation, model training, evaluation, automated testing, Docker configuration, and GitHub Actions.\n\nMacro F1 is used as a primary evaluation metric because performance across different ticket categories matters.\n\nThe training dataset is synthetic. Real support conversations contain more variation, ambiguity, and changing language patterns.\n\nThe system is intended to assist support agents, not replace human decisions.\n\n**GitHub repository:** [https://github.com/tasnem-tech/ticket-triage-ai](https://github.com/tasnem-tech/ticket-triage-ai)\n\nI'm particularly interested in improving model confidence and practical human-in-the-loop workflows.", "url": "https://wpnews.pro/news/i-built-tickettriage-ai-an-nlp-based-support-ticket-classification-system", "canonical_source": "https://dev.to/tasnem-tech/i-built-tickettriage-ai-an-nlp-based-support-ticket-classification-system-40ma", "published_at": "2026-11-09 12:39:06+00:00", "updated_at": "2026-11-09 12:55:20.015936+00:00", "lang": "en", "topics": ["natural-language-processing", "machine-learning", "ai-tools", "developer-tools"], "entities": ["TicketTriage AI", "GitHub", "Docker", "GitHub Actions"], "also_reported_by": [], "alternates": {"html": "https://wpnews.pro/news/i-built-tickettriage-ai-an-nlp-based-support-ticket-classification-system", "markdown": "https://wpnews.pro/news/i-built-tickettriage-ai-an-nlp-based-support-ticket-classification-system.md", "text": "https://wpnews.pro/news/i-built-tickettriage-ai-an-nlp-based-support-ticket-classification-system.txt", "jsonld": "https://wpnews.pro/news/i-built-tickettriage-ai-an-nlp-based-support-ticket-classification-system.jsonld"}}