{"slug": "my-ai-agent-rejected-90-of-its-own-ideas-and-that-s-why-it-won", "title": "My AI Agent Rejected 90% of Its Own Ideas, and That's Why It Won 🏆", "summary": "A developer at TAMU Datathon 2026 built a self-improving agent that learns plain-English if-then rules from examples and only keeps a change after it proves itself on unseen data, finishing 3rd at the event. The agent runs validation in rounds, freezes itself when a round stops paying off, and routes its own uncertain failures to a teacher model that writes reusable \"skills\" — more than half of which made results worse and were automatically discarded. No model weights were modified; the agent's knowledge stays as readable text and settings, with teammates Nidhi, Mihir and Ravi credited.", "body_md": "*This is a submission for the [MLH x DEV Writing Challenge](https://dev.to/mlh-hackathon)*\n\nEveryone wants AI that improves itself. Almost nobody talks about the scary part: an agent that changes itself can just as easily make itself worse, and confidently tell you it got better.\n\nAt TAMU Datathon 2026, I built an agent around one rule:\n\nNo change is kept until it proves itself on data it has never seen.\n\nIt finished on the podium, taking 3rd place. Here's how it works.\n\nInstead of hiding everything inside a black box, the agent learns plain-English if-then rules from examples. Then it puts every rule on trial:\n\nIt runs this in rounds, and here's my favorite part: it decides when to stop. Once a round no longer earns its keep, the agent freezes itself. No babysitting.\n\nThe result is a rulebook a human can actually open, read and argue with.\n\nSome decisions need real reading comprehension, not pattern-matching. So the agent looks at where its own rules are unsure and keep failing, and hands those mistakes to a teacher model. The teacher writes a short, reusable \"skill,\" and the base model uses that skill to double-check only the shaky answers.\n\nThen the same trial happens again: a skill survives only where it measurably helps. In more than half of the places I tried, the AI made things worse, so the agent threw those skills away automatically.\n\nNo model weights were touched. Everything the agent \"knows\" is readable text and settings it learned and tested itself.\n\nTAMU Datathon 2026 was pure energy from the opening minute: whiteboards filling up with half-baked ideas, people huddled over laptops sketching architectures, and that moment of \"wait… what if the agent checks its own work?\" that turned into this whole project. The brainstorming was easily the best part: chasing an idea, watching it fail, and coming back with a better one a few hours later.\n\nThen came the late-night chaos:\n\nHearing \"3rd place\" at the end made every one of those 3am bugs worth it. 🏆\n\nKudos to my teammates Nidhi, Mihir and Ravi, and huge thanks to the TAMU Datathon organizers for an amazing event!", "url": "https://wpnews.pro/news/my-ai-agent-rejected-90-of-its-own-ideas-and-that-s-why-it-won", "canonical_source": "https://dev.to/sanika/my-ai-agent-rejected-90-of-its-own-ideas-and-thats-why-it-won-3i38", "published_at": "2026-11-20 21:41:05+00:00", "updated_at": "2026-11-20 21:44:55.629238+00:00", "lang": "en", "topics": ["ai-agents", "artificial-intelligence", "machine-learning", "ai-tools"], "entities": ["TAMU Datathon", "MLH", "DEV", "Nidhi", "Mihir", "Ravi"], "also_reported_by": [], "takeaway": "Gate every self-generated rule or skill behind validation on held-out data and discard it automatically where it doesn't measurably help — over half the teacher-model skills in this build made results worse.", "recommendation": {"advice": "Validate each self-generated rule or skill on unseen data before keeping it, and auto-discard any that don't measurably improve results.", "playbook": "evals-testing", "playbook_url": "https://wpnews.pro/playbooks/evals-testing"}, "alternates": {"html": "https://wpnews.pro/news/my-ai-agent-rejected-90-of-its-own-ideas-and-that-s-why-it-won", "markdown": "https://wpnews.pro/news/my-ai-agent-rejected-90-of-its-own-ideas-and-that-s-why-it-won.md", "text": "https://wpnews.pro/news/my-ai-agent-rejected-90-of-its-own-ideas-and-that-s-why-it-won.txt", "jsonld": "https://wpnews.pro/news/my-ai-agent-rejected-90-of-its-own-ideas-and-that-s-why-it-won.jsonld"}}