{"slug": "i-scraped-20000-youtube-comments-the-videos-and-the-comments-were-having-two", "title": "I Scraped 20,000 YouTube Comments. The Videos and the Comments Were Having Two Different Conversations.", "summary": "A developer scraped 22,000 comments from 140 Korean YouTube videos about AI coding tools and found a disconnect between video content and viewer concerns. While videos focus on getting started, comments reveal complaints about cost, trust, and debugging. The developer is now focusing on addressing these post-startup challenges.", "body_md": "I once collected about 22,000 comments from roughly 140 Korean YouTube videos about AI coding tools and classified them. (Quotes below are translated from Korean.)\n\nI wanted to see what people were asking. What came out was something else.\n\nPut the titles and tags of those 140 videos in one pile and they say:\n\nHow to install. How to get started. How to build an app. Which tool is best.\n\nAll of it is \"starting.\" Follow along, a result appears on the screen, the video ends.\n\nThe comments sweeping up the likes were telling a different story.\n\n\"Verifying AI mistakes takes so much time. Checking every answer for nonsense got so tiring I just do the work myself now.\" (👍598)\n\n\"Coding with AI makes me anxious. If one bug ships, I'm the one responsible. Checking and debugging everything one by one ends up being more work.\" (👍265)\n\n\"I pay every month and it lies about work matters like it's nothing.\" (👍72)\n\n\"Tokens burn too fast… added $50 and it was gone in half a day.\" (👍30)\n\nIt compresses into three complaints: **expensive, can't trust it, can't fix it.**\n\nThe videos teach the start. The people are dying right after the start.\n\n\"Asked it for shampoo recommendations and it recommended one that doesn't exist. Slipped it in between real products — with the weight, the benefits, even a price.\" (👍49)\n\nThat comment is the essence of the problem. **When AI is wrong, it doesn't look wrong.** The fake sits among the real ones, wearing plausible numbers.\n\nThis is why \"just write better prompts\" is half an answer. Better prompts lower the odds of being wrong. They don't create **a way to know when it's wrong.** Drop the error rate from 10% to 3% and you still don't know where the 3% is hiding. If that 3% detonates inside payment logic, money leaves the building.\n\nWhile collecting, I noticed the nature of comments changes with channel size.\n\n```\nmulti-million-sub videos   real questions/needs = 12% of comments — the rest is reactions and anxiety\n10k–300k sub channels      real needs = 26% — \"I followed along and got stuck RIGHT HERE\"\n```\n\nIt's the difference between spectators and people actually doing the thing. Comments under the big videos ask \"what happens to us in the AI era.\" Comments under mid-size channels ask \"how do I fix this error.\"\n\n**The real questions were in the mid-size channels.** And collecting reply threads, not just top-level comments, surfaced 470 more needs that the top level never showed.\n\nContent that teaches starting is already everywhere. I decided to work on the stretch right after the start — the can't-trust-it, can't-fix-it stretch.\n\nThe earlier posts in this series are the first result of that decision: [giving my LLM an exam](https://dev.to/ramses203/i-gave-my-llm-an-exam-the-exam-author-lost-5-times-12b0), [planting traps in it](https://dev.to/ramses203/a-good-llm-exam-is-90-traps-4faj), [grading by severity instead of pass/fail](https://dev.to/ramses203/grade-your-llm-passfail-and-you-will-ship-a-disaster-1f19), [why passing still wasn't enough to ship](https://dev.to/ramses203/it-passed-every-test-thats-why-it-cant-ship-yet-3dnm). Every one of them is about turning \"I can't trust it\" into \"I verified it.\"\n\nPeople don't die at the start. They die right after it.\n\nBut almost everyone is selling the start.\n\n*P.S. The classifier that produced the percentages above later sat an exam of its own — the same kind I give my LLMs — and failed three fatal-grade questions. That public correction is its own story, coming later in this series.*\n\n*Next up: how to steal this exam and port it to your own pipeline, step by step.*", "url": "https://wpnews.pro/news/i-scraped-20000-youtube-comments-the-videos-and-the-comments-were-having-two", "canonical_source": "https://dev.to/ramses203/i-scraped-20000-youtube-comments-the-videos-and-the-comments-were-having-two-different-l30", "published_at": "2026-08-25 00:25:03+00:00", "updated_at": "2026-08-25 00:43:11.498368+00:00", "lang": "en", "topics": ["artificial-intelligence", "developer-tools", "ai-tools"], "entities": [], "alternates": {"html": "https://wpnews.pro/news/i-scraped-20000-youtube-comments-the-videos-and-the-comments-were-having-two", "markdown": "https://wpnews.pro/news/i-scraped-20000-youtube-comments-the-videos-and-the-comments-were-having-two.md", "text": "https://wpnews.pro/news/i-scraped-20000-youtube-comments-the-videos-and-the-comments-were-having-two.txt", "jsonld": "https://wpnews.pro/news/i-scraped-20000-youtube-comments-the-videos-and-the-comments-were-having-two.jsonld"}}