I re-read the rank badge behind 12 of my listings. All 12 numbers had moved A developer running a 4,323-listing AI tool directory re-checked the source pages behind 12 listings and found every published rank badge was stale, with deltas ranging from +4 to +30 and none moving up. The cause was a crawler that dropped the source's "Latest AI" chronological feed as a category but kept the rank number from the same badge, then re-attached it to an unrelated category name — producing sentences like "ranks #3040 in the Business category" for numbers measured in a feed of thousands of items. The developer also found 37 listings claiming rank #1 across 37 different categories, and a Video Generators page whose 205 claimed ranks fill only 133 positions, a sparse pattern that reveals the numbers were never a ranking of the site's own set. My catalog has 4,323 AI tool listings. On 4,176 of them 96.6% the "About" block ends with a sentence I never wrote: Voicepanel is a paid AI tool in the Business category. It currently ranks 3040 in the Business category. The number is copied by a crawler from the directory I pull records from. It is the only "objective" ranking signal sitting on my pages, and readers see it 4,176 times a day's worth of page loads. Last week I asked a simple question: is that sentence still true today? I re-fetched the 12 source pages behind 12 of my listings and read the badge again. Every one. Not one matched what I publish. | listing | number I publish | number at the source now | badge's own list, then vs now | |---|---|---|---| | QuickMagic | 1031 | 1039 | Video Generators → Latest AI | | UltraPixel AI | 1321 | 1331 | Github Projects → Latest AI | | PostWizard AI | 1786 | 1806 | Marketing → Latest AI | | Chatter by Hume AI | 1882 | 1906 | Text To Speech → Latest AI | | Cuebric | 2226 | 2246 | Image Generators → Latest AI | | Code Llama | 2368 | 2392 | Assistant Code → Latest AI | | GaussianObject | 2561 | 2590 | 3D model → Latest AI | | Voicepanel | 3040 | 3070 | Business → Latest AI | | Illustroke AI | 294 | 298 | Image Generators → Image Generators | | Maze AI | 295 | 299 | Image Generators → Image Generators | | Iconik AI | 301 | 305 | Image Generators → Image Generators | | PatternAI | 302 | 306 | Image Generators → Image Generators | The deltas are all positive: +4, +4, +4, +4, +8, +10, +20, +20, +24, +24, +29, +30. Nothing moved up the list. That is what an append-only ranking does to everyone below the new entries. A stored rank is not a position, it is a timestamp — and I record no timestamp next to it. That is the part that surprised me. On 8 of the 12 source pages, the badge is no longer attached to a category at all; it reads " 3070 in Latest AI ". "Latest AI" is a chronological feed of every entry the source has ever listed — a list of three thousand-odd items, not a subject. My crawler already knows that feed is not a category. It has an explicit exclusion list: js const CURATION CATEGORIES = new Set "featured-en", "last-ai-en" ; const primaryIsCuration = primarySlug && CURATION CATEGORIES.has primarySlug ; const categories = ; if primarySlug && primaryIsCuration { categories.push { name: primaryName || primarySlug, slug: primarySlug } ; } So the category is dropped — but the rank is read from a different selector on the same badge span rank: text ".aix rank-num" and is kept. The template then marries it to whatever survived as categories 0 : js const rankNote = record.rank ? It currently ranks ${record.rank} in the ${category} category. : ""; The result is a sentence that asserts a position in "the Business category" for a number that was measured in somebody's "just added this week" river. The two halves came off the same DOM element and my code separated them, then re-joined them as if they still belonged together. If the sentence were a rank inside my own category page, it could never exceed the number of tools on that page. It does, 476 times. And the reverse check is just as bad. My Video Generators listing holds 205 tools that name that category in their sentence; their claimed ranks fill only 133 of the 205 positions. Seventy-two slots are simply missing — because the ranks were sampled out of a much longer foreign list and I only ever scraped part of it. A real in-category ranking is dense: 1, 2, 3, no holes. Mine is sparse, which is the tell that it was never a ranking of my set. So the " 1" claims are also not what they look like. 37 listings claim rank 1, in 37 different named categories. Each one is plausible as "first in some list at the source, on the day I scraped it"; none of them is first in my category, and my category pages don't even order by that field — they order by a mirrored read counter I also did not measure. I checked the pricing badge while I was there, since it is the other column readers filter on. Eleven of twelve matched. The twelfth: Cuebric's source badge says Free-Trial , and my row says free . The reason is a precedence chain, not a data problem: if pricingText.includes "freemium" pricingType = "freemium"; else if pricingText.includes "free" pricingType = "free"; else if /paid|payant|premium|subscription/.test pricingText pricingType = "paid"; "free-trial" contains "free". A trial is a paid product with a demo, and it lands in the bucket a reader uses to avoid paying. That bucket is my biggest one 2,198 of 4,323 listings , so a substring rule with the wrong order is a trust event waiting to happen. One mismatch in twelve is a 8% sample rate, not a measurement of the whole library — the honest statement is "the classifier has a known hole and I have not sized it". Not "crawl more often". Recrawling just gives me fresher stale numbers. The sentence needs the triple it was cut from: rank: {value, listSlug, listSize, capturedAt} . If listSlug is a feed I don't publish, don't emit the sentence — that alone would remove the eight of twelve cases above. Until one of those lands, the cheapest honest version of the page is: the number goes away, and the read counter stays, clearly labelled as mirrored from the source. If you want to see what my "best" ordering actually is when nothing is pretending to be a rank, it is here: AIVerse — most-read AI tools https://aiverse.mindutil.com/best?utm source=devto&utm medium=social&utm campaign=topic . It ranks by a copy of somebody else's view count, which is a weaker claim than " 3040 in Business" and therefore a safer one to print. The numbers in this post come from a read-only pass over my local SQLite database 4,323 rows and twelve source pages fetched today. Nothing here is fixed yet; this is the measurement, not the patch.