cd /news/ai-tools/i-re-read-the-rank-badge-behind-12-o… · home › topics › ai-tools › article
[ARTICLE · art-173558] src=dev.to ↗ pub= topic=ai-tools verified=true sentiment=↓ negative

I re-read the rank badge behind 12 of my listings. All 12 numbers had moved

A developer running a 4,323-listing AI tool directory re-checked the source pages behind 12 listings and found every published rank badge was stale, with deltas ranging from +4 to +30 and none moving up. The cause was a crawler that dropped the source's "Latest AI" chronological feed as a category but kept the rank number from the same badge, then re-attached it to an unrelated category name — producing sentences like "ranks #3040 in the Business category" for numbers measured in a feed of thousands of items. The developer also found 37 listings claiming rank #1 across 37 different categories, and a Video Generators page whose 205 claimed ranks fill only 133 positions, a sparse pattern that reveals the numbers were never a ranking of the site's own set.

recommendation

Store a fetch timestamp and source list alongside every scraped rank, and validate that claimed ranks densely fill your own category before publishing them as positions.

more in playbook: Retrieval and RAG
by read5 min views6 publishedNov 21, 2026

My catalog has 4,323 AI tool listings. On 4,176 of them (96.6%) the "About" block ends with a sentence I never wrote:

Voicepanel is a paid AI tool in the Business category. It currently ranks #3040 in the Business category.

The number is copied by a crawler from the directory I pull records from. It is the only "objective" ranking signal sitting on my pages, and readers see it 4,176 times a day's worth of page loads. Last week I asked a simple question: is that sentence still true today? I re-fetched the 12 source pages behind 12 of my listings and read the badge again.

Every one. Not one matched what I publish.

listing number I publish number at the source now badge's own list, then vs now
QuickMagic #1031 #1039 Video Generators → Latest AI
UltraPixel AI #1321 #1331 Github Projects → Latest AI
PostWizard AI #1786 #1806 Marketing → Latest AI
Chatter by Hume AI #1882 #1906 Text To Speech → Latest AI
Cuebric #2226 #2246 Image Generators → Latest AI
Code Llama #2368 #2392 Assistant Code → Latest AI
GaussianObject #2561 #2590 3D model → Latest AI
Voicepanel #3040 #3070 Business → Latest AI
Illustroke AI #294 #298 Image Generators → Image Generators
Maze AI #295 #299 Image Generators → Image Generators
Iconik AI #301 #305 Image Generators → Image Generators
PatternAI #302 #306 Image Generators → Image Generators

The deltas are all positive: +4, +4, +4, +4, +8, +10, +20, +20, +24, +24, +29, +30. Nothing moved up the list. That is what an append-only ranking does to everyone below the new entries. A stored rank is not a position, it is a timestamp — and I record no timestamp next to it.

That is the part that surprised me. On 8 of the 12 source pages, the badge is no longer attached to a category at all; it reads "#3070 in Latest AI". "Latest AI" is a chronological feed of every entry the source has ever listed — a list of three thousand-odd items, not a subject.

My crawler already knows that feed is not a category. It has an explicit exclusion list:

const CURATION_CATEGORIES = new Set(["featured-en", "last-ai-en"]);
const primaryIsCuration = primarySlug && CURATION_CATEGORIES.has(primarySlug);
const categories = [];
if (primarySlug && !primaryIsCuration) {
  categories.push({ name: primaryName || primarySlug, slug: primarySlug });
}

So the category is dropped — but the rank is read from a different selector on the same badge span (rank: text(".aix_rank-num")) and is kept. The template then marries it to whatever survived as categories[0]:

const rankNote = record.rank ? ` It currently ranks #${record.rank} in the ${category} category.` : "";

The result is a sentence that asserts a position in "the Business category" for a number that was measured in somebody's "just added this week" river. The two halves came off the same DOM element and my code separated them, then re-joined them as if they still belonged together.

If the sentence were a rank inside my own category page, it could never exceed the number of tools on that page. It does, 476 times.

And the reverse check is just as bad. My Video Generators listing holds 205 tools that name that category in their sentence; their claimed ranks fill only 133 of the 205 positions. Seventy-two slots are simply missing — because the ranks were sampled out of a much longer foreign list and I only ever scraped part of it. A real in-category ranking is dense: 1, 2, 3, no holes. Mine is sparse, which is the tell that it was never a ranking of my set.

So the "#1" claims are also not what they look like. 37 listings claim rank #1, in 37 different named categories. Each one is plausible as "first in some list at the source, on the day I scraped it"; none of them is first in my category, and my category pages don't even order by that field — they order by a mirrored read counter I also did not measure.

I checked the pricing badge while I was there, since it is the other column readers filter on. Eleven of twelve matched. The twelfth: Cuebric's source badge says Free-Trial, and my row says free. The reason is a precedence chain, not a data problem:

if (pricingText.includes("freemium")) pricingType = "freemium";
else if (pricingText.includes("free")) pricingType = "free";
else if (/paid|payant|premium|subscription/.test(pricingText)) pricingType = "paid";

"free-trial" contains "free". A trial is a paid product with a demo, and it lands in the bucket a reader uses to avoid paying. That bucket is my biggest one (2,198 of 4,323 listings), so a substring rule with the wrong order is a trust event waiting to happen. One mismatch in twelve is a 8% sample rate, not a measurement of the whole library — the honest statement is "the classifier has a known hole and I have not sized it".

Not "crawl more often". Recrawling just gives me fresher stale numbers. The sentence needs the triple it was cut from:

rank: {value, listSlug, listSize, capturedAt}. If listSlug is a feed I don't publish, don't emit the sentence — that alone would remove the eight of twelve cases above. Until one of those lands, the cheapest honest version of the page is: the number goes away, and the read counter stays, clearly labelled as mirrored from the source. If you want to see what my "best" ordering actually is when nothing is pretending to be a rank, it is here: AIVerse — most-read AI tools. It ranks by a copy of somebody else's view count, which is a weaker claim than "#3040 in Business" and therefore a safer one to print.

The numbers in this post come from a read-only pass over my local SQLite database (4,323 rows) and twelve source pages fetched today. Nothing here is fixed yet; this is the measurement, not the patch.

── more in #ai-tools 4 stories · sorted by recency
── more on @quickmagic 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
→ Live at https://your-agent.zahid.host ✓
Get free account → Pricing
from €0/mo · no card required
LIVE [news/i-re-read-the-rank-b…] indexed:0 read:5min 2026-11-21 · —