cd /news/ai-products/how-we-built-an-evidence-backed-dire… · home topics ai-products article
[ARTICLE · art-90026] src=dev.to ↗ pub= topic=ai-products verified=true sentiment=· neutral

How We Built an Evidence-Backed Directory for AI Email Assistants

A developer built AI Email Assistants, a directory of AI email tools generated from detailed research dossiers rather than vendor landing pages. The project uses a data-driven approach with Markdown dossiers as the source of truth, separating research from presentation to ensure accuracy and consistency. The directory includes structured data, screenshots, and independent evidence tracks to help users compare products meaningfully.

read4 min views2 publishedAug 10, 2026

Most software directories have the same failure mode: they look comprehensive, but the entries are thin rewrites of vendor landing pages.

That is especially risky for AI email tools. A product may call itself an “AI email assistant” while doing anything from suggesting a single reply to autonomously triaging a shared support inbox. Pricing changes, provider support differs, and the privacy details matter because the software may read the most sensitive data in a company.

We wanted a better way to compare the category, so we built AI Email Assistants, a focused directory generated from research dossiers rather than a hand-maintained list of cards.

This is the process behind it and what we learned.

Our first temptation was to build a broad AI-assistant directory. That would have given us a much larger pool of products and keywords.

It also would have made the site less useful.

“AI assistant” can describe a coding tool, meeting recorder, research agent, calendar app, or email client. A visitor cannot meaningfully compare those products. Email gave us a constrained problem with real buying questions:

A vertical directory can answer those questions with a consistent data model. A broad directory usually cannot.

We researched dozens of products before deciding what each card should show.

Each product has a Markdown dossier covering the same broad areas:

The dossier is the source of truth. The homepage, filters, profile pages, and structured data are generated from it.

That separation turned out to matter. It lets us improve the interface without rewriting the research, and update a changed price in one place instead of correcting several components.

Vendor documentation is usually the best source for questions such as supported platforms, published prices, and official security claims. It is not independent evidence that the product works well.

We therefore keep two evidence tracks:

When independent evidence is sparse, the profile says so. Silence is better than turning two comments into a market consensus.

This also exposed contradictions that a normal directory card would miss. A concise privacy page may say email content is deleted immediately while a full privacy policy permits retention in some circumstances. A feature page may advertise a capability that the pricing page still labels “coming soon.” A product may support Outlook, but reserve its best inbox-management features for Outlook while offering only drafting in Gmail.

Those qualifiers often matter more than the feature list.

Structured facts make products comparable, but they do not replace judgment.

Two tools can both support Gmail, summarize threads, and draft replies while serving completely different users. One may be a privacy-focused desktop client; the other may be an autonomous support agent billed per resolved conversation.

Each profile therefore includes a free-form review explaining:

The structured fields help visitors filter. The review helps them decide.

Our first implementation mistake was keeping too much of the work behind the scenes. We had detailed dossiers, but the public profiles felt bare.

We changed the profile template to surface the useful parts directly:

We also captured each product's public website at a consistent viewport and converted the screenshots to WebP. Screenshots make a directory much easier to scan, but treating them as data keeps the layout consistent and makes missing assets obvious.

The public site is built with Astro and TypeScript.

A data module parses the reviewed Markdown dossiers into typed product records. Astro then generates:

ItemList

, Article

, and SoftwareApplication

structured data where the facts support it.The filters are client-side view state and can be represented in URL parameters for sharing. We avoid generating indexable pages for every filter combination because those thin permutations would add crawl noise rather than useful search pages.

We also added integrity tests. A qualified product must have a limitation, and the build cannot invent rankings, scores, or aggregate ratings that the research does not support.

The Astro build was straightforward. The hard work was editorial maintenance.

Several products share names with unrelated companies, common words, or old products. Search results and social posts can easily be attributed to the wrong entity. Exact domains, developer names, store identifiers, and official profiles are essential.

Monthly and annual rates differ. AI features may be an add-on. Some vendors bill per seat, mailbox, automated resolution, or generated draft. A “starts at” price without its unit is often misleading.

Established tools may have years of reviews that describe an older version. New products may have excellent documentation and almost no independent feedback. The profile needs to distinguish product maturity from research confidence.

AIEmailAssistants.com is published by Inbox Zero Inc., which also makes Inbox Zero. We disclose that relationship on the site and on the Inbox Zero profile. Ownership does not disappear because a methodology exists, so readers should be able to see the conflict and inspect the evidence themselves.

The directory is live, but it should not be static.

The next useful layers are:

The long-term advantage of a directory is not the number of entries. It is whether every new entry makes the dataset more useful and whether readers can understand why a claim is there.

If you work on an AI email product, or use one we missed, you can suggest a listing or correction. I would also love feedback on the research model: what would you need to see before trusting a software directory with a purchase decision?

── more in #ai-products 4 stories · sorted by recency
── more on @ai email assistants 3 stories trending now
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/how-we-built-an-evid…] indexed:0 read:4min 2026-08-10 ·