cd /news/machine-learning/add-convence-parseembed-as-an-offici… · home topics machine-learning article
[ARTICLE · art-28186] src=discuss.huggingface.co ↗ pub= topic=machine-learning verified=true sentiment=· neutral

Add Convence/ParseEmbed as an official benchmark on the Hub (If possible)

A user requests Hugging Face to add Convence/ParseEmbed as an official benchmark on the Hub. ParseEmbed is a retrieval benchmark for embedding models that tests parse-sensitive meaning under hard negatives. The dataset includes an eval.yaml configuration and is designed to evaluate semantic scope, formatting-sensitive text, and table grounding.

read1 min publishedJun 15, 2026

Hi Hugging Face team,

I’d like to register Convence/ParseEmbed

as an official benchmark on the Hub.

Dataset: Convence/ParseEmbed · Datasets at Hugging Face It includes a root eval.yaml

with:

- name: ParseEmbed
- evaluation_framework: mteb
- tasks: mean, text_formatting, table
- config: parse-embed

ParseEmbed is a retrieval benchmark for embedding models. It tests whether models preserve parse-sensitive meaning under hard negatives, including semantic scope, formatting-sensitive text, and table grounding.

The dataset card documents the purpose, files, task IDs, and usage. The dataset loads with datasets

using the parse-embed config and the task splits.

Could you please add it to the official benchmark allow-list?

Thanks! if something is wrong let me know

By any chance if a hf staff is reading this, respond please if you have time

── more in #machine-learning 4 stories · sorted by recency
sponsored brought to you by zahid.host 4,200+ EU-deployed projects
reading about agents? ship yours in a single git push.

Run your AI side-project on zahid.host

EU-based hosting, git-push deploys, automatic HTTPS, no cold starts. Free tier with a custom domain — perfect for shipping the agent you just read about.

$git push zahid main
Live at https://your-agent.zahid.host
Get free account → Pricing
from €0/mo · no card required
LIVE [news/add-convence-parseem…] indexed:0 read:1min 2026-06-15 ·