{"slug": "add-convence-parseembed-as-an-official-benchmark-on-the-hub-if-possible", "title": "Add Convence/ParseEmbed as an official benchmark on the Hub (If possible)", "summary": "A user requests Hugging Face to add Convence/ParseEmbed as an official benchmark on the Hub. ParseEmbed is a retrieval benchmark for embedding models that tests parse-sensitive meaning under hard negatives. The dataset includes an eval.yaml configuration and is designed to evaluate semantic scope, formatting-sensitive text, and table grounding.", "body_md": "Hi Hugging Face team,\n\nI’d like to register `Convence/ParseEmbed`\n\nas an official benchmark on the Hub.\n\nDataset: [Convence/ParseEmbed · Datasets at Hugging Face](https://huggingface.co/datasets/Convence/ParseEmbed)\n\nIt includes a root `eval.yaml`\n\nwith:\n\n- name: ParseEmbed\n- evaluation_framework: mteb\n- tasks: mean, text_formatting, table\n- config: parse-embed\n\nParseEmbed is a retrieval benchmark for embedding models. It tests whether models preserve parse-sensitive meaning under hard negatives, including semantic scope, formatting-sensitive text, and table grounding.\n\nThe dataset card documents the purpose, files, task IDs, and usage. The dataset loads with `datasets`\n\nusing the `parse-embed`\n\nconfig and the task splits.\n\nCould you please add it to the official benchmark allow-list?\n\nThanks! if something is wrong let me know\n\nBy any chance if a hf staff is reading this, respond please if you have time", "url": "https://wpnews.pro/news/add-convence-parseembed-as-an-official-benchmark-on-the-hub-if-possible", "canonical_source": "https://discuss.huggingface.co/t/add-convence-parseembed-as-an-official-benchmark-on-the-hub-if-possible/176152#post_4", "published_at": "2026-06-15 15:39:52+00:00", "updated_at": "2026-06-15 15:46:36.376522+00:00", "lang": "en", "topics": ["machine-learning", "natural-language-processing", "ai-research", "ai-tools"], "entities": ["Hugging Face", "Convence", "ParseEmbed", "MTEB"], "alternates": {"html": "https://wpnews.pro/news/add-convence-parseembed-as-an-official-benchmark-on-the-hub-if-possible", "markdown": "https://wpnews.pro/news/add-convence-parseembed-as-an-official-benchmark-on-the-hub-if-possible.md", "text": "https://wpnews.pro/news/add-convence-parseembed-as-an-official-benchmark-on-the-hub-if-possible.txt", "jsonld": "https://wpnews.pro/news/add-convence-parseembed-as-an-official-benchmark-on-the-hub-if-possible.jsonld"}}