# Request to register DedeProGames/phone-tool-bench as an official benchmark on the Hub

> Source: <https://discuss.huggingface.co/t/request-to-register-dedeprogames-phone-tool-bench-as-an-official-benchmark-on-the-hub/192104#post_1>
> Published: 2026-11-18 17:21:49+00:00

**Recommendation:** Score tool-calling agents with deterministic exact match on the full predicted call list and report macro averages across categories like single, multi, lookalike, partial, no_tool and clarify, as PhoneToolBench does, rather than relying on an LLM judge.
More in the playbook "Evals and testing for LLM apps": <https://wpnews.pro/playbooks/evals-testing>

Hello HF team,

I would like to request the registration of my dataset as a benchmark on the Hugging Face Hub:

Dataset: DedeProGames/phone-tool-bench  ← (link 1: [DedeProGames/phone-tool-bench · Datasets at Hugging Face](https://huggingface.co/datasets/DedeProGames/phone-tool-bench))

PhoneToolBench is a held-out benchmark for phone tool calling: 520 items across

English, Portuguese, Spanish and German, over the full 108-tool phone catalog from

LiquidAI/phone-assistant-tools. Scoring is deterministic exact match of the predicted

tool-call list (no LLM judge); the headline metric is macro exact match over the

seven item categories (single, multi, reasoning, lookalike, partial, no_tool, clarify).

The eval.yaml file is already at the repository root and was validated at push time

(tasks: phone_tool_bench, config: default, split: test). The benchmark ships its own

harness (phonebench) with unit tests, plus tools.json and scoring.json for

reproduction. A first result (klein-ml/KV1-1.2B, macro 12.5%) is documented with full

traces here:  ← (link 2: [DedeProGames/kv1-1.2B-phone-tool-bench-results · Datasets at Hugging Face](https://huggingface.co/datasets/DedeProGames/kv1-1.2B-phone-tool-bench-results))

Could you please add it to the benchmark allow-list? Happy to adjust the eval.yaml

if any schema changes are needed.

Thank you!
