# Beta testing Giraffe: test your LLM serving setup against a saved baseline

> Source: <https://discuss.huggingface.co/t/beta-testing-giraffe-test-your-llm-serving-setup-against-a-saved-baseline/191032#post_1>
> Published: 2026-10-26 11:49:14+00:00

You change a batching setting, upgrade your inference server, or switch a model. The endpoint still answers a prompt, but the question is: does it still handle your workload properly?

I’m building **Giraffe**, an open-source tool that tests existing OpenAI-compatible LLM endpoints and compares results with a saved baseline.

It checks things like:

There’s a CLI and a local browser UI.

**I’m looking for beta testers. If you run local or self-hosted LLMs, try Giraffe and let me know what works, what breaks, and what’s confusing.**

Get started: [github.com/0dust/giraffe](https://github.com/0dust/giraffe)

Feedback and questions: [Join the Discord](https://discord.gg/GBefPbWebr)